Data Engineer
- Maersk Global Service
- Not Specified
- Pune
- 5 years ago
- Email to a friend
- Report this job
Job Description
Key responsibilities
Project experience using Azure cloud, data lake storage, Data factory, Hadoop 2.x, HDInsight, Spark, Scala, Hive, HDFS. Exp with Spark more relevant.
Exp on creating Batch and Realtime Data pipelines on Azure Data Platform using Logic Apps, Automation Run Books, Azure Data Factory, Azure Databricks, Azure Event Hub, Kafka, Azure Stream Analytics.
Experience in performance tuning of complex ETL mappings for relational and non-relational workloads
Advanced SQL programming, SparkSQL, PySpark, PL/SQL or T-SQL,
Hands on Unix scripting or PowerShell, experience with Azure PaaS services
Hadoop Data Serialization mechanism line PARQUET, AVRO, ORC.
Hands on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, data warehouse and big data.
Design DWH model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model.
Experience with enterprise-class data modelling tools (Erwin Data Modeler, Sparx Enterprise Architect etc)
Facilitate data integration, data conformity, data integrity and ensure data structures are designed for flexibility to support future business needs and enhancements.
Understand the relationships across business information and units of data, Reverse engineer data from various source systems.
Ensure that data transformations are well documented follow best practices and understood by business users and developers.
Have experience cleansing, manipulating and analysing large datasets both structured and Unstructured.
Exceptional data analysis, critical thinking, communication, problem solving and cross-group collaboration skills
Experience with Power BI would be an added advantage
We are looking for
We are seeking for a Big Data Engineer who has strong experience in DWH, ETL and BI technologies on Big Data Framework/Hadoop Technologies.
One who has been in at least 4-5 BI projects and has 4+Yrs Exp and Strong Coding skills in Scala.
Candidates must have strong communication skills that allow you to regularly deal with the business, as well as with specialists from related fields including BAs, architects and Front-End Engineers
Employement Category:
Employement Type: Full timeIndustry: RecruitmentFunctional Area: Customer ServiceRole Category: Data Processing ExecutiveRole/Responsibilies: Data EngineerContact Details:
Company: Maersk Global ServiceLocation(s): Pune+ View Contact
Fraud Alert to job seekers!
₹ Not Specified
Maersk Global Service
Maersk Group has five core businesses which include Maersk Line, APM Terminals, Maersk Oil and Maersk Drilling and Services and Other Shipping. Through these companies and several others, the Group employs roughly 89,000 people and generated 47 billion US dollars in revenue in 2013. When the Glo...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in