Data Engineer with Azure+Big Data pipelines @ ITSource

Job Description

Experience - 7 to 12 Years Location PAN India ( except Delhi / Gurgaon) Notice - Immediate to 15 days max Job Roles and Responsibility :- Working Experience on Azure Data Bricks, Azure Data factory, Azure Data Lake and Azure Data Lake Storage, Pyspark. Experience in SQL Programming language /Cosmos/Scope scripting. Implement end-end data pipelines using cosmos/Azure Data factory. Monitoring of data pipeline created in Azure Data factory. Working Knowledge on MSBI stack on Azure. Knowledge of Big Data pipelines/Data Engineering. Hands-on in Visualization like PowerBI. Should have good analytical thinking and Problem solving. Good communication and co-ordination skills. Able to work as Individual contributor. Requirement Analysis. Create/Maintain and Enhance Big Data Pipeline. Daily status reporting, interacting with Leads. Version control/ADO/GIT, CI/CD. Marketing Campaign experiences. Data Platform, Product telemetry, Analytical. thinking. Data Validation of the new streams. Data quality check of the new streams. updating the Tech spec and wiki page for each implementation of pipeline. Updating ADO on daily basis

Employement Category:

Employement Type: Full time
Industry: IT Services & Consulting
Role Category: Engineering Design / Construction
Functional Area: Not Applicable
Role/Responsibilies: Data Engineer with Azure+Big Data pipelines

+ View Contact

Keyskills:   Cosmos Data Engineering Requirement Analysis Data Validation ADO Azure Data Bricks Azure Data factory Azure Data Lake Azure Data Lake Storage Pyspark SQL Programming language Scope scripting MSBI stack on Azure Big Data pipelines PowerBI Version controlADOGIT CICD Marketing Campaign experiences Data Platform Product telemetry Analytical thinking Data quality check Tech spec wiki page