Role Overview:
We are looking for a skilled Azure Data Engineer to design, develop, and optimize data pipelines and solutions on the Azure cloud platform. The ideal candidate will have expertise in SQL, ETL, Azure, Python, PySpark, Databricks, and ADF, ensuring efficient data processing and integration.
Key Responsibilities:
- Design and implement ETL pipelines using Azure Data Factory (ADF), Databricks, and PySpark.
- Develop and optimize SQL queries for data extraction, transformation, and loading.
- Work with Azure cloud services such as Azure Data Lake, Azure Synapse, and Azure Blob Storage.
- Build scalable data solutions using Python and PySpark for big data processing.
- Ensure data integrity, security, and governance across all pipelines.
- Collaborate with data analysts, scientists, and business teams to support data-driven decision-making.
- Monitor and troubleshoot data workflows for performance optimization.
Required Skills & Qualifications:
- Strong proficiency in SQL for data manipulation and querying.
- Hands-on experience with ETL tools and Azure Data Factory (ADF).
- Expertise in Azure cloud services for data storage and processing.
- Proficiency in Python and PySpark for data engineering tasks.
- Experience with Databricks for big data processing and analytics.
- Knowledge of data modeling, warehousing, and governance.
- Familiarity with CI/CD pipelines for data deployment.
Preferred Qualifications:
- Experience with Azure Synapse Analytics.
- Knowledge of Kafka or Event Hub for real-time data streaming.
- Certifications in Microsoft Azure Data Engineering.
Key Words for Job Posting & Resume Screening
- SQL, ETL, Azure, Python, PySpark, Databricks, ADF
- Azure Data Lake, Azure Synapse, Azure Blob Storage
- Data Engineering, Big Data, Data Pipelines
- Data Transformation, Data Governance, Data Security
- CI/CD, Data Warehousing, Cloud Computing
- Machine Learning, AI, Analytics, Business Intelligence
Keyskills: cloud computing python sql data transformation data governance azure data engineering big data
White Horse Manpower Consultancy Private Limited Recruitment Company with more than 15 Plus International BPOs in the consultancy giving SPOT OFFER Letters Walkin with 2-3 Resumes from Monday 2 Saturday 10am to 6pm call Niki 9886747291,9342431048,9886188040 Free Recruitment no charges Niki ...