Azure Data Engineer
- Idatalytics
- 10 - 15 years
- Hyderabad
- 5 days ago
- Email to a friend
- Report this job
Job Description
Hi Connections,
Please let me if you are comfortable with the job description
We are looking for a Senior Data Engineer with deep expertise in Azure Data Platform to design, build, and optimize scalable data pipelines and analytics platforms. The ideal candidate brings strong hands-on experience with Azure Data Factory (ADF), Fabric, Azure Databricks, and SQL, and has led data engineering initiatives in enterprise environments.
Key Responsibilities
Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF)
Build scalable and high-performance ETL/ELT workflows leveraging Azure Databricks (PySpark / Spark SQL)
Develop and optimize complex SQL queries, views, and stored procedures for analytics and reporting
Implement data lake architectures using Azure Data Lake Storage (ADLS Gen2)
Apply data modeling techniques (star schema, snowflake, dimensional modeling)
Ensure data quality, reliability, performance, and security across pipelines
Collaborate with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets
Implement CI/CD for data pipelines using Azure DevOps
Monitor, troubleshoot, and optimize pipeline failures and performance bottlenecks
Mentor junior data engineers and contribute to best practices and standards
Required Skills & Experience
10+ years of overall experience in Data Engineering / Data Warehousing
Strong hands-on experience with Azure Data Factory (ADF)
Expertise in Azure Databricks (PySpark, Spark SQL, performance tuning)
Advanced SQL skills (query optimization, complex joins, window functions)
Experience with Azure Data Lake (ADLS Gen2)
Solid understanding of data warehousing concepts and analytics architectures
Experience with Azure Synapse Analytics or equivalent data warehouse solutions
Familiarity with Azure DevOps for CI/CD and version control
Strong problem-solving and debugging skills
Good to Have
Experience with Delta Lake, Medallion Architecture
Exposure to streaming data (Event Hubs, Kafka, Structured Streaming)
Knowledge of Power BI and analytics consumption patterns
Experience working in large enterprise or multi-client environments
Understanding of data security and governance (RBAC, encryption, Purview)
Please share your updated resume to An*****r@id*******s.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: IdatalyticsLocation(s): Hyderabad
Keyskills: Azure Databricks Microsoft Azure Azure Synapse Datafactory Azure Data Lake Python
Similar positions
Idatalytics
iDatalytics Pvt.Ltd. is a global digital consulting and delivery organization with core focus on AI, ML, BI and Analytics. We help organizations work smarter and grow faster by enabling their digital transformation initiatives. Our mission is to serve as a catalyst of digital transformation for ou...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in