Azure Data Engineer
- Quinnox
- 7 - 11 years
- Bengaluru
- 2 months ago
- Email to a friend
- Report this job
Job Description
*** We are looking for ETL Developer with strong expertise in Python, Azure Data Engineering services who can join us immediately at our Bangalore Office***
Experience : 7-10 years
Job Overview :
Role & responsibilities :
- We are looking for an experienced ETL Developer with strong expertise in Python, Azure Data Engineering services, and data integration frameworks. The ideal candidate will design, build, and optimize scalable ETL/ELT pipelines to support enterprise data needs.
- Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Python, Azure Data Factory, and Azure Databricks.
- Build robust data ingestion workflows from various sources (APIs, flat files, databases, cloud systems).
- Work with Azure services including Azure Data Lake Storage (ADLS), Azure SQL Database, Synapse Analytics, Azure Functions, and Key Vault.
- Optimize ETL performance, implement error handling, and ensure data quality & reliability.
- Develop reusable Python components/modules for data transformations.
- Implement CI/CD pipelines for data workflows using Azure DevOps or Git.
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
- Ensure data security, compliance, and governance standards across ETL pipelines.
- Conduct root-cause analysis and troubleshoot data pipeline issues.
- Prepare technical documentation for workflows, code, and architecture.
- Required Skills & Qualifications:
- 57 years of overall experience in data engineering or ETL development.
- Strong hands-on experience with Python, including libraries like Pandas, PySpark, NumPy.
- Proficiency in Azure Data Factory (ADF) for orchestrating ETL workflows.
- Experience with Azure Databricks, PySpark, or other distributed data processing frameworks.
- Solid understanding of SQL, stored procedures, and performance tuning.
- Experience working with Azure cloud data components (ADLS, Synapse, Azure SQL, Azure Functions).
- Good understanding of data modelling, data warehousing, and design patterns.
- Experience integrating on-premise and cloud data sources.
- Knowledge of version control systems (Git) and DevOps pipelines.
- Strong analytical and troubleshooting skills.
- Excellent communication and documentation abilities.
- Good to Have:
- Experience with Delta Lake and lakehouse architectures.
- Exposure to CI/CD using Azure DevOps.
- Knowledge of REST APIs and integration patterns.
- Experience with data governance tools .
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: OtherRole Category: OtherRole: OtherEmployement Type: Full timeContact Details:
Company: QuinnoxLocation(s): Bengaluru
Keyskills: Api Integration Azure Databricks Etl Development Python SQL Pyspark Rest Azure Data Lake
Similar positions
Quinnox
Quinnox is a leading provider of IT consulting and services to global clients. We devise solutions that fit business requirements and deliver measurable business gains. By leveraging the on-shore - offshore model, we provide speedy and affordable solutions that allow its customers to stretch their I...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in