Azure Data Engineer
- Cybage
- 4 - 7 years
- Pune
- 2 months ago
- Email to a friend
- Report this job
Job Description
Azure Data Engineer (4-7 yrs dedicated exp.) to help on design, implement, and maintain scalable data pipelines and environments in Azure.
The ideal candidate will have hands-on experience with Azure Databricks, Logic Apps, Azure Storage Services, Azure Data Factory (ADF), and Medallion Architecture, and will play a key role in development of analytics solutions and ETL workflows.
Key Responsibilities:
- Design, configure, and maintain data ingestion and processing environments using Azure Data Lake, Databricks, Logic App and ADF.
- Well versed to design all layers of Medallion architecture.
- Implement ETL/ELT workflows for batch and real / near real-time data processing to load, transform and prepare aggregated data across all layers Bronze, Silver and Gold.
- Apply Medallion Architecture principles to organize and transform raw data into curated and consumable datasets.
- Experienced in Delta Lake design and implementation
- Hands-on experience in data cleansing, loading, and processing for staging and data warehouse environments using ETL pipelines
- Collaborate with teams to develop data pipelines, notebooks, and dashboards to support analytics and reporting.
- Automate data workflows and integrations using Azure Logic Apps and other orchestration tools.
- Ensure data quality, reliability, and performance across all layers of the data platform.
- Assist in troubleshooting and optimization of existing pipelines or delta lake for efficiency and scalability.
- Document solutions, best practices, and maintain environment configuration standards.
Required Skills & Experience:
- Strong experience with Azure Data Lake, Azure Databricks, Logic Apps, Data warehouse, Azure key Valult and Azure data factory.
- Proficiency in PySpark, Spark SQL, and ETL/ELT development.
- Understanding of Medallion Architecture, Delta Lake and its implementation in Azure Databricks.
- Experience with data modelling, transformations, and pipeline orchestration.
- Familiarity with data governance, quality checks, and performance optimization.
- Good problem-solving skills and ability to work independently and collaboratively.
Good to have Skills:
- Knowledge of Azure DevOps/GitHub for CI/CD integration.
- Knowledge on SCALA and Python
- Data platform related environment setup and configuration
- Understanding of business intelligence tools like Power BI or Tableau.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CybageLocation(s): Pune
Keyskills: Azure Databricks Azure Logic Apps Azure Data Lake Pyspark Power Bi Github Spark SQL Azure Key Vault Medallion Architecture Ci/Cd Tableau Devops Azure Data Factory Delta Lake SCALA Data Warehousing ETL/ELT development Python
Similar positions
Cybage
About Cybage:Founded in 1995, Cybage Software Pvt. Ltd., a technology consulting organization is a leader in the hi-tech and outsourced product engineering space. We are a valued partner to technology startups, mid-size companies, and Fortune 500 corporations alike. Our solutions are focused on mode...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in