Azure Data Platform Engineer
- Apptad
- 5 - 10 years
- Mumbai
- 5 months ago
- Email to a friend
- Report this job
Job Description
Job Summary
We are seeking a skilled Azure Data Platform Engineer to join our Business Intelligence and Reporting team The ideal candidate will have proven experience in designing implementing and managing endtoend data solutions on the Azure cloud platform with a strong focus on Azure Data Factory Azure Databricks and Power BI A solid understanding of DevOps practices is essential for this role to facilitate continuous integration and deployment of data solutions
Key Responsibilities
Design develop and maintain scalable data pipelines and ELT processes using Azure Data Factory Azure Data Lake and Azure Databricks
Monitor and troubleshoot data pipeline performance and reliability
Automate and manage deployment processes to ensure consistent and reliable releases of data solutions across environments development testing production using Azure DevOps and GitHub
Ensure data quality and integrity through validation and testing processes
Implement best practices for data access encryption and storage in compliance with organizational policies
Required Skills and Qualifications
5 years of experience in data engineering or a related role with a focus on Azure cloud technologies
Strong experience with Azure Databricks including cluster management PySpark and SQL notebook development creation and management of workflows
Experience with Azure Data Factory for building and orchestrating data pipelines to ingest both structured and unstructured data from various types of sources
Prior experience with data lake medallion architecture including the management of bronze silver and gold data layers
Proficient in SQL and with data modeling and database design
Familiarity with YAML for configuration management and orchestration of data workflows
Proficient in using version control systems eg Git and CICD tools eg Azure DevOps for managing code and deployment processes
Experience in implementing automated testing and deployment strategies
Strong analytical and problemsolving skills with the ability to work independently and collaboratively in a team environment
Excellent communication skills with the ability to convey technical concepts to nontechnical stakeholders
Preferred Qualifications
Azure certifications eg Azure Data Engineer Associate Azure Solutions Architect are highly desirable
Experience with dbt data build tool for data transformation and modeling is a plus
Knowledge of Power BI or other reporting visualization tool is a plus
Job Classification
Industry: Recruitment / StaffingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: ApptadLocation(s): Mumbai
Keyskills: azure databricks azure data factory sql database design data modeling github azure data lake version control microsoft azure power bi ci/cd pyspark data engineering azure devops azure cloud sql server git devops ssrs data transformation ssis yaml
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in