Technical Specialist - Azure Data Engineering
- Damco Solutions
- 7 - 12 years
- Delhi, NCR
- 1 month ago
- Email to a friend
- Report this job
Job Description
Position: Technical Specialist / Lead - Azure Data Engineer
Location: Faridabad/Noida (Hybrid) OR Remote
Job Description:
We are seeking a skilled Data Engineer with experience in designing, building, and optimizing scalable data pipelines. The ideal candidate will have expertise in Microsoft Azure technologies, including Azure Data Factory, Synapse, Fabric, Databricks, PySpark, SQL, Python, and DevOps (CI/CD). This role requires working closely with data analysts, data scientists, and business stakeholders to deliver high-performance and reliable data solutions.
Mandatory Skills:
- Strong experience in Azure Data Engineering with Data Factory, Synapse, Fabric, Databricks.
- Expertise in SQL, T-SQL, and Python for data processing and transformation.
- Hands-on experience with PySpark for big data processing.
- Experience in designing ETL/ELT pipelines and working with large datasets.
- Proficiency with Azure Data Lake (ADLS) Gen2 for data storage and processing.
- CI/CD and DevOps knowledge, including Azure DevOps, Git, and automated deployments.
- Understanding of data modeling, data warehousing, and schema design principles.
Preferred Skills:
- Familiarity with Data Governance and Security best practices in cloud-based data solutions.
- Experience with real-time data processing using Kafka, Event Hub, or Stream Analytics is a plus.
- Knowledge of DataOps methodologies and best practices.
- Experience with APIs, REST services, and integrating third-party data sources.
- Familiarity with Power BI or other visualization tools is an added advantage
Key Responsibilities:
- Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.
- Design and implement scalable data architectures following Medallion Architecture and best practices.
- Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.
- Develop and maintain data lake solutions in Azure Data Lake Storage (ADLS) Gen2.
- Write and optimize SQL queries for data extraction, transformation, and analysis.
- Implement CI/CD pipelines for data workflows using Azure DevOps.
- Collaborate with stakeholders to understand data requirements and ensure data availability.
- Ensure data governance, security, and compliance in Azure-based data solutions.
- Monitor and troubleshoot data pipelines to maintain reliability and performance.
- Stay updated with the latest Azure and big data technologies and implement best practices.
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Technical Lead
Employement Type: Full time
Contact Details:
Company: Damco SolutionsLocation(s): Delhi, NCR
Keyskills: SQL Azure Data Factory Azure Synapse Datafactory ADF Azure Data Warehouse Azure Databricks Azure Data Lake Azure Blob Storage Data Lake Azure Fabric Data Bricks
Similar positions
Damco Solutions
Damco is a fast growing IT Solutions and Services provider. Started in 1996, Damco has clients all round the globe and has offices in UK, USA, Luxembourg and Australia apart from its world-class facilities in New Delhi NCR, Chandigarh and Hyderabad, India. Damco provides Onsite Consulting se...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in