Adf/databricks Job In Capgemini Technology
- Capgemini Technology
- 4 to 9 Yrs
- Mumbai
- 11 months ago
- Email to a friend
- Report this job
Job Description
- Design, implement, and manage data pipelines in Azure Data Factory (ADF) and Azure Databricks (ADB) to automate data workflows and integration.
- Utilize Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics for data storage, transformation, and processing.
- Develop and optimize data processing scripts using Python, PySpark, Scala, and Hive.
- Build and maintain CI/CD pipelines for data applications and workflows in an Azure environment.
- Collaborate with data engineering, data science, and DevOps teams to streamline processes and improve data integration and delivery.
- Perform data transformation and data wrangling tasks, ensuring high-quality and reliable data outputs.
- Ensure data pipelines are scalable, efficient, and cost-effective within the Azure cloud infrastructure.
-
Primary Skills:
- Experience with Azure Data Factory (ADF) or Azure Databricks (ADB).
- Hands-on experience with Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics.
- Proficiency in Python, PySpark, Scala, and Hive programming for data processing.
- Experience building CI/CD pipelines in data environments.
-
Secondary Skills:
- Strong communication skills, both verbal and written.
- Excellent interpersonal skills and ability to collaborate effectively within a team environment.
- Ability to work independently and manage multiple priorities in a fast-paced environment.
- Proven experience in data engineering, with a focus on Azure cloud technologies.
- Experience with designing and deploying data pipelines for large-scale data workflows.
- Strong problem-solving skills and a deep understanding of data integration and orchestration processes in cloud-based systems.
- Familiarity with data security, governance, and best practices in the cloud.
- Experience with Azure Synapse Studio and advanced data warehousing techniques.
- Knowledge of additional Azure services such as Azure Machine Learning, Azure Blob Storage, etc.
Role - ADF/Databricks
Looking for candidates for a face-to-face Interview scheduled on 22nd February 2025 for Mumbai and Pune.
Shortlisted candidates will be contacted directly for further details.
Job Overview:
We are seeking an experienced Azure Data Engineer with a strong background in Azure Data Factory (ADF), Azure Databricks (ADB), and a range of Azure Data Components including Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics. The ideal candidate will have hands-on experience with Python, PySpark, Scala, and Hive programming, as well as a strong understanding of building and deploying CI/CD pipelines in data environments.
As part of our dynamic team, you will collaborate with cross-functional teams to develop and maintain robust data pipelines, manage cloud-based data solutions, and drive continuous integration and delivery best practices in an Azure environment.
Key Responsibilities:
Required Skills:
Qualifications:
Preferred:
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: General / Other SoftwareFunctional Area: Not SpecifiedRole/Responsibilies: Adf/databricks Job In Capgemini TechnologyContact Details:
Company: Capgemini TechnologyLocation(s): Mumbai
Similar positions
Capgemini Technology
Capgemini Technology Services India Limited Capgemini in India is over 85,000 people strong across nine cities (Mumbai, Bangalore, Gurgaon, Noida, Gandhinagar, Hyderabad, Pune, Kolkata and Chennai - Trichy and Salem). A pioneer in the IT industry, Capgemini has over 45 years of global expertise ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in