Azure Databricks Developer with Terraform
- Adastra Corp
- 5 - 10 years
- Bengaluru
- 29 days ago
- Email to a friend
- Report this job
Job Description
ob Summary:
We are seeking a skilled Azure Databricks Developer with strong Terraform expertise to join our data engineering or cloud team. This role involves building, automating, and maintaining scalable data pipelines and infrastructure in the Azure cloud environment using Databricks and Infrastructure as Code (IaC) practices. The ideal candidate has hands-on experience with data processing in Databricks and cloud provisioning using Terraform.
Key Responsibilities:
- Develop and optimize data pipelines using Azure Databricks (Spark, Delta Lake, notebooks, jobs)
- Design and automate infrastructure provisioning on Azure using Terraform
- Collaborate with data engineers, analysts, and cloud architects to integrate Databricks with other Azure services (e.g., Data Lake, Synapse, Key Vault)
- Maintain CI/CD pipelines for deploying Databricks and Terraform configurations
- Apply best practices for security, scalability, cost optimization, and performance
- Monitor and troubleshoot jobs and infrastructure components
- Document architecture, processes, and configuration standards
Required Skills & Experience:
- 5+ years of experience in Azure Databricks, including PySpark, notebooks, cluster management, Delta Lake
- Strong hands-on experience in Terraform for managing cloud infrastructure (especially Azure)
- Proficiency in Python and SQL
- Experience with Azure services: Azure Data Lake, Azure Data Factory, Azure Key Vault, Azure DevOps
- Familiarity with CI/CD pipelines and version control (e.g., Git)
- Good understanding of data engineering concepts and cloud-native architecture
Preferred Qualifications:
- Azure certifications (e.g., DP-203, AZ-104, or AZ-400)
- Knowledge of Databricks CLI, REST API, and workspace automation
- Experience with monitoring and alerting for data pipelines and cloud resources
- Understanding of cost management for Databricks and Azure servicesRole & responsibilities
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & Analytics
Role Category: Business Intelligence & Analytics
Role: Data Analyst
Employement Type: Full time
Contact Details:
Company: Adastra CorpLocation(s): Bengaluru
Keyskills: Terraform Azure Databricks Python Pyspark Ci Cd Pipeline Data Engineering Azure Certified SQL
Similar positions
Adastra Corp
Adastra is a global leader in data and analytics consulting, empowering organizations to become digital frontrunners since 2000. Our expertise spans across Artificial Intelligence, Cloud, Digital Transformation, and Data Governance, helping businesses make smarter, data-driven decisions. With a str...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in