Azure Databricks Developer
- Coforge
- 6 - 8 years
- Noida, Gurugram
- 5 months ago
- Email to a friend
- Report this job
Job Description
Core Responsibilities
Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:
- Developing ETL pipelines using Python, SQL, and Delta Live Tables
- Managing job execution through Databricks Jobs, including scheduling and parameterisation
- Implementing data transformation using built-in Databricks features Collaborating with data architects and analysts to ensure data models align with business needs
- Implementing security and governance using features like encryption, access control and data lineage tracking Data performance management using built-in Databricks features (i.e. concurrency for better query execution) Must be an expert in writing complex SQL queries.
Technical Skills
The following technical proficiencies are commonly required:
- Languages: Python, SQL Databricks
- Features: Delta Lake, Delta Live Tables, MLflow, Databricks Jobs, Secrets Management, encryption access control etc.
- Azure Integration: Azure Key Vault, Azure Functions, Azure Data Lake, Azure DevOps
- Deployment Pipelines: Experience with CI/CD for Databricks and integration with Snowflake schemas (DEV, PRE-PROD, PROD)
- Monitoring & Optimisation: Cost analysis of clusters, performance tuning, and job concurrency management Desirable Experience Working knowledge of Control-M for orchestrating Databricks jobs
- Familiarity with Power BI integration and semantic modelling Exposure to geospatial or time-series data processing using Databricks Basic knowledge of data modelling
Share your resume at Aa***********a@co****e.com if you are early or immediate joiner.
- Good to have exposure to Agile methodology of software development
- Soft Skills & Qualifications Strong problem-solving and communication and interpersonal skills.
- Ability to work collaboratively across teams (e.g. HR, Architecture, Data Engineering).
- A degree in Computer Science, Data Engineering, or a related field is typically preferred
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data Science & Machine Learning - OtherEmployement Type: Full timeContact Details:
Company: CoforgeLocation(s): Noida, Gurugram+ View Contact
Keyskills: Microsoft Azure Databricks Python SQL Delta Lake Azure Key Vault Azure Devops
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in