Lead Data Engineer
- Randomtrees
- 8 - 13 years
- Hyderabad
- 4 months ago
- Email to a friend
- Report this job
Job Description
Role: Lead Data Engineer
Location: Hyderabad/Chennai, Remote
Experience:8+Years
Overview
We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.
The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.
Key Responsibilities
- Design, develop, and optimize data pipelines using Azure and Databricks.
- Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
- Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
- Continuously adopt and apply new Databricks features to accelerate delivery.
- Optimize Spark, SQL, and Python code for performance and scalability.
- Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
- Mentor team members to improve overall team productivity and technical capability.
- Deliver in a fast-paced environment with quick turnaround expectations.
Required Skills & Experience
- 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
- Strong expertise in:
- Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
- Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
- Python, SQL, Spark (with proven performance optimization skills)
- Strong knowledge of modern data architectures (Lakehouse, governance).
- Track record of efficient delivery and helping teams accelerate execution.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: RandomtreesLocation(s): Hyderabad
Keyskills: data bricks azure Pyspark data pipelines CI/CD ELT/ETL SQL Python
Similar positions
Randomtrees
Voice Process Requirements\r\nLanguages:\r\n\r\nEnglish & Tamil\r\nEnglish & Hindi\r\n\r\nEligibility Criteria:\r\nGood communication skills\r\nGraduates only (No active backlogs)\r\nCandidates (no far-location profiles)\r\nSalary: Up to 20,000/month (depending on performance)
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in