Job Description
Databricks Architect to lead the migration of our enterprise data platform from Cloudera to the Databricks Lakehouse.
The role involves defining target architecture, designing migration pathways, modernizing workloads, and ensuring secure and optimized operations on Databricks.
Define Databricks Lakehouse architecture (Delta Lake, medallion layers, security, governance).
Assess existing Cloudera/Hadoop environment and design migration strategy.
Lead conversion of Hive tables, Spark jobs, Oozie workflows, Sqoop/NiFi pipelines to Databricks (Jobs, Workflows, DLT, Unity Catalog).
Implement best practices for performance, cost optimization, cluster management, and monitoring.
Establish data governance using Unity Catalog and ensure compliance/security standards.
Guide engineering teams, review solutions, and collaborate with cloud/platform teams.
Job Classification
Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: DBA / Data warehousing
Role: Data warehouse Architect / Consultant
Employement Type: Full time
Contact Details:
Company: Happiest Minds
Location(s): Bengaluru
Keyskills:
cloudera
Compliance
Architectural design
Cluster Management
Data Architect
Hadoop
data governance
sqoop
Cost optimization
Monitoring