Lakehouse Architect (GCP + Databricks)/Principal Data Engineer
- FCS Software Solutions
- 10 - 20 years
- Bengaluru
- 9 days ago
- Email to a friend
- Report this job
Job Description
Lakehouse Architect (GCP + Databricks)/Principal Data Engineer
Bangalore (Hybrid) - Working Hours India Hours
12+ Months
We are seeking a Principal Data Engineer / Lakehouse Architect to design and build a modern, enterprise-scale Lakehouse platform on GCP and Databricks.
This is a hands-on technical leadership role focused on architecting scalable data systems, establishing foundational frameworks, and leading large-scale data migrations from legacy environments to a cloud-native Lakehouse.
________________________________________
What Youll Do
? Architect and implement a Lakehouse platform using the Medallion architecture (Bronze / Silver / Gold)
? Lead development using Apache Spark (expert level) for large-scale data processing
? Design and manage data storage using:
- Delta Lake (required)
- Apache Iceberg (strong plus)
? Build and standardize transformation workflows using dbt (expert level)
? Implement orchestration pipelines using Airflow and Cosmos
? Design and deploy cloud-native infrastructure on GCP, leveraging Databricks and related tooling
? Establish engineering best practices:
- Microservices architecture
- Event-driven pipelines
- CI/CD pipelines
- Infrastructure as Code (Terraform)
? Lead Platform Zero initiatives:
- Evaluate, select, and deploy foundational Lakehouse components
? Develop reusable frameworks, libraries, and templates for scalable data pipeline development
? Drive legacy system migration strategy:
- Transition high-priority business and finance data to the Lakehouse
? Optimize performance and cost:
- Improve Spark and cloud efficiency by 20%+
? Ensure strong understanding and implementation of:
- IAM
- VPC networking
- Object storage
- Serverless compute
________________________________________
What Were Looking For
? Extensive experience in data engineering and Lakehouse architecture
? Expert-level knowledge of:
- Apache Spark
- dbt
? Strong hands-on experience with:
- Delta Lake (required)
- Apache Iceberg (preferred)
? Proven track record of building enterprise-scale data platforms
? Deep experience with GCP (preferred) and Databricks ecosystem
? Strong understanding of modern data architecture patterns:
- Event-driven systems
- Microservices
- CI/CD and DevOps
? Hands-on experience with large-scale data migrations, including:
- On-prem cloud
- Redshift / Snowflake Lakehouse
? Ability to migrate petabyte-scale datasets without data loss
? Strong performance tuning and cost optimization experience
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: OtherRole Category: OtherRole: OtherEmployement Type: ContractContact Details:
Company: FCS Software SolutionsLocation(s): Bengaluru
Keyskills: Data Engineering Architecture GCP Data Bricks
Similar positions
FCS Software Solutions
FCS is a leading provider of IT services. In the past one decade of its existence, FCS has carved out a niche for itself in core IT areas like E-learning, Digital content services, Resource staffing, BPO and Product engineering services. As a business innovator, FCS helps clients achieve extraordina...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in