AWS Data Architect || Infogain
- Infogain
- 11 - 18 years
- Bengaluru
- 7 months ago
- Email to a friend
- Report this job
Job Description
Exp: 10+ years
Job Role : AWS Architect with Databricks
Job Location: Noida / Mumbai / Pune / Bangalore / Gurgaon / Kochi (Hybrid Work)
Role & responsibilities
- Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark, Delta Lake) on AWS.
- Ingest and process structured, semi-structured, and unstructured data from multiple sources (RDBMS, APIs, streaming).
- Integrate AWS services such as S3, Glue, Lambda, Kinesis, Athena, Redshift with Databricks.
- Implement data quality checks, validation frameworks, and monitoring for production workloads.
- Optimize data storage, partitioning, and caching strategies for performance and cost efficiency.
- Collaborate with Data Architects and Analysts to design data models and lakehouse layers (raw, curated, semantic).
- Implement CI/CD pipelines for Databricks jobs and notebooks using Git-based workflows (e.g., CodeCommit, GitHub).
- Apply security best practices: IAM roles, encryption, VPC, and data governance policies.
- Work with stakeholders to understand data requirements and deliver scalable, reusable solutions.
- Participate in code reviews, peer programming, and Agile ceremonies.
Required Skills & Experience
- 3- 6 years of experience in Data Engineering (cloud-based preferred).
- Strong hands-on expertise in Databricks (PySpark, Delta Lake, SQL).
- Proficiency in AWS data services: S3, Glue, Lambda, Kinesis, Athena, Redshift.
- Experience in ETL/ELT design patterns and best practices.
- Strong Python and SQL skills for data manipulation and transformation.
- Knowledge of data warehousing, dimensional modeling, and lakehouse concepts.
- Experience with version control (Git) and DevOps tools.
- Understanding of data security, encryption, and governance on AWS.
Good to Have / Preferred
- AWS certifications: AWS Certified Data Engineer Associate / Professional or AWS Certified Solutions Architect Associate.
- DataBricks Certification: DataBricks certified Associate / Professional
- Experience with Glue or other orchestration tools.
- Exposure to machine learning pipelines in Databricks.
- Familiarity with Terraform or AWS CloudFormation for IaC.
- Experience in Agile/Scrum delivery models.
Education
- Bachelors or Masters degree in Computer Science, Information Systems, or related field.
Preferred candidate profile
Interested candidates , kindly share updated resume at si*********i@in*****n.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT & Information Security - OtherRole: IT & Information Security - OtherEmployement Type: Full timeContact Details:
Company: InfogainLocation(s): Bengaluru
Keyskills: architect databricks AWS SQL Delta Lake pyspark Aws Glue
Similar positions
Infogain
Infogain is a Silicon Valley headquartered company with software platform engineering and deep domain expertise in the travel, retail, insurance and high technology industries. We accelerate the delivery of digital customer engagement systems using digital technologies such as cloud, mic...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in