Aws Data Engineer
- Adastra Corp
- 5 - 9 years
- India
- 26 days ago
- Email to a friend
- Report this job
Job Description
Job Summary:
We are seeking a highly skilled AWS Data Engineer with over 5 years of experience in designing and implementing scalable data pipelines and analytics solutions using AWS cloud services. The ideal candidate will have hands-on expertise in AWS Glue, Spark (Scala), Redshift, Athena, and Lambda (Python), and will be proficient in building infrastructure using Terraform and managing pipelines with GitHub Actions.
Key Responsibilities:
- Design, develop, and maintain robust ETL/ELT data pipelines using AWS Glue and Apache Spark (Scala).
- Architect and implement scalable data solutions using AWS services including S3, Redshift, Athena, and Lambda.
- Optimize and troubleshoot performance of data pipelines and queries.
- Ensure data quality, consistency, and governance across the pipeline.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.
- Automate infrastructure deployment and configuration using Terraform.
- Implement and maintain CI/CD pipelines using GitHub Actions for data engineering workflows.
- Monitor data workflows, set up alerts, and ensure SLAs are met.
- Write efficient and reusable code and maintain comprehensive documentation.
Required Skills & Qualifications:
- Minimum 5 years of experience in Data Engineering, with strong expertise in AWS ecosystem.
- Proficiency in:
- AWS Glue
- Spark (Scala)
- Amazon S3, Redshift, Athena
- AWS Lambda (Python)
- Solid understanding of SQL and experience working with large datasets.
- Experience with Terraform for infrastructure as code.
- Hands-on experience with GitHub Actions or similar CI/CD tools.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
Preferred Qualifications:
- AWS Certified (e.g., AWS Certified Data Analytics Specialty, AWS Certified Solutions Architect).
- Experience with data lake and data warehouse architectures.
- Familiarity with data cataloging, security, and governance best practices in AWS.
- Exposure to additional languages (e.g., Python for data processing).
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: Adastra CorpLocation(s): India
Keyskills: Terraform Aws Glue GIT Github Redshift Aws SCALA Ci/Cd Spark Athena SQL
Similar positions
Adastra Corp
Adastra is a global leader in data and analytics consulting, empowering organizations to become digital frontrunners since 2000. Our expertise spans across Artificial Intelligence, Cloud, Digital Transformation, and Data Governance, helping businesses make smarter, data-driven decisions. With a str...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in