Data Engineer
- IGT Solutions
- 5 - 10 years
- Noida, Gurugram
- 7 days ago
- Email to a friend
- Report this job
Job Description
Mandate Skillsets : AWS data engineering experience, including S3, Glue, Pyspark, Athena, Lambda, Step Functions, Lake Formation, KMS, and CloudWatch, Advanced SQL, Python, Data lake, Apache Iceberg, Infrastructure as Code (Terraform or CloudFormation) Good to have skills : CI/CD and DevOps (Familiar), Git, JIRA, SonarQube
What Your Day Would Be Like
- Design, implement, and maintain ETL pipelines on AWS using Step Functions, Glue, Lambda, and S3, aligned with Iceberg-based Lakehouse patterns.
- Build and optimize SQL transformations for Athena and Iceberg tables, including implementation of star and snowflake schemas from YAML table definitions and SQL transformations.
- Develop and maintain data models (fact and dimension tables) that power analytics and reporting in the data lake.
- Operate data ingestion pipelines and manage Lake Formation permissions to ensure secure and governed data access.
- Implement data quality checks and alerting using the in-repository data quality framework and AWS services.
- Provision, maintain, and evolve infrastructure using Terraform /AWS CDK as the Infrastructureas-Code framework.
- Contribute to CI/CD pipelines, including testing, linting, and deployments.
- Ensure data security and compliance through KMS encryption, IAM, Lake Formation controls, and audit logging.
- Monitor pipelines and infrastructure using CloudWatch and event-driven alerts.
- Collaborate effectively with cross-functional stakeholders using Atlassian project management tools, demonstrating strong stakeholder management and clear communication throughout the delivery lifecycle.
- Leverage AI-assisted development tools to accelerate troubleshooting, code reviews, and pipeline optimization while maintaining high quality and security standards.
We Would Love to Hear From You If You Have
- A bachelors or masters degree in a technical field.
- 5+ years of experience in data engineering or a similar role.
- Strong AWS data engineering experience, including S3, Glue, Athena, Lambda, Step Functions, Lake Formation, KMS, and CloudWatch.
- Advanced SQL skills for complex transformations and data modeling.
- Proficiency in Python.
- Experience with data lake architectures and Apache Iceberg (or similar table formats).
- Familiarity with CI/CD and DevOps practices.
- Comfort using AI tools responsibly within software development workflows.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: IGT SolutionsLocation(s): Noida, Gurugram
Keyskills: SonarQube AWS Python Cloud Formation Aws Lamda Amazon Cloudwatch JIRA Jenkins Cloud Trail Glue Terraform IAM Ansible
Similar positions
IGT Solutions
IGT Solutions (IGT) is a leading BPM, Technology and Digital Services and Solutions Company committed to deliver innovation and business excellence across the entire spectrum of Travel, Transportation and Hospitality domain.Established in 1998, with 100% focused on the Travel indus...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in