AWS Data Engineer
- Zensar
- 7 - 12 years
- Hyderabad
- 1 month ago
- Email to a friend
- Report this job
Job Description
Senior Data Engineer
The Healthcare Digital team at Compass Group is looking for a highly skilled Data Engineer. The ideal candidate will have expertise in ETL, Data Warehouse and Business Intelligence data management technologies. Experience and skill in the following areas is expected:
ETL/ELT Pipeline Development: Design, implement, and optimize scalable data pipelines (ETL/ELT processes) to ingest, process, and load large volumes of data from various sources (DBs, APIs, flat files, real-time streams)
Data Transformation & Quality: Transform raw, complex data into clean, consistent, and analysis-ready formats. Implement automated data quality checks, validation, and monitoring systems to ensure data integrity and reliability.
Performance Optimization: Optimize data systems and pipelines for performance, scalability, and cost-efficiency. Tune SQL queries and database performance to handle growing data volumes and user demands.
Collaboration & Support: Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into effective technical solutions and data models.
Build and maintain existing Airflow DAGs: Develop, design and monitor job orchestration using Airflow DAGs.
Prototype new technology that supports our vision of making our consumers experiences better with our data
Provide support and insights to the business analytics and data science teams
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs
Work with Data Scientists and Machine Learning Engineers to build out robust and scalable pipelines and APIs
Were committed to hiring the best talent for the role. Heres how well know youll be successful in the role:
Education Qualification:
- Bachelors degree or equivalent in Computer Science, Computer Engineering, Information Systems or similar
- Experience in a similar role or function
- Good Communication and open to learning new skills
- Comfortable working in a fast-paced environment that changes along with the needs of a growing business
- Have a strong focus on delivering value, being creative and collaborative
Technical Qualifications:
- Programming skills with Python, Airflow, Spark, Flink
- Experience with public cloud provider a bonus (AWS preferred)
- In depth knowledge of SQL, relational database concepts and SQL scripting
- Deep expertise in Data Modelling concepts catering to high performance
- Experience with AWS Glue, Snowflake (and Snow pipe), CI/CD is a bonus
- Experience with Docker, Kubernetes
- Understanding of AI/ML design concepts
- Good understanding of BI concepts (PowerBI preferred)
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Database Developer / EngineerEmployement Type: Full timeContact Details:
Company: ZensarLocation(s): Hyderabad
Keyskills: Airflow Amazon Redshift Redshift Aws Aws Glue S3
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in