Data Engineer III
- Cbts
- 8 - 14 years
- Chennai
- 3 months ago
- Email to a friend
- Report this job
Job Description
Design, develop, and maintain scalable data pipelines using AWS Data Engineering tools (eg, AWS Glue, AWS Lambda, Amazon Redshift)
Implement ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes
Develop and manage event streaming solutions using tools such as Apache Kafka, AWS Kinesis, or similar technologies
Essential Functions:
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs
Optimize and troubleshoot data pipelines to ensure high performance and reliability
Monitor and maintain data quality and integrity across all data systems
Stay up-to-date with the latest trends and best practices in data engineering and AWS technologies
Work within Agile Scrum and XP methodologies, participating in sprint planning, daily stand-ups, and retrospectives to ensure timely delivery of projects
Apply Test Driven Development (TDD) practices to ensure high-quality code and robust data solutions
Education
Four years of college resulting in a Bachelor s degree or equivalent Certifications, Accreditations, Licenses
N/A Experience
8 to 14 years of related experience Special Knowledge, Skills And Abilities
5+ years of relevant experience in data engineering, with a focus on AWS Data Engineering tools
Proficiency in ETL processes and tools (eg, AWS Glue, PySpark, Apache Airflow)
Experience with event streaming technologies (eg, Apache Kafka, AWS Kinesis)
Strong programming skills in languages such as Python, Java, or Scala
Familiarity with SQL and database management systems (eg, PostgreSQL, MySQL)
Excellent problem-solving skills and attention to detail
Ability to work collaboratively in a team environment
Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders
Experience working in Agile Scrum and XP methodologies
Experience with Test Driven Development (TDD)
Preferred Qualifications:
Experience with data warehousing solutions (eg, Amazon Redshift, Snowflake)
Knowledge of data governance and security best practices
Certification in AWS Data Engineering or related fields
Nice to Have Skills: Experience with MS Azure and MS Fabric
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CbtsLocation(s): Chennai+ View Contact
Keyskills: Agile scrum amazon redshift MySQL Healthcare test driven development Apache AWS Monitoring SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Cbts
The Contec Global Group has a worldwide presence, with operations in Asia, Africa, Europe and America.As a company established on the platform of e-Governance and smart technologies, Contec Global is amongst the most experienced independent technology and systems organizations operating in developin...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in