Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Data Quality Engineer @ Epam Systems

Home > Software Development

 Lead Data Quality Engineer

Job Description

We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.

The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.


Responsibilities

  • Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
  • Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
  • Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
  • Develop reusable and scalable test automation frameworks using Python and SQL
  • Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
  • Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
  • Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming

Requirements

  • Experience: 9+ Years
  • Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
  • Proficient in SQL for data validation and test automation
  • Good knowledge of Python for scripting and framework development
  • Experience with one or more Test Automation Frameworks
  • Exposure to Cloud Data Services across major platforms: Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), GCP (BigQuery)
  • Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
  • Familiarity with Agile/Scrum methodologies

Nice to have

  • Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
  • Basic understanding of data governance and metadata management concepts
  • Certification in cloud platforms (Azure/AWS/GCP) is a plus

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Search Engineer
Employement Type: Full time

Contact Details:

Company: Epam Systems
Location(s): Coimbatore

+ View Contactajax loader


Keyskills:   cd continuous integration python data services data validation automation testing data warehousing ci/cd microsoft azure sql cloud data quality etl automation quality engineering gcp test automation framework jenkins data warehouse testing etl db knowledge aws data lake

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Engineer /senior Engineer - (mcu Rtos)

  • Einfochips
  • 5 - 10 years
  • Hyderabad
  • 21 hours ago
₹ Not Disclosed

SDET Technical Lead

  • Wipro HR Soniya
  • 5 - 8 years
  • Hyderabad
  • 2 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 15 - 20 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 5 - 8 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Epam Systems

About us:EPAM Systems