Senior Data Quality / ETL Engineer
- Pattern Technologies
- 6 - 10 years
- Pune
- 4 months ago
- Email to a friend
- Report this job
Job Description
Senior Data Quality / ETL Tester- Analyze business and technical requirements to design, develop, and execute comprehensive test plans for ETL pipelines and data transformations.
- Perform data validation, reconciliation, and integrity checks across various data sources and target systems.
- Build and automate data quality checks using SQL and/or Python scripting.
- Identify, document, and track data quality issues, anomalies, and defects.
- Collaborate with data engineers, developers, QA, and business stakeholders to understand data requirements and ensure data quality standards are met.
- Define data quality KPIs and implement continuous monitoring frameworks.
- Participate in data model reviews and provide input on data quality considerations.
- Perform root cause analysis for data discrepancies and work with teams to drive resolution.
- Ensure alignment to data governance policies, standards, and best practices
- Experience with data quality frameworks (e.g., Soda, Great Expectations, Deequ, Monte Carlo, DBT Test).
- Experience with modern cloud data ecosystems (AWS, Snowflake, Apache Spark, Redshift).
- Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and performance tuning.
- Familiarity with data pipeline tools like Airflow, DBT, or Informatica.
- Experience integrating data validation processes into CI/CD pipelines using tools like GitHub Actions, Jenkins, or similar.
- Background to big data platforms, data lakes, or non-relational databases.
- Understanding of data lineage, and master data management (MDM) concepts.
- Experience with Agile/Scrum development methodologies
- Bachelors degree in Computer Science, Information Technology, or a related field.
- 8 plus years of experience as a Data Quality Engineer, ETL Tester, or a similar role.
- Strong understanding of ETL concepts, data warehousing principles, and relational database design.
- Proficiency in SQL for complex querying, data profiling, and validation tasks.
- Familiarity with data quality tools and testing methodologies.
Job Classification
Industry: RetailFunctional Area / Department: Engineering - Software & QARole Category: Quality Assurance and TestingRole: Data / Big Data Testing EngineerEmployement Type: Full timeContact Details:
Company: Pattern TechnologiesLocation(s): Pune
Keyskills: Computer science Performance tuning Database design Data quality Informatica Stored procedures Information technology Monitoring SQL Python
Similar positions
Pattern Technologies
Pattern is the premier partner for global e-commerce acceleration and is headquartered in Utah's Silicon Slopes tech hubwith offices in Asia, Australia, Europe, the Middle East, and North America. Valued at $2 billion, Pattern has been named one of the fastest-growing tech companies in North Amer...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in