Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Azure Data Engineer @ Infogain

Home > Software Development

 Azure Data Engineer

Job Description

1. Data Quality Development & Monitoring
  • Design and implement automated data quality rules and validation checks using Databricks (Delta Lake) and PySpark .
  • Build and operationalize data quality workflows in Ataccama ONE / Ataccama Studio .
  • Perform data profiling, anomaly detection, and reconciliation across systems and data sources.
  • Establish thresholds, KPIs, and alerts for data quality metrics.
2. Root Cause Analysis & Issue Management
  • Investigate data anomalies and quality incidents using SQL, Python, and Ataccama diagnostics.
  • Collaborate with data engineers and business analysts to identify and remediate root causes.
  • Document recurring data issues and contribute to preventive automation solutions.
3. Collaboration & Governance Support
  • Partner with data stewards, governance, and analytics teams to define and maintain DQ rules and SLAs.
  • Contribute to metadata enrichment, lineage documentation, and data catalog integration.
  • Support adoption of DQ frameworks and promote data reliability best practices.
4. Automation & Continuous Improvement
  • Integrate DQ validations into orchestration tools (Airflow, Databricks Workflows, or ADF).
  • Leverage Python/Pyspark libraries to complement existing platforms.
  • Propose process improvements to enhance automation, monitoring, and exception management

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Infogain
Location(s): Bengaluru

+ View Contactajax loader


Keyskills:   Computer science Telecom Automation Analytical Reconciliation Healthcare Data quality Continuous improvement Analytics Monitoring

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Lead Engineer Software

  • Empower
  • 3 - 8 years
  • Bengaluru
  • 2 days ago
₹ Not Disclosed

Cloud Automation Engineer (AI Enablement)

  • Teamlease Digital
  • 6 - 10 years
  • Hyderabad
  • 2 days ago
₹ 1.25-2.5 Lacs P.A.

Cloud FinOps Engineer (AI-Enablement)

  • Teamlease Digital
  • 6 - 10 years
  • Hyderabad
  • 2 days ago
₹ 1-2 Lacs P.A.

Data Engineer

  • ConverseHR
  • 2 - 5 years
  • Hyderabad
  • 2 days ago
₹ 15-25 Lacs P.A.

Infogain

Infogain is a Silicon Valley headquartered company with software platform engineering and deep domain expertise in the travel, retail, insurance and high technology industries. We accelerate the delivery of digital customer engagement systems using digital technologies such as cloud, mic...