Data Engineer (Cloudera Data Platform and Banking)
- Top IT Services Firm
- 5 - 10 years
- Bengaluru
- 5 months ago
- Email to a friend
- Report this job
Job Description
INTERESTED CANDIDATES SHARE CV TO VA**********M@PA******O.COM
Exp: 5-10 Years
Notice: Max 30 Days
Location: Pan India (Remote - Work From Home)
Domain: Core Banking is Must
Must Required Skills:
Cloudera Data Platform (CDP) hands-on experience
Strong programming in: Python, PySpark
Workflow orchestration: Apache Airflow
ETL Development: Batch and streaming pipelines
DevOps Practices: CI/CD, version control, automation
Data Governance & Quality: Security, validation, alerting
Nice-to-Have / Preferred:
AI/ML & Generative AI exposure Use case implementation/support
Experience with ML workflows, model pipelines
Familiarity with cloud-native data tools (Azure/AWS)
Collaboration in cross-functional Agile teams
Job Description:
- We are seeking a highly skilled and motivated Data Engineer to join our dynamic technology team. The ideal candidate will have deep expertise in data engineering tools and platforms, particularly Apache Airflow, PySpark, and Python, with hands-on experience in Cloudera Data Platform (CDP). A strong understanding of DevOps practices and exposure to AI/ML and Generative AI use cases is highly desirable.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using Python, PySpark and Airflow.
- Develop and optimize ETL workflows on Cloudera Data Platform (CDP).
- Implement data quality checks, monitoring, and alerting mechanisms.
- Ensure data security, governance, and compliance across all pipelines.
- Work closely with cross-functional teams to understand data requirements and deliver solutions.
- Troubleshoot and resolve issues in production data pipelines.
- Contribute to the architecture and design of the data platform.
- Collaborate with engineering teams and analysts to work on AI/ML and Gen AI use cases.
- Automate deployment and monitoring of data workflows using DevOps tools and practices.
- Stay updated with the latest trends in data engineering, AI/ML, and Gen AI technologies.
INTERESTED CANDIDATES SHARE CV TO VA**********M@PA******O.COM
Job Classification
Industry: BankingFunctional Area / Department: OtherRole Category: OtherRole: OtherEmployement Type: Full timeContact Details:
Company: Top Banking FirmLocation(s): Bengaluru
Keyskills: Cloudera Data Platform Banking Data Engineer ETL Python
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in