Openings GCP Data Engineer
- Tech Mahindra
- 5 - 8 years
- Noida, Gurugram
- 3 months ago
- Email to a friend
- Report this job
Job Description
5 to 7 years of good hands on exposure in :
- Develop and maintain data ingestion pipelines for various data sources, including transactional databases, streaming big data, and batch data, utilizing tools such as GCP, GitHub, Terraform , and PySpark, Kafka, ECS.
- Set up and manage batch orchestration jobs using Apache Airflow, ensuring timely execution and reliability.
- Monitor data pipelines continuously to ensure operational efficiency and address any anomalies or incidents that may arise in a timely manner.
- Collaborate with the data governance team to ensure compliance with data governance guidelines, including data classification and quality, using monitoring tools like Grafana and metrics from Prometheus.
- Document operational procedures, incident reports, and performance metrics to support continuous improvement efforts.
Qualifications:
- bachelor in IT or information systems
- Proficient in GitHub and GitHub Actions, as well as Terraform for infrastructure management.
- Experience with AWS Glue, Python, and PySpark for data processing.
- Familiarity with monitoring and visualization tools such as Grafana and Prometheus.
- A solid understanding of object-oriented programming principles and SOLID principles is a plus.
Desired Skills:
- Strong analytical and problem-solving abilities, particularly in an operational context.
- Capable of effectively communicating technical concepts to non-technical stakeholders.
- A proactive team player with a hands-on mindset, ready to tackle operational challenges Role & responsibilities
Preferred candidate profile
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: Tech MahindraLocation(s): Noida, Gurugram
Keyskills: and PySpark streaming big data Terraform GitHub Kafka utilizing tools such as GCP ECS. and batch data
Similar positions
Tech Mahindra
Tech Mahindra Limited is an Indian multinational provider of information technology (IT), networking technology solutions and Business Process Outsourcing (BPO) to the telecommunications industry. Tech Mahindra is a US$4.2 billion company with over 117,000 employees across 90 countries. It provide...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in