Basic requirements: A data engineer with strong programming experience in Python Extensive experience related to processing frameworks such as Spark, Spark Streaming, Hive, Sqoop, Airflow, Kafka etc. Experience with big data processing within cloud environments such AWS S3. Passion for Data Privacy and Security, Data Management. Experience building and shipping data production pipelines sourcing data from a diverse array of sources. Deep understanding of measuring and ensuring data quality at scale and the required tooling to monitor and optimize the performance of our data pipelines Ability to influence and communicate effectively with team members and business stakeholders
Employement Category:
Employement Type: Full time Industry: IT/Computers - Software Functional Area: IT/Software Development - Other Role Category: Technical Consultant Role/Responsibilies: Big Data Engineer
Advent Global Solution Private Limited Advent is a systems, solutions , product and services company with approximately 1000+ people serving customers and creating opportunities across the globe.