Sr. Technical Lead Bigdata at Compunnel

Job Description:

• Must have valid US B1 VISA and open to travel to US for short terms 
• Should have worked as big data engineer in at least two projects in Apache Hadoop with one of them on AWS
• Should have experience in Hive/Kafka on AWS   
• Experience in python and working with master data quality and management in big data environment
• Large-scale batch or real-time data processing (EMR, Spark etc) with strong SQL and ETL skills in Hive
• Experience in Data Lakes with Columnar Data format (ORC, Parquet, etc.)
• Moderate experience in or understanding of publishing/media industry and their advertising data
• Experience in ingesting, querying and manipulation of clickstream data and event tracking in Adobe Analytics or Google Analytics
• Self-motivated person that can deliver tasks on time with minimal supervision