Data Engineer - Bengaluru/Bangalore - NTT Data

Requirements:

• Analyze and understand data sources APIs
• Design and Develop methods to connect collect data from different data sources
• Design and Develop methods to filter/cleanse the data
• Design and Develop SQL, Hive queries, APIs to extract data from the store
• Work closely with data scientists to ensure the source data is aggregated and cleansed
• Work with product managers to understand the business objectives
• Work with cloud and data architects to define robust architecture in cloud setup pipelines and workflows
• Work with DevOps to build automated data pipelines

Total Experience Required

• 4
• The candidate should have performed client-facing roles and possess excellent communication skills
• Business Domain knowledge: Finance banking systems, Fraud, Payments

Required Technical Skills

• Big Data-Hadoop, NoSQL (MongoDB), Hive, Apache Spark
• Python/Scala
• Kafka
• Java REST
• GIT and Version Control

Desirable Technical Skills

• Familiarity with HTTP and invoking web-APIs
• Exposure to machine learning engineering
• Exposure to NLP and text processing
• Experience with pipelines, job scheduling, and workflow management

Personal Skills

• Experienced in managing work with distributed teams
• Experience working in SCRUM methodology
• Proven sense of high accountability and self-drive to take on and see through big challenges
• Confident, takes ownership, willingness to get the job done
• Excellent verbal communications and cross group collaboration skills