Big Data Engineer @ Huquo Consulting

Job Description

: Responsible for Hadoop development Implementation including loading from disparate data sets, preprocessing using Hive and Pig. Scope and deliver various Big Data solutions Ability to design solutions independently based on high-level architecture. Manage the technical communication between the survey vendor and internal systems Thorough understanding of the responsibilities of the platform, database, API, caching layer, proxies, and other web services used in the system Maintain the production systems (Kafka, Hadoop, Cassandra, Elasticsearch) Collaborate with other development and research teams Building a cloud based platform that allows easy development of new applications Experience with Java oriented technologies (JBoss, Spring, SpringMVC, Hibernate, REST/SOAP) Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.) Experience with Spark, or the Hadoop. ecosystem and similar frameworks Familiarity with various tools such as AWS, Mesos or Docker and an instinct for automation

Employement Category:

Employement Type: Full time
Industry: IT
Role Category: IT Services & Consulting
Functional Area: Not Applicable
Role/Responsibilies: Big Data Engineer

+ View Contact

Keyskills:   Hive Pig Java JBoss Spring Hibernate REST SOAP SQL MySQL NoSQL Hadoop MongoDB Spark AWS Docker Hadoop development SpringMVC Mesos