Data Engineer - Hadoop/Big Data Technologies @ WorkiFicient

Job Description

Job Requirements :

- In-depth knowledge of Big Data technologies - Spark, HDFS, Hive, Kudu, Impala
- Solid programming experience in Python, Java, Scala, or other statically typed programming language

- Production experience in core Hadoop technologies including HDFS, Hive and YARN
- Strong working knowledge of SQL and the ability to write, debug, and optimize distributed SQL queries
- Having advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases including NOSQL.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Having experience building and optimizing 'big data' data pipelines, architectures and data sets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Excellent attention to detail and communication/presentation skills
- Experience in working in a highly collaborative environment with a heavy emphasis on teamwork
- Experience in working in Agile scrum methodology
- Experience working through all phases of SDLC including Project Management, Business Analysis, Data Analysis, Architecture Design, Development, Testing and Implementation
- Having strong project management and organizational skills.
- Proficient in process modeling, business process flow and data flow diagrams
- Extensive experience working in a data warehouse environment.
- Excellent understanding of data warehouse concepts, data marts, Extraction Transformation and Loading (ETL),Autosys, feed processing, batch processing and data modeling - ER diagrams, RDBMS
- Expert in SQL for data analysis, data integrity, data accuracy, data mining and data mapping across various database platforms like Oracle and SQL Server

Employement Category:

Employement Type: Full time
Industry: IT Services & Consulting
Role Category: General / Other SoftwareIT Operations / EDP / MIS
Functional Area: Not Applicable
Role/Responsibilies: Data Engineer - Hadoop/Big Data Technologies

+ View Contact

Keyskills:   sql java data warehousing informatica python root cause analysis big data data flow sql server root cause data marts data mining process flow data mapping music making data analysis