Job Description
Hi All,
Greeting from Quess Corp Ltd.
Expertise Area to be:
Proficient in Core JAVA (Multithreading and Collections framework)
Proficient in cleaning, transforming, and analyzing vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts.
Proficient in designing efficient data processing pipelines by writing suitable Spark batch and streaming Jobs involving various transformations and aggregations.
Proficient in Spark data structures and APIs based on RDDs, Dataframe and Datasets.
Proficient in Spark query tuning and performance optimization
Proficient in usage of Hadoop Distributed File System (HDFS)
Proficient in data formats such as JSON, ORC, Parquet, Avro, etc.
Desirable: Experience with Zookeeper, Hive, Sqoop and other utilities of Hadoop Ecosystem.
Must have strong troubleshooting skill in debugging the failure of Spark Jobs on production cluster.
Employement Category:
Employement Type: Part time
Industry: Telecom
Functional Area: IT
Role Category: Software Engineer
Role/Responsibilies: Big Data Developer
Contact Details:
Company: Quess IT Staffing
Location(s): Hyderabad
Keyskills:
Big Data Developer
Big Data Engineer
Big Data Analys
Juniper Networks Products
Big Data Consultan