Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Big Data Engineer - Chennai - Tango It @ Tango It Solutions

Home > Other






 Big Data Engineer - Chennai - Tango It

Job Description

  • Experience in developing Apache spark Scala distributed application
  • Should have real time experience in handling large volumes of data (both structured and unstructured)
  • Expertise in distributing data workloads to handle TB of data for machine learning Jobs (parallel execution)
  • Should have experience in building large scale spark application using Scala
  • Experience in both streaming and batch data processing workloads using Apache Spark
  • Experience in working Hive database and optimising it
  • Expertise in presto analytical query engine
  • Should have experience in handling/optimising various file formats like parquet, Avro etc
  • Ability to resolve ongoing issues with operating the cluster
  • Create and maintain optimal data pipeline workflow in AWS
  • Ability to optimise HDFS file system operation
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using big data tools
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Working knowledge of message queuing using Apache Kafka
  • Experience with big data tools: HDFS, Hive, Apache Spark, Kafka
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Experience with stream-processing systems: Spark-Streaming
  • Experience with object-oriented and functional programming language: Python, Java
  • Follow business targets and Scrum.
  • If worked on Pyspark application also, is an added advantage

Job Classification

Industry: IT-Software, Software Services
Functional Area: Other,
Role Category: Other
Role: Other
Employement Type: Full time

Education

Under Graduation: Any Graduate in Any Specialization
Post Graduation: Post Graduation Not Required
Doctorate: Doctorate Not Required

Contact Details:

Company: Tango It Solutions
Location(s): Chennai

+ View Contactajax loader


Keyskills:   hive python spark scala kafka pyspark hdfs aws presto

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Sfdc Architect

  • Quinnox
  • 15 - 24 years
  • Bengaluru
  • 2 days ago
₹ Not Disclosed

Looking For immediate joiners - Lab Data Analyst-Python Programming

  • IQVIA
  • 0 - 1 years
  • Bengaluru
  • 4 days ago
₹ Not Disclosed

Lead Software Engineer

  • Icertis
  • 7 - 15 years
  • Pune
  • 4 days ago
₹ 15-30 Lacs P.A.

Hcl Tech-software Development Engineer In Test-senior Test Lead -noida

  • HCLTech
  • 7 - 10 years
  • Noida, Gurugram
  • 4 days ago
₹ Not Disclosed

Tango It Solutions

*Tango IT is an AI based product company operating from Chennai. We started our journey as an AI service provider and provided a solution to NPCI for UPI payments analytics.* Currently we are into retail analytics. We have a SAAS product called Tango Eye for instore video analytics. we service ...