Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Spark Scala AWS -- Module Lead/Technical Lead @ C P Careers

Home > Software Developer

 Spark Scala AWS -- Module Lead/Technical Lead

Job Description

Job Description
Responsibilities Build and optimize performance of Scala Spark batch jobs using AWS EMR Build and optimize performance of Kafka NIFI and other components of real time pipelines Participate and contribute to the design architecture and develo pment of high quality data lake data models Build data pipeline orchestration Ensuring code quality and conformance of code to applicable rules norms and relevant best practices Coaching mentoring and developing new hires and less experien ced developers to work on Big Data projects Skills Strong understanding of distributed systems and distributed computation Strong working knowledge in Scala and Spark Good knowledge in AWS services like S3 EMR Glue SageMaker Lambda ECS DMW and Athena Demonstrated working knowledge in Spark Kafka NiFi Demonstrated working knowledge of data modeling Experience in designing and running Unit and Integration testing Hands on exposure to data store technologies like MongoDB DynamoDB Postgres and Redshift Knowledge of TDD BDD methodologies tools and practices Working experience with Go lang python scala Responsibilities Build and optimize performance of Scala Spark batch jobs using AWS EMR Build an d optimize performance of Kafka NIFI and other components of real time pipelines Participate and contribute to the design architecture and development of high quality data lake data models Build data pipeline orchestration Ensuring code quali ty and conformance of code to applicable rules norms and relevant best practices Coaching mentoring and developing new hires and less experienced developers to work on Big Data projects Skills Strong understanding of distributed systems an d distributed computation Strong working knowledge in Scala and Spark Good knowledge in AWS services like S3 EMR Glue SageMaker Lambda ECS DMW and Athena Demonstrated working knowledge in Spark Kafka NiFi Demonstrated working know.

Employement Category:

Employement Type: Full time
Industry: IT
Functional Area: IT
Role Category: Software Developer
Role/Responsibilies: Spark Scala AWS -- Module Lead/Technical Lead

Contact Details:

Company: C P Careers
Location(s): Mumbai

+ View Contactajax loader


 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ 700000 - 1700000

C P Careers

C P Careers Pvt. Ltd