Job Description
Java/Scala/Spark/Big Data
o In-depth knowledge on Apache Spark and its underlying MPP Architecture
o Understanding of Jobs,Stages, Tasks, Drivers, Executors, YARN in Spark and debugging Spark Applications
o Strong Skills in Scala Functional Programming with respective to Spark
o Good understanding of different data formats like Parquet/Json/CSV/Text and parsing data between formats
o Excellent Coding skills to utilise Spark parallel processing
o Good understanding of Performance Tuning and Optimisation of Spark Jobs
o Working Knowledge on integrating Unit Testing/Code Coverage/Threat and Security Scans of Code
o Working in CICD Approach following Code-Build-Test-Deploy. TDD Understanding is good to have
o Working knowledge in Git techniques like new branches, commits, merge requests
o Good Knowledge in AWS Services such EC2, EMR, Lambda, ASG, Load Balancers, SNS, SQS, S3, CloudWatch
o Worked in build tools like Jenkins/GitLab Runner to deploy Artifacts
o Good to have understanding about Docker/Containerization/AWS ECS/Fargat
Required Candidate profile
Java/Scala/Spark/Big Data
o In-depth knowledge on Apache Spark and its underlying MPP Architecture
o Understanding of Jobs,Stages, Tasks, Drivers, Executors, YARN in Spark and debugging Spark Applications
o Strong Skills in Scala Functional Programming with respective to Spark
o Good understanding of different data formats like Parquet/Json/CSV/Text and parsing data between formats
o Excellent Coding skills to utilise Spark parallel processing
o Good understanding of Performance Tuning and Optimisation of Spark Jobs
o Working Knowledge on integrating Unit Testing/Code Coverage/Threat and Security Scans of Code
o Working in CICD Approach following Code-Build-Test-Deploy. TDD Understanding is good to have
o Working knowledge in Git techniques like new branches, commits, merge requests
o Good Knowledge in AWS Services such EC2, EMR, Lambda, ASG, Load Balancers, SNS, SQS, S3, CloudWatch
o Worked in build tools like Jenkins/GitLab Runner to deploy Artifacts
o Good to have understanding about Docker/Containerization/AWS ECS/Fargat
Job Classification
Industry: IT-Software, Software Services
Functional Area: IT Software - Application Programming, Maintenance,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time
Education
Under Graduation: Graduation Not Required, Any Graduate in Any Specialization
Post Graduation: Post Graduation Not Required, Any Postgraduate in Any Specialization
Doctorate: Doctorate Not Required, Any Doctorate in Any Specialization
Contact Details:
Company: Focus Management
Location(s): Chennai
Keyskills:
Java
GIT
Parsing
SCALA
Big Data
JSON
Parallel Processing
Spark
YARN
AWS