TheDataTeam is looking for a Technical Lead - Big Data who will be responsible for the following :
- To lead the technical discussion during the requirements gathering phase
- Coordinate with Solution Architect to arrive at a technical solution for the problem statement.
- Lead the team for task estimation, planning, tracking and resolving technical blocker issues.
- Proactively keep the Project Managers and Client stakeholders updated
- Should prepare Low Level Design Document
- Should participate in preparing High Level Design Document
- Manage CICD Pipelines
- Periodic Code Review and Code merge
- Manage cloud deployments
- Track and help the clientvendor to complete the UAT
Key skills :
- Should have minimum 7+ years of IT experience; at least 2-3 years of exp on BigData Ecosystem Should have good knowledge on Spark, NoSQL ,OozieAirflow,ScalaJava
- Core Java or Python Skills is must
- Experience on AWS
- Experience on developing complex data processing pipelines
- Hands on experience on either one of the Hadoop Distributions MapR, Cloudera and or Cloud (AWS EMR, Azure HD Insights, Qubole, etc)
- Got to have practical knowledge of Data Driven Approaches, Data Security Approaches
- Worked as Technical Lead for a minimum of 3 or more projects.
- Experience on performance tuning of Spark Jobs
- Assist in documenting requirements and resolving technical clarification with client
- Experience on CICD Deployments
- Good knowledge on Linux and Bash commands
- Experience on documenting LLD Documents
Keyskills: scala big data aws python nosql cloud spark java ci/cd pipeline