Module Lead Software Engineer: Big Data/Cloud @ Impetus

• Develop and maintain data pipelines on Bigdata and cloud ETL stack
• Work closely with product owners to implementing data science use case and data analytic pipelines
• Anticipate on technological evolutions
• Design, build maintain efficient, reusable reliable code with quality timely deliverables
• Drive various architectural, design and status calls with multiple stakeholders
• Help define data governance policies and support data versioning processes
• Maintain security and data privacy working closely with Data Protection Officer
• Provide the team technical direction(s)/approach(es) to be undertaken and guide them in resolution of queries/issues etc.
• Prepare training manuals for users
• Mentor the team in design development of software application(s)/component(s)
• Fulfill organizational responsibilities (sharing knowledge experience with other teams/groups)
• Conduct technical training(s)/session(s), write whitepapers/ case studies / blogs etc.

Must have

• We need a person from Java background with experience working on Hadoop (CDH/HDP/MapR) , MapReduce, Hive 2.x*, Spark 2.x
• Conceptual knowledge of Data Structures Algorithms
• Possessing in-depth knowledge of various Design Patterns (Java/BigData), Data Processing Patterns (Batch/NRT/RT processing) capable of providing design architecture of typical business problems
• Kafka, Redis, Distributed Message Queues along with Distributed Caching
• Proficient understanding of Build tools (Ant/Maven), Code Versioning tools (Git) with Continuous Integration
• Exposure and awareness of complete PDLC/SDLC. Good to have experience working in projects with Agile Scrum methodology
• Smart Bigdata engineer with strong problem-solving skills ability to thrive in a fast paced, dynamic environment operate under stringent deadlines
• Strong technical development experience in writing performant code leveraging best coding practices as well as conducting code reviews
• Self-starter resourceful personality with good communication, problem solving interpersonal skills.
• Confident, highly motivated, and passionate about delivery and customer satisfaction
• Out of box thinker and not just limited to work done in existing assignment(s)
• Knowledge of core Java, Linux, SQL, and any scripting language
• Good interpersonal skills and a positive attitude

Good to have

• Knowledge and experience with NoSQL Database (Cassandra / HBase / MongoDB / CouchDB / Neo4j) , SQL Database (MySQL/Oracle)

• Knowledge/experience working on Search Platforms (Solr/ElasticSearch), designing as well as implementing RESTful APIs
• Experience with Cloud environments (AWS/GCP/Azure), exposure to Containers Container Management Platforms (Dockers/Kubernetes)
• Understanding of Data Lake vs Data Warehousing concept along with the ability to perform comparative analysis of Data Stores and knowledge/experience with creation maintenance of the same
• Experience with Big Data Cloud ML toolkits (SparkML)
• Knowledge on Data Privacy, Data Governance, Data Compliance Security
• Programming experience with Python/Scala
• Experience with building maintaining optimal data pipelines in a reliable manner so as to deliver solutions on the fly
• Experience working on open-source products