Key Responsibilities:
Develop and test code to deliver functionality that meets the overall business strategy and objectives
Build the work needed to implement features from the product backlog
Size user stories
Unit test code, create automated test scripts, and execute all other testing-related tasks
Test deliverables against a user storys acceptance tests
Execute necessary project documentation
Work closely with other team to ensure that features meet business needs
Follow industry-standard agile software design methodology for development and documentation
Work with infrastructure, security, and other partners
3-5 years in an engineering role1-3 years participating in agile development Experience with test-driven development and software test automation
Hands on experience on BigData technologies specially Apache Spark and Hadoop Ecosystem(oozie, hive).
Good knowledge and experience in programming language Scala.
Development experience on building data pipeline end-to-end.
Experience integrating with REST APIs
Knowledgeable of streaming solutions (e.g. Kafka)
Knowledge on Continuous Integration/Deployment (Vela, Jenkins, Git etc.)
Experience working with a source versioning tool, such as Git.
Able to understand existing projects / data pipelines to monitor them and support in case of issues to achieve the SLA.
Requirements:
Keyskills: continuous integration Software design GIT Test scripts Staffing spark Hadoop test driven development Business strategy infrastructure security