Cloud Engineer - Bengaluru/Bangalore @ staffio

Experience: 8-12 years

Key Skills: JavaPython, Big Data

Qualification: B.TechB.E Only

• Design, Develop and manage of Big Data infrastructures Solution Focused professional with experience in Data Engineering, Data Analysis, Workflow monitoring in distributed computing environment for implementing Big Data solution.
• Good understanding of complex processing needs of big data and has experience in developing codes and modules to address those needs.
• Participate in architectural discussions to ensure solutions are designed for successful deployment, security, and high availability in the cloud
• Write and maintain code for automating the creation of scalableresilient systemsinfrastructure
• Design, implement, and maintain server, storage, network, and security infrastructure
• Work with application teams to move existing applications to AWS Azure through lift-and-Shift and refactoring migration strategies
• Develop, implement, and test data backup and recovery, and disaster recovery procedures
• Write and maintain clear, concise documentation, runbooks and operational standards including infrastructure diagrams
• Ensure all solutions are properly monitored and instrumented
• Troubleshoot and resolve complex issues in development, test and production environments
• Educatementor product teams and junior engineers.

Requirements:

• 8+ Years of software development experience (Java or Python) with good knowledge of computer science fundamentals
• Able to integrate state-of-the-art CloudBig Data technologies into the overall architecture and lead a team of developers through the construction, testing and implementation- Experience with designing data pipelines
• Experience with Data Quality Management (Semantic and Syntactic Checks)
• Hands on Experience with SQL
• Experience in Cloud Computing technologies like AWS (EC2, S3, ECS, Lambda, RedShift, EMR, SQS, SNS, IAM, Pivotal Cloud Foundry).
• Experience in Big Data Technologies like Hadoop, Python and knowledge of Spark and Scala.
• Experience in Hadoop components like HDFS, Map Reduce, Hive, Pig, HBase, Impala, Sqoop, Flume and Oozie.
• Experience in Python Scripting, Git, Maven, Junit, SonarCube, Nexus, Ansible, Docker, Microservices, Jenkins
• Broad range of technology interests across different disciplines including computer and system architecture, web applications, Scalability, performance analysis, distributed systems design, and testing.
• Strong understanding of object oriented programming and software architecture.
• Strong understanding of the SDLC in an AgileScrum environment.
• Proven ability to successfully design, build, and deliver globally scalable software applications.
• Experience in successfully communicating with stakeholders, product management, and other key contributors.
• Understanding of immutable infrastructure and infrastructure as code concepts
• Familiar with Linux andor Windows operating systems