We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges.
As a Lead Engineer, you will be pivotal in creating and implementing Data solutions across various projects. The ideal candidate will possess deep experience in Data and associated technologies, strongly emphasizing Apache Spark, Python, Azure and AWS.
Technologies
Hadoop
Hive
Responsibilities
Develop and execute end-to-end Data solutions for intricate business needs
Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions
Apply your knowledge in Apache Spark, Python, Azure and AWS to build scalable and effective data processing systems
Maintain the performance, security, and scalability of Big Data applications
Keep abreast of industry trends and advancements in Big Data technologies to enhance our development processes
Requirements
8-12 years of hands-on experience in Data and Data-related technologies
Expert-level knowledge and practical experience with Apache Spark
Proficiency in Python
Strong proficiency with Hadoop and Hive
Experience working with native Cloud data services, specifically AWS and Azure
Nice to have
Background in machine learning algorithms and techniques
Skills in data visualization tools such as Tableau or Power BI
Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm
Understanding of containerization technologies like Docker or Kubernetes
Job Classification
Industry: IT Services & Consulting Functional Area / Department: Engineering - Software & QA, Role Category: Software Development Role: Software Development - Other Employement Type: Full time