Lead Developer (Databricks) @ Sapiens

Criterias

Job Requirements

General Job Description

A seasoned, experienced professional with a full understanding of area of specialization; resolves a wide range of issues in creative ways. This job is the fully qualified, career-oriented, journey-level position.

Pre - requisites Knowledge & Experience

• B.E (or equivalent)
• In-depth understanding of distributed data processing frameworks like Apache Spark, with specific expertise in Databricks.
• Proficiency in designing and building data pipelines for data extraction, transformation, and loading (ETL).
• Familiarity with big data technologies and concepts, including Hadoop, Hive, and HDFS (good to have).
• Proven experience in building scalable and high-performance data solutions for large datasets.
• Solid understanding of database design, and data warehousing concepts.
• Knowledge of both SQL and NoSQL databases, and ability to choose the right database type based on project requirements.
• Extensive hands-on experience with Databricks for big data processing and analytics.
• Ability to set up and configure Databricks clusters and optimize their performance.
• Proficiency in Spark Data Frame and Spark SQL for data manipulation and querying.
• Understanding of data architecture principles and experience in designing data solutions that meet scalability and reliability requirements.
• Familiarity with cloud-based data platforms like AWS or Azure.
• Problem-Solving and Analytical Skills:
• Strong problem-solving skills and the ability to analyse complex data-related issues.
• Capacity to propose innovative and efficient solutions to data engineering challenges.
• Excellent communication skills, both verbal and written, with the ability to convey technical concepts to non-technical stakeholders effectively.
• A strong inclination to stay updated with the latest advancements in data engineering, and Databricks technologies.
• Adaptability to new tools and technologies to support evolving data requirements.

Required Product/project Knowledge

• Ability to work in an agile development environment.
• Hand on experience in technical design document preparation
• Proven experience in fine tuning and identifying the potential bottle necks on the applications

Required Skills

• Ability to work on tasks (POCs, Stories, CR's, Defects etc.) without taking much help.
• Technical ability includes Programming, Debugging and Logical skills.

Common Tasks

• Come up and follow process for:
• Technical compliance and documentation
• Code review
• Unit & Functional testing
• Deployment
• Ensures that the team is also following the process properly.
• Able to write at least two technical paper or present one tech talk in a year
• 100% Compliance to Sprint Plan.

Required Soft Skills

• Providing technical leadership and mentoring to junior developers
• Collaboration and teamwork skills
• Self-motivated with strong initiative and excellent Communication Skills
• Abilities of becoming a technical activity leader
• Proactive and initiative approach
• Self-motivated, flexible and a team player
• Have good understanding of the requirements in the area of functionality being developed