Lead Developer (Databricks)
- Sapiens
- 5 - 8 years
- Bengaluru
- 5 months ago
- Email to a friend
- Report this job
Job Description
Criterias
Job Requirements
General Job Description
A seasoned, experienced professional with a full understanding of area of specialization; resolves a wide range of issues in creative ways. This job is the fully qualified, career-oriented, journey-level position.
Pre - requisites Knowledge & Experience
- B.E (or equivalent)
- In-depth understanding of distributed data processing frameworks like Apache Spark , with specific expertise in Databricks .
- Proficiency in designing and building data pipelines for data extraction, transformation, and loading (ETL).
- Familiarity with big data technologies and concepts, including Hadoop, Hive, and HDFS (good to have).
- Proven experience in building scalable and high-performance data solutions for large datasets.
- Solid understanding of database design, and data warehousing concepts.
- Knowledge of both SQL and NoSQL databases , and ability to choose the right database type based on project requirements.
- Extensive hands-on experience with Databricks for big data processing and analytics.
- Ability to set up and configure Databricks clusters and optimize their performance.
- Proficiency in Spark Data Frame and Spark SQL for data manipulation and querying.
- Understanding of data architecture principles and experience in designing data solutions that meet scalability and reliability requirements.
- Familiarity with cloud-based data platforms like AWS or Azure.
- Problem-Solving and Analytical Skills:
- Strong problem-solving skills and the ability to analyse complex data-related issues.
- Capacity to propose innovative and efficient solutions to data engineering challenges.
- Excellent communication skills, both verbal and written, with the ability to convey technical concepts to non-technical stakeholders effectively.
- A strong inclination to stay updated with the latest advancements in data engineering, and Databricks technologies.
- Adaptability to new tools and technologies to support evolving data requirements.
Required Product/project Knowledge
- Ability to work in an agile development environment.
- Hand on experience in technical design document preparation
- Proven experience in fine tuning and identifying the potential bottle necks on the applications
Required Skills
- Ability to work on tasks (POCs, Stories, CR's, Defects etc.) without taking much help.
- Technical ability includes Programming, Debugging and Logical skills.
Common Tasks
- Come up and follow process for:
- Technical compliance and documentation
- Code review
- Unit & Functional testing
- Deployment
- Ensures that the team is also following the process properly.
- Able to write at least two technical paper or present one tech talk in a year
- 100% Compliance to Sprint Plan.
Required Soft Skills
- Providing technical leadership and mentoring to junior developers
- Collaboration and teamwork skills
- Self-motivated with strong initiative and excellent Communication Skills
- Abilities of becoming a technical activity leader
- Proactive and initiative approach
- Self-motivated, flexible and a team player
- Have good understanding of the requirements in the area of functionality being developed
Job Classification
Industry: BPM / BPOFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Database Architect / DesignerEmployement Type: Full timeContact Details:
Company: SapiensLocation(s): Bengaluru
Keyskills: data manipulation data processing data bricks data extraction spark hive data warehousing pyspark microsoft azure spark core sql nosql database design functional testing data warehousing concepts debugging hadoop agile big data aws etl
Similar positions
Sapiens
Sapiens International Corporation (NASDAQ and TASE: SPNS) is a leading global provider of software solutions for the insurance industry, with a growing presence in the financial services sector. We offer integrated core software solutions and business services, and a full digital suite for the prope...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in