Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Apache Spark Senior Technical Lead @ Sopra Steria

Home > Software Development

 Apache Spark Senior Technical Lead

Job Description

Job Title: Technical Lead/Senior Technical Lead
Location: Chennai
Role Overview:
We are looking for a skilled Data Engineer to build and maintain scalable data pipelines, manage large datasets, and support analytics initiatives. This role involves working with Big Data technologies like Spark, Scala, SQL/PLSQL, and cloud-ready environments.
Experience:
  1. 8+ years of relevant experience in data engineering / big data development
  2. Proven track record of handling large-scale data solutions
  1. Maintain, develop, and design data ingestion and transformation pipelines using Spark and Scala
  2. Process and optimize SQL and PL/SQL queries for large datasets
  3. Integrate and process data from multiple sources for analytics and reporting
  4. Collaborate with BI and Analytics teams to support reporting and dashboard needs
  5. Ensure data quality, performance, and security
  6. Provide innovative solutions to complex business/technical problems
  7. Identify and resolve technical, integration and development issues
  8. Implement best practices, standards and processes to ensure quality of the final product
  9. Responsible for development of features independently
  10. Continuous build, automated testing, and release management
  11. Participate in status meetings and provide regular updates
Required Skills:
Technical:
  1. Expertise in Spark and Scala for large-scale data processing
  2. Proficiency in Python and SQL, including hands-on experience with PL/SQL
  3. Experience in data integration/ETL workflows;
  4. Strong knowledge of relational databases such as Oracle and PostgreSQL
Professional Competencies:
  1. Excellent verbal and written communication skills
  2. Result-oriented with strong analytical and problem-solving skills
  3. Ability to work in a fast-paced, agile, and collaborative environment
Desired Skills:
  1. Exposure to cloud data services (AWS preferred)
  2. Proficiency in Linux/Unix shell scripting for automation and data operation
  3. Experience working in Agile environments Scrum and/or SAFe frameworks
  4. Exposure to DevOps culture and practices, including CI/CD and automation
  5. Understanding of software engineering lifecycle Development, Testing, and Production Support
  6. Experience in production issue handling and transformation support management
Good to Have Skills:
  1. Exposure to Dataiku preferred
  2. Awareness of cloud and big data architecture principles
Total Experience Expected: 08-10 years
BE / B.Tech/ MS/ M.Tech/ MCA

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Technical Lead
Employement Type: Full time

Contact Details:

Company: Sopra Steria
Location(s): Chennai

+ View Contactajax loader


Keyskills:   Automation Linux Production support Agile Scrum Oracle Release management Unix shell scripting Analytics Python

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Engineer /senior Engineer - (mcu Rtos)

  • Einfochips
  • 5 - 10 years
  • Hyderabad
  • 23 hours ago
₹ Not Disclosed

SDET Technical Lead

  • Wipro HR Soniya
  • 5 - 8 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 15 - 20 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 5 - 8 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Sopra Steria

Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by c...