Apache Spark Senior Technical Lead
- Sopra Steria
- 8 - 10 years
- Chennai
- 4 months ago
- Email to a friend
- Report this job
Job Description
- 8+ years of relevant experience in data engineering / big data development
- Proven track record of handling large-scale data solutions
- Maintain, develop, and design data ingestion and transformation pipelines using Spark and Scala
- Process and optimize SQL and PL/SQL queries for large datasets
- Integrate and process data from multiple sources for analytics and reporting
- Collaborate with BI and Analytics teams to support reporting and dashboard needs
- Ensure data quality, performance, and security
- Provide innovative solutions to complex business/technical problems
- Identify and resolve technical, integration and development issues
- Implement best practices, standards and processes to ensure quality of the final product
- Responsible for development of features independently
- Continuous build, automated testing, and release management
- Participate in status meetings and provide regular updates
- Expertise in Spark and Scala for large-scale data processing
- Proficiency in Python and SQL, including hands-on experience with PL/SQL
- Experience in data integration/ETL workflows;
- Strong knowledge of relational databases such as Oracle and PostgreSQL
- Excellent verbal and written communication skills
- Result-oriented with strong analytical and problem-solving skills
- Ability to work in a fast-paced, agile, and collaborative environment
- Exposure to cloud data services (AWS preferred)
- Proficiency in Linux/Unix shell scripting for automation and data operation
- Experience working in Agile environments Scrum and/or SAFe frameworks
- Exposure to DevOps culture and practices, including CI/CD and automation
- Understanding of software engineering lifecycle Development, Testing, and Production Support
- Experience in production issue handling and transformation support management
- Exposure to Dataiku preferred
- Awareness of cloud and big data architecture principles
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Technical LeadEmployement Type: Full timeContact Details:
Company: Sopra SteriaLocation(s): Chennai
Keyskills: Automation Linux Production support Agile Scrum Oracle Release management Unix shell scripting Analytics Python
Similar positions
Sopra Steria
Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by c...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in