Role Overview
We are looking for a highly skilled ETL Tester to join our team. In this role, you will collaborate closely with development teams and product managers to design, develop, and maintain robust software applications. You should be comfortable working on both client-side and server-side architectures, ensuring the delivery of scalable, reliable, and high-performing solutions.
Key Responsibilities
Collaborate with development teams and product managers to design and develop software applications.
Design and work with client-side and server-side architectures.
Build reliable, scalable applications and features with responsive design principles.
Test, troubleshoot, debug, and upgrade software to ensure high performance and efficiency.
Develop and maintain well-functioning databases and applications.
Work in an Agile environment using tools such as JIRA boards.
Optimize Spark jobs for performance, including executor/driver sizing, memory management, adaptive query execution, and join strategies.
Must-Have Qualifications
3+ years of hands-on experience building and maintaining ETL/ELT pipelines.
Strong problem-solving skills using data structures and algorithms in Java.
Expertise in Apache Spark performance tuning (executor/driver sizing, memory management, adaptive query execution, broadcast vs. shuffle joins).
Proficiency in SQL (complex joins, window functions, performance tuning) on relational databases such as DB2 or MySQL.
Knowledge of database creation and maintenance (DB2, MySQL).
Working knowledge of at least one scripting language (Shell).
Familiarity with job scheduling/workflow orchestration tools (Control-M).
Good-to-Have Skills
Understanding of microservices architecture.
Basic knowledge of web applications and their working.
Exposure to Linux-based environments.
Experience with source control tools (Git) and CI/CD pipelines (Jenkins).

Keyskills: sql apache spark etl performance tuning continuous integration ci/cd data warehousing dbms control-m microservices plsql java git linux jenkins shell scripting mysql jira software testing elt sql server pipeline etl testing agile informatica unix