Big Data Engineer - Spark/Scala
- Tint Tone & Shade
- 3 to 7 Yrs
- Maharashtra
- 3 months ago
- Email to a friend
- Report this job
Job Description
- As a Spark Scala Developer, you will be responsible for designing and developing scalable data pipelines using Apache Spark and Scala. Your role will involve optimizing and troubleshooting Spark jobs for performance, working with massive datasets in on-prem Hadoop clusters or cloud platforms, and writing clean, modular Scala code using functional programming principles. Collaborating with data teams to integrate with platforms like Snowflake, Databricks, or data lakes will also be a key part of your responsibilities. It will be essential to ensure code quality, documentation, and CI/CD practices are followed diligently. The ideal candidate for this position should possess 3+ years of experience with Apache Spark in Scala and have a deep understanding of Spark internals including DAG, stages, tasks, caching, joins, and partitioning. Hands-on experience with performance tuning in production Spark jobs, proficiency in Scala functional programming, and a strong command over SQL are must-have skills. Additionally, experience with any major cloud platform such as AWS, Azure, or GCP is required. Having worked with Databricks, Snowflake, or Delta Lake, exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery, familiarity with CI/CD pipelines and Git-based workflows, and comfort with SQL optimization and schema design in distributed environments are considered nice-to-have skills for this role. If you are someone with real-world experience working in Big Data environments, both on-prem and/or in the cloud, and possess the necessary skills and expertise in Spark Scala development, this opportunity may be the right fit for you.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Big Data Engineer - Spark/ScalaContact Details:
Company: Strategic HR SolutionsLocation(s): Maharashtra+ View Contact
Keyskills: Apache Spark Scala Big Data Snowflake Hadoop AWS GCP Azure Functional Programming SQL
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Tint Tone & Shade
At Tint Tone and Shade, we believe great design goes beyond creating beautiful spaces and about shaping lifestyles. Recognized among the top interior design firms in Chennai and Hyderabad, we specialize in delivering luxurious, tailor-made interiors that blend creativity, functionality, and craftsma...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in