Your browser does not support javascript! Please enable it, otherwise web will not work for you.

EMR_Spark SME @ Leading Client

Home > Devops

 EMR_Spark SME

Job Description

 Job Title:EMR_Spark SME
Experience:5-10 Years
Location:Bangalore  :  Technical Skills:
  •  
  •  5+ years of experience in big data technologies with hands-on expertise in AWS EMR and Apache Spark. 
  •  Proficiency in Spark Core, Spark SQL, and Spark Streaming for large-scale data processing. 
  •  Strong experience with data formats (Parquet, Avro, JSON) and data storage solutions (Amazon S3, HDFS). 
  •  Solid understanding of distributed systems architecture and cluster resource management (YARN). 
  •  Familiarity with AWS services (S3, IAM, Lambda, Glue, Redshift, Athena). 
  •  Experience in scripting and programming languages such as Python, Scala, and Java. 
  •  Knowledge of containerization and orchestration (Docker, Kubernetes) is a plus. 
  •  Architect and develop scalable data processing solutions using AWS EMR and Apache Spark. 
  •  Optimize and tune Spark jobs for performance and cost efficiency on EMR clusters. 
  •  Monitor, troubleshoot, and resolve issues related to EMR and Spark workloads. 
  •  Implement best practices for cluster management, data partitioning, and job execution. 
  •  Collaborate with data engineering and analytics teams to integrate Spark solutions with broader data ecosystems (S3, RDS, Redshift, Glue, etc.). 
  •  Automate deployments and cluster management using infrastructure-as-code tools like CloudFormation, Terraform, and CI/CD pipelines. 
  •  Ensure data security and governance in EMR and Spark environments in compliance with company policies. 
  •  Provide technical leadership and mentorship to junior engineers and data analysts. 
  •  Stay current with new AWS EMR features and Spark versions to recommend improvements and upgrades. 

    •  Requirements and Skills 
  •  Performance tuning and optimization of Spark jobs. 
  •  Problem-solving skills with the ability to diagnose and resolve complex technical issues. 
  •  Strong experience with version control systems (Git) and CI/CD pipelines. 
  •  Excellent communication skills to explain technical concepts to both technical and non-technical audiences. 

    •  Qualification: 
  •  Education qualificationB.Tech, BE, BCA, MCA, M. Tech or equivalent technical degree from a reputed college. 

    •  Certifications: 
  •  AWS Certified Solutions Architect Associate/Professional 
  •  AWS Certified Data Analytics Specialty 

    • Job Classification

    Industry: Recruitment / Staffing
    Functional Area / Department: Engineering - Software & QA
    Role Category: DevOps
    Role: DevOps Consultant / Architect
    Employement Type: Full time

    Contact Details:

    Company: Leading Client
    Location(s): Bengaluru

    + View Contact

    Keyskills:   resource management continuous integration spark streaming spark ci cd pipeline python scala glue version control amazon redshift big data technologies ci/cd spark core java aws emr athena aws big data database system architecture

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    AWS - SME / Architect- Hyderabad

    • Infosys
    • 5 - 10 years
    • Pune
    • 4 days ago
    ₹ Not Disclosed

    AWS - SME / Architect- Pune

    • Infosys
    • 5 - 10 years
    • Pune
    • 4 days ago
    ₹ Not Disclosed

    SME - DevOps (DV1)

    • Microland
    • 7 - 15 years
    • Noida, Gurugram
    • 21 days ago
    ₹ Not Disclosed

    SME - DevOps (DV1)

    • Microland
    • 4 - 5 years
    • Bengaluru
    • 26 days ago
    ₹ Not Disclosed

    Leading Client

    Leading Client In Paper

    IndigoJobs © 2025

    For enquiries: contact(at)indigojobs.in

    We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in