Associate Principal Engineer, Big Data Engineer (Apache Spark)
- Nagarro
- 11 - 14 years
- India
- 22 days ago
- Email to a friend
- Report this job
Job Description
We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital , and our people exist everywhere in the world (17500+ experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in.
REQUIREMENTS:
- Total Experience 11+ years
- Excellent knowledge and experience in Big data.
- Strong experience with Spark (Core & Streaming), Scala/Java, and Hadoop
- Solid grasp of Data Engineering concepts, ETL/ELT pipelines, and Distributed Systems
- Hands-on with SQL, Query Tuning, and Performance Optimization
- Experience with Python, Shell Scripting, and Automation tools like Ansible
- Familiarity with file formats: ORC, Avro, Parquet, JSON, CS
- Hands on experience in Big Data ecosystem: Hadoop, Sqoop, Kafka, NiFi, Airflow, YARN, Oozie, Azkaban
- Knowledge of Version control and DevOps tools: Git, Jenkins, Maven, Artifactory
- Experience with CI/CD and deployment practices
- Provan experience in Data quality & validation frameworks and practices
- Strong understanding of Data Lakes and data orchestration frameworks.
- Strong problem-solving, leadership, and communication skills, with the ability to guide teams and engage stakeholders..
- Strong communication and collaboration skills, with experience working in cross-functional teams
RESPONSIBILITIES:
- Writing and reviewing great quality code
- Understanding the clients business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements
- Mapping decisions with requirements and be able to translate the same to developers
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
- Understanding and relating technology integration scenarios and applying these learnings in projects
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken
- Carrying out POCs to make sure that suggested design/technologies meet the requirements
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Technical Architect
Employement Type: Full time
Contact Details:
Company: NagarroLocation(s): India
Keyskills: Big Data Databricks Hive Kinesis. Kafka Spark Flink
Similar positions
Nagarro
Nagarro Software Pvt. Ltd Nagarro ( www.nagarro.com. ) is a professionally managed company dedicated to providing high quality, on time and custom tailored software solutions for Fortune 100 companies .Our ranks include people from the IITs , IIMs, RECs, BITS and top universities in USA.We opera...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in