Senior Big Data Developer - Youappi @ Affle

Home > Software Development

Senior Big Data Developer - Youappi

Affle
7 - 10 years
Noida, Gurugram
2 months ago
Email to a friend
Report this job

Job Description

We are looking for an experienced Senior Big Data Developer to join our team and help build and optimize high-performance, scalable, and resilient data processing systems. You will work in a fast-paced startup environment, handling highly loaded systems and developing data pipelines that process billions of records in real time.

As a key member of the Big Data team, you will be responsible for architecting and optimizing distributed systems, leveraging modern cloud-native technologies, and ensuring high availability and fault tolerance in our data infrastructure.

Primary Responsibilities:

Design, develop, and maintain real-time and batch processing pipelines using Apache Spark, Kafka, and Kubernetes.
Architect high-throughput distributed systems that handle large-scale data ingestion and processing.
Work extensively with AWS services, including Kinesis, DynamoDB, ECS, S3, and Lambda.
Manage and optimize containerized workloads using Kubernetes (EKS) and ECS.
Implement Kafka-based event-driven architectures to support scalable, low-latency applications.
Ensure high availability, fault tolerance, and resilience of data pipelines.
Work with MySQL, Elasticsearch, Aerospike, Redis, and DynamoDB to store and retrieve massive datasets efficiently.
Automate infrastructure provisioning and deployment using Terraform, Helm, or CloudFormation.
Optimize system performance, monitor production issues, and ensure efficient resource utilization.
Collaborate with data scientists, backend engineers, and DevOps teams to support advanced analytics and machine learning initiatives.
Continuously improve and modernize the data architecture to support growing business needs.

Required Skills:

7-10+ years of experience in big data engineering or distributed systems development.
Expert-level proficiency in Scala, Java, or Python.
Deep understanding of Kafka, Spark, and Kubernetes in large-scale environments.
Strong hands-on experience with AWS (Kinesis, DynamoDB, ECS, S3, etc.).
Proven experience working with highly loaded, low-latency distributed systems.
Experience with Kafka, Kinesis, Flink, or other streaming technologies for event-driven architectures.
Expertise in SQL and database optimizations for MySQL, Elasticsearch, and NoSQL stores.
Strong experience in automating infrastructure using Terraform, Helm, or CloudFormation.
Experience managing production-grade Kubernetes clusters (EKS).
Deep knowledge of performance tuning, caching strategies, and data consistency models.
Experience working in a startup environment, adapting to rapid changes and building scalable solutions from scratch.

Nice to Have

Experience with machine learning pipelines and AI-driven analytics.
Knowledge of workflow orchestration tools such as Apache Airflow.

Job Classification

Industry: Software Product
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Software Development - Other
Employement Type: Full time

Contact Details:

Company: Affle
Location(s): Noida, Gurugram

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

500 characters remaining

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: kubernetes python aws iam performance tuning scala data engineering kinesis redis helm sql nosql database optimization elastic search java system ecs spark automating kafka caching techniques mysql terraform aws big data

Fraud Alert to job seekers!

₹ Not Disclosed

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Similar positions

Looking For Java Fullstack Developer_loc -yelahanka-hybrid_3 Days Wfo

Intel

6 - 8 years

Bengaluru

13 hours ago

₹ Not Disclosed

GN- T&O-Senior Manager - Instructional Design

Accenture

13 - 18 years

Mumbai

13 hours ago

₹ Not Disclosed

Network Developer 3

Oracle

6 - 9 years

Kolkata

1 day ago

₹ Not Disclosed

Java Developer With Cloud ! 6+yrs ! Hyd/bang

Tech Mahindra

6 - 11 years

Hyderabad

1 day ago

₹ 17-27.5 Lacs P.A.

Affle

Raffles University, Neemrana established by an Act 2011 of Rajasthan State Legislative, is recognised as per Section 2(f) of the UGC Act [1] is a multidisciplinary University. Raffles University is situated in NCR region, at Neemrana.

Senior Big Data Developer - Youappi @ Affle

Home > Software Development