Bigdata + Python Developer
- Grid Dynamics
- 9 - 14 years
- Bengaluru
- 5 months ago
- Email to a friend
- Report this job
Job Description
NOTE: We are only looking for candidates who can join Immediately to available to join in 15 days
Experience level- 6+ years
Location: Bangalore, Hyderabad, Chennai (Candidates who are currently in one of these 3 locations can apply)
Job Summary:
We are seeking a highly skilled and experienced Senior Big Data + Python Developer to join our team in Bangalore. The ideal candidate will have a strong background in distributed computing, data engineering, and systems design. You will work on building scalable data pipelines, integrating with modern data platforms, and contributing to architectural decisions. Prior experience with AIML platforms is a plus but not mandatory.
Key Responsibilities:
- Design, develop, and maintain large-scale data processing pipelines using Python, Spark, and Ray.
- Manage and optimize workflows with Airflow.
- Work with Apache Hive, Iceberg, and Druid for efficient data storage, querying, and real-time analytics.
- Deploy, monitor, and manage containerized applications using Kubernetes.
- Develop dashboards and visualizations using Apache Superset or similar tools.
- Collaborate with architects and data scientists to design high-performance systems.
- Ensure data quality, scalability, and performance in all solutions delivered.
- Participate in code reviews and provide technical mentorship to junior team members.
Required Skill Set:
- Strong programming experience with Python.
- Hands-on experience with Ray, Apache Spark, and Hive.
- Solid understanding of Apache Iceberg for data lake management.
- Experience working with Kubernetes for container orchestration.
- Workflow orchestration with Apache Airflow.
- Familiarity with Apache Druid for real-time analytics.
- Expertise in data visualization tools such as Superset.
- Strong knowledge of data architecture and design patterns.
- Proven track record of delivering scalable and production-grade systems.
Preferred Qualifications:
- Exposure to AI/ML workflows or platforms is a plus.
- Experience in system and data architecture design.
- Contributions to open-source or published technical blogs/articles.
- Excellent problem-solving and analytical skills.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: Grid DynamicsLocation(s): Bengaluru
Keyskills: Big Data Technologies Hive Spark Ray Python Kubernetes
Similar positions
Grid Dynamics
NextSphere is full-service custom application development firm that helps customers grow and keep up, in a constantly changing technology landscape. We at NextSphere develop and support business applications for customers in wide range of industries. We strive to work on projects where the NextSpher...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in