Big Data Developer
- Forbes Global
- 3 - 8 years
- Mumbai
- 5 months ago
- Email to a friend
- Report this job
Job Description
Job Title: Big Data Developer
Work Type: Full-Time
Experience Required: 3+ Years
Position Overview:
We are seeking a talented Software Development Engineer- Big Data with strong expertise in big data technologies. The ideal candidate will have hands-on experience with Apache Spark, Hadoop, AWS (Amazon Web Services), Kafka, NoSQL databases (e.g., MongoDB, Cassandra), Hive, Docker, Kubernetes, and proficiency in SQL and one or more of the coding languages such as Java, Scala, Python. This role requires a deep understanding of software
development principles, distributed systems, and container orchestration.
Responsibilities:
- Design, develop, and optimize scalable and efficient big data applications and pipelines using Apache Spark, Hadoop, and related frameworks.
- Implement data processing workflows and streaming solutions utilizing Apache Kafka for real-time data ingestion and processing.
- Develop and maintain ETL (Extract, Transform, Load) processes to support data integration and transformation tasks.
- Utilize NoSQL databases for data storage and retrieval needs, ensuring data consistency and performance.
- Containerize and orchestrate big data applications using Docker and Kubernetes for scalability and reliability.
- Collaborate closely with data scientists, analysts, and product teams to understand requirements and deliver robust data solutions.
- Optimize performance and efficiency of data processing workflows and applications, focusing on scalability and cost-effectiveness.
- Mentor and guide junior team members, participate in code reviews, and contribute to improving team processes and practices.
Qualifications:
- Bachelors or Masters degree in Computer Science, Engineering, or related field.
- 2+ years of professional software development experience with a focus on big data technologies.
- Strong programming skills in Java/Scala/Python, and SQL for building scalable applications and data processing pipelines.
- Hands-on experience with Apache Spark, Hadoop, and related ecosystem tools is preferred.
- Solid understanding of NoSQL databases and distributed computing principles.
- Familiarity with real-time data streaming and messaging systems like Apache Kafka.
- Excellent problem-solving skills, analytical mindset, and attention to detail.
- Strong communication skills and ability to collaborate effectively in a team environment.
- Experience with Agile methodologies and DevOps practices is a plus.
- Hands-on experience in containerization and orchestration technologies such as Docker and Kubernetes is a plus.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: Forbes GlobalLocation(s): Mumbai
Keyskills: Java SCALA Hadoop Python SQL Pyspark NoSQL Big Data Spark
Similar positions
Forbes Global
Industry -Software Development Company size -10,001+ employees Headquarters - Setagaya-ku, Tokyo Founded 1997 Specialties - E-commerce , Card & Payments, Life & Leisure support services, Communications & Energy & Mobile, Investment, Sports, Digital Contents, Open EC, AD, Affilia...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in