Big Data Developer
- Lion And Elephants
- 1 Positions
- Bengaluru
- 5 months ago
- Email to a friend
- Report this job
Job Description
- Design, develop, and maintain large-scale distributed data pipelines using Apache Spark and Scala.
- Write clean, efficient, and maintainable Scala code adhering to industry best practices.
- Implement Spark Core, Spark SQL, and Spark Streaming modules for real-time and batch data processing.
- Collaborate with cross-functional teams to gather and understand data processing requirements.
- Optimize performance of complex queries and processing logic in Hadoop ecosystems.
- Develop and manage workflows using UNIX shell scripting, Hive, Sqoop, and Impala.
- Participate actively in Agile/Scrum ceremoniesdaily stand-ups, sprint planning, retrospectives, etc.
- Provide production support and maintenance for existing applications, ensuring high availability and performance.
- Conduct root cause analysis and resolve data pipeline issues in collaboration with upstream/downstream teams.
- Stay updated with the latest Big Data technologies and contribute to continuous improvement initiatives.
- Strong proficiency in Scala with at least 8+ years of hands-on experience.
- Solid experience with Apache Spark for building distributed data processing applications.
- In-depth understanding of data structures, algorithms, and design patterns.
- Strong command over SQL and working knowledge of NoSQL databases.
- Spark Streaming
- Hadoop and HDFS
- Hive, Sqoop, Impala
- UNIX shell scripting
- Familiarity with ETL concepts, Data Warehousing
Key Responsibilities
Mandatory Skills
Desired Skills
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: General / Other SoftwareFunctional Area: Not SpecifiedRole/Responsibilies: Big Data DeveloperContact Details:
Company: Lion And ElephantsLocation(s): Bengaluru+ View Contact
Fraud Alert to job seekers!
₹ to 10 Yr
Similar positions
Lion And Elephants
At Humango, we are a dynamic and rapidly growing startup at the intersection of artificial intelligence and sports coaching. With a distributed development team spanning the USA, Europe, and India, we leverage cutting-edge technology to revolutionize coaching methodologies. Our work not only dr...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in