Big Data Developer
- SP Software
- 6 - 9 years
- Bengaluru
- 4 months ago
- Email to a friend
- Report this job
Job Description
- Preferred candidate profile - Currently serving Notice Period who can join with in 15--20 days only !
- 5+ Years of Experience is Mandate in AWS and Bigdata
Role & responsibilities
- Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)
Write SQL queries to validate the dashboard output
Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.
Performing code reviews and pair programming
Supporting and enhancing current applications
Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications. - Profound understanding of Big Data core concepts and technologies Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.
Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).
Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
Programming experience with Python/Scala, Shell scripting.
Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.
Good understanding of business and operational processes.
Capable of Problem / issue resolution, capable of thinking out of the box.
Preferred candidate profile
AWS, Big Data Engineer, Data Engineer (Bigdata, Redshift, spark, Scala and AWS)
5+ Years of Experience is Mandate in AWS and Bigdata
6+ years experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.
6+ years experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch
6+ years experience with Spark programming paradigms (batch and stream-processing)
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: SP SoftwareLocation(s): Bengaluru
Keyskills: Big Data SQL SCALA Spark AWS RDS AWS Lambda Postgresql Hadoop Kafka AWS Glue Redshift Apache Spark Hive NoSQL MySQL Spark streaming
Similar positions
SP Software
SP Software (P) Limited, a flagship of SP Group, is a leading enterprise business software and information technology (IT) Services company, providing IT Consulting, technology and outsourcing services. Founded in 1995, SPSoft is one of the fastest growing IT companies in India having strong strateg...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in