AWS Engineer (Databricks mandatory)
- Coforge
- 5 - 8 years
- Hyderabad
- 2 months ago
- Email to a friend
- Report this job
Job Description
We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.
Key Responsibilities:
- Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
- Design and develop solution in combination of Cloudera, Palantir and Databricks.
- Develop Python-based automation scripts to optimize workflows and processes.
- Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
- Define architecture for data-driven solutions.
- Ensure scalability, security, and performance of deployed solutions.
- Collaborate with business teams, data engineers, and developers to align solutions with business goals.
Mandatory Skills:
- Databricks:
- Expertise in design jobs and workloads.
- Proficiency in pyspark / scala for data manipulation, transformation and analysis
- Optimization of Databricks clusters and notebooks.
- Python: Hands-on experience in automation and scripting.
- Cloudera: Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management.
- Palantir: Hands on experience with analytics, data fusion and developing analytical workflows
- DevOps Basics: Familiarity with Jenkins CI/CD pipelines.
- Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
- Communication: Excellent verbal and written communication skills.
- Fast Learner: Ability to quickly grasp new technologies and adapt to changing requirements.
Share your resume at Aa***********a@co****e.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: ConsultingRole Category: IT ConsultingRole: IT Consulting - OtherEmployement Type: Full timeContact Details:
Company: CoforgeLocation(s): Hyderabad
Keyskills: Ci/Cd AWS Data Bricks Cloudera
Similar positions
Coforge
Coforge is a leading global IT solutions organization, enabling its clients to transform at the intersect of unparalleled domain expertise and emerging technologies to achieve real-world business impact. A focus on very select industries, a detailed understanding of the underlying processes of those...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in