AWS Data Engineer
- Cognizant
- 9 - 13 years
- Chennai
- 2 months ago
- Email to a friend
- Report this job
Job Description
Skills- AWS Data Engineer
Experience: 9 to 13 years
Location: AIA-Pune
We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS.
- Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data processing capabilities:
- AWS: Glue, Athena, Lambda, Redshift, Step Functions, DynamoDB, SNS.
- Optimize Spark job performance to ensure high efficiency and reliability. - Stay proactive in learning and implementing new technologies to improve data processing frameworks. - Collaborate with cross-functional teams to deliver robust data solutions. - Work on Spark Streaming for real-time data processing as necessary.
Qualifications:
- 5-8 years of experience in data engineering with a strong focus on cloud environments. - Proficiency in PySpark or Spark is mandatory. - Proven experience with data ingestion, transformation, and data warehousing. - In-depth knowledge and hands-on experience with cloud services(AWS): - Demonstrated ability in performance optimization of Spark jobs. - Strong problem-solving skills and the ability to work independently as well as in a team. - Cloud Certification (AWS) is a plus. - Familiarity with Spark Streaming is a bonus.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CognizantLocation(s): Chennai
Keyskills: cloud services dynamo db glue amazon redshift pyspark data warehousing cloud platforms data pipeline dynamo data engineering cloud data bricks spark streaming environment streaming framework lambda expressions spark data ingestion sns athena aws db
Similar positions
Cognizant
Morningstar, Inc. is a leading provider of independent investment insights in North America, Europe, Australia, and Asia. The Company offers an extensive line of products and solutions that serve a wide range of market participants, including individual and institutional investors in public and priv...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in