AWS + Pyspark
- Cognizant
- 4 - 6 years
- Chennai
- 2 months ago
- Email to a friend
- Report this job
Job Description
Skills- AWS +Pyspark
Experience: 4 to 9 years
Location: AIA-Pune
As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and decision-making.
Key Responsibilities :
- Data Pipeline Development: Design, implement, and maintain scalable data pipelines using AWS services such as S3, Glue, Lambda, EMR, and Kinesis.
- Data Processing and Transformation: Utilize PySpark, Spark, and SQL to perform complex data transformations and aggregations on large datasets within the AWS ecosystem.
- Data Storage and Management: Design and implement data storage solutions using Amazon S3, RDS, DynamoDB, and Redshift, ensuring data quality, integrity, and accessibility.
- Data Modeling and Warehousing: Develop and maintain data models to support analytics and reporting, leveraging Redshift as the data warehousing solution.
- Infrastructure and Cloud Technologies: Provision and manage scalable data infrastructure using EC2, VPC, IAM, CloudFormation, and other relevant AWS services.
- Performance Optimization and Monitoring: Continuously monitor and optimize data pipelines and systems using CloudWatch, identifying and resolving performance bottlenecks.
- Collaboration and Knowledge Sharing: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical guidance.
Qualifications :
- Proficiency in Python, SQL, PySpark, and Spark.
- Strong expertise in AWS data services (S3, Glue, Lambda, EMR, Redshift, DynamoDB, RDS).
- Experience with data warehousing, ETL processes, and data modeling.
- Excellent problem-solving, analytical, and communication skills.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CognizantLocation(s): Chennai
Keyskills: analytical glue amazon redshift pyspark data warehousing emr data pipeline kinesis sql cloud data modeling spark aws cloud etl communication skills amazon cloudwatch python data services dynamo db vpc amazon rds aws cloudformation pipeline amazon ec2 s lambda expressions aws
Similar positions
Cognizant
Morningstar, Inc. is a leading provider of independent investment insights in North America, Europe, Australia, and Asia. The Company offers an extensive line of products and solutions that serve a wide range of market participants, including individual and institutional investors in public and priv...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in