Senior data engineer - Python, Pyspark, AWS - 5+ years Gurgaon
- Global software
- 5 - 10 years
- Noida, Gurugram
- 7 months ago
- Email to a friend
- Report this job
Job Description
Senior data engineer - Python, Pyspark, AWS - 5+ years Gurgaon
Summary: An excellent opportunity for someone having a minimum of five years of experience with expertise in building data pipelines. A person must have experience in Python, Pyspark and AWS.
Location- Gurgaon (Hybrid)
Your Future Employer- One of the largest insurance providers.
Responsibilities-
- To design, develop, and maintain large-scale data pipelines that can handle large datasets from multiple sources.
- Real-time data replication and batch processing of data using distributed computing platforms like Spark, Kafka, etc.
- To optimize the performance of data processing jobs and ensure system scalability and reliability.
- To collaborate with DevOps teams to manage infrastructure, including cloud environments like AWS.
- To collaborate with data scientists, analysts, and business stakeholders to develop tools and platforms that enable advanced analytics and reporting.
Requirements-
- Hands-on experience with AWS services such as S3, DMS, Lambda, EMR, Glue, Redshift, RDS (Postgres) Athena, Kinesics, etc.
- Expertise in data modeling and knowledge of modern file and table formats.
- Proficiency in programming languages such as Python, PySpark, and SQL/PLSQL for implementing data pipelines and ETL processes.
- Experience data architecting or deploying Cloud/Virtualization solutions (Like Data Lake, EDW, Mart ) in the enterprise.
- Cloud/hybrid cloud (preferably AWS) solution for data strategy for Data lake, BI and Analytics.
What is in for you-
- A stimulating working environment with equal employment opportunities.
- Growing of skills while working with industry leaders and top brands.
- A meritocratic culture with great career progression.
Reach us- If you feel that you are the right fit for the role please share your updated CV at ra*************n@cr***********p.in
Disclaimer- Crescendo Global specializes in Senior to C-level niche recruitment. We are passionate about empowering job seekers and employers with an engaging memorable job search and leadership hiring experience. Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Job Classification
Industry: InsuranceFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: One largest insuranceLocation(s): Noida, Gurugram
Keyskills: Pyspark Data Pipeline AWS Data Ingestion Data Engineering Data Processing
Similar positions
Global software
Bosch Global Software Technologies Pvt Ltd.BGSW is a 100% owned subsidiary of Robert Bosch GmbH, one of the world€™s leading global supplier of technology and services, offering end to end engineering, IT and Business solutions.With over 25000 associates, BGSW is the largest ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in