Pyspark Developer (4yrs)
- Tech Mahindra
- 4 - 6 years
- Pune
- 4 months ago
- Email to a friend
- Report this job
Job Description
Pyspark Developer
Requirements:
Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data Bricks
- Good Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.
- Must have excellent knowledge in Apache Spark and Python programming experience
- Hands-on experience in Azure data bricks & Pyspark to develop ETL pipelines
- Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, performing data enrichment and loading into target data destinations.
- Should have experience in integrating PySpark with downstream and upstream applications through a batch/real-time interface
- Data modeling experience using advanced statistical analysis, unstructured data processing
- Participate in the agile development process, and document and communicate issues and bugs relative to data standards in scrum meetings
- Work collaboratively with onsite and offshore team.
- Develop & review technical documentation for artifacts delivered.
- Ability to solve complex data-driven scenarios and triage towards defects and production issues
- Drive discussions with partner teams to identify resolutions to production issues.
- Clearly document and draft clear, concise, communication on production incidents to share with stakeholders.
- Identify platform vulnerabilities and opportunities for improvement.
- Maintain metrics to help drive improvement in all areas of Production Services.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Software Development - OtherEmployement Type: Full timeContact Details:
Company: Tech MahindraLocation(s): Pune+ View Contact
Keyskills: Pyspark Cloud Data Warehousing SQL ETL
Fraud Alert to job seekers!
₹ 10-16 Lacs P.A
Similar positions
Tech Mahindra
Tech Mahindra Limited is an Indian multinational provider of information technology (IT), networking technology solutions and Business Process Outsourcing (BPO) to the telecommunications industry. Tech Mahindra is a US$4.2 billion company with over 117,000 employees across 90 countries. It provide...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in