Job Description We are seeking a Data Engineer with expertise in OpenShift, Python, Scala, PySpark, and REST APIs to develop and optimize data pipelines, integrate with Collibra, and deploy solutions using GitHub Actions. The ideal candidate will have hands-on experience in Oracle database management, API development, and cloud-based deployments. Key Responsibilities Analyze and modify Scala code for data retrieval and transformation. Design and develop data architecture for efficient data flow. Write and optimize Python scripts to ingest data into Oracle. Develop Scala-based solutions to fetch data from Oracle. Deploy applications using OpenShift and automate CI/CD with GitHub Actions. Develop and expose REST APIs, ensuring seamless integration with Swagger UI. Work closely with Collibra for data governance and integration. Optimize PySpark workflows for large-scale data processing. Required Skills Strong experience with Python, Scala, and PySpark Hands-on experience with Oracle database (data ingestion and retrieval) Proficiency in REST API development and Swagger UI Experience with OpenShift for cloud-based deployment Knowledge of GitHub Actions for CI/CD automation Familiarity with Collibra for data governance Strong problem-solving and debugging skills (ref:hirist.tech),
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Data Engineer - Python Job in Relite 360
Contact Details:
Company: Relite 360 ConsultancyLocation(s): All India