Gcp Data Engineer - Lead
- Estuate Software
- 8 - 13 years
- Hyderabad
- 2 months ago
- Email to a friend
- Report this job
Job Description
Design, build,
Job Title: Data Engineer / Integration Engineer
Job Summary:
We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines and workflows.
- Develop and optimize ETL/ELT processes using Python and workflow automation tools.
- Implement and manage data integration between various systems, including APIs and Oracle EBS.
- Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.
- Utilize Apache Spark or similar big data frameworks for efficient data processing.
- Develop robust API integrations for seamless data exchange between applications.
- Ensure data accuracy, consistency, and security across all systems.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
- Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.
- Document data workflows, processes, and best practices for future reference.
Required Skills & Qualifications:
- Strong proficiency in Python for data engineering and workflow automation.
- Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar).
- Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).
- Expertise in big data processing frameworks, such as Apache Spark.
- Experience with API integrations (REST, SOAP, GraphQL) and handling structured/unstructured data.
- Strong problem-solving skills and ability to optimize data pipelines for performance.
- Experience working in an agile environment with CI/CD processes.
- Strong communication and collaboration skills.
Preferred Skills & Nice-to-Have:
- Experience with Ascend.io platform for data pipeline automation.
- Knowledge of SQL and NoSQL databases.
- Familiarity with Docker and Kubernetes for containerized workloads.
- Exposure to machine learning workflows is a plus.
Why Join Us?
- Opportunity to work on cutting-edge data engineering projects.
- Collaborative and dynamic work environment.
- Competitive compensation and benefits.
- Professional growth opportunities with exposure to the latest technologies.
How to Apply:
Interested candidates can apply by sending their resume to 8892751*** / de************u@es****e.com or through Naukri
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: Estuate SoftwareLocation(s): Hyderabad
Similar positions
Estuate Software
Estuate is a global Information Technology Services company headquartered in Milpitas, California, and with offices in New Jersey, Canada, India, the UK , UAE and development centre in Bangalore. We were founded on the simple premise that clients value a partner that is adept at technology and busin...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in