Gcp Data Engineer
- Onix
- 4 - 7 years
- Pune
- 5 months ago
- Email to a friend
- Report this job
Job Description
Job Title: GCP Data Engineer
Location: Pune, India
Experience: 4 to 7 Years
Job Type: Full-Time
Job Summary:
We are looking for a highly skilled GCP Data Engineer with 4 to 7 years of experience to join our data engineering team in Pune. The ideal candidate should have strong experience working with Google Cloud Platform (GCP), including Dataproc, Cloud Composer (Apache Airflow), and must be proficient in Python, SQL, and Apache Spark. The role involves designing, building, and optimizing data pipelines and workflows to support enterprise-grade analytics and data science initiatives.
Key Responsibilities:
- Design and implement scalable and efficient data pipelines on GCP, leveraging Dataproc, BigQuery, Cloud Storage, and Pub/Sub.
- Develop and manage ETL/ELT workflows using Apache Spark, SQL, and Python.
- Orchestrate and automate data workflows using Cloud Composer (Apache Airflow).
- Build batch and streaming data processing jobs that integrate data from various structured and unstructured sources.
- Optimize pipeline performance and ensure cost-effective data processing.
- Collaborate with data analysts, scientists, and business teams to understand data requirements and deliver high-quality solutions.
- Implement and monitor data quality checks, validation, and transformation logic.
Required Skills:
- Strong hands-on experience with Google Cloud Platform (GCP)
- Proficiency with Dataproc for big data processing and Apache Spark
- Expertise in Python and SQL for data manipulation and scripting
- Experience with Cloud Composer / Apache Airflow for workflow orchestration
- Knowledge of data modeling, warehousing, and pipeline best practices
- Solid understanding of ETL/ELT architecture and implementation
- Strong troubleshooting and problem-solving skills
Preferred Qualifications:
- GCP Data Engineer or Cloud Architect Certification.
- Familiarity with BigQuery, Dataflow, and Pub/Sub.
Interested candidates can send your your resume on pr*********a@on****t.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: OnixLocation(s): Pune
Keyskills: SQL GCP Data Pipeline Spark Google Cloud Platforms Airflow Pyspark Bigquery Dataproc Data Flow Data Warehousing Data Modeling ETL Python
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in