Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Data Engineer - GCP @ Smartavya Analytica

Home > Software Development

 Senior Data Engineer - GCP

Job Description

Job Summary

We are seeking an energetic Senior Data Engineer with hands-on expertise in Google Cloud Platform to build, maintain, and migrate data pipelines that power analytics and AI workloads. You will leverage GCP servicesBigQuery, Dataflow, Cloud Composer, Pub/Sub, and Cloud Storagewhile collaborating with data modelers, analysts, and product teams to deliver highly reliable, well-governed datasets. Familiarity with Microsoft Azure data services (Data Factory, Databricks, Synapse, Fabric) is valuable, as many existing workloads will transition from Azure to GCP.

Key Responsibilities

  • Design, develop, and optimize batch and streaming pipelines on GCP using Dataflow / Apache Beam, BigQuery, Cloud Composer (Airflow), and Pub/Sub.
  • Maintain and enhance existing data workflowsmonitoring performance, refactoring code, and automating tests to ensure data quality and reliability.
  • Migrate data assets and ETL / ELT workloads from Azure (Data Factory, Databricks, Synapse, Fabric) to corresponding GCP services, ensuring functional parity and cost efficiency.
  • Partner with data modelers to implement partitioning, clustering, and materialized-view strategies in BigQuery to meet SLAs for analytics and reporting.
  • Conduct root-cause analysis for pipeline failures, implement guardrails for data quality, and document lineage.

Must-Have Skills

  • 4-6 years of data-engineering experience, including 2+ years building pipelines on GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer).
  • Proficiency in SQL and one programming language (Python, Java, or Scala).
  • Solid understanding of ETL / ELT patterns, data-warehouse modeling (star, snowflake, data vault), and performance-tuning techniques.
  • Experience implementing data-quality checks, observability, and cost-optimization practices in cloud environments.

Nice-to-Have Skills

  • Practical exposure to Azure data servicesData Factory, Databricks, Synapse Analytics, or Microsoft Fabric.

Preferred Certifications

  • Google Professional Data Engineer or Associate Cloud Engineer
  • Microsoft Certified: Azure Data Engineer Associate (nice to have)

Education

  • Bachelors or Masters degree in Computer Science, Information Systems, Engineering, or a related technical field. Equivalent professional experience will be considered.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Smartavya Analytica
Location(s): Pune

+ View Contactajax loader


Keyskills:   Data Engineering Java Data Factory GCP Scala Databricks ETL ELT root-cause analysis SQL Python

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Full-Stack AI Engineer

  • Intellect Design Arena
  • 2 - 6 years
  • Pune
  • 2 days ago
₹ Not Disclosed

Manager, Site Reliability Engineering

  • Cvent
  • 8 - 14 years
  • Noida, Gurugram
  • 2 days ago
₹ Not Disclosed

Senior Software Developer ADF

  • CAI
  • 5 - 10 years
  • Noida, Gurugram
  • 2 days ago
₹ 15-25 Lacs P.A.

Software Engineer Practitioner

  • TekWissen
  • 6 - 8 years
  • Chennai
  • 2 days ago
₹ Not Disclosed

Smartavya Analytica

Company DetailsSmartavya Analytica