Gcp Data Engineer (Snowflake)
- ION
- 5 - 10 years
- Noida, Gurugram
- 3 months ago
- Email to a friend
- Report this job
Job Description
Mandatory skill- Advance Python & SQL GCP Services- BigQuery, Dataflow, Dataproc and Pub/Sub.
Key Responsibilities
- Design, develop and optimize scalable data pipelines and ETL workflows using Google Cloud Platform (GCP), particularly leveraging BigQuery, Dataflow, Dataproc and Pub/Sub.
- Design and manage secure, efficient data integrations involving Snowflake and BigQuery.
- Write, test and maintain high-quality Python code for data extraction, transformation and loading (ETL), analytics and automation tasks.
- Use Git for collaborative version control, code reviews and managing data engineering projects.
- Implement infrastructure-as-code practices using Pulumi for cloud resources management and automation within GCP environments.
- Apply clean room techniques to design and maintain secure data sharing environments in alignment with privacy standards and client requirements.
- Collaborate with cross-functional teams (data scientists, business analysts, product teams) to deliver data solutions, troubleshoot issues and assure data integrity throughout the lifecycle.
- Optimize performance of batch and streaming data pipelines, ensuring reliability and scalability.
- Maintain documentation on processes, data flows and configurations for operational transparency.
________________________________________
Required Skills
- Strong hands-on experience of 5+ years with GCP core data services: BigQuery, Dataflow, Dataproc and Pub/Sub.
- Proficiency in data engineering development using Python.
- Deep familiarity with Snowflakedata modeling, secure data sharing and advanced query optimization.
- Proven experience with Git for source code management and collaborative development.
- Demonstrated ability using Pulumi (or similar IaC tools) for deployment and support of cloud infrastructure.
- Practical understanding of cleanroom concepts in cloud data warehousing, including privacy/compliance considerations.
- Solid skills in debugging complex issues within data pipelines and cloud environments.
- Effective communication and documentation skills.
________________________________________
Great to Have
- GCP certification (e.g., Professional Data Engineer).
- Experience working in regulated environments (telecom/financial/healthcare) with data privacy and compliance focus.
- Exposure to additional GCP services such as Cloud Storage, Cloud Functions or Kubernetes.
- Demonstrated success collaborating in agile, distributed teams.
- Experience with data visualization tools (e.g., Tableau, Looker) is nice to have.
- EST Shift
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: TELUS InternationalLocation(s): Noida, Gurugram
Keyskills: Pubsub SQL Snowflake Gcp Services Python Modelling Techniques Bigquery Google Cloud Services Dataproc Cloud Storage Cloud Sql Cloud Orchestration Cloud Pubsub Data Flow
Similar positions
ION
About Accenture\\\\r\\\\n\\\\r\\\\n \\\\r\\\\n\\\\r\\\\nAccenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Interactive, T...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in