GCP Data Engineer @ Jade Business Service

Home > Data Science & Machine Learning

GCP Data Engineer

Jade Business Service
7 - 12 years
Bengaluru
3 months ago
Email to a friend
Report this job

Job Description

Role & responsibilities

Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud).

Build large and complex datasets based on business requirements.
Construct big data pipeline architecture.
Identify opportunities for data acquisition via working with stakeholders and business clients.
Translate business needs to technical requirements.
Leverage a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines.
Use logs & alerts to effectively monitor pipelines.
Develop JSON messaging structure for integrating with various applications.
Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.
Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data.
Use roles to secure access to datasets, authorized views to share data between projects.
Design and build an ingestion pipeline using Rest API.
Recommends ways to improve data quality, reliability, and efficiency.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Jade Business Service
Location(s): Bengaluru

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: GCP Cloud Storage Cloud Sql Airflow Pubsub Cloud Orchestration Bigquery Data Flow Dataproc Python

Fraud Alert to job seekers!

₹ Not Disclosed

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Similar positions

Generative AI Engineer

Einfochips

3 - 8 years

Indore

8 days ago

₹ Not Disclosed

Walk In - Aiml / Genai / Mlops/data Science - Hyderabad Gar

Capgemini

4 - 9 years

Hyderabad

9 days ago

₹ Not Disclosed

AI Engineer L1

Wipro

1 - 5 years

Hyderabad

9 days ago

₹ Not Disclosed

Data Science Lead

Hexaware Technologies

6 - 9 years

Hyderabad

10 days ago

₹ Not Disclosed

Jade Business Service

Jade Business Services (JBS) is a US-based company specializing in Data and Analytics solutions for industries such as Energy, Oil & Gas, Healthcare, and Finance. We help our customers become data-driven organizations by providing comprehensive data solutions, including Data Strategy, Data Gov...

GCP Data Engineer @ Jade Business Service

Home > Data Science & Machine Learning