Your browser does not support javascript! Please enable it, otherwise web will not work for you.

GCP Data Enginner @ Artech Infosystems

Home > Application Programming / Maintenance

 GCP Data Enginner

Job Description

    Key Responsibilities:

    • Develop scalable ETL/ELT pipelines using PySpark on distributed data processing systems.

    • Integrate and manage data flows between Apache Kafka, MongoDB, and cloud data warehouses such as Google BigQuery.

    • Design and implement robust data ingestion frameworks, ensuring performance, reliability, and scalability.

    • Work closely with data scientists, analysts, and platform engineers to deliver real-time and batch data solutions.

    • Build and consume RESTful APIs for data integration.

    • Write and maintain Unix shell scripts for automation and data processing workflows.

    • Collaborate in an Agile environment using modern CI/CD practices and tools (e.g., Jenkins, GitLab CI, or similar).

    • Ensure adherence to data quality, governance, and security standards.


    Required Skills and Experience:

    • 5+ years of experience in data engineering or software development.

    • Strong hands-on experience with Apache Spark and PySpark.

    • Proficiency with Google Cloud Platform (GCP), particularly BigQuery, Dataflow, and Cloud Storage.

    • Working knowledge of MongoDB and experience integrating NoSQL databases into data pipelines.

    • Experience working with Kafka for real-time data streaming and processing.

    • Strong understanding of API design/integration, including RESTful services.

    • Proficiency in Unix/Linux shell scripting.

    • Experience with CI/CD pipelines for data workflows.

    • Solid understanding of data modeling, data warehousing, and SQL.

     

    Interested Candidate Please share your Resume (+91 hidden_mobile)

Employement Category:

Employement Type: Full time
Industry: Retail
Role Category: Application Programming / Maintenance
Functional Area: Not Specified
Role/Responsibilies: GCP Data Enginner

Contact Details:

Company: Artech Infosystems
Location(s): Bengaluru

+ View Contactajax loader


Keyskills:   apache python gcp

 Fraud Alert to job seekers!

₹ 5 to 10 Yr

Similar positions

NTT Data- Opening for Talend with AWS

  • ION
  • 1 Positions
  • Bengaluru
  • 5 days ago
₹ 5 to 10 Yr

Solution Architect with GCP

  • Infor
  • 1 Positions
  • Bengaluru
  • 12 days ago
₹ 5 to 8 Yr

Senior Data Engineer( Java/Scala+ Hadoop)

  • Mastercard
  • 5 to 9 Yrs
  • 19 days ago
₹ Not Disclosed

Data Engineer

  • Artech Infosystems
  • 25 Positions
  • Bengaluru
  • 19 days ago
₹ 5 to 10 Yr

Artech Infosystems

Artech Infosystems Pvt. Ltd. Artech is a Global Provider of Workforce Solutions & IT Consulting Services. Having our Head Office at New Jersey and other locations are Noida, Bangalore, Pune, Hyderabad, & Chennai. Having global employee strength of 7000+.