Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Data Engineer @ Uplers

Home > Software Development

 Data Engineer

Job Description

Expected Notice Period: 15 Days
Shift: (GMT+05:30) Asia/Kolkata (IST) What do you need for this opportunity? Must have skills required:
Apache Hudi, Flink, Iceberg, Apache Airflow, Spark, AWS, Azure, GCP, Kafka, SQL Nomupay is Looking for:
  • Design, build, and optimize scalable ETL pipelines using Apache Airflow or similar frameworks to process and transform large datasets efficiently.
  • Utilize Spark (PySpark), Kafka, Flink, or similar tools to enable distributed data processing and real-time streaming solutions.
  • Deploy, manage, and optimize data infrastructure on cloud platforms such as AWS, GCP, or Azure, ensuring security, scalability, and cost-effectiveness.
  • Design and implement robust data models, ensuring data consistency, integrity, and performance across warehouses and lakes.
  • Enhance query performance through indexing, partitioning, and tuning techniques for large-scale datasets.
  • Manage cloud-based storage solutions (Amazon S3, Google Cloud Storage, Azure Blob Storage) and ensure data governance, security, and compliance.
  • Work closely with data scientists, analysts, and software engineers to support data-driven decision-making, while maintaining thorough documentation of data processes.
  • Strong proficiency in Python and SQL, with additional experience in languages such as Java or Scala.
  • Hands-on experience with frameworks like Spark (PySpark), Kafka, Apache Hudi, Iceberg, Apache Flink, or similar tools for distributed data processing and real-time streaming.
  • Familiarity with cloud platforms like AWS, Google Cloud Platform (GCP), or Microsoft Azure for building and managing data infrastructure.
  • Strong understanding of data warehousing concepts and data modeling principles.
  • Experience with ETL tools such as Apache Airflow or comparable data transformation frameworks.
  • Proficiency in working with data lakes and cloud based storage solutions like Amazon S3, Google Cloud Storage, or Azure Blob Storage.
  • Expertise in Git for version control and collaborative coding.
  • Expertise in performance tuning for large-scale data processing, including partitioning, indexing, and query optimization.

Job Classification

Industry: Banking
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Uplers
Location(s): Mumbai

+ View Contactajax loader


Keyskills:   python airflow sql spark aws performance tuning scala version control microsoft azure pyspark data warehousing apache flink azure blob storage git apache java data modeling gcp kafka data warehousing concepts google analytics etl data lake

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

CTO - Quantum Engineering - Developer

  • Wipro
  • 2 - 7 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Data Engineer (Azure Purview)

  • Capgemini
  • 6 - 11 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

MLOps Engineer

  • Capgemini
  • 5 - 10 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Custom Software Engineer

  • Accenture
  • 2 - 5 years
  • Mumbai
  • 4 days ago
₹ Not Disclosed

Uplers

Mavlers is a full-service digital marketing agency that has propelled growth for over 7,000 brands and agencies worldwide. As Google, Mailchimp, WP VIP, Microsoft, Salesforce, and HubSpot partners, we possess the expertise to deliver high-impact projects and campaigns tailored to our clients uniqu...