We are looking for a Mid-Senior Data Engineer to join our growing data team and help build scalable, reliable, and efficient data pipelines and platforms. The ideal candidate has hands-on experience in managing large-scale data systems, cloud platforms, and workflow orchestration tools. You will play a critical role in enabling analytics, machine learning, and real-time decision-making across the organization.
Key Responsibilities:
Design, build, and optimize robust ETL/ELT pipelines using Python and SQL.
Develop and manage big data processing jobs using Apache Spark (PySpark) on platforms like Databricks .
Build and maintain orchestrated workflows using Apache Airflow , Dagster , or Prefect .
Develop and scale cloud-based data platforms using:
AWS (Redshift, Glue, S3, Lambda)
Azure (Data Factory, Synapse, Blob Storage)
GCP (BigQuery, Dataflow, Composer)
Leverage Databricks for scalable data processing, Delta Lake integration, and collaborative analytics.
Work closely with data analysts, scientists, and product teams to understand data needs and translate them into scalable solutions.
Ensure data quality, integrity, and security across all data systems.
Contribute to CI/CD practices for data pipeline deployment and version control.
Required Skills Experience:
4-6 years of professional experience in data engineering or a related field.
Proficient in Python , with hands-on experience using Pandas , PySpark , and SQLAlchemy .
Solid understanding of Apache Spark architecture and performance tuning.
Experience working on Databricks and using Delta Lake for high-performance data storage and retrieval.
Hands-on experience with at least one cloud platform (AWS, Azure, or GCP).
Experience in data modeling , warehouse architecture , and dimensional modeling .
Comfortable with Git and DevOps practices for data projects.
Soft Skills:
Excellent problem-solving and debugging skills.
Strong written and verbal communication.
Ability to thrive in a cross-functional and agile environment.
Job Classification
Industry: IT Services & Consulting Functional Area / Department: Data Science & Analytics Role Category: Data Science & Machine Learning Role: Data Engineer Employement Type: Full time