Data Engineer - Python
- Aceolution India
- 7 - 12 years
- any
- 1 month ago
- Email to a friend
- Report this job
Job Description
Role: Senior Data Engineer
Type: Freelance Contract (6 Months Full-time, 8 hours/day)
Role Summary
We are seeking a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior individual contributor (IC), you will be the teams expert in data ingestion, processing, and quality management for AI training.Your mission is to design and implement scalable, automated systems that transform massive, raw datasets into high-quality, model-ready formats. This role is ideal for a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning.Key Responsibilities
- Design and develop robust, scalable, and automated ETL/ELT pipelines in Python.
- Implement and enforce data quality standards.
- Structure and format large, diverse datasets (JSON, Parquet, etc.) for model training.
- Collaborate closely with AI researchers and ML engineers.
- Optimize data workflows for speed, cost, and reliability.
- Support model training runs by troubleshooting data-related issues.
Required Qualifications
- 8+ years of experience in data engineering, data processing, or backend software engineering.
- Expert-level proficiency in Python and its data ecosystem (Pandas, NumPy, Dask, Polars).
- Proven track record of building and maintaining large-scale data pipelines.
- Strong understanding of data structures, modeling, and software engineering best practices.
- Experience handling large-scale data formats (JSON, CSV, XML, Parquet).
Preferred Qualifications
- Experience with LLM data preprocessing (e.g., LLaMA, BERT, GPT-family).
- Familiarity with big data frameworks (Spark, Ray) and Hugging Face libraries.
- Exposure to ML frameworks (PyTorch, TensorFlow).
- Experience with cloud data platforms (AWS, GCP, Azure).
If you are interested, please share the below details:
Exp in Python
Exp in Data Engineering
Exp in Data Ingestion
Current ctc
Willing to work as a freelancer/ Part time
Share your cv to sh*****a@ac*******n.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Part timeContact Details:
Company: Aceolution IndiaLocation(s): any
Keyskills: Data Ingestion Python Data Extraction Data Processing
Similar positions
Aceolution India
Aceolution is a solutions-driven company that excels in delivering creative and flexible strategies for business challenges. With over 10 years of experience, Aceolution provides a diverse range of services, including IT, media, GIS, and digital marketing. Known for its adaptability and high-quality...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in