Sr. Data Engineer
- Hitech Digital
- 4 - 6 years
- Ahmedabad
- 3 months ago
- Email to a friend
- Report this job
Job Description
Position Summary
We are seeking a Data Engineer / Lead Data Engineer with deep experience in data architecture, ETL pipelines, and advanced analytics support. This role is crucial for designing robust pipelines to process structured and unstructured data, integrate ML models, and ensure data reliability. The ideal candidate will be proficient in Python, R, SQL, and cloud-based tools, and possess hands-on experience in creating end-to-end data engineering solutions that support data science and analytics teams.
Key Responsibilities
- Design and optimize data pipelines to ingest, transform, and load data from diverse sources.
- Build programmatic ETL pipelines using SQL and related platforms.
- Understand complex data structures and perform data transformation effectively.
- Create and manage scalable, secure data warehouses and data lakes.
- Collaborate with data scientists to structure data for analysis and modeling.
- Define solution architecture for layered data stacks ensuring high data quality.
- Develop design artifacts including data flow diagrams, models, and functional documents.
- Work with technologies such as Python, R, SQL, MS Office, and SageMaker.
- Conduct data profiling, sampling, and testing to ensure reliability.
- Collaborate with business stakeholders to identify and address data use cases.
Qualifications & Experience
- 4 to 6 years of experience in data engineering, ETL development, or database administration.
- Bachelors degree in Mathematics, Computer Science, or Engineering (B.Tech/B.E.).
- Postgraduate qualification in Data Science or related discipline preferred.
- Strong proficiency in Python, SQL, Advanced MS Office tools, and R.
- Familiarity with ML concepts and integrating models into pipelines.
- Experience with NoSQL systems like MongoDB, Cassandra, or HBase.
- Knowledge of Snowflake, Databricks, and other cloud-based data tools.
- ETL tool experience and understanding of data integration best practices.
- Data modeling skills for relational and NoSQL databases.
- Knowledge of Hadoop, Spark, and scalable data processing frameworks.
- Experience with SciKit, TensorFlow, Pytorch, GPT, PySpark, etc.
- Ability to build web scrapers and collect data from APIs.
- Experience with Airflow or similar tools for pipeline automation.
- Strong SQL performance tuning skills in large-scale environments.
What We Offer
- Competitive compensation package based on skills and experience.
- Opportunity to work with international clients and contribute to high-impact data projects.
- Continuous learning and professional growth within a tech-forward organization.
- Collaborative and inclusive work environment.
If you're passionate about building data-driven infrastructure to fuel analytics and AI applications, we look forward to connecting with you.
Job Classification
Industry: BPM / BPOFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Hitech DigitalLocation(s): Ahmedabad
Keyskills: Data Engineering PySpark Cassandra Hadoop GPT data architecture SQL HBase Pytorch R Snowflake MongoDB Databricks Spark ETL Python TensorFlow
Similar positions
Hitech Digital
Hi-Tech Digital Solutions LLP is a leading ISO certified and award-winning company offering one-stop solutions across various service lines and functions including BIM Solutions, Engineering Solutions, Business Process Management, and Aero navigation engineering. The newly formed Process ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in