Job Description
Job Responsibilities.
Collaborate with data scientists, software engineers, and business stakeholders to understand data requirements and design efficient data models..
Develop, implement, and maintain robust and scalable data pipelines, ETL processes, and data integration solutions..
Extract, transform, and load data from various sources, ensuring data quality, integrity, and consistency..
Optimize data processing and storage systems to handle large volumes of structured and unstructured data efficiently..
Perform data cleaning, normalization, and enrichment tasks to prepare datasets for analysis and modelling..
Monitor data flows and processes, identify and resolve data-related issues and bottlenecks..
Contribute to the continuous improvement of data engineering practices and standards within the organization..
Stay up-to-date with industry trends and emerging technologies in data engineering, artificial intelligence, and dynamic pricing.
Candidate Profile.
Strong passion for data engineering, artificial intelligence, and problem-solving..
Solid understanding of data engineering concepts, data modeling, and data integration techniques..
Proficiency in programming languages such as Python, SQL and Web Scrapping..
Understanding of databases like No Sql , relational database, In Memory database and technologies like MongoDB, Redis, Apache Spark would be add on...
Knowledge of distributed computing frameworks and big data technologies (e.g., Hadoop, Spark) is a plus..
Excellent analytical and problem-solving skills, with a keen eye for detail..
Strong communication and collaboration skills, with the ability to work effectively in a teamoriented environment..
Self-motivated, quick learner, and adaptable to changing priorities and technologies..
(ref:hirist.tech).
Job Classification
Industry: Software Product
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: Sciative Solutions
Location(s): Mumbai
Keyskills:
web scraping
data engineering
artificial intelligence
data modeling
data integration
python
big data technologies
dbms
relational databases
redis
distributed computing
sql
nosql
data quality
apache
spark
hadoop
etl
mongodb
data flow