Designing, developing, and maintaining scalable and high-performance data pipelines using cloud-based technologies such as Azure Data Factory or Databricks.
Implementing data ingestion, transformation, and storage processes to support batch and real-time data processing requirements.
Collaborating with data scientists and analysts to integrate machine learning models and analytical tools into data pipelines for predictive analytics and insights generation.
Optimizing data workflows and ETL processes to improve performance, reliability, and cost-effectiveness.
Ensuring data security and privacy by implementing access controls, encryption, and compliance measures across data platforms.
Providing technical leadership and mentorship to junior data engineers, fostering a culture of innovation, collaboration, and continuous learning.
Preferred candidate profile
Any Graduate
3 to 6 years of experience in data engineering roles, with a proven track record of designing and implementing complex data solutions.
Strong skills in Azure Data Factory or Databricks, including an understanding of control flow and data flow tasks, with package auditing of data.
Good understanding of SQL/PySpark programming.
Ability to program custom scripting tasks for complex assignments (preferably in Python).
Knowledge of all SQL Server database (T-SQL) tasks, including jobs, data backups and redundancy, and database maintenance (indexing and statistics), or a good understanding of Databricks or Spark.
Familiarity with DevOps practices, version control systems (e.g., Azure DevOps), and CI/CD
Regards,
Neelam BIjlani
ne***********i@te****************s.com
Job Classification
Industry: BPO / Call Centre Functional Area: BPO / Call Centre Role Category: Data Science & Machine Learning Role: Data Engineer Employement Type: Full time