Data Engineer Databricks & ML Models Job
- Kpr sugar apperals
- 4 to 8 Yrs
- Noida, Gurugram
- 9 months ago
- Email to a friend
- Report this job
Job Description
- We are looking for an experienced and motivated Data Engineer with a strong background in Databricks and Machine Learning (ML) models. The ideal candidate will have a passion for transforming data into valuable insights and optimizing data pipelines for analytics and business intelligence. Key Responsibilities: Design, develop, and maintain scalable data pipelines on Databricks to process large datasets. Collaborate with data scientists and business stakeholders to implement ML models and deploy them into production environments. Implement best practices for data architecture, data modeling, and ETL processes in Databricks. Optimize data processing workflows for performance, reliability, and cost-effectiveness. Work with structured and unstructured data from multiple sources and integrate it for advanced analytics. Develop and maintain data lakehouse solutions using Delta Lake. Ensure data quality, integrity, and governance across all data platforms. Monitor, troubleshoot, and enhance existing data pipelines and ML model deployments. Create documentation and maintain data cataloging for the implemented solutions. Required Skills: 4-6 years of experience in data engineering, data warehousing, and big data technologies. Hands-on experience with Databricks for data processing, analytics, and ML model deployment. Strong expertise in Python or Scala for data manipulation and pipeline development. Proficiency in Spark for distributed data processing. Experience with ML model development, deployment, and monitoring on Databricks. Knowledge of Delta Lake and its implementation for data lakehouse architecture. Experience with cloud platforms like Azure, AWS, or GCP. Familiarity with SQL for querying and data transformation. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills. Preferred Qualifications: Experience with data visualization tools like Power BI, Tableau, or QlikView. Knowledge of MLOps practices and CI/CD for ML pipelines. Understanding of data security, compliance, and data governance principles. Certifications in Databricks, Azure, AWS, or GCP are a plus. Education: B.E./B.Tech.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Data Engineer Databricks & ML Models JobContact Details:
Company: VribaLocation(s): Noida, Gurugram+ View Contact
Keyskills: Machine Learning Python Scala Spark SQL Azure AWS GCP Data Engineering Data Warehousing Data Modeling Data Quality Data Governance Data Visualization Data Security Compliance
Fraud Alert to job seekers!
₹ Not Specified
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in