AI Engineer (With Cortex AI Mandatory)
- Coforge
- 6 - 9 years
- Hyderabad
- 6 days ago
- Email to a friend
- Report this job
Job Description
The Data Engineer is responsible for building and operating scalable data pipelines and curated datasets on the Snowflake platform. The role emphasizes high standards of data quality, performance, governance, and automation to support analytics and AI initiatives across the enterprise.
Key Responsibilities:-
- Design and implement automated ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines to ingest data from multiple enterprise systems.
- Construct scalable data transformation workflows using Python and advanced SQL, ensuring both reliability and maintainability.
- Perform data discovery and profiling of new and existing data sources, including documentation of data definitions, relationships, and completeness.
- Conduct data exploration and validation activities to ensure datasets are ready for analytics and AI applications, translating business requirements into actionable data solutions.
- Develop robust data models for analytics and reporting, including dimensional modeling (fact and dimension tables) and the creation of curated datasets optimized for consumption.
- Implement data quality controls, such as validation rules, monitoring systems, and processes for remediating duplicates or inconsistencies, ensuring ongoing data quality management.
- Optimize Snowflake performance through advanced SQL tuning and workload optimization strategies, including clustering and partitioning techniques. Manage data governance and metadata, including documenting lineage, establishing access controls, and aligning with enterprise security policies. Establish automation and CI/CD practices through Git-based workflows and automated deployment and monitoring checks.
Required Qualifications:-
- Strong proficiency in Python for data processing, transformation, and pipeline automation.
- Advanced SQL skills, including querying, transformation, and performance optimization.
- Experience with libraries such as Pandas, PySpark, and NumPy.
- Deep expertise with Snowflake, including data architecture, storage and compute optimization, and data sharing
Share your resume over Aa***********a@Co****e.Com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data ScientistEmployement Type: Full timeContact Details:
Company: CoforgeLocation(s): Hyderabad
Keyskills: Snowflake snowpark python Data Pipeline Cortex
Similar positions
Coforge
Ernst & Young (EY) is a global professional services firm and one of the Big Four accounting firms. It offers audit, tax, consulting, and advisory services to clients worldwide, helping businesses with transformation, risk management, and innovation. With a presence in over 150 countries and nea...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in