Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Astronomer Airflow @ Cognizant

Home > Software Development

Cognizant  Astronomer Airflow

Job Description

Skill: Astronomer, Airflow

Experience: 6 to 9 Years

Location : AIA Kolkata

Job Description

 RoleResponsibilities:

  • Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
  • Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
  • Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
  • Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.
  • Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
  • Collaborate to build reusable assets, automation tools, and documented best practices.
  • Interact with Domain and Engineering teams to channel product feedback and requirements discussions.
  • Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys. 

Requirements:

  • 3+ years of Data Architect with Airflow / Astronomer.
  • Experience with Apache Airflow in production environments.
  • Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
  • Proficiency in Python.
  • Knowledge of Azure cloud-native data architecture.
  • Demonstrated technical leadership on team projects.
  • Strong oral and written communication skills.
  • Willingness to learn new technologies and build reference implementations.
  • Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.
  • Experience in integrating with Azure Data Factory pipelines.
  • Snowflake and Databricks experience.
  • Experience working with containers.
  • SQL experience.
  • Kubernetes experience, either on-premise or in the cloud.
  • Enterprise data experience in regulated environments. 

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Head - Engineering
Employement Type: Full time

Contact Details:

Company: Cognizant
Location(s): Chennai

+ View Contactajax loader


Keyskills:   snowflake kubernetes communication skills written python technical leadership airflow data warehousing data architecture azure data factory data pipeline azure cloud job description sql data bricks apache automation tools written communication etl communication skills

 Fraud Alert to job seekers!

₹ Not Disclosed

Cognizant

Cognizant