Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Data Engineer @ phData

Home > Data Science & Machine Learning

 Lead Data Engineer

Job Description

Required Experience:
  • 8+ years as a hands-on Data Engineer designing and implementing data solutions
  • Team lead, and/or mentorship of other engineers
  • Ability to develop end-to-end technical solutions into production and to help ensure performance, security, scalability, and robust data integration.
  • Programming expertise in Java, Python and/or Scala
  • Core cloud data platforms including Snowflake, AWS, Azure, Databricks and GCP
  • SQL and the ability to write, debug, and optimize SQL queries
  • Client-facing written and verbal communication skills and experience
  • Create and deliver detailed presentations
  • Detailed solution documentation (e.g. including POCS and roadmaps, sequence diagrams, class hierarchies, logical system views, etc.)
  • 4-year Bachelors degree in Computer Science or a related field
Prefer any of the following:
  • Production experience in core data platforms: Snowflake, AWS, Azure, GCP, Hadoop, Databricks
  • Cloud and Distributed Data Storage: S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra or other NoSQL storage systems
  • Data integration technologies: Spark, Kafka, event/streaming, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica Intelligent Cloud Services (IICS), Google DataProc or other data integration technologies
  • Multiple data sources (e.g. queues, relational databases, files, search, API)
  • Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment
  • Automated data transformation and data curation: dbt , Spark, Spark streaming, automated pipelines
  • Workflow Management and Orchestration : Airflow, AWS Managed Airflow, Luigi, NiFi
Why phDataWe Offer:
  • Remote-First Workplace
  • Medical Insurance for Self & Family
  • Medical Insurance for Parents
  • Term Life & Personal Accident
  • Wellness Allowance
  • Broadband Reimbursement
  • Continuous learning and growth opportunities to enhance your skills and expertise
  • Other benefits include paid certifications, professional development allowance, and bonuses for creating for company-approved content
#LI-DNI

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: phData
Location(s): Kolkata

+ View Contactajax loader


Keyskills:   Computer science Data migration GCP Workflow management Software development life cycle Wellness Medical insurance Informatica AWS Python

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Data Engineer II

  • Amazon
  • 3 - 8 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Generative AI Engineer

  • Einfochips
  • 3 - 8 years
  • Indore
  • 9 days ago
₹ Not Disclosed

Walk In - Aiml / Genai / Mlops/data Science - Hyderabad Gar

  • Capgemini
  • 4 - 9 years
  • Hyderabad
  • 9 days ago
₹ Not Disclosed

AI Engineer L1

  • Wipro
  • 1 - 5 years
  • Hyderabad
  • 10 days ago
₹ Not Disclosed

phData

Company DetailsphData