Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Data Engineer @ Epam Systems

Home > Software Development

 Lead Data Engineer

Job Description

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore).


Exp: 10-14 years

Location: Bengaluru

Work Mode: Hybrid (2-3 days office in a week)


Job Description:

  1. 10-14 Years of in Big Data & Data related technology experience
  2. Expert level understanding of distributed computing principles
  3. Expert level knowledge and experience in Apache Spark
  4. Hands on programming with Python
  5. Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
  6. Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
  7. Good understanding of SQL queries, joins, stored procedures, relational schemas
  8. Knowledge of ETL techniques and frameworks
  9. Performance tuning of Spark Jobs
  10. Experience with native Cloud data services AWS.
  11. Ability to lead a team efficiently
  12. Experience with designing and implementing Big data solutions
  13. Practitioner of AGILE methodology

What you'll do

  • Create and maintain optimal cloud-based Operational Datasource (ODS) & data pipeline architectures capable of ingesting structured and unstructured data using both batch & kafka streaming methods
  • Assemble large, complex data sets that meet functional and technical requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Develop data flows that can leverage both on premise and cloud architectures.
  • Work with stakeholders including the business analytics teams and IS architecture teams to assist with data-related technical issues and support their data infrastructure needs.

WE OFFER

  1. Opportunity to work on technical challenges that may impact across geographies
  2. Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
  3. Opportunity to share your ideas on international platforms
  4. Sponsored Tech Talks & Hackathons
  5. Possibility to relocate to any EPAM office for short and long-term projects
  6. Focused individual development
  7. Benefit package:

         Health benefits, Medical Benefits         Retirement benefits         Paid time off         Flexible benefits

  1. Forums to explore beyond work passion (CSR, photography, painting, sports, etc.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Epam Systems
Location(s): Bengaluru

+ View Contactajax loader


Keyskills:   Spark AWS Python Airflow Pyspark Glue EMR Aws Glue Athena Aws Emr SQL

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Engineer /senior Engineer - (mcu Rtos)

  • Einfochips
  • 5 - 10 years
  • Hyderabad
  • 1 day ago
₹ Not Disclosed

Solutions Engineer - Linux BSP

  • Einfochips
  • 5 - 10 years
  • Noida, Gurugram
  • 2 days ago
₹ Not Disclosed

SDET Technical Lead

  • Wipro HR Soniya
  • 5 - 8 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 15 - 20 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Epam Systems

About us:EPAM Systems