Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Data Engineer @ Incedo

Home > Software Development

 Lead Data Engineer

Job Description

Role Description:
As a Senior Technical Lead - Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise.

Roles & Responsibilities:
Designing, developing and maintaining large-scale big data platforms using technologies like Hadoop, Spark and Kafka
Creating and managing data warehouses, data lakes and data marts
Implementing and optimizing ETL processes and data pipelines
Developing and maintaining security and access controls
Troubleshooting and resolving big data platform issues
Collaborating with other teams to ensure the consistency and integrity of data
Foster a collaborative and supportive work environment, promoting open communication and teamwork.
Demonstrate strong leadership skills, with the ability to inspire and motivate team members to perform at their best.

Technical Skills

Skills Requirements:

Experience with big data processing technologies such as Apache Hadoop, Apache Spark, or Apache Kafka.
Understanding of distributed computing concepts such as MapReduce, Spark RDDs, or Apache Flink data streams.
Familiarity with big data storage solutions such as HDFS, Amazon S3, or Azure Data Lake Storage.
Knowledge of big data processing frameworks such as Apache Hive, Apache Pig, or Apache Impala.
Lead and manage a team of professionals to achieve organizational goals.
Provide guidance, support, and mentorship to help employees grow and develop professionally and focus on Career Management.

Nice-to-have skills
Qualifications
8-10 years of work experience in relevant field
B.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred

Job Classification

Industry: Banking
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Incedo
Location(s): Hyderabad

+ View Contactajax loader


Keyskills:   hive apache pig impala spark hadoop azure data lake data processing big data technologies microsoft azure apache flink data engineering data mart apache mapreduce data science kafka aws etl data integration data lake etl process

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Engineer /senior Engineer - (mcu Rtos)

  • Einfochips
  • 5 - 10 years
  • Hyderabad
  • 1 day ago
₹ Not Disclosed

Solutions Engineer - Linux BSP

  • Einfochips
  • 5 - 10 years
  • Noida, Gurugram
  • 2 days ago
₹ Not Disclosed

SDET Technical Lead

  • Wipro HR Soniya
  • 5 - 8 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 15 - 20 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Incedo

If youre thinking scale, think bigger and dont stop there. At Walmart Global Tech India, we dont just innovate, we enable transformations across stores and different channels for the Walmart experience. \\\\\\\\r\\\\\\\\n \\\\\\\\r\\\\\\\\nA regular day at Walmart Global Tech India means using tech...