Manager
- EXL
- 5 - 10 years
- Noida, Gurugram
- 8 months ago
- Email to a friend
- Report this job
Job Description
Job Title: Lead Cloud Data Engineer
Job Type: Full-Time
Introduction: We are seeking an experienced and dynamic Lead Cloud Data Engineer to guide our cloud data engineering team. This is a leadership role that combines technical expertise in cloud-based data engineering with the ability to lead, mentor, and inspire a team of engineers. The ideal candidate will have extensive experience in AWS services (such as EC2, S3, Lambda, etc.), PySpark or Scala , and a deep understanding of infrastructure as code (IaC) with AWS CloudFormation and Terraform . If youre passionate about cloud technologies, big data, and leading high-performing teams, we would love for you to join us!
Key Responsibilities:
-
Leadership & Team Management:
-
Lead, mentor, and manage a team of cloud data engineers, guiding them through project phases and ensuring they meet both technical and business objectives.
-
Foster a collaborative and innovative culture within the team by encouraging knowledge sharing, continuous learning, and best practices in cloud data engineering.
-
Coordinate and prioritize tasks within the team, ensuring alignment with overall business goals and project timelines.
-
Conduct performance reviews, provide regular feedback, and facilitate career growth and development opportunities for team members.
-
-
Cloud Solution Design & Implementation:
-
Lead the design and development of cloud-based data solutions using AWS services such as EC2, S3, Lambda, RDS, and Redshift .
-
Oversee the architecture of scalable data pipelines and distributed data processing systems using PySpark or Scala for large-scale data ingestion, processing, and transformation.
-
-
Infrastructure Automation & Deployment:
-
Oversee and guide the automation of cloud infrastructure deployment using AWS CloudFormation and Terraform to ensure consistency, repeatability, and scalability.
-
Drive the teams use of Infrastructure as Code (IaC) to automate the provisioning, configuration, and management of cloud resources in a cost-efficient and secure manner.
-
-
Strategy & Innovation:
-
Contribute to the development of long-term cloud data engineering strategies to meet evolving business needs and technological advancements.
-
Research and adopt new cloud and data technologies, ensuring the team stays on the cutting edge of data engineering practices and cloud solutions.
-
-
Cross-Functional Collaboration:
-
Work closely with data scientists, analysts, and other stakeholders to understand business requirements and design data solutions that meet those needs.
-
Act as a liaison between the engineering team and senior management, translating technical objectives into business outcomes.
-
-
Optimization & Monitoring:
-
Ensure the efficient use of cloud resources, implementing monitoring and logging solutions to track the performance, security, and cost-efficiency of data solutions.
-
Lead initiatives to optimize data processing workflows and enhance the performance and scalability of cloud data systems.
-
-
Documentation & Governance:
-
Ensure the team maintains clear, thorough documentation of data engineering processes, architecture, and cloud infrastructure.
-
Establish and enforce data governance policies to ensure the security, compliance, and integrity of data solutions.
-
Required Skills and Qualifications:
-
Leadership & Management:
-
Proven experience leading and mentoring a team of cloud data engineers or similar technical teams.
-
Strong interpersonal skills with the ability to manage and develop a diverse team of engineers.
-
Ability to coordinate and manage multiple priorities in a fast-paced, deadline-driven environment.
-
-
Cloud Platform Expertise:
-
Extensive hands-on experience with AWS services, including EC2, S3, Lambda, RDS, Redshift, and others .
-
Familiarity with cloud security best practices and cost management in AWS.
-
-
Infrastructure as Code (IaC):
-
Strong experience with AWS CloudFormation and Terraform for deploying, managing, and automating cloud infrastructure.
-
-
Data Engineering:
-
Proficiency in PySpark or Scala for designing and implementing distributed data processing systems at scale.
-
Knowledge of data integration, ETL pipelines, data warehousing, and large-scale data processing.
-
Experience working with cloud data storage solutions such as S3 , DynamoDB , and relational databases ( RDS , Redshift ).
-
-
Big Data Technologies:
-
Strong background in big data frameworks such as Apache Spark (via PySpark or Scala ), Hadoop , or Kafka .
-
-
Programming and Scripting:
-
Proficiency in programming languages like Python , Java , or Scala for cloud-based data solutions.
-
Knowledge of data formats (e.g., Parquet, JSON, CSV) and experience with data processing frameworks.
-
-
CI/CD and Automation:
-
Experience with CI/CD pipelines for automating cloud deployments (e.g., Jenkins , GitLab CI , AWS CodePipeline ).
-
Familiarity with containerization and orchestration (e.g., Docker , Kubernetes ) is a plus.
-
-
Problem-Solving & Communication:
-
Strong problem-solving skills, with the ability to debug complex cloud and data infrastructure issues.
-
Excellent communication skills, including the ability to explain complex technical concepts to non-technical stakeholders.
-
Preferred Qualifications:
-
Certifications:
-
AWS Certified Solutions Architect Associate or Professional.
-
AWS Certified DevOps Engineer Professional.
-
Other relevant cloud or data engineering certifications are a plus.
-
-
Agile Methodologies:
-
Familiarity with Agile methodologies and experience working in Agile teams.
-
-
DevOps & Automation:
-
Strong experience with DevOps practices, including continuous integration, continuous delivery, and infrastructure automation.
-
Job Classification
Industry: Software ProductFunctional Area / Department: Finance & AccountingRole Category: FinanceRole: Finance ManagerEmployement Type: Full timeContact Details:
Company: EXLLocation(s): Noida, Gurugram
Keyskills: Manager
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in