Lead Data Engineer
- Tata Consultancy
- 10 - 20 years
- Bengaluru
- 2 months ago
- Email to a friend
- Report this job
Job Description
Lead Data Engineer
Experience Range: 10 - 20 years
Location: Bengaluru, India
We are looking for a Data Engineer to architect and guide the development of scalable data solutions across the enterprise. Youll be instrumental in shaping our data strategy, driving best practices, and mentoring a team of engineers while partnering with cross-functional stakeholders.
Bonus: Experience in Ad Tech, particularly Linear or Addressable Advertising, is a strong plus.
Preferred: Experience supporting Business Intelligence (BI) data platforms, dashboards, and reporting environments is highly valuable.
Responsibilities and Duties of the Role:
- Champion core engineering principles including pipeline reliability, fault tolerance, and automation
- Drive clean architecture patterns, design for extensibility, and enforce rigorous code quality standards
- Coordinate closely with Product Management to align data engineering deliverables with business goals
- Work collaboratively with Program Management to manage execution timelines, dependencies, and reporting
- Partner with QA to ensure robust testing, validation, and data accuracy for each release including system reliability, fault tolerance, and automation
- Drive clean architecture patterns, design for extensibility, and enforce rigorous code quality standards
- Architect and build reusable and modular components for the data platform
- Drive best practices in pipeline design, performance tuning, version control, CI/CD, and observability
- Lead large-scale data migration, warehousing, and platform modernization efforts
- Mentor junior engineers, lead design discussions, and set technical direction
- Collaborate cross-functionally with Product, Analytics, and Infrastructure teams to ensure alignment and scalability
- Ensure high availability and fault tolerance across all data systems and flows.
- Work closely with BI developers to align data models and delivery schedules
Required Qualifications
- Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience preferably with a digital media or digital advertising company
- Experience delivering products in an agile software development environment including sprint work in Jira
- Excellent interpersonal skills with the ability to collaborate and partner across multiple teams and organizations
- Strong SQL experience including writing/optimizing complex queries against distributed data stores such as Aurora, Hadoop, Hive, Oracle, and Snowflake
- Experience with data pipeline and workflow management tools: Apache NiFi or Apache Airflow
- Expert level knowledge in at least one programming language such as Python, R, Scala, Java.
- Demonstrated experience working with business intelligence tools such as MicroStrategy, Tableau, Business Objects, Looker, etc.
Category Technologies
Languages - Scala, Python, SQL
Data Processing - Apache Spark, Flink, Airflow
Platforms & Tools - Databricks, Hive, Presto, Snowflake
Cloud - AWS (S3, EMR, Glue, Lambda)
- Demonstrated ability to effectively communicate complex concepts to technical and unacquainted audiences
- Experience in working with large datasets (Terabytes or more)
- Strong presentation and documentation skills including experience working with Confluence, Power Point, and Lucid Chart
- Strong analytical and critical thinking skills
- Enjoy working collaboratively with a talented group of people to tackle challenging business problems so we all succeed (or fail fast) as a team.
Preferred Qualifications
- Experience with digital advertising systems and ecosystems
- Experience using data analytics to triage and troubleshoot advertising workflows
- Experience with network topologies, systems architecture overviews, and entity relationship diagrams (ERD)
Required Education
Bachelors degree in computer science, Data Analytics or Science, Applied Mathematics, Statistics, related technical fields, or equivalent experience
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Tata ConsultancyLocation(s): Bengaluru
Keyskills: Data Bricks Hive Spark AWS Python Airflow Java Data Engineering Apache Flink Kafka SQL Presto SCALA Snowflake Data Warehousing
Similar positions
Tata Consultancy
\n\nMavlers is a full-service digital marketing agency that has propelled growth for over 7,000 brands and agencies worldwide. As Google, Mailchimp, WP VIP, Microsoft, Salesforce, and HubSpot partners, we possess the expertise to deliver high-impact projects and campaigns tailored to our clients uni...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in