Staff, Software Engineer
- Walmart
- 8 - 13 years
- Bengaluru
- 3 months ago
- Email to a friend
- Report this job
Job Description
- Design, implement, and optimize data lake architectures (AWS S3, Azure Data Lake, GCP, etc.)
- Develop and maintain ETL/ELT pipelines for batch and real-time data ingestion
- Implement intelligent data synchronization using CDC, streaming, and event-driven frameworks (e.g., Kafka, Debezium)
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions
- Ensure data quality, security, and compliance across all data assets
- Automate data workflows and orchestrate pipelines using tools like Airflow, Azure Data Factory, or similar
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability
- Enable AI/ML teams by ensuring data is discoverable, high-quality, and ready for modeling and analytics
- Collaborate with data scientists, ML engineers, and business stakeholders to deliver production-ready data for AI solutions
- Build and maintain data pipelines that support AI/ML workflows, including feature engineering and model serving
- Apply AI-driven data quality checks and anomaly detection to improve pipeline reliability and data integrity
- 8+ years of relevant experience in software development and solution architecture focusing on building large scale complex distributed systems.
- Must have experience leading teams in a solution architect role building complex systems, Data lakes and Pipelines.
- Proficiency with cloud data lake platforms (AWS, Azure, GCP)
- Strong programming skills in Python, Scala, or Java
- Experience with ETL/ELT tools and frameworks (Spark, Databricks, Glue, etc.)
- Knowledge of data synchronization and integration patterns (CDC, streaming, replication)
- Familiarity with orchestration tools (Airflow, Prefect, Azure Data Factory)
- Experience working with AI/ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn) and supporting ML lifecycle
- Advanced knowledge of complex software design, distributed system design, design patterns, data structures, and algorithms.
- Excellent decision-making skills with the ability to balance conflicting interests in a complex and fast-paced environment.
- Passion for staying current with industry trends and emerging technologies, with a commitment to continuous learning and professional growth.
- Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams and stakeholders.
Job Classification
Industry: RetailFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: WalmartLocation(s): Bengaluru
Keyskills: algorithms python software development cdc scala software design scikit-learn glue system design azure data factory artificial intelligence java spark design patterns data structures aws programming data lake communication skills architecture
Similar positions
Walmart
If youre thinking scale, think bigger and dont stop there. At Walmart Global Tech India, we dont just innovate, we enable transformations across stores and different channels for the Walmart experience. A regular day at Walmart Global Tech India means using technology to deliver leading-edge i...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in