Data Engineer Big Data
- Litmus7 Systems
- 3 - 7 years
- Kochi
- 3 months ago
- Email to a friend
- Report this job
Job Description
- Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems.
- Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.
- Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases.
- Optimize and tune data pipelines for performance, scalability, and reliability.
- Monitor and troubleshoot pipeline performance issues, identifying and resolving bottlenecks.
- Ensure data quality and integrity throughout the pipeline, implementing data validation and error handling mechanisms.
- Stay updated on emerging technologies and best practices in big data processing and analytics, incorporating them into our data engineering practices.
- Document design decisions, technical specifications, and data workflows.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Litmus7 SystemsLocation(s): Kochi
Keyskills: big data data processing machine learning data engineering data quality hive cloudera data validation scala pyspark distributed computing sql java spark data ingestion technical specifications hadoop etl hbase python nosql mapreduce kafka sqoop aws
Similar positions
Litmus7 Systems
Litmus7 is a technology company with a 100% focus on retail. We build, transform, enhance, and support platforms that enable the retailers' digital commerce business. With one of a kind micro-vertical practices in grocery, general merchandise, fashion, beauty, and pet products, the biggest different...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in