B.Tech. (CSE, IT,ECE or Equivalent) MScs. (CSE or Equivalent)/ MCA
1+ years of experience programming with at least one of the following languages: Python, Scala, Go.
1+ years of experience in SQL and data transformation
1+ years of experience in developing distributed systems using open source technologies such as Spark and Dask.
1+ years of experience with relational databases or NoSQL databases running in Linux environments (MySQL, MariaDB, PostgreSQL, MongoDB, Redis).
Experience working with AWS / Azure / GCP environment is highly desired.
Experience in data models in the Retail and Consumer products industry is desired.
Experience working on agile projects and understanding of agile concepts is desired.
Demonstrated ability to learn new technologies quickly and independently.
Excellent verbal and written communication skills, especially in technical communications.
Ability to work and achieve stretch goals in a very innovative and fast-paced environment.
Ability to work collaboratively in a diverse team environment
Good-to-have Experience :
Not Available
Job Responsibilities :
Build data pipeline frameworks to automate high-volume and real-time data delivery for our data hub.
Operationalize scalable data pipelines to support data science and advanced analytics.
Optimize customer data science workloads and manage cloud services costs/utilization.
Licenses/Certifications, special qualifications: GCP Certification is highly desired
Play a critical role in the design and implementation of data platforms for the AI and data visualization products.
Develop productized and parameterized data pipelines that feed AI products leveraging GPUs and CPUs.
Develop efficient data transformation code in Python or other relevant language.
Build workflows to automate data pipeline using Python, Airflow, Dataflow etc.
Develop data validation tests to assess the quality of the input data.
Conduct performance testing and profiling of the code using a variety of tools and techniques.
Apply For Data Engineer Position
Anything else you would like us to know about you Upload your CV (max 20 MB) (Only jpg/pdf/jpeg/png files are supported) I have read this Privacy Policy consent to my data being used for the purposes specified.
Job Classification
Industry: Software ProductFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full time