Senior Data Engineer (AWS+Spark+Kubernetes) @ Bringle Excellence

Job Description

Profile - Senior Data Engineer (AWS+Spark+Kubernetes) Experience - 5 - 10 years Location - Remote & PAN India Company - Ksolves India Limited Apply - https://whereuelevate.com/jobs/ksolvesindialimited-dataengineer-pHrA Mandate Skills - Python, Spark, AWS, Kubernetes, Dockers and SQL What you will do and achieve: Reporting to the Data Integration Manager, the duties and responsibilities of the Data Engineer include, but are not limited to: Model and architect data to solve business problems Analyze and resolve technical and application problems Create data pipelines to prepare and maintain data to solve specific use cases Adhere to high-quality development principles while delivering solutions on time and on-budget Migrate existing workflows to newer infrastructures Analyze use cases and propose solutions to meet business objectives Experience 5 - 10 yrs. experience as a data engineer Key Knowledge & Skills Strong RDMS skills, utilizing MS-SQL or MySQL . Proven experience designing databases, troubleshooting performance issues, and writing advanced SQL queries and stored procedures for efficient data extraction and manipulation. Experience building scalable and maintainable data-intensive applications At least one modern programming language, preferably Python Knowledge and experience with OOP design patterns Pipeline orchestration technology, such as Prefect, Luigi, or Airflow Pipeline transformation tools, using Python and pandas library Big data technologies, such as Hadoop & Spark, ideally including Python pandas and dask Core Competencies Keen interest in data engineering and a tinkering mindset Driven to learn about and incorporate new technologies continually Thrive in a self-driven environment Understanding and integrating human and machine workflows Data Lake & Warehouse Modeling Git, Docker, Kubernetes Cloud infrastructure, such as Azure, AWS, or Google Cloud Development of Linux Other Desirable Attributes Location Spatial Data Distributed systems storage, compute & access patterns Unstructured Data extraction PDF, scraping Graph database, such as Neo4j Data catalog platforms, such as Amundsen Education Bachelor's degree or better in Computer Science or equivalent Must have an excellent academic record with a good grounding in Software Engineering theory including at least one modern programming language Familiar with Standards, concepts, practices, and procedures within Computer Science

Employement Category:

Employement Type: Full time
Industry: Others
Role Category: Embedded / System SoftwareDBA / Datawarehousing
Functional Area: Not Applicable
Role/Responsibilies: Senior Data Engineer (AWS+Spark+Kubernetes)

+ View Contact

Keyskills:   Python Spark AWS Kubernetes SQL MySQL OOP Airflow Hadoop Git Docker Kubernetes Azure Linux Spatial Data Dockers MSSQL Prefect Luigi pandas dask Google Cloud Graph database Amundsen