Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Associate Engineer @ ThoughtFocus

Home > Software Development

 Associate Engineer

Job Description

Data Engineer
Experience - 6+ Years
Summary

We are seeking a highly skilled and motivated Data Engineer Associate to join our dynamic team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python, and SQL. As a Data Engineer Associate, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support various business needs.

Key Responsibilities
  • Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks
  • Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.
  • Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.
  • Optimize database performance by designing scalable and cost-effective solutions.

Candidate Profile

Preferred Experience & Skills:
  • 6+ years experience in Data Engineering
  • Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning, and query optimization
  • Exposure to Azure.
  • Proven experience in setting up and orchestrating Databricks pipelines, including automated workflows and job scheduling.
  • Strong hands-on knowledge of Databricks Unity Catalog, Hive Metastore, and the ability to build and manage Databricks Dashboards for data visualization and monitoring.
  • Working experience with Azure Functions for serverless data processing and event-driven workflows.
  • Proficient in implementing Medallion Architecture (Bronze, Silver, Gold layers) for scalable and structured data ingestion, transformation, and delivery.
  • Experience in building end-to-end data pipelines on Azure and Databricks environments.
  • Good to have: Familiarity with Box for data integration and Databricks Asset Bundles (DAB) for managing and deploying reusable code artifacts.
  • Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).
  • Experience with ETL/ELT tools like snap logic and programming languages (Python).
  • Familiar with data governance frameworks and security protocols.
  • Excellent problem-solving skills and attention to detail.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Platform Engineer
Employement Type: Full time

Contact Details:

Company: ThoughtFocus
Location(s): Bengaluru

+ View Contactajax loader


Keyskills:   query optimization Data modeling Schema data governance Data structures Data processing Scheduling Investment management SQL Python

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Principal Applied AI Engineer

  • Zycus Infotech
  • 6 - 11 years
  • Pune
  • 16 hours ago
₹ Not Disclosed

Python + DevOps Engineer

  • TekPillar
  • 4 - 8 years
  • Pune
  • 18 hours ago
₹ -15 Lacs P.A.

Data Engineer

  • Tata Consultancy
  • 5 - 10 years
  • Bengaluru
  • 19 hours ago
₹ Not Disclosed

Full Stack Data Engineer -AWS (Pan India)

  • Infosys
  • 5 - 10 years
  • Hyderabad
  • 24 hours ago
₹ Not Disclosed

ThoughtFocus

Thoughtfocus ThoughtFocus is a privately held company, headquartered in Milwaukee, Wisconsin. We lead transformation in business with technology and insights to add value in four major sectors, Aerospace & Defense, Education, Finance, and Manufacturing. We're unlike the large consulting firm...