Data Engineer - Power BI / Spark
- Forward Eye
- 6 - 8 years
- Bengaluru
- 2 months ago
- Email to a friend
- Report this job
Job Description
Key Responsibilities :
- Designing, developing, and maintaining database solutions using Microsoft SQL Server.
- Developing and optimizing SQL queries, stored procedures, and functions for efficient data retrieval and manipulation.
- Designing and implementing data models, schemas, and data warehouses to support business requirements and analytical needs.
- Building and maintaining SSIS ETL processes and data pipelines to extract, transform, and load data from various sources into the SQL Server database.
- Implementing data quality checks, data validation rules, and data cleansing processes to ensure data accuracy and integrity.
- Performance tuning and optimization of database queries, indexes, and server configurations to improve data processing speed and efficiency.
- Collaborating with data scientists and analysts to understand data requirements, design data structures, and implement solutions for advanced analytics and reporting.
- Working closely with software engineers to integrate database solutions with application systems and ensure data consistency and integrity across the entire technology stack.
- Monitoring database performance, diagnosing and resolving issues, and implementing proactive measures to prevent downtime and optimize performance.
- Documenting database designs, data models, ETL processes, and data governance policies for knowledge sharing and compliance purposes.
Requirements :
- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent work experience).
- Proven experience as a SQL Server developer or data engineer with expertise in designing and developing database solutions using Microsoft SQL Server.
- Strong proficiency in SQL programming, including advanced querying techniques, stored procedures, functions, and performance optimization.
- Experience with database design and data modeling concepts, including normalization, denormalization, and dimensional modeling.
- Hands-on experience with ETL tools and technologies such as SSIS (SQL Server Integration Services) or similar data integration platforms.
- Knowledge of data warehousing principles and best practices, including data ingestion, transformation, and storage.
- Familiarity with data governance, data quality, and data security principles and practices.
- Experience working with large-scale databases, high-volume transactional systems, and distributed computing environments.
- Strong analytical and problem-solving skills, with the ability to analyze complex data sets and troubleshoot database-related issues.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Preferred Qualifications :
- Experience with other database technologies such as Oracle, PostgreSQL, or MySQL.
- Familiarity with cloud-based data platforms such as Microsoft Azure SQL Database
- Knowledge of data visualization tools and technologies such as Power BI, Tableau, or QlikView.
- Experience with data streaming technologies such as Kafka, Spark Streaming, or Apache Flink.
- Certification in Microsoft SQL Server or related technologies.
Job Classification
Industry: IT Services & ConsultingFunctional Area: IT Services & Consulting
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: Forward EyeLocation(s): Bengaluru
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in
