Data Engineer
- Trigyn Technologies
- 5 - 10 years
- Delhi, NCR
- 4 months ago
- Email to a friend
- Report this job
Job Description
- Key Responsibilities:-Data Pipeline Developmento Design, build, and maintain scalable ETL (Extract, Transform, Load) processes for collecting, storing, and processing structured and unstructured data from multiple sources
- o Develop workflows to automate data extraction from APIs, databases, and external sources
- o Ensure data pipelines are optimized for performance and handle large data volumes with minimal latency
- -Data Integration and Managemento Integrate data from various sources (eg, databases, APIs, cloud storage) into the centralized daIta warehouse or data lake to support real-time dashboards
- o Ensure smooth data flow and seamless integration with analytics tools like Power BI and Tableau
- o Manage and maintain data storage solutions, including relational (SQL-based) and NoSQL databases
- -Data Quality and Governanceo Implement data validation checks and quality assurance processes to ensure data accuracy, consistency, and integrity
- o Develop monitoring systems to identify and troubleshoot data inconsistencies, duplications, or errors during ingestion and processing
- o Ensure compliance with data governance policies and standards, including data protection regulations such as the Digital Personal Data Protection (DPDP) Act
- -Database Management and Optimizationo Design and manage both relational and NoSQL databases, ensuring efficient storage, query performance, and reliability
- o Optimize database performance, ensuring fast query execution times and efficient data retrieval for dashboard visualization
- o Implement data partitioning, indexing, and replication strategies to support large-scale data operations
- -Data Security and Complianceo Ensure that all data processes adhere to security best practices, including encryption, authentication, and access control
- o Implement mechanisms for secure data storage and transmission, especially for sensitive government or public sector data
- o Conduct regular audits of data pipelines and storage systems to ensure compliance with relevant data protection regulations
- - Cloud Infrastructure and Deploymento Deploy and manage cloud-based data solutions using AWS, Azure, or GCP, including data lakes, data warehouses, and cloud-native ETL tools
- o Set up cloud infrastructure to support high availability, fault tolerance, and scalability of data systems
- o Monitor cloud usage and optimize costs for data storage, processing, and retrieval
- -Performance Monitoring and Troubleshootingo Continuously monitor data pipeline performance and data ingestion times to identify bottlenecks and areas for improvementTroubleshoot and resolve any data flow issues, ensuring high availability and reliability of data for dashboards and analytics
- o Implement logging and alerting mechanisms to detect and address any operational issues proactively
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Trigyn TechnologiesLocation(s): Delhi, NCR
Keyskills: Computer science Manager Quality Assurance NoSQL HP data protector data security Data quality Information technology SQL Data architecture Data extraction
Similar positions
Trigyn Technologies
Trigyn Technologies ltd Trigyn is an ISO 9001:2008 certified, and CMMI Level 5 assessed company. Trigyn Technologies is an IT Services Company that has been in business for more than 30 years. Trigyn provides IT Solutions, Consulting, Systems Integration, Managed Services, Software Development, ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in