IBM Data stage/Software Engineer
- Hsbc
- 0 - 5 years
- Hyderabad
- 3 months ago
- Email to a friend
- Report this job
Job Description
Some careers shine brighter than others.
If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer
- Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP).
- Optimize and automate data workflows using Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub.
- Build and maintain ETL processes for data ingestion, transformation, and loading into data warehouses
- Ensure the reliability and performance of data pipelines by implementing Apache Airflow for orchestration.
- Collaborate with stakeholders to gather and translate requirements into technical solutions.
- Work on multiple data warehousing projects, applying a thorough understanding of concepts such as dimensions, facts, and slowly changing dimensions (SCDs).
- Develop scripts and applications in Python and PySpark to handle large-scale data processing tasks.
- Write optimized SQL queries for data analysis and transformations.
- Use GitHub, Jenkins, Terraform, and Ansible to deploy and manage code in production.
- Troubleshoot and resolve issues related to data pipelines, ensuring high availability and scalability.
- Explore opportunities to integrate and leverage
Requirements
- Cloud Expertise: Hands-on experience with GCP services like Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub.
- Multi-cloud knowledge (e. g. , AWS, Azure) is a plus.
- Programming & Tools: Strong skills in Python, PySpark, and SQL for data processing and analysis.
- Experience with Apache Airflow for workflow orchestration.
- Data Warehousing: Clear understanding of dimensions, facts, SCDs, and other core data warehousing concepts.
- Proven experience working on multiple data warehousing projects.
- DevOps & Deployment Tools: Experience working with GitHub, Jenkins, Terraform, and Ansible for CI/CD processes.
- General Skills: Strong problem-solving and analytical skills.
- Excellent communication and stakeholder management abilities.
- Ability to work independently and as part of a team.
Job Classification
Industry: Consumer Electronics & AppliancesFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: HsbcLocation(s): Hyderabad+ View Contact
Keyskills: Data analysis github orchestration Workflow Data processing Apache Stakeholder management Financial services SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in