Senior Data Engineer
- Sunbrilo Technology
- 3 - 6 years
- Pune
- 3 months ago
- Email to a friend
- Report this job
Job Description
We are hiring for -
Role: Senior Data Engineer
Experience Range: 3 to 5 Years
Qualification: Degree in Computer Science (or similar), alternatively well-founded professional
experience in the desired field
Roles & Responsibilities:
- As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You are responsible for the implementation of the IT governance guidelines.
- Collaborate with the Spokes Data Scientists, Data Analysts, and Business Analysts, when relevant.
Tasks
- Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation
- Experience working with and creating cloud data solutions
- Assemble large, complex data sets that meet functional/non-functional business requirements
- Implement the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Pyspark, SQL and AWS big data-technologies
- Build analytics tools that use the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
- Manipulate data at scale: getting data in a ready-to-use state in close alignment with various business and Spoke stakeholders
Must Have:
Advanced knowledge:
- ETL
- Data Lake, Data Warehouse, RDS architectures knowledge
- Python, SQL (Any other OOP language is also valuable)
- Pyspark (preferably) or Spark Knowledge
- Object-oriented programming, Clean Code and good documentation skills
- AWS: S3, Athena, Lambda, Glue, IAM, SQS, EC2, Quicksight, and etc.
- Git
- Data Analysis & Visualization
Optional:.
- AWS CDK Cloud Development Kit
- CI/CD knowledge
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Sunbrilo TechnologyLocation(s): Pune
Keyskills: Pyspark Data Lake Data Warehousing ETL Python S3 rds architecture SQL Cicd Methodology Git Glue IAM SQS Quicksight EC2 Data Analysis Data Visualization AWS Athena Lambda
Similar positions
Sunbrilo Technology
\n\n Classified as an Upper-Layer NBFC by the RBI pursuant to Scale Based Regulations, Bajaj Housing Finance Limited (BHFL) is a subsidiary of Bajaj Finance Limited one of the most diversified NBFCs in the Indian market, catering to more than 92.09 million customers across the country. Headquartered...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in