Senior Data Engineer
- Orion Systems
- 7 - 12 years
- Hyderabad
- 3 months ago
- Email to a friend
- Report this job
Job Description
Work Location : Hybrid - Chennai / Mumbai / Hyderabad / Gurugram
Notice : Immediate to 45 days
Experience : 7+ years
Required skills and experience
- Proven experience in working with GA4 data, including understanding its data model, event-based tracking, and integration with BigQuery.
- 6+ years of hands-on experience with Google BigQuery or Snowflake including advanced SQL techniques (CTEs, window functions, aggregate functions), schema design, and performance optimization.
- 6+ years of hands-on experience with advanced SQL techniques (CTEs, window functions, aggregate functions).
- 5+ years of strong experience in Python programming (object-oriented/functional programming, Pandas, PySpark).
- 5+ years working with cloud platforms.
- Experience designing star schemas, analyzing data warehouses, and applying data warehouse methodologies, particularly in the context of digital analytics data.
- Essential experience in loading data into warehouse/ODS environments from diverse sources and formats. Design strategies for new data ingestion requests, including logical and physical data modeling.
- Hands-on experience with version control and CI/CD pipelines for data engineering workflows.
- Proven ability to perform unit testing (SQL scripts, ETL modules), integration testing, and performance/load/stress testing.
Roles & Responsibility:
- Design, build, and deploy robust ETL and data management processes specifically for ingesting, transforming, and loading high-volume digital analytics data from Google Analytics 4 (GA4) into BigQuery/Snowflake.
- Develop and optimize BigQuery/Snowflake datasets, tables, and views to support various analytical needs, ensuring efficient querying and data integrity.
- Design, build, and deploy ETL job workflows with reliable error/exception handling and rollback frameworks. This includes designing and implementing data pipelines to feed data models for subsequent consumption.
- Monitoring and optimizing data processing and storage resources, with a focus on performance and cost efficiency.
- Troubleshooting and resolving data pipeline issues and performance bottlenecks, particularly those related to large-scale digital data processing.
- Write complex, customized SQL queries to manipulate data, generate automatic periodic reports, and support ad-hoc analytical requests.
- Build applications and scripts using Python to automate data processes, integrate systems, and enhance data quality.
Interested candidates can mail me your resume to ma**************n@or*****c.com
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data Science & Machine Learning - OtherEmployement Type: Full timeContact Details:
Company: Orion SystemsLocation(s): Hyderabad
Keyskills: Pyspark data engineer Bigquery Snowflake Pandas Python
Similar positions
Orion Systems
Orion’s dedication and passion for excellence enables us to successfully develop, integrate, deploy and manage IT solutions to Fortune 500 clients across the globe. Headquartered in the USA with state-of-the-art development centers in Mumbia and Kocki, India and Latin America, we employ over4...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in