Data Engineer
- Xoriant
- 7 - 12 years
- Hyderabad
- 1 month ago
- Email to a friend
- Report this job
Job Description
Job Summary:
We are seeking a skilled Data Engineer with expertise in AWS services, Python programming, and Snowflake. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures, ensuring data quality and reliability. This role requires a deep understanding of data warehousing, ETL processes, and cloud-based data solutions.
Key Responsibilities
- Design and Development:
- Develop, construct, test, and maintain data architectures and large-scale processing systems.
- Design and implement ETL (Extract, Transform, Load) processes using AWS services, Python, and Snowflake.
- Develop data integration solutions to support data ingestion from various sources.
- AWS Services:
- Utilize AWS services such as S3, RDS, Lambda for data storage, processing, and analytics.
- Implement data security best practices on AWS, including encryption and IAM roles.
- Monitor and optimize data storage and compute resources on AWS for cost efficiency and performance.
- Snowflake:
- Design and manage Snowflake data warehouses, ensuring optimal performance and data integrity.
- Implement data modeling, schema design, and ELT (Extract, Load, Transform) processes within Snowflake.
- Python Programming:
- Develop robust, reusable, and scalable code for data transformation and processing tasks.
- Automate data workflows using Python scripts and libraries.
- Troubleshoot and resolve data pipeline issues and bugs.
- Data Quality and Governance:
- Implement data quality checks and validation processes to ensure data accuracy and consistency.
- Maintain comprehensive documentation of data processes, pipelines, and architectures.
- Ensure compliance with data governance policies and standards.
- Collaboration and Communication:
- Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions.
- Communicate effectively with cross-functional teams to ensure alignment on data initiatives.
Qualifications
- Education:
- Bachelors degree in computer science, Information Technology, Engineering, or a related field. Master's degree preferred.
- Experience:
- 6+ years of experience in data engineering or a similar role.
- Strong expertise in Snowflake data warehousing or related cloud data warehouse.
- Proven experience with AWS services, particularly S3, RDS, Lambda
- Proficiency in Python programming.
- Skills:
- Solid understanding of data warehousing concepts and best practices.
- Experience with ETL/ELT tools and processes.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork abilities.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: XoriantLocation(s): Hyderabad
Keyskills: Pyspark Data Engineering Snowflake AWS SQL Python
Similar positions
Xoriant
Xoriant Corporation is a product engineering and services company, serving technology startups as well as mid-size to large corporations. We offer a flexible blend of onsite, offsite and offshore services from our Global delivery centers ( Sunnyvale, New Jersey, Mumbai, Pune, Gurgaon, Kolkata and B...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in