Principal - Data Architect
- Affine Analytics
- 8 - 12 years
- Chennai
- 29 days ago
- Email to a friend
- Report this job
Job Description
We are seeking a highly skilled Data Architect to design and implement robust, scalable, and secure data solutions on AWS Cloud. The ideal candidate should have expertise in AWS services, data modeling, ETL processes, and big data technologies, with hands-on experience in Glue, DMS, Python, PySpark, and MPP databases like Snowflake, Redshift, or Databricks.
Key Responsibilities:
- Architect and implement data solutions leveraging AWS services such as EC2, S3, IAM, Glue (Mandatory), and DMS for efficient data processing and storage.
- Develop scalable ETL pipelines using AWS Glue, Lambda, and PySpark to support data transformation, ingestion, and migration.
- Design and optimize data models following Medallion architecture, Data Mesh, and Enterprise Data Warehouse (EDW) principles.
- Implement data governance, security, and compliance best practices using IAM policies, encryption, and data masking.
- Work with MPP databases such as Snowflake, Redshift, or Databricks, ensuring performance tuning, indexing, and query optimization.
- Collaborate with cross-functional teams, including data engineers, analysts, and business stakeholders, to design efficient data integration strategies.
- Ensure high availability and reliability of data solutions by implementing monitoring, logging, and automation in AWS.
- Evaluate and recommend best practices for ETL workflows, data pipelines, and cloud-based data warehousing solutions.
- Troubleshoot performance bottlenecks and optimize query execution plans, indexing strategies, and data partitioning.
Job Requirement
Required Qualifications & Skills:
- Strong expertise in AWS Cloud Services: Compute (EC2), Storage (S3), and security (IAM).
- Proficiency in programming languages: Python, PySpark, and AWS Lambda.
- Mandatory experience in ETL tools: AWS Glue and DMS for data migration and transformation.
- Expertise in MPP databases: Snowflake, Redshift, or Databricks; knowledge of RDBMS (Oracle, SQL Server) is a plus.
- Deep understanding of data modeling techniques: Medallion architecture, Data Mesh, EDW principles.
- Experience in designing and implementing large-scale, high-performance data solutions.
- Strong analytical and problem-solving skills, with the ability to optimize data pipelines and storage solutions.
- Excellent communication and collaboration skills, with experience working in agile environments.
Preferred Qualifications:
- AWS Certification (AWS Certified Data Analytics, AWS Certified Solutions Architect, or equivalent).
- Experience with real-time data streaming (Kafka, Kinesis, or similar).
- Familiarity with Infrastructure as Code (Terraform, CloudFormation).
- Understanding of data governance frameworks and compliance standards (GDPR, HIPAA, etc.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: DBA / Data warehousing
Role: Data warehouse Architect / Consultant
Employement Type: Full time
Contact Details:
Company: Affine AnalyticsLocation(s): Chennai
Keyskills: Python S3 AWS Glue DMS SQL Server Redshift Glue IAM EC2 Snowflake Databricks Oracle Lambda
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in