Data Architect
- Litmus7 Systems
- 10 - 15 years
- Kochi
- 3 months ago
- Email to a friend
- Report this job
Job Description
Data Architect is responsible to define and lead the Data Architecture, Data Quality, Data Governance, ingesting, processing, and storing millions of rows of data per day. This hands-on role helps solve real big data problems.
You will be working with our product, business, engineering stakeholders, understanding our current eco-systems, and then building consensus to designing solutions, writing codes and automation, defining standards, establishing best practices across the company and building world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker passionate about building systems at scale.
Role
- Design, implement and lead Data Architecture, Data Quality, Data Governance
- Defining data modeling standards and foundational best practices
- Develop and evangelize data quality standards and practices
- Establish data governance processes, procedures, policies, and guidelines to maintain the integrity and security of the data
- Drive the successful adoption of organizational data utilization and self-serviced data platforms
- Create and maintain critical data standards and metadata that allows data to be understood and leveraged as a shared asset
- Develop standards and write template codes for sourcing, collecting, and transforming data for streaming or batch processing data
- Design data schemes, object models, and flow diagrams to structure, store, process, and integrate data
- Provide architectural assessments, strategies, and roadmaps for data management
- Apply hands-on subject matter expertise in the Architecture and administration of Big Data platforms, Data Lake Technologies (AWS S3/Hive), and experience with ML and Data Science platforms
- Implement and manage industry best practice tools and processes such as Data Lake, Databricks, Delta Lake, S3, Spark ETL, Airflow, Hive Catalog, Redshift, Kafka, Kubernetes, Docker, CI/CD
- Translate big data and analytics requirements into data models that will operate at a large scale and high performance and guide the data analytics engineers on these data models
- Define templates and processes for the design and analysis of data models, data flows, and integration
- Lead and mentor Data Analytics team members in best practices, processes, and technologies in Data platforms
Qualifications
- B.S. or M.S. in Computer Science, or equivalent degree
- 10+ years of hands-on experience in Data Warehouse, ETL, Data Modeling & Reporting
- 7+ years of hands-on experience in productionizing and deploying Big Data platforms and applications, Hands-on experience working with: Relational/SQL, distributed columnar data stores/NoSQL databases, time-series databases, Spark streaming, Kafka, Hive, Delta Parquet, Avro, and more
- Extensive experience in understanding a variety of complex business use cases and modeling the data in the data warehouse
- Highly skilled in SQL, Python, Spark, AWS S3, Hive Data Catalog, Parquet, Redshift, Airflow, and Tableau or similar tools
- Proven experience in building a Custom Enterprise Data Warehouse or implementing tools like Data Catalogs, Spark, Tableau, Kubernetes, and Docker
- Knowledge of infrastructure requirements such as Networking, Storage, and Hardware Optimization with hands-on experience inAmazon Web Services (AWS)
- Strong verbal and written communications skills are a must and should work effectively across internal and external organizations and virtual teams
- Demonstrated industry leadership in the fields of Data Warehousing, Data Science, and Big Data related technologies
- Strong understanding of distributed systems and container-based development using Docker and Kubernetes ecosystem
- Deep knowledge of data structures and algorithms
- Experience working in large teams using CI/CD and agile methodologies.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Data warehouse Architect / ConsultantEmployement Type: Full timeContact Details:
Company: Litmus7 SystemsLocation(s): Kochi
Keyskills: container algorithms distribution system data warehousing data structures hive continuous integration kubernetes python amazon redshift airflow ci/cd sql docker nosql spark streaming productionizing data modeling spark kafka etl big data aws
Similar positions
Litmus7 Systems
Litmus7 is a technology company with a 100% focus on retail. We build, transform, enhance, and support platforms that enable the retailers' digital commerce business. With one of a kind micro-vertical practices in grocery, general merchandise, fashion, beauty, and pet products, the biggest different...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in