Data Engineer-Lead/Architect
- Tredence
- 8 - 13 years
- Pune
- 2 months ago
- Email to a friend
- Report this job
Job Description
Experience Level: 8+ Years
Loc: Bangalore/Chennai/Pune/Kolkata/Gurugram
Role & responsibilities
- Bachelor's and/or masters degree in computer science or equivalent experience.
- Must have total 8+ yrs. of IT experience and experience in Data warehouse/ETL projects.
- Deep understanding of Star and Snowflake dimensional modelling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in AWS/ Azure stack
- Desirable to have ETL with batch and streaming (Kinesis).
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / event-based data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detail.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full timeContact Details:
Company: TredenceLocation(s): Pune+ View Contact
Keyskills: Azure Databricks Pyspark Spark ETL SQL
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Tredence
Founded in 2000, Chetu is a global leader in providing tailored software development solutions and support services. Chetu\\\\\\\'s dedicated team of technology professionals offers an extensive array of software solutions, including custom application development, enterprise software integration, m...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in