47Billion - Big Data Developer - Data @ Visa

Job Description

Position - Big Data Developer Job Overview Looking for hardworking, passionate and results-oriented individuals to join our Data To build data foundations and tools to craft the future of big data analytics platform. Required Technology Stack Experience in python programming with hands-on experience in data processing related libraries. Experience in working with Apache Spark (pyspark, spark-sql). Hands on with AWS databricks platform. Experience with Apache airflow. Experience in data visualisation tools. In-depth knowledge of big data ecosystem ( hadoop, hive, sqoop, mongodb, cassandra ) Experience in cloud technology like Azure, GCP, AWS Responsibilities Managing master data, including creation, updates, and deletion. Provide quality assurance of imported data, working with quality assurance analyst if necessary. Commissioning and decommissioning of data sets. Managing and designing the reporting environment, including data sources, security, and. metadata. Processing confidential data and information according to guidelines. Helping develop reports and analysis. Supporting the data warehouse in identifying and revising reporting requirements. Supporting initiatives for data integrity and normalization. Assessing tests, implementing new or upgraded software and assisting with strategic decisions on new systems. Generating reports from single or multiple systems. Troubleshooting the reporting database environment and reports. Evaluating changes and updates to source production systems. Training end users on new reports and dashboards. Providing technical expertise on data storage structures, data mining, and data : Ability to analyse existing tools and databases and provide software solution recommendations. High-level experience in methodologies and processes for managing large-scale databases. Demonstrated experience in handling large data sets and relational databases. Understanding of addressing and metadata standards. High-level written and verbal communication skills (ref:hirist.tech

Employement Category:

Employement Type: Full time
Industry: IT
Role Category: IT Services & Consulting
Functional Area: Not Applicable
Role/Responsibilies: 47Billion - Big Data Developer - Data

+ View Contact

Keyskills:   Apache Spark Hadoop Hive Sqoop MongoDB Cassandra Azure GCP AWS Python programming AWS Databricks Apache Airflow Data visualisation tools