Big Data Lead
- IQVIA
- 8 - 13 years
- Bengaluru
- 9 months ago
- Email to a friend
- Report this job
Job Description
Job Title / Primary Skill: Big Data Developer (Lead/Associate Manager)
Management Level: G150
Years of Experience: 8 to 13 years
Job Location: Bangalore (Hybrid)
Must Have Skills: Big data, Spark, Scala, SQL, Hadoop Ecosystem.
Educational Qualification: BE/BTech/ MTech/ MCA, Bachelor or masters degree in Computer Science,
Job Overview
Overall Experience 8+ years in IT, Software Engineering or relevant discipline.
Designs, develops, implements, and updates software systems in accordance with the needs of the organization.
Evaluates, schedules, and resources development projects; investigates user needs; and documents, tests, and maintains computer programs.
Job Description:
We look for developers to have good knowledge of Scala programming skills and Knowledge of SQL
Technical Skills:
- Scala, Python -> Scala is often used for Hadoop-based projects, while Python and Scala are choices for Apache Spark-based projects.
- SQL -> Knowledge of SQL (Structured Query Language) is important for querying and manipulating data
- Shell Script -> Shell scripts are used for batch processing of data, it can be used for scheduling the jobs and shell scripts are often used for deploying applications
- Spark Scala -> Spark Scala allows you to write Spark applications using the Spark API in Scala
- Spark SQL -> It allows to work with structured data using SQL-like queries and Data Frame APIs.
- We can execute SQL queries against Data Frames, enabling easy data exploration, transformation, and analysis.
The typical tasks and responsibilities of a Big Data Developer include:
1. Data Ingestion: Collecting and importing data from various sources, such as databases, logs, APIs into the Big Data infrastructure.
2. Data Processing: Designing data pipelines to clean, transform, and prepare raw data for analysis. This often involves using technologies like Apache Hadoop, Apache Spark.
3. Data Storage: Selecting appropriate data storage technologies like Hadoop Distributed File System (HDFS), HIVE, IMPALA, or cloud-based storage solutions (Snowflake, Databricks).
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA, Role Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: IQVIALocation(s): Bengaluru
Keyskills: SCALA Big Data Spark Hive Apache Pig Hadoop Hadoop Development Mapreduce Hdfs Impala YARN
Similar positions
IQVIA
IQVIA Healthcare is an industry designed to help humans. As a global community, we continuously invest and commit to advancing human health. To deliver value and real outcomes. To rise to the challenge to find the next breakthrough by making the most of increasingly limited resources.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in