Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead/Senior Big Data Tester_Exp: 7+ Years @ Atyeti

Home > Quality Assurance and Testing

 Lead/Senior Big Data Tester_Exp: 7+ Years

Job Description

Roles & Responsibilities

  • Perform Big Data Testing to ensure data accuracy, completeness, and consistency across distributed systems.
  • Validate data ingestion, transformation, and processing using SQL, Hive, and Spark.
  • Execute source-to-target data validation including record counts, null checks, and data type validation.
  • Write and execute complex SQL/Hive queries to validate large datasets.
  • Develop and execute test plans, test cases, and test scripts.
  • Validate Data Lake and Enterprise Data Warehouse applications.
  • Perform performance and scalability testing for large data volumes.
  • Support data migration testing and collaborate in an Agile environment.

Required Skills

  • 5+ years of experience in Big Data Testing
  • Strong expertise in SQL (joins, subqueries, aggregations, analytical queries)
  • Hands-on experience with:
    • Hadoop (HDFS)
    • Apache Spark
    • Hive
  • Strong knowledge of:
    • Data Warehousing concepts
    • Big Data architecture
    • Data models
  • Experience validating large-scale datasets (TBs/PBs)
  • Experience in Agile/Scrum methodology

Good to Have Skills

  • Cloud experience on AWS or GCP
    • AWS: S3, EMR, Glue
    • GCP: BigQuery, Dataflow, Dataproc
  • Data migration testing (on-prem to cloud/cloud to cloud)
  • Unix/Linux commands for data and log validation
  • Basic Python/Scala scripting for data validation

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Quality Assurance and Testing
Role: Data / Big Data Testing Engineer
Employement Type: Full time

Contact Details:

Company: Atyeti
Location(s): Pune

+ View Contactajax loader


Keyskills:   Unix Big Data/ETL Testing SQL Python Hive Big Data Testing GCP Hadoop HDFS Informatica AWS ETL Testing

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Automation Tester( 5-10 years) Infosys---R

  • Infosys
  • 5 - 10 years
  • Hyderabad
  • 7 days ago
₹ Not Disclosed

BigData Testing

  • Cognizant
  • 4 - 8 years
  • Hyderabad
  • 8 days ago
₹ Not Disclosed

Manager, Quality Business Data Engineer

  • Pfizer
  • 5 - 8 years
  • Chennai
  • 13 days ago
₹ Not Disclosed

Manager, Quality Business Data Engineer

  • Pfizer
  • 5 - 8 years
  • Mumbai
  • 13 days ago
₹ Not Disclosed

Atyeti

In the dynamic landscape of IT contingent workforce and training solutions in India, Diensten Tech Limited stands out as a leading and organized player, providing unparalleled services to esteemed clients.\\\\\\\\\\\\\\\\n\\\\\\\\\\\\\\\\nWith a robust business foundation, the company has garnered a...