The Job

Data QA Engineer (GCP / BigQuery)

Teknik, data och digitalt · Data, AI och analys · Data engineering · QA och testning

Gå med för uppdateringar

I korthet

We are seeking a Data QA Engineer to validate data engineering solutions built on Google Cloud Platform (GCP). The role focuses on testing ETL/ELT pipelines and data transformations using SQL and Python, ensuring data correctness and adherence to business rules. Experience with BigQuery, GCS, and automated testing frameworks is required.

Ansvarsområden

  • Validate ETL/ELT pipelines, transformation logic, and data processing workflows.
  • Develop SQL-based test cases and reconciliation queries using BigQuery.
  • Compare outputs from new pipelines and transformations against trusted reference datasets.
  • Perform source-to-target validation, regression testing, and functional testing of data engineering artifacts.
  • Design, develop, and maintain automated test scripts and reusable validation frameworks using Python.
  • Execute test plans, record test results, and report defects.
  • Collaborate with Data Engineers to clarify requirements, validate fixes, and ensure successful delivery.
  • Contribute to the continuous improvement of QA processes, automation frameworks, and testing standards.

Krav

  • Strong SQL expertise with hands-on experience in BigQuery.
  • Strong Python programming skills for test automation.
  • Experience with Google Cloud Platform (GCP), including BigQuery and GCS.
  • Strong understanding of ETL/ELT processes, data transformations, and data warehousing concepts.
  • Familiarity with Backend Kafka and API.
  • Experience in data validation, reconciliation testing, and regression testing.
  • Familiarity with Git, CI/CD pipelines, and automated testing frameworks.
  • 6 – 10 years of experience in Data QA, ETL Testing, or Data Test Automation.
  • Experience testing cloud-based data engineering solutions, preferably on GCP.

Önskade kvalifikationer

  • Exposure to Cloud Composer, Dataflow, or Dataproc is desirable.
#Data QA#ETL Testing#Data Test Automation#GCP#BigQuery#SQL#Python#Cloud
HCLTech Logo

Företag

HCLTech

Publicerade jobb

för 2 veckor sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Senior

Platser

Chennai, India

Sökande

Ansök tidigt