Test Lead
Technology, Data & Digital · Data, AI & Analytics · Data Engineering · QA & Testing · Data Analysis
In short
We are seeking a detail-oriented Test Lead in Nagpur, India, to validate ETL/ELT pipelines built on a Medallion Architecture. You will ensure data accuracy and integrity, working closely with data engineers and analysts to deliver trustworthy, production-ready data. This role requires strong SQL proficiency, experience with data warehousing concepts, and familiarity with testing tools like JIRA.
Responsibilities
- Design, develop, and execute test cases for ETL/ELT pipelines across Bronze, Silver, and Gold layers.
- Validate data ingestion, transformation logic, and business computations.
- Perform source-to-target data validation and reconciliation.
- Conduct row-count checks, checksum validation, referential integrity checks, and duplicate/null value analysis.
- Validate incremental loads, CDC, and SCD logic.
- Test data pipeline jobs orchestrated through tools like Databricks, Azure Data Factory, Apache Airflow, or Informatica.
- Write and execute SQL queries to validate large datasets across data lakes and warehouses.
- Identify, document, and track defects using JIRA.
- Develop reusable test scripts and frameworks for automating regression testing.
- Validate data lineage, metadata, and audit/logging mechanisms.
- Participate in Agile ceremonies and contribute to test strategy documentation.
- Perform performance and load testing on large-volume data pipelines.
Requirements
- Bachelor's degree in Computer Science, Information Systems, or equivalent experience.
- 7+ years of experience in ETL/data testing, with hands-on exposure to Medallion Architecture.
- Strong proficiency in SQL for complex data validation and reconciliation queries.
- Understanding of data warehousing concepts (fact/dimension tables, star/snowflake schemas, SCD types).
- Experience with test management and defect tracking tools (JIRA, TestRail, qTest).
- Basic scripting skills in Python or PySpark for test automation.
- Strong analytical skills and attention to detail.
- Excellent communication skills.
- Experience testing pipelines built on Databricks, Apache Spark, and Delta Lake.
- Familiarity with cloud data platforms: Azure (ADF, Synapse), AWS (Glue, Redshift), or GCP (BigQuery, Dataflow).
Desired Qualifications
- Knowledge of data quality frameworks and tools, such as Great Expectations, dbt tests, or Deequ, is a plus.
- Experience with CI/CD pipelines for data testing, such as Azure DevOps, Jenkins, or GitHub Actions.
- Exposure to data cataloging and lineage tools, including Unity Catalog, Purview, or Collibra.
- Familiarity with BI tools such as Power BI or Tableau to validate Gold-layer reporting outputs.
- Prior experience in a regulated industry (finance, healthcare, insurance) with data governance requirements.
- Certification in Databricks, Azure Data Engineering, or a similar discipline.
Benefits
- Supercharge your potential at HCLTech.
- Find your career and your spark.
- A place that puts its people first.
- Be part of a global technology company with a broad portfolio of services and products.
#ETL#Data Pipeline#Medallion Architecture#Data Quality#Data Engineering#Testing#SQL#Databricks#Snowflake#BigQuery#Agile