Senior Technical Lead

Teknik, data och digitalt · Data, AI och analys · Data engineering

I korthet

We are seeking a skilled Data Engineer with hands-on experience in Apache Spark, SQL, and Database technologies to design, develop, and maintain scalable data pipelines and data processing solutions. The candidate will work closely with data architects, business analysts, and analytics teams to enable efficient data ingestion, transformation, and delivery for enterprise reporting and analytics platforms.

Ansvarsområden

  • Design, develop, and maintain scalable ETL/ELT pipelines using Spark.
  • Build robust data ingestion frameworks for structured and semi-structured data.
  • Develop and optimize batch and near real-time data processing workflows.
  • Troubleshoot and resolve data pipeline failures and performance bottlenecks.
  • Write complex SQL queries, stored procedures, and data transformation logic.
  • Design and optimize database schemas, tables, partitions, and indexes.
  • Perform query tuning and performance optimization for large datasets.
  • Ensure data integrity, consistency, and quality across source and target systems.

Krav

  • Hands-on experience in Apache Spark, SQL, and Database technologies.
  • Skilled in designing, developing, and maintaining scalable data pipelines and data processing solutions.
  • Experience working closely with data architects, business analysts, and analytics teams.
  • Proficiency in building robust data ingestion frameworks for structured and semi-structured data.
  • Experience in developing and optimizing batch and near real-time data processing workflows.
  • Ability to troubleshoot and resolve data pipeline failures and performance bottlenecks.
  • Experience writing complex SQL queries, stored procedures, and data transformation logic.
  • Experience designing and optimizing database schemas, tables, partitions, and indexes.
  • Experience in query tuning and performance optimization for large datasets.
  • Ability to ensure data integrity, consistency, and quality across source and target systems.
#Data Engineering#ETL#Spark#SQL#Database
HCLTech Logo

Företag

HCLTech

Publicerade jobb

för 2 veckor sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Senior

Platser

Bangalore, India

Sökande

Ansök tidigt