The Job

Azure Data Technical Specialist

Teknik, data och digitalt · Data, AI och analys · Data engineering · Dataanalys

Gå med för uppdateringar

I korthet

We are looking for a SQL-focused Data Engineer/Developer with Databricks expertise to design, optimize, and manage data pipelines. The role emphasizes query performance tuning, scalability, and efficient data processing on Azure. Responsibilities include developing SQL queries, stored procedures, and data pipelines, alongside optimizing Spark jobs and Delta Lake. Experience with Azure, Python/PySpark, and Git is preferred.

Ansvarsområden

  • Develop, optimize, and maintain SQL queries, stored procedures, and data pipelines.
  • Design scalable and efficient data processing solutions using Databricks.
  • Work with large-scale structured and semi-structured datasets.
  • Ensure data quality, integrity, and reliability across systems.
  • Collaborate with data analysts, engineers, and business stakeholders.
  • Support data migration, transformation, and integration initiatives.

Krav

  • Hands-on experience with Azure Databricks / Databricks Lakehouse platform.
  • Strong knowledge of Apache Spark (SQL & PySpark).
  • Strong knowledge of Delta Lake architecture.
  • Experience building ETL/ELT data pipelines.
  • Experience building data transformations using Spark.
  • Familiarity with Notebooks, clusters, jobs, and workflows.
  • Understanding of data lake and medallion architecture (Bronze, Silver, Gold layers).
  • Optimize SQL queries for performance using indexing, query execution plan analysis, partitioning, and data distribution techniques.
  • Improve data processing efficiency in Databricks via Spark job optimization (partitioning, caching, broadcast joins) and Delta Lake optimizations (Z-ordering, vacuum, optimize commands).
  • Identify and resolve performance bottlenecks in pipelines and queries.
  • Reduce query runtime and resource utilization.

Önskade kvalifikationer

  • Experience with cloud platforms (Azure preferred).
  • Knowledge of ETL tools and pipelines.
  • Familiarity with Python / PySpark.
  • Exposure to CI/CD pipelines and version control (Git).
  • Understanding of big data frameworks and distributed systems.

Förmåner

  • Supercharge your potential at HCLTech.
  • Find your career at HCLTech.
  • Find your spark at HCLTech.
  • HCLTech knows that helping its customers stay on top starts by putting its people first.
#data pipelines#SQL#Databricks#performance tuning#scalability#data processing#query performance#Azure
HCLTech Logo

Företag

HCLTech

Publicerade jobb

för 3 veckor sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Mellannivå

Platser

Chennai, India

Sökande

Ansök tidigt