The Job

Azure Data Technical Specialist

Technology, Data & Digital · Data, AI & Analytics · Data Engineering · Data Analysis

Join for updates

In short

We are looking for a SQL-focused Data Engineer/Developer with Databricks expertise to design, optimize, and manage data pipelines. The role emphasizes query performance tuning, scalability, and efficient data processing on Azure. Responsibilities include developing SQL queries, stored procedures, and data pipelines, alongside optimizing Spark jobs and Delta Lake. Experience with Azure, Python/PySpark, and Git is preferred.

Responsibilities

  • Develop, optimize, and maintain SQL queries, stored procedures, and data pipelines.
  • Design scalable and efficient data processing solutions using Databricks.
  • Work with large-scale structured and semi-structured datasets.
  • Ensure data quality, integrity, and reliability across systems.
  • Collaborate with data analysts, engineers, and business stakeholders.
  • Support data migration, transformation, and integration initiatives.

Requirements

  • Hands-on experience with Azure Databricks / Databricks Lakehouse platform.
  • Strong knowledge of Apache Spark (SQL & PySpark).
  • Strong knowledge of Delta Lake architecture.
  • Experience building ETL/ELT data pipelines.
  • Experience building data transformations using Spark.
  • Familiarity with Notebooks, clusters, jobs, and workflows.
  • Understanding of data lake and medallion architecture (Bronze, Silver, Gold layers).
  • Optimize SQL queries for performance using indexing, query execution plan analysis, partitioning, and data distribution techniques.
  • Improve data processing efficiency in Databricks via Spark job optimization (partitioning, caching, broadcast joins) and Delta Lake optimizations (Z-ordering, vacuum, optimize commands).
  • Identify and resolve performance bottlenecks in pipelines and queries.
  • Reduce query runtime and resource utilization.

Desired Qualifications

  • Experience with cloud platforms (Azure preferred).
  • Knowledge of ETL tools and pipelines.
  • Familiarity with Python / PySpark.
  • Exposure to CI/CD pipelines and version control (Git).
  • Understanding of big data frameworks and distributed systems.

Benefits

  • Supercharge your potential at HCLTech.
  • Find your career at HCLTech.
  • Find your spark at HCLTech.
  • HCLTech knows that helping its customers stay on top starts by putting its people first.
#data pipelines#SQL#Databricks#performance tuning#scalability#data processing#query performance#Azure
HCLTech Logo

Company

HCLTech

Job Posted

3 weeks ago

Employment Type

Full Time

WorkMode

On Site

Experience Level

Mid-Senior

Locations

Chennai, India

Applicants

Be an early applicant