The Job

Azure Senior Data Lead

Teknik, data och digitalt · Data, AI och analys · Data engineering · Datavetenskap · Mjukvaruutveckling

Gå med för uppdateringar

I korthet

A Senior Data Engineer (ETL) is sought to design, build, and optimize scalable data pipelines. This role involves owning the architecture of extraction, transformation, and loading processes to ensure data quality, reliability, and performance across data lakes and warehouses.

Ansvarsområden

  • Design and build complex, high-throughput ETL/ELT pipelines to ingest structured and unstructured data from diverse sources.
  • Structure scalable data models, data warehouses (e.g., Snowflake, BigQuery, Redshift), and data lakes to support advanced analytics and reporting.
  • Optimize SQL queries, data indexing, partitioning, and cluster configurations to reduce compute costs and pipeline latency.
  • Implement automated testing, data validation frameworks, and data lineage tracking to guarantee data integrity and compliance.
  • Automate deployment workflows using CI/CD tools (e.g., GitHub Actions, Jenkins) and orchestrate pipelines using scheduling tools (e.g., Airflow, Prefect).

Krav

  • 7+ years of dedicated data engineering experience, with a proven track record of architecting production-grade ETL pipelines.
  • Advanced proficiency in Python, Scala, or Java.
  • Expert-level SQL optimization skills.
  • Hands-on experience with distributed computing tools such as Apache Spark, PySpark, Databricks, or Hadoop.
  • Deep familiarity with cloud data ecosystems on AWS, Azure, or GCP.
  • Strong experience managing complex workflows with Apache Airflow, Dagster, or similar orchestration engines.

Önskade kvalifikationer

  • Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python would be a plus.

Förmåner

  • Supercharge your potential at HCLTech.
  • Find your career and your spark.
  • A place that knows that helping its customers stay on top starts by putting its people first.
  • Work with a global technology company with over 223,000 people across 60 countries.
  • Deliver industry-leading capabilities centered around digital, engineering, cloud and AI.
  • Work with clients across all major verticals: Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services.
#data engineering#ETL#ELT#data pipelines#data architecture#SQL#Python#Scala#Java#Apache Spark#Databricks#AWS#Azure#GCP#Apache Airflow
HCLTech Logo

Företag

HCLTech

Publicerade jobb

för 1 månad sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Senior

Platser

Bengaluru, India

Sökande

Ansök tidigt