The Job

Senior Design Lead

Teknik, data och digitalt · Data, AI och analys · Data engineering · Molnteknik · Mjukvaruutveckling

Gå med för uppdateringar

I korthet

We are looking for an experienced ETL Architect to design, build, and govern large-scale data processing platforms on AWS. The role requires deep expertise in AWS technologies like EC2 and EMR, big data technologies such as Apache Spark, and experience with Parquet and Avro data formats for high-performance data pipelines.

Ansvarsområden

  • Design, build, and govern large-scale data processing platforms on AWS.
  • Develop high-performance data pipelines supporting analytics and business-critical workloads.
  • Implement data ingestion frameworks, batch and streaming processing, and data quality frameworks.
  • Establish data governance practices including data lineage, data cataloging, dataset versioning, metadata management, and audit controls.

Krav

  • Experienced ETL Architect with deep expertise in designing and building large-scale data processing platforms on AWS.
  • Strong hands-on experience with Amazon EC2, Amazon EMR, Apache Spark.
  • Proficiency in data lake architectures and enterprise ETL frameworks.
  • Strong hands-on experience with Parquet and Avro data formats.
  • Experience with schema management, data versioning, and high-performance data pipelines.
  • Familiarity with batch & streaming processing and data quality frameworks.
  • Knowledge of data governance principles: data lineage, data cataloging, dataset versioning, metadata management, and audit & compliance controls.
  • Programming skills in Python and SQL.
  • Understanding of Data Warehouse Concepts.

Önskade kvalifikationer

  • Experience with Scala and Scala Spark is preferred.
  • Experience with AWS Glue is preferred.
  • Understanding of Hadoop ecosystem fundamentals.

Förmåner

  • Supercharge your potential at HCLTech.
  • Find your career and spark.
  • A place that puts its people first.
  • Work for a global technology company with over 223,000 people across 60 countries.
  • Deliver industry-leading capabilities in digital, engineering, cloud, and AI.
  • Work with clients across major verticals including Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services.
#ETL Architect#data processing platforms#AWS#data lake architectures#enterprise ETL frameworks#data pipelines#analytics#business-critical workloads#Parquet#Avro#schema management#data versioning#data ingestion#batch processing#streaming processing#data quality#data governance#data lineage#data cataloging#metadata management#audit#compliance#Python#Scala#SQL#data warehousing
HCLTech Logo

Företag

HCLTech

Publicerade jobb

för 2 veckor sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Senior

Platser

Bangalore, India

Sökande

Ansök tidigt