Track Lead - Extract Transform Load (ETL), Data Lakes

Teknik, data och digitalt · Data, AI och analys · Data engineering

I korthet

We are seeking a Senior Data Engineer with Databricks, SQL, and data warehousing expertise to lead an Oracle data warehouse migration to Databricks on the Allianz Data Platform (ADP). Responsibilities include designing target models, building ETL/ELT pipelines, translating SQL logic, ensuring data quality, and collaborating with stakeholders.

Ansvarsområden

Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETL–generated structures) and design the target model in Databricks.
Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks.
Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation.
Ensure data quality, performance, and reliability of the new Databricks-based data warehouse, enabling downstream analytics and AI/ML use cases.
Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices.
Document migration patterns, data models, and operational procedures to support long-term maintainability and reusability.

Krav

Graduate or Postgraduate in Engineering or a Post graduate in non-engineering disciplines.
Experience of 5-9 years of experience in ITIL process/application support/Deployment activities.
Basic knowledge on database
Strong hands-on experience with Databricks (Spark SQL, PySpark, Delta Lake, jobs, clusters).
Proven background in data warehousing (dimensional modelling, ETL/ELT, performance tuning).
Solid experience with Oracle DWH (SQL, PL/SQL) and migrations from Oracle or similar legacy DWH platforms.
Experience integrating PostgreSQL as a data source into a central DWH/Lakehouse.
Ability to reverse-engineer existing ETL logic (e.g. SAS jobs) and translate it into Databricks pipelines, even if not directly working on SAS BI reports.
Strong communication and stakeholder management skills in an international, multi-vendor setup.
Good understanding of how high-quality, well-modelled data underpins advanced analytics and AI/ML capabilities.
Strong Analytical, Logical and Communication Skills (written, oral, one to one etc).
Professional, Innovative, Drive for continuous improvement.
Positive attitude, proactively provides solutions.

Förmåner

At HCLTech, you'll supercharge your potential.
You'll find your career.
And you'll find your spark.
All at a place that knows that helping its customers stay on top starts by putting its people first.

Färdigheter

DatabricksSQLData WarehousingETLELTSpark SQLPySparkOraclePL/SQLPostgreSQLSASDelta Lake

#ETL#Data Lakes#Databricks#SQL#Data Warehousing#Spark SQL#PySpark#Oracle#PL/SQL#PostgreSQL#SAS#Delta Lake

Om HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

Se alla lediga jobb hos HCLTech Läs mer om HCLTech Webbplats