Technical Architect

Technology, Data & Digital · Data, AI & Analytics · Data Engineering · Artificial Intelligence

In short

We are looking for a Technical Architect with extensive experience in Data Engineering and Architecture, particularly within the Databricks ecosystem. The role involves designing end-to-end data architectures, leading AI innovation with a focus on Agentic AI and LLM orchestration, and optimizing Databricks platform efficiency through FinOps practices. Experience in the insurance or FinServ sector is highly desirable.

Responsibilities

Design and govern end-to-end data architectures on the Databricks Data Intelligence Platform.
Lead the design of emerging AI workflows, specifically focusing on Agentic AI, LLM orchestration, and RAG patterns.
Own the platform’s efficiency by implementing cluster policies, Photon engine optimisations, and cost-attribution models.
Standardise data engineering templates and implement robust data modelling to handle insurance data.
Translate complex insurance concepts into scalable technical schemas and AI logic.
Ensure all designs comply with industry regulations using Databricks Unity Catalog.

Requirements

8+ years in Data Engineering/Architecture.
At least 3+ years of hands-on leadership within the Databricks ecosystem.
Expert-level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.
Proven experience building and deploying AI solutions.
Deep understanding of the Agentic AI landscape.
Specific experience in Databricks cost management, instance selection, and performance tuning.
Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
Prior experience in the Insurance or FinServ sector is highly preferred.

Desired Qualifications

Understanding the nuances of policy-centric data.

Benefits

Supercharge your potential.
Find your career.
Find your spark.
A place that knows that helping its customers stay on top starts by putting its people first.
Work with clients across all major verticals including Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services.

Skills

PySparkScalaDelta LakeDatabricks SQLSpark frameworkAgentic AILangChainLlamaIndexRAGDatabricksETLELTStar SchemaSnowflake SchemaVault 2.0Unity Catalog

#Technical Architect#Data Engineering#Architecture#Databricks#Spark#AI#Agentic AI#LLM#FinOps#Data Modeling#ETL#ELT#Insurance

About HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

See all open jobs at HCLTech Read more about HCLTech Website