Senior Technical Architect

Technology, Data & Digital · Data, AI & Analytics · Data Engineering

In short

Senior Technical Architect specializing in Azure Databricks is needed to design, build, and optimize scalable data platforms and analytics solutions on Microsoft Azure. This role involves architecting end-to-end data pipelines, ensuring data governance, and enabling advanced analytics and AI solutions. Requires strong experience with Azure services, big data architecture, SQL, Python, and DevOps practices.

Responsibilities

Design and implement scalable data architectures using Azure services
Build and optimize ETL/ELT pipelines using Azure Databricks and Apache Spark
Architect data lake and data warehouse solutions using Azure Data Lake and Azure Synapse Analytics
Define data modeling strategies (batch & real-time processing)
Ensure data security, governance, and compliance standards
Collaborate with stakeholders to understand business requirements and translate them into technical solutions
Optimize performance and cost efficiency of data workloads
Implement CI/CD pipelines for data engineering workflows
Mentor and guide data engineers and development teams
Integrate advanced analytics, AI, and ML solutions when required

Requirements

2-4 years of Architect Exp is mandatory
Strong experience with Azure Databricks and Spark (PySpark/Scala)
Hands-on experience with Azure services (ADF, ADLS, Synapse, Event Hub)
Expertise in big data architecture and distributed systems
Strong knowledge of SQL, Python, and data engineering concepts
Experience with data modeling techniques (star schema, dimensional modeling)
Understanding of real-time streaming (Kafka/Event Hub)
Knowledge of DevOps and CI/CD practices
Analytical Skills & Problem Solving
Stake Holder Management

Desired Qualifications

Data Engineering Foundations
SQL
Apache Spark (Core)
PySpark
Databricks Platform
Delta Lake / Lakehouse Patterns
Orchestration & Scheduling
Python (Core for Data)
Data Quality & Testing
Security & Governance
Cost & Performance Optimization

Benefits

You'll supercharge your potential
You'll find your career
You'll find your spark
A place that knows that helping its customers stay on top starts by putting its people first.

Skills

Azure DatabricksApache SparkPySparkScalaAzureAzure Data FactoryAzure Data LakeAzure Synapse AnalyticsSQLPythonKafkaEvent HubDevOpsCI/CDDelta LakeUnity CatalogMLflowREST APIsGreat ExpectationsGitHub ActionsJenkinsMicrosoft Azure

#Data Engineering#Azure Databricks#ETL/ELT#Apache Spark#Azure Data Lake#Azure Synapse Analytics#Data Modeling#Data Governance#AI#ML#DevOps#CI/CD#SQL#Python#Streaming#Kafka#Event Hub#Cloud#Big Data#Architecture

About HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

See all open jobs at HCLTech Read more about HCLTech Website