Azure Data Technical Specialist
Teknik, data och digitalt · Data, AI och analys · Data engineering · DevOps · Mjukvaruutveckling
I korthet
We are looking for an experienced Azure Data Engineer to design, develop, and support enterprise-grade data integration solutions on Microsoft Azure. The role involves building scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure DevOps, requiring collaboration with architects and stakeholders to deliver robust cloud-based data solutions.
Ansvarsområden
- Design, develop, and maintain Azure Data Factory (ADF) pipelines for data ingestion, transformation, and orchestration.
- Develop Azure Databricks notebooks using PySpark and Spark SQL for large-scale data processing.
- Build and optimize ETL/ELT pipelines to ingest data from SQL Server and other enterprise data sources into Azure Data Lake.
- Implement data movement between Development, UAT, ADP, and Production environments.
- Perform data transformation, cleansing, validation, and reconciliation activities.
- Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Develop reusable frameworks and coding standards for data engineering solutions.
- Collaborate with Solution Architects during solution design and implementation.
- Support Azure DevOps-based CI/CD implementation, repository management, branching strategies, and release deployments.
- Create and maintain technical documentation, deployment guides, and operational runbooks.
- Participate in code reviews and ensure adherence to development standards and best practices.
- Troubleshoot production issues and provide timely resolution.
- Support compliance activities, including IAM, SDF, RACE, and security reviews.
- Work closely with business users, project managers, architects, and infrastructure teams throughout the project lifecycle.
Krav
- Microsoft Azure Data Factory (ADF)
- Azure Databricks
- PySpark
- Spark SQL
- Azure Data Lake Storage Gen2 (ADLS)
- Azure SQL Database / SQL Server
- Azure DevOps (Repos, Pipelines, CI/CD)
- Git Version Control
- SQL Programming
- ETL/ELT Development
- Data Integration
- Performance Tuning and Optimization
- Data Modelling
- Azure Monitor and Log Analytics
- REST API integration
Önskade kvalifikationer
- Unity Catalog
- Delta Lake
- Microsoft Fabric (Good to Have)
- Synapse Analytics (Good to Have)
- Power BI integration
- Infrastructure as Code (Terraform/Bicep)
- Python scripting
- Agile/Scrum methodology
- Insurance or Reinsurance domain experience is preferred.
- Experience working in enterprise cloud migration and modernization projects.
- Exposure to financial or actuarial data platforms will be an added advantage.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management.
- Ability to work independently with minimal supervision.
- Strong collaboration and teamwork.
- Ability to work in a global delivery model.
Förmåner
- Supercharge your potential at HCLTech.
- Find your career and spark at a place that puts people first.
- Global technology company with over 223,000 people in 60 countries.
- Industry-leading capabilities in digital, engineering, cloud, and AI.
- Diverse client base across major verticals including Financial Services, Manufacturing, Life Sciences, Healthcare, Technology, Telecom, Media, Retail, CPG, and Public Services.
#Azure#Data Engineering#Data Integration#ETL#ELT#Cloud#Microsoft Azure#Azure Data Factory#Azure Databricks#PySpark#Spark SQL#Azure Data Lake Storage Gen2#Azure DevOps#CI/CD#Data Platform#Insurance