Senior Technical Lead
Teknik, data och digitalt · IT-infrastruktur och säkerhet · DevOps · Data engineering
I korthet
Senior Technical Lead wanted in Pune, India, to design, build, and operate a scalable data platform with a focus on Databricks and Azure. Key responsibilities include automating resource provisioning with Terraform, implementing CI/CD pipelines, and driving FinOps integration.
Ansvarsområden
- Automate the provisioning of Databricks and Azure platform resources using Terraform, adhering to Infrastructure-as-Code (IaC) best practices.
- Design and develop reusable, modular Terraform components for scalable and maintainable deployments within the Databricks platform.
- Implement and maintain CI/CD pipelines using Azure DevOps for automated infrastructure and platform deployments.
- Provision new infrastructure using customized Databricks Terraform modules for standardized and governed deployments of catalogs, job policies, and clusters.
- Enable self-service infrastructure provisioning by integrating ServiceNow with automated workflows to generate pull requests for new Databricks resources.
- Troubleshoot and resolve platform-related issues, ensuring high availability through proactive monitoring of Azure quota limits, cluster performance, resource utilization, and platform constraints.
- Drive FinOps integration by onboarding Databricks service cost data into the FinOps (Umbrella) system for cost monitoring, reporting, and optimized resource usage.
- Stay up to date with industry best practices and emerging technologies, especially Terraform (Azure Provider, Databricks Provider).
Krav
- Degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Platform Engineer/Cloud Engineer or similar role.
- Strong understanding of cloud platforms (preferably Microsoft Azure) and their services.
- Good knowledge of infrastructure as code (IaC) using Terraform.
- Experience with Azure Data Lake Gen2 setup using Terraform.
- Knowledge in data management (e.g. archiving, backup) and the setup of interfaces between systems along with authentication mechanisms.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
- Strong communication and collaboration skills.
- Excellent English skills.
Önskade kvalifikationer
- Familiarity with Databricks Provider is an advantage.
- German skills are a bonus.
- Certifications in Microsoft Azure or Databricks are welcome.
Förmåner
- Global technology company with over 223,000 people across 60 countries.
- Opportunities to work with clients across all major verticals.
- Consolidated revenues of $14.8 billion as of 12 months ending June 2026.
#Data Platform#Databricks#Azure#Terraform#Infrastructure as Code#CI/CD#Azure DevOps#FinOps#ServiceNow#Data Engineering#Cloud Automation#Analytics#AI