Sr Technical Lead (Tools & Automation)

Job Summary

We are looking for an experienced Prometheus L3 (SME) with deep hands-on expertise in Prometheus and Grafana to maintain, optimise, and continuously improve monitoring and observability platforms. The role owns the overall health/availability/configurations of Prometheus & Grafana solutions and drives proactive monitoring, alerting hygiene, and platform reliability improvements.

Key Responsibilities

Key Responsibilities 1) Prometheus & Grafana Platform Administration Configure, maintain, and scale Prometheus and Grafana instances for reliability and performance. Build and maintain custom dashboards for key service and infrastructure metrics Troubleshoot platform issues, validate metric integrity/data accuracy, and optimise query performance. 2) Monitoring, Alerting & Signal Quality (Noise Reduction) Design, implement, and manage alerting rules to identify issues proactively and reduce false positives/noise. Continuously improve monitoring coverage as services

Skill Requirements

Required Skills (Must Have)Strong hands-on experience in Prometheus administration (scraping, service discovery, relabeling basics, recording/alert rules, exporters ecosystem).(Skill expectations based on Prometheus/Grafana SME scope)

Strong hands-on experience in Grafana (dashboard design, templating, variables, query optimisation).

Proficiency in building custom dashboards and writing/optimising queries for operational use-cases. Solid understanding of monitoring best practices, alerting strategy, and time-series storage considerations.

Scripting/automation skills for efficient system management (e.g., Bash/Python/PowerShell or equivalent). 

Other Requirements

Experience & Qualifications

• 5+ years in SRE/Platform/Monitoring/Observability roles with L3 responsibilities (or equivalent depth of expertise).
• Experience operating monitoring platforms for production environments (availability, performance, incident response).

Good to Have

• Kubernetes/cloud-native monitoring exposure (Prometheus widely used for cloud-native/Kubernetes monitoring).
• Familiarity with long-term metrics storage or scaling patterns (e.g., federation/remote-write concepts)(optional depending on your stack)
• Experience integrating alerting with ITSM/on-call workflows_(PagerDuty/Opsgenie/ServiceNow etc., as applicable)_

Operational Expectations

• Participate in on-call/major-incident bridge support as the Prometheus/Grafana SME for critical situations.
• Work within a tiered support model (Tier1–Tier3) with strong escalation and governance discipline.