Staff Software Engineer, Infrastructure, Google Cloud

Technology, Data & Digital · Software & Web Development · Software Engineering · Cloud Engineering

In short

Google is seeking a Staff Software Engineer, Infrastructure for their Google Cloud division in Bengaluru. This role involves designing, developing, and optimizing large-scale infrastructure systems, focusing on telemetry, monitoring, and logging for products like Dataproc and Managed Service for Apache Spark. The engineer will work with cross-functional teams to enhance observability and build robust monitoring systems.

Responsibilities

Design and develop systems or enhancements to existing telemetry, monitoring, and logging infrastructure to improve observability and debugging for Dataproc and Managed Service for Apache Spark.
Architect and optimize observability pipelines for Spark Streaming and Structured Streaming workloads, providing insights into micro-batch latencies, checkpointing bottlenecks, and input message lag.
Apply Apache Spark core internals knowledge to build tools that detect performance regressions, data skew, and resource inefficiencies in customer workloads.
Collaborate with cross-functional partners (e.g., Product, UX) to design and deliver intuitive monitoring dashboards, cost-attribution features, and developer tools.
Collaborate with Dataproc and Cloud Platform teams to integrate and release telemetry features, OpenTelemetry (OTel) pipelines, and diagnostic frameworks safely at scale.
Build robust monitoring systems providing visibility, execution history, and real-time performance insights into distributed big data workloads.

Requirements

Bachelor's degree or equivalent practical experience.
8 years of experience programming in C++, Python, C, C++, Java and JavaScript.
5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
5 years of experience testing, and launching software products.
Experience with a backend server infrastructure.
Understanding of algorithms and data structures, and their time and space performance.

Desired Qualifications

8 years of experience with data structures and algorithms.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

Benefits

Google is proud to be an equal opportunity and affirmative action employer.
We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
English proficiency is a requirement for all roles unless stated otherwise in the job posting.
Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc.

Skills

C++PythonJavaJavaScriptdata structuresalgorithmsOpenTelemetryApache Spark

#infrastructure#Google Cloud#Dataproc#Managed Service for Apache Spark#Spark Streaming#Structured Streaming#telemetry#monitoring#logging#observability#OpenTelemetry#Apache Spark

About Google

Innovative Full-Stack Developer | Building Scalable Solutions with Node.js & React

At Google, our mission is to organize the world's information and make it universally accessible and useful. From Search to AI, we develop products and services that improve the lives of billions, empowering individuals and businesses globally. We're driven by a passion for innovation, a commitment to solving complex problems, and a belief in the transformative power of technology. Since our founding in 1998, we've remained dedicated to creating a more helpful and connected world.

See all open jobs at Google Read more about Google Website