Staff Software Engineer, Cloud ML Compute Services

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
The Cloud ML Compute Services team is building the next generation of on-premise AI infrastructure to empower AI solution builders globally. We design fully integrated AI systems—spanning hardware, software, and workload management—to optimize large-scale training and inference workloads. Our mission is to enable seamless production operations for our customers while maintaining comprehensive visibility into the hardware health of Google's global fleet. Join us to build a brand-new product in a fast-paced environment and help shape the future of AI acceleration, cluster interconnects, and networking.
Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits
Learn more about
benefits at Google
.

Minimum qualifications
Bachelor's degree or equivalent practical experience.
8 years of experience programming in C++.
5 years of experience testing, and launching software products.
5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
3 years of experience with software design and architecture.

Preferred qualifications
Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

Responsibilities
Set the strategic direction and technical roadmap to build scalable, next-generation on-premise AI infrastructure and compute services.
Guide the design and development of complex cloud and systems-level infrastructure, spanning the entire hardware and software stack, including low-level software, OS, firmware, and networking.
Act as a technical leader within a newly formed team to mentor and grow software engineers, successfully scoping bold, ambiguous problems into tractable projects.
Define and implement clear success metrics, integrating service level objectives (SLOs), telemetry, and logs to ensure seamless production operations and continuous improvement.
Take central ownership of system troubleshooting and diagnostics, leading specialized efforts to resolve complex technical issues and build automated repair systems for the global fleet.