All interviews
Google logo

Google

Senior

Serving infrastructure for Gemini models at Google DeepMind

Join Google DeepMind's team building and scaling serving infrastructure for Gemini models in New York, including large-scale streaming and audio orchestration capabilities. This role requires production ML infrastructure experience — productionizing large language and multimodal models, not just training or research prototyping — plus C++ systems chops and the ability to drive technical direction for a team. Suited for senior engineers who've shipped ML systems at real production scale.

Step into this interview

Free · a live voice mock calibrated to this exact role

Practice this interview

Likely format

Google's standard onsite loop typically includes coding, system design/ML infra design, and Googleyness/leadership behavioral rounds.

What this interview tests

  • Productionizing LLMs/multimodal models (serving, deployment, evaluation)
  • C++ for performance-critical systems
  • Algorithm/data-structure choices for scalability
  • Root-cause analysis and production debugging of ML systems
  • Software architecture for reliability and performance
  • Driving technical direction and team roadmap

Common question themes

Design a serving system for a large multimodal model with diverse client configurations

Describe debugging a production quality or latency regression in an ML system

How do you choose data structures/algorithms when scaling a system

Tell me about a technical direction or architecture decision you drove for your team

How would you build monitoring to catch model quality issues in production

Explain a large-scale streaming or real-time infrastructure challenge you've solved

View the original posting

Related interviews