Coinbase
Staff
Staff Engineer owning Coinbase's company-wide LLM Gateway and agent runtime platform
Coinbase is hiring a Staff Software Engineer for its AI Platform team to own the architecture of the company's single path to LLMs — the LLM Gateway (60+ models), agent runtime with microVM sandboxes and governed MCP gateway, Knowledge Base infrastructure, and AI FinOps spend governance. This is a multi-quarter, org-wide platform ownership role requiring deep LLM/agent infrastructure expertise plus Python and a systems language.
Step into this interview
Free · a live voice mock calibrated to this exact role
What this interview tests
- LLM gateway architecture: multi-model routing, auth, PII redaction, fallbacks, cost optimization
- Agent runtime infrastructure: microVM sandboxing, governed MCP gateway
- Knowledge base / vector database infrastructure design
- AI FinOps: spend attribution and cost governance across AI workloads
- Evaluation and observability: LLM-as-judge, tracing, feedback loops
- Leading multi-quarter, Staff-level initiatives cross-functionally with security/legal/finance
Common question themes
Design an LLM gateway that routes across 60+ models with fallback and cost controls
How would you build a governed MCP gateway for agent tool access with security in the loop
Tell me about leading a multi-quarter platform initiative end-to-end
How do you approach cost attribution/FinOps for shared AI infrastructure
Describe an LLM-as-judge or agent evaluation system you've built
How have you partnered with security/legal teams to ship a production-grade AI system
Related interviews
Coinbase
Senior
Senior Software Engineer - Data Platform
Coinbase
Mid
Regional Threat Assessment Manager
Coinbase
Mid
Analytics Engineer, Compliance Data
Cohere
Senior
Senior Software Engineer, Agent Infrastructure
Figma
Senior
Software Engineer, AI Platforms
Brex
Staff