Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Production AI Engineering Interview Questions (Page 2) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Production AI Engineering interview questions

Monitoring, drift, cost, and reliability.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

39 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started21.How does vLLM work?Production AI Engineering · Conceptual · 12 min

Asked %

Companies

Production AI Engineering

Conceptual

12 min

Pro feature

Hard

Not started22.What is LLM observability, and how do you implement logging and tracing for LLM applications (including finding which pipeline step fails)?Production AI Engineering · Practical exercise · 12 minAsked %CompaniesProduction AI EngineeringPractical exercise12 minPro featurePro featureMedium

Not started23.How does Ollama work?Production AI Engineering · Conceptual · 8 minAsked %CompaniesProduction AI EngineeringConceptual8 minPro featurePro featureEasy

Not started24.What is model versioning, and how do you handle model rollbacks?Production AI Engineering · Practical exercise · 10 minAsked %CompaniesProduction AI EngineeringPractical exercise10 minPro featurePro featureMedium

Not started25.How do you implement rate limiting and throttling for LLM APIs, and handle provider rate limits at peak?Production AI Engineering · Practical exercise · 12 minAsked %CompaniesProduction AI EngineeringPractical exercise12 minPro featurePro featureMedium

Not started26.Your LLM endpoint's p99 latency doubled after a deploy with no model change. How do you diagnose it?Production AI Engineering · Debugging · 12 minAsked %CompaniesProduction AI EngineeringDebugging12 minPro featurePro featureHard

Not started27.Cut LLM inference costs without hurting answer qualityProduction AI Engineering · Case study · 20 minAsked %CompaniesProduction AI EngineeringCase study20 minPro featurePro featureMedium

Not started28.How do you estimate the cost of running an AI-powered feature in production?Production AI Engineering · Practical exercise · 12 minAsked %CompaniesProduction AI EngineeringPractical exercise12 minPro featurePro featureMedium

Not started29.Diagnose high latency in an LLM chat applicationProduction AI Engineering · Debugging · 25 minAsked %CompaniesProduction AI EngineeringDebugging25 minPro featurePro featureHard

Not started30.A deployed model got worse three months after launchProduction AI Engineering · Debugging · 15 minAsked %CompaniesProduction AI EngineeringDebugging15 minPro featurePro featureMedium

Not started31.How do you manage secrets and API keys securely in LLM applications?Production AI Engineering · Practical exercise · 10 minAsked %CompaniesProduction AI EngineeringPractical exercise10 minPro featurePro featureMedium

Not started32.How do you handle model updates and provider migrations (switching LLM providers) without downtime?Production AI Engineering · Practical exercise · 12 minAsked %CompaniesProduction AI EngineeringPractical exercise12 minPro featurePro featureHard

Not started33.A model trained on normalised data gives wrong predictions on raw input. Why?Production AI Engineering · Debugging · 8 minAsked %CompaniesProduction AI EngineeringDebugging8 minPro featurePro featureMedium

Not started34.What is chunked prefill, and why does it improve tail latency under mixed traffic?Production AI Engineering · Conceptual · 10 minAsked %CompaniesProduction AI EngineeringConceptual10 minPro featurePro featureHard

Not started35.You quantized your LLM, but accuracy dropped significantly. How do you minimise quantization loss?Production AI Engineering · Debugging · 12 minAsked %CompaniesProduction AI EngineeringDebugging12 minPro featurePro featureHard

Not started36.What is prefill-decode disaggregation, and when does it pay off?Production AI Engineering · Conceptual · 10 minAsked %CompaniesProduction AI EngineeringConceptual10 minPro featurePro featureHard

Not started37.How does prompt caching work, and how do you structure prompts to benefit from it?Production AI Engineering · Conceptual · 10 minAsked %CompaniesProduction AI EngineeringConceptual10 minPro featurePro featureMedium

Not started38.What are guardrails for LLMs, and how do you implement them (including content filtering of outputs)?Production AI Engineering · Conceptual · 12 minAsked %CompaniesProduction AI EngineeringConceptual12 minPro featurePro featureMedium

Not started39.What are the key SLAs and metrics for production AI systems (latency, throughput, availability)?Production AI Engineering · Conceptual · 10 minAsked %CompaniesProduction AI EngineeringConceptual10 minPro featurePro featureMedium

Page 2 of 2