Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

AI Infrastructure and Scalability Interview Questions (Page 2) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Topic

AI Infrastructure and Scalability interview questions

GPUs and accelerators, inference optimisation, parallelism, serving, scaling, and cost of AI systems.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

29 problems

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started21.What is the difference between synchronous and asynchronous inference, and when do you use each?AI Infrastructure and Scalability · Conceptual · 10 minAsked %CompaniesAI Infrastructure and ScalabilityConceptual10 minPro featurePro featureMedium
Not started22.What is n-gram speculation in LLMs, and how does it speed up generation?AI Infrastructure and Scalability · Conceptual · 8 minAsked %CompaniesAI Infrastructure and ScalabilityConceptual8 minPro featurePro featureMedium
Not started23.How does GGUF work?AI Infrastructure and Scalability · Conceptual · 10 minAsked %CompaniesAI Infrastructure and ScalabilityConceptual10 minPro featurePro featureMedium
Not started24.How does a GPU work for deep learning?AI Infrastructure and Scalability · Conceptual · 12 minAsked %CompaniesAI Infrastructure and ScalabilityConceptual12 minPro featurePro featureMedium
Not started25.How do you implement request queuing and priority scheduling for AI services?AI Infrastructure and Scalability · Practical exercise · 14 minAsked %CompaniesAI Infrastructure and ScalabilityPractical exercise14 minPro featurePro featureHard
Not started26.What are the cost trade-offs between self-hosted and API-based AI inference?AI Infrastructure and Scalability · Practical exercise · 12 minAsked %CompaniesAI Infrastructure and ScalabilityPractical exercise12 minPro featurePro featureMedium
Not started27.How does an LPU (Language Processing Unit) work?AI Infrastructure and Scalability · Conceptual · 12 minAsked %CompaniesAI Infrastructure and ScalabilityConceptual12 minPro featurePro featureHard
Not started28.What is FSDP (Fully Sharded Data Parallel), and how does it differ from DeepSpeed ZeRO?AI Infrastructure and Scalability · Conceptual · 14 minAsked %CompaniesAI Infrastructure and ScalabilityConceptual14 minPro featurePro featureHard
Not started29.How do you improve inference speed in production LLM deployments? (LLM optimization techniques)AI Infrastructure and Scalability · Practical exercise · 14 minAsked %CompaniesAI Infrastructure and ScalabilityPractical exercise14 minPro featurePro featureMedium

Page 2 of 2