Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

LLM Evaluation and Testing Interview Questions (Page 2) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Topic

LLM Evaluation and Testing interview questions

Metrics, LLM-as-judge, benchmarks, red teaming, fairness, and continuous evaluation of AI systems.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

27 problems

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started21.Your new model version scores higher on every benchmark, but users say it got worse. Why does this happen, and how do you find the problem?LLM Evaluation and Testing · Debugging · 14 minAsked %CompaniesLLM Evaluation and TestingDebugging14 minPro featurePro featureHard
Not started22.How do you evaluate multi-turn conversation quality?LLM Evaluation and Testing · Practical exercise · 12 minAsked %CompaniesLLM Evaluation and TestingPractical exercise12 minPro featurePro featureMedium
Not started23.What is red teaming, and how do you structure red teaming for an LLM application before launch?LLM Evaluation and Testing · Practical exercise · 14 minAsked %CompaniesLLM Evaluation and TestingPractical exercise14 minPro featurePro featureHard
Not started24.What is benchmark contamination, and how do you guard against it?LLM Evaluation and Testing · Conceptual · 10 minAsked %CompaniesLLM Evaluation and TestingConceptual10 minPro featurePro featureMedium
Not started25.How do you evaluate the robustness of an LLM application across input variations?LLM Evaluation and Testing · Practical exercise · 12 minAsked %CompaniesLLM Evaluation and TestingPractical exercise12 minPro featurePro featureMedium
Not started26.How do you red team a multimodal model where text-only safety tests miss cross-modal attacks?LLM Evaluation and Testing · Case study · 14 minAsked %CompaniesLLM Evaluation and TestingCase study14 minPro featurePro featureHard
Not started27.What is evaluation-driven development for AI applications, and why is AI only as good as your definition of done?LLM Evaluation and Testing · Conceptual · 10 minAsked %CompaniesLLM Evaluation and TestingConceptual10 minPro featurePro featureMedium

Page 2 of 2