Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Generative AI and LLMs Interview Questions (Page 2) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Generative AI and LLMs interview questions

Transformers, prompting, and LLM behaviour.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

122 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started21.What are multi-head attention mechanisms? Why use multiple attention heads?Generative AI and LLMs · Conceptual · 12 min

Asked %

Companies

Generative AI and LLMs

Conceptual

12 min

Pro feature

Medium

Not started22.What are foundation models, and how have they changed AI engineering?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started23.How does Rotary Position Embedding (RoPE) work, and why is it preferred over learned positional embeddings?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started24.Your QA system always answers, even when the context has no answer. How do you detect unanswerable questions?Generative AI and LLMs · Practical exercise · 9 minAsked %CompaniesGenerative AI and LLMsPractical exercise9 minPro featurePro featureMedium

Not started25.What is role prompting, and when is it effective?Generative AI and LLMs · Conceptual · 6 minAsked %CompaniesGenerative AI and LLMsConceptual6 minPro featurePro featureEasy

Not started26.What is Generative AI?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started27.Your LLM coding assistant generates outdated code using deprecated libraries. How do you fix it?Generative AI and LLMs · Practical exercise · 8 minAsked %CompaniesGenerative AI and LLMsPractical exercise8 minPro featurePro featureMedium

Not started28.What are Feed-Forward Networks in LLMs?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureMedium

Not started29.What is Flash Attention, and why is it faster?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started30.Build a simple prompt versioning systemGenerative AI and LLMs · Practical exercise · 15 minAsked %CompaniesGenerative AI and LLMsPractical exercise15 minPro featurePro featureMedium

Not started31.Your AI system works in English but fails for other languages. How do you add multilingual support?Generative AI and LLMs · Practical exercise · 11 minAsked %CompaniesGenerative AI and LLMsPractical exercise11 minPro featurePro featureMedium

Not started32.Compare greedy decoding, beam search, top-k, top-p, and temperature sampling. When does each fail?Generative AI and LLMs · Conceptual · 15 minAsked %CompaniesGenerative AI and LLMsConceptual15 minPro featurePro featureHard

Not started33.What is prompt engineering, and why is it critical for AI applications?Generative AI and LLMs · Conceptual · 7 minAsked %CompaniesGenerative AI and LLMsConceptual7 minPro featurePro featureEasy

Not started34.Implement top-k, top-p and temperature sampling over a logits vectorGenerative AI and LLMs · Practical exercise · 15 minAsked %CompaniesGenerative AI and LLMsPractical exercise15 minPro featurePro featureMedium

Not started35.What is Hugging Face used for?Generative AI and LLMs · Conceptual · 5 minAsked %CompaniesGenerative AI and LLMsConceptual5 minPro featurePro featureEasy

Not started36.Your few-shot prompting gives inconsistent results across similar inputs. How do you stabilise it?Generative AI and LLMs · Debugging · 10 minAsked %CompaniesGenerative AI and LLMsDebugging10 minPro featurePro featureMedium

Not started37.What is jailbreaking in LLMs, and what are common jailbreak techniques?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureMedium

Not started38.How do RNNs and Transformers differ?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started39.Why is the context window limited in LLMs?Generative AI and LLMs · Conceptual · 12 minAsked %CompaniesGenerative AI and LLMsConceptual12 minPro featurePro featureMedium

Not started40.Implement an LLM output guardrails system that checks for off-topic responses and PII leakageGenerative AI and LLMs · Practical exercise · 18 minAsked %CompaniesGenerative AI and LLMsPractical exercise18 minPro featurePro featureMedium

Page 2 of 7