Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Generative AI and LLMs Interview Questions (Page 5) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Generative AI and LLMs interview questions

Transformers, prompting, and LLM behaviour.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

122 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started81.Your summarisation system adds facts that are not in the source article. How do you fix it?Generative AI and LLMs · Debugging · 9 min

Asked %

Companies

Generative AI and LLMs

Debugging

9 min

Pro feature

Medium

Not started82.Your LLM responses are too verbose. How do you control response length?Generative AI and LLMs · Practical exercise · 6 minAsked %CompaniesGenerative AI and LLMsPractical exercise6 minPro featurePro featureEasy

Not started83.What is the difference between prompt engineering and prompt tuning?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started84.What are skip connections (residual connections) in Transformers?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureMedium

Not started85.Explain BPE (Byte Pair Encoding)Generative AI and LLMs · Conceptual · 12 minAsked %CompaniesGenerative AI and LLMsConceptual12 minPro featurePro featureMedium

Not started86.What are Large Reasoning Models (LRMs), and how do they differ from standard LLMs?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureMedium

Not started87.Your LLM ignores instructions and breaks the required output format. How do you enforce structured output?Generative AI and LLMs · Practical exercise · 9 minAsked %CompaniesGenerative AI and LLMsPractical exercise9 minPro featurePro featureMedium

Not started88.Implement a KV cache and single-step decode for causal multi-head attentionGenerative AI and LLMs · Practical exercise · 20 minAsked %CompaniesGenerative AI and LLMsPractical exercise20 minPro featurePro featureHard

Not started89.Implement streaming responses for an LLM API, including an SSE parser that handles arbitrary chunk boundariesGenerative AI and LLMs · Practical exercise · 18 minAsked %CompaniesGenerative AI and LLMsPractical exercise18 minPro featurePro featureMedium

Not started90.How do you handle edge cases and adversarial inputs in prompt design?Generative AI and LLMs · Practical exercise · 10 minAsked %CompaniesGenerative AI and LLMsPractical exercise10 minPro featurePro featureHard

Not started91.Explain Group Relative Policy Optimization (GRPO)Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started92.What is the difference between open-source and closed-source LLMs? When would you choose one over the other?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureEasy

Not started93.Explain the difference between autoregressive and masked language modelingGenerative AI and LLMs · Conceptual · 7 minAsked %CompaniesGenerative AI and LLMsConceptual7 minPro featurePro featureMedium

Not started94.How does Sliding Window Attention work?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started95.Why do modern Transformers use Pre-LayerNorm instead of Post-LayerNorm?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureHard

Not started96.Your chatbot fails when users switch topics mid-conversation. How do you handle topic switches?Generative AI and LLMs · Practical exercise · 8 minAsked %CompaniesGenerative AI and LLMsPractical exercise8 minPro featurePro featureMedium

Not started97.What are autoregressive models?Generative AI and LLMs · Conceptual · 6 minAsked %CompaniesGenerative AI and LLMsConceptual6 minPro featurePro featureEasy

Not started98.Write code for token counting and context window managementGenerative AI and LLMs · Practical exercise · 15 minAsked %CompaniesGenerative AI and LLMsPractical exercise15 minPro featurePro featureMedium

Not started99.What is the "lost in the middle" problem in long-context prompting?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started100.Implement a prompt template system with variable substitutionGenerative AI and LLMs · Practical exercise · 12 minAsked %CompaniesGenerative AI and LLMsPractical exercise12 minPro featurePro featureEasy

Page 5 of 7