Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Generative AI and LLMs Interview Questions (Page 6) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Generative AI and LLMs interview questions

Transformers, prompting, and LLM behaviour.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

122 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started101.Your LLM tool hits the context window limit on long documents. How do you handle it?Generative AI and LLMs · Practical exercise · 9 min

Asked %

Companies

Generative AI and LLMs

Practical exercise

9 min

Pro feature

Medium

Not started102.What is Mixture of Experts (MoE), and how does it differ from a dense model?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureMedium

Not started103.What is a Large Language Model (LLM), and how does it work?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started104.Your distilled student model fails on the complex reasoning the teacher handled. How do you close the gap?Generative AI and LLMs · Debugging · 10 minAsked %CompaniesGenerative AI and LLMsDebugging10 minPro featurePro featureHard

Not started105.What are the common failure modes in prompting, and how do you debug them?Generative AI and LLMs · Debugging · 11 minAsked %CompaniesGenerative AI and LLMsDebugging11 minPro featurePro featureMedium

Not started106.Explain Top-p (nucleus) sampling and Top-k sampling. How do they differ?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureMedium

Not started107.How does LLM watermarking work?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureHard

Not started108.What are Recursive Language Models (RLMs)?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureHard

Not started109.What is chain-of-thought (CoT) prompting, and when should you use it?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureMedium

Not started110.Implement multi-head attention, then convert it to grouped-query attentionGenerative AI and LLMs · Practical exercise · 20 minAsked %CompaniesGenerative AI and LLMsPractical exercise20 minPro featurePro featureHard

Not started111.Build an evaluation pipeline for LLM outputs using LLM-as-a-judgeGenerative AI and LLMs · Practical exercise · 18 minAsked %CompaniesGenerative AI and LLMsPractical exercise18 minPro featurePro featureMedium

Not started112.What is the difference between a stop token and a stop sequence?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started113.What is the context window in LLMs, and why does it matter?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started114.Implement BPE (Byte Pair Encoding) training and encoding from scratchGenerative AI and LLMs · Practical exercise · 18 minAsked %CompaniesGenerative AI and LLMsPractical exercise18 minPro featurePro featureMedium

Not started115.What is the Transformer architecture, and how does it work?Generative AI and LLMs · Conceptual · 12 minAsked %CompaniesGenerative AI and LLMsConceptual12 minPro featurePro featureMedium

Not started116.How do you evaluate and iterate on prompt quality?Generative AI and LLMs · Practical exercise · 11 minAsked %CompaniesGenerative AI and LLMsPractical exercise11 minPro featurePro featureMedium

Not started117.Your zero-shot cross-lingual transfer from English fails on other languages. How do you fix it?Generative AI and LLMs · Debugging · 11 minAsked %CompaniesGenerative AI and LLMsDebugging11 minPro featurePro featureHard

Not started118.After RLHF your LLM became safer but lost capability on hard tasks. How do you manage the alignment tax?Generative AI and LLMs · Debugging · 10 minAsked %CompaniesGenerative AI and LLMsDebugging10 minPro featurePro featureHard

Not started119.What are stop tokens in LLMs, and how does an LLM know when to stop generating?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started120.Write code to detect prompt injection attempts in user inputsGenerative AI and LLMs · Practical exercise · 15 minAsked %CompaniesGenerative AI and LLMsPractical exercise15 minPro featurePro featureMedium

Page 6 of 7