Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Generative AI and LLMs Interview Questions | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Generative AI and LLMs interview questions

Transformers, prompting, and LLM behaviour.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

122 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started1.What are the key components of the Transformer architecture?Generative AI and LLMs · Conceptual · 10 min

Asked %

Companies

Generative AI and LLMs

Conceptual

10 min

Pro feature

Medium

Not started2.Your tokenizer splits important domain terms into meaningless pieces. How do you fix it?Generative AI and LLMs · Practical exercise · 9 minAsked %CompaniesGenerative AI and LLMsPractical exercise9 minPro featurePro featureMedium

Not started3.Your Transformer runs out of memory on long documents because of quadratic self-attention. How do you scale it?Generative AI and LLMs · Practical exercise · 10 minAsked %CompaniesGenerative AI and LLMsPractical exercise10 minPro featurePro featureHard

Not started4.What is a system prompt, and how does it influence model behaviour?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started5.What is positional encoding, and why is it needed in Transformers?Generative AI and LLMs · Conceptual · 12 minAsked %CompaniesGenerative AI and LLMsConceptual12 minPro featurePro featureMedium

Not started6.Your LLM memorised proprietary training data and leaks it in responses. How do you prevent this?Generative AI and LLMs · Practical exercise · 10 minAsked %CompaniesGenerative AI and LLMsPractical exercise10 minPro featurePro featureHard

Not started7.Your chatbot loses context after about 10 turns. How do you maintain long conversation context?Generative AI and LLMs · Practical exercise · 9 minAsked %CompaniesGenerative AI and LLMsPractical exercise9 minPro featurePro featureMedium

Not started8.What is Recursive Self-Improvement (RSI) in AI?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started9.What is the KV cache, and how does it speed up LLM inference?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started10.Walk through one forward pass of a decoder-only TransformerGenerative AI and LLMs · Conceptual · 20 minAsked %CompaniesGenerative AI and LLMsConceptual20 minPro featurePro featureHard

Not started11.Inside ChatGPT: what happens after you hit Enter?Generative AI and LLMs · Conceptual · 12 minAsked %CompaniesGenerative AI and LLMsConceptual12 minPro featurePro featureMedium

Not started12.Estimate the KV cache memory for a large model and explain how to reduce itGenerative AI and LLMs · Practical exercise · 12 minAsked %CompaniesGenerative AI and LLMsPractical exercise12 minPro featurePro featureHard

Not started13.What is ReAct (Reasoning + Acting) prompting, and how does it work?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureMedium

Not started14.Explain Layer Normalization and how it differs from Batch NormalizationGenerative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started15.What is a diffusion model, and how does it generate images?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started16.Explain self-consistency prompting and how it improves reasoningGenerative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started17.Explain Proximal Policy Optimization (PPO)Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started18.Your chain-of-thought prompting is not improving accuracy on reasoning tasks. What do you fix?Generative AI and LLMs · Debugging · 10 minAsked %CompaniesGenerative AI and LLMsDebugging10 minPro featurePro featureHard

Not started19.Transformers work on text, so can they also understand images?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started20.What are meta-prompts, and how can they be used to generate prompts?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Page 1 of 7