Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Generative AI and LLMs Interview Questions (Page 4) | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Generative AI and LLMs interview questions

Transformers, prompting, and LLM behaviour.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

122 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started61.Why is Python so important in Generative AI?Generative AI and LLMs · Conceptual · 6 min

Asked %

Companies

Generative AI and LLMs

Conceptual

6 min

Pro feature

Easy

Not started62.What is cross-entropy loss, and why is it used to train language models?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started63.How do you handle multi-language prompting effectively?Generative AI and LLMs · Practical exercise · 9 minAsked %CompaniesGenerative AI and LLMsPractical exercise9 minPro featurePro featureMedium

Not started64.What is prompt injection, and how do you defend against it?Generative AI and LLMs · Conceptual · 11 minAsked %CompaniesGenerative AI and LLMsConceptual11 minPro featurePro featureHard

Not started65.What is model distillation, and how is it used with LLMs?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureMedium

Not started66.What is continual learning in LLMs, and why is catastrophic forgetting a problem?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started67.What is causal masking?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureMedium

Not started68.What is cross-attention in Transformers?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureMedium

Not started69.What are Small Language Models (SLMs), and when should you use them?Generative AI and LLMs · Conceptual · 7 minAsked %CompaniesGenerative AI and LLMsConceptual7 minPro featurePro featureEasy

Not started70.What are logits, and how are they used in text generation?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started71.What is tree-of-thought prompting?Generative AI and LLMs · Conceptual · 9 minAsked %CompaniesGenerative AI and LLMsConceptual9 minPro featurePro featureHard

Not started72.How does DeepSeek-V4 work? Summarise its key architectural ideasGenerative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started73.What is tokenization in LLMs?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started74.Implement scaled dot-product attention with a causal mask from scratchGenerative AI and LLMs · Practical exercise · 15 minAsked %CompaniesGenerative AI and LLMsPractical exercise15 minPro featurePro featureMedium

Not started75.What is prompt chaining, and how do you design a chain of prompts for complex tasks?Generative AI and LLMs · Practical exercise · 10 minAsked %CompaniesGenerative AI and LLMsPractical exercise10 minPro featurePro featureMedium

Not started76.Users are extracting your chatbot's system prompt, including proprietary business logic. How do you prevent it, and how do you defend an agent against injection that reveals it?Generative AI and LLMs · Practical exercise · 11 minAsked %CompaniesGenerative AI and LLMsPractical exercise11 minPro featurePro featureHard

Not started77.What are scaling laws (Chinchilla), and how do they guide model size versus training data?Generative AI and LLMs · Conceptual · 10 minAsked %CompaniesGenerative AI and LLMsConceptual10 minPro featurePro featureHard

Not started78.What is temperature in the context of LLMs, and how does it affect output?Generative AI and LLMs · Conceptual · 8 minAsked %CompaniesGenerative AI and LLMsConceptual8 minPro featurePro featureEasy

Not started79.Your LLM never admits it does not know the answer. How do you make it say "I don't know"?Generative AI and LLMs · Practical exercise · 9 minAsked %CompaniesGenerative AI and LLMsPractical exercise9 minPro featurePro featureMedium

Not started80.Explain WordPiece and SentencePieceGenerative AI and LLMs · Conceptual · 12 minAsked %CompaniesGenerative AI and LLMsConceptual12 minPro featurePro featureMedium

Page 4 of 7