Search problems

Loading…

Practice for AI, ML and GenAI engineering interviews. Answer out loud or in writing, then learn from the reference solution.

Start practicing

Practice

All problems
Easy warm-ups
Hard challenges
System design
Blog

Your space

Dashboard
Saved problems
Privacy
Terms

Account

Create free account
Log in

Loading…

Fine-Tuning Interview Questions | Buncho

Library Dashboard Saved for later

Topics

Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

of 565

Solved

Easy0/73
Med.0/297
Hard0/195

Topic

Fine-Tuning interview questions

LoRA/QLoRA, PEFT, RLHF/DPO, data preparation, and fine-tuning troubleshooting.

All topics565 Python for AI/ML75 Machine Learning Fundamentals10 ML Algorithms0 ML System Design1 Deep Learning5 Statistics and Mathematics1 Generative AI and LLMs122 Embeddings13 RAG and Vector Databases47 AI Agents and Tool Calling50 MCP0 Multimodal AI29 LLM Evaluation and Testing27 AI Safety, Ethics, and Responsible AI36 AI System Design41 Fine-Tuning25 AI Infrastructure and Scalability29 LLM Gateways0 Production AI Engineering39 AI Engineering Case Studies15

Search problems

DifficultyProblem type

25 problems

See how often each question is asked, and which companies asked it.Part of Buncho Pro.Unlock

TitleTopicTypeTimeAsked Companies Level

Not started1.What is QLoRA, and how does it enable fine-tuning on consumer hardware?Fine-Tuning · Conceptual · 12 min

Asked %

Companies

Fine-Tuning

Conceptual

12 min

Pro feature

Hard

Not started2.What is LoRA (Low-Rank Adaptation), and how does it work?Fine-Tuning · Conceptual · 12 minAsked %CompaniesFine-TuningConceptual12 minPro featurePro featureMedium

Not started3.What is RLAIF (RL from AI Feedback), and how does it differ from RLHF?Fine-Tuning · Conceptual · 10 minAsked %CompaniesFine-TuningConceptual10 minPro featurePro featureMedium

Not started4.You must choose between LoRA and full fine-tuning for a domain-specific assistant. How do you decide?Fine-Tuning · Case study · 12 minAsked %CompaniesFine-TuningCase study12 minPro featurePro featureMedium

Not started5.Explain Prefix Tuning and Prompt Tuning. How are they different from LoRA?Fine-Tuning · Conceptual · 10 minAsked %CompaniesFine-TuningConceptual10 minPro featurePro featureHard

Not started6.How do you fine-tune a model for a specific domain (legal, medical, finance)?Fine-Tuning · Practical exercise · 14 minAsked %CompaniesFine-TuningPractical exercise14 minPro featurePro featureHard

Not started7.What is Constitutional AI, and how does it differ from RLHF?Fine-Tuning · Conceptual · 10 minAsked %CompaniesFine-TuningConceptual10 minPro featurePro featureMedium

Not started8.What is RLVR (Reinforcement Learning with Verifiable Rewards), and when does it beat a learned reward model?Fine-Tuning · Conceptual · 12 minAsked %CompaniesFine-TuningConceptual12 minPro featurePro featureHard

Not started9.Your fine-tuned LLM forgot its general capabilities after domain-specific fine-tuning. How do you fix catastrophic forgetting?Fine-Tuning · Debugging · 12 minAsked %CompaniesFine-TuningDebugging12 minPro featurePro featureMedium

Not started10.What is adapter-based fine-tuning?Fine-Tuning · Conceptual · 8 minAsked %CompaniesFine-TuningConceptual8 minPro featurePro featureMedium

Not started11.Do the GPU memory math for full fine-tuning a 7B model in bf16 with Adam. Now with LoRA and QLoRA.Fine-Tuning · Practical exercise · 15 minAsked %CompaniesFine-TuningPractical exercise15 minPro featurePro featureHard

Not started12.Your fine-tuned LLM produces factually wrong outputs due to training data quality issues. How do you fix it?Fine-Tuning · Debugging · 12 minAsked %CompaniesFine-TuningDebugging12 minPro featurePro featureHard

Not started13.What is instruction tuning, and why is it important for chat models?Fine-Tuning · Conceptual · 8 minAsked %CompaniesFine-TuningConceptual8 minPro featurePro featureEasy

Not started14.What is fine-tuning, how does it work, and when should you fine-tune an LLM?Fine-Tuning · Conceptual · 10 minAsked %CompaniesFine-TuningConceptual10 minPro featurePro featureEasy

Not started15.Your RLHF preference data has low annotator agreement. How do you ensure data quality?Fine-Tuning · Debugging · 12 minAsked %CompaniesFine-TuningDebugging12 minPro featurePro featureHard

Not started16.What is RLHF (Reinforcement Learning from Human Feedback), and how does it align LLMs? What was the original Deep RL from Human Preferences paper?Fine-Tuning · Conceptual · 14 minAsked %CompaniesFine-TuningConceptual14 minPro featurePro featureHard

Not started17.What are the key hyperparameters for fine-tuning (learning rate, epochs, batch size, LoRA rank)?Fine-Tuning · Practical exercise · 12 minAsked %CompaniesFine-TuningPractical exercise12 minPro featurePro featureMedium

Not started18.Your fine-tuned model memorized training data verbatim instead of learning patterns. How do you fix overfitting?Fine-Tuning · Debugging · 12 minAsked %CompaniesFine-TuningDebugging12 minPro featurePro featureMedium

Not started19.What is the difference between full fine-tuning and parameter-efficient fine-tuning (PEFT)?Fine-Tuning · Conceptual · 10 minAsked %CompaniesFine-TuningConceptual10 minPro featurePro featureMedium

Not started20.How do you merge multiple LoRA adapters?Fine-Tuning · Practical exercise · 12 minAsked %CompaniesFine-TuningPractical exercise12 minPro featurePro featureHard

Page 1 of 2