LLM Calls: Speed and Failures

MediumPython for AI/MLPractical exercise8 min Save for later

Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.

(1) Your app calls an LLM API 100 times sequentially, 2 seconds each. How do you cut the total time? (2) Your app depends on three external APIs and one is down. Should the whole application fail?

Hints

AI feedback

Locked until you attempt this problem

Log in and submit an answer to get personalised AI feedback.

Answer

Write your answer here. Your answer is private to you.

You need to log in / sign up to submit an answer and get AI feedback.