Ficelle
Tag
reliability
3 posts on this topic.
-
LLM fallback: handle rate limits, outages, and capability mismatches
A working LLM fallback reads the failure before it moves on. How to tell a Groq per-minute 429 from a daily cap, a Gemini project quota from a transient error, and an OpenRouter 402 from a 429, and where capability checks fit.
-
What is an LLM gateway? Routing, reliability, and cost control
An LLM gateway sits between your code and model providers. Here is a practical map of its five layers (compatibility, routing, health, cost policy, maintenance) and which ones Ficelle actually owns.
-
Provider breakage is the silent killer of AI agents
Free and free-tier LLM providers rate-limit, retire models, and misreport capabilities, weekly. If your agent points at one provider, it breaks when they do. Routing with cooldowns, quarantine, and fallback is the fix.
