How do you handle provider variance on OpenRouter for the opensource models? Or do you use your own hosted version to mitigate this?
And for both opensource and closed source, does the router account for provider quality, or catch it when a provider degrades?
rirze 1 hours ago [-]
How does this choose which models to use with any arbitrary set of model providers to work from? And why is an openrouter necessary for self-hosting?
jamesforestwest 2 hours ago [-]
How do you define the model buckets, and what happens when a session genuinely needs a model that isn't in the bucket the HMM picked?
thefourthchime 2 hours ago [-]
Interesting work, and thanks for describing how your router works internally. It's definitely a fascinating subject. How would you say this compares to Cursor's auto mode?
adchurch 2 hours ago [-]
Absolutely!
Conceptually very similar to Cursor's auto mode. The key distinctions are:
- We plug into any harness (e.g. Claude Code, Codex, OpenCode, Pi)
- We aren't incentivized to route to our own model, we're incentivized to route to the best model whatever it may be
aschla 2 hours ago [-]
And similarly, Copilot’s Auto mode?
1minusp 1 hours ago [-]
Does this allow for a predefined budget?
redrove 3 hours ago [-]
Is the model you trained available as open weights?
adchurch 2 hours ago [-]
It is not sorry!
aminsamir45 2 hours ago [-]
AGI is here!
itsmeduncan 3 hours ago [-]
[flagged]
adurnos 1 hours ago [-]
[dead]
xms17189 19 hours ago [-]
[dead]
Rendered at 21:08:30 GMT+0000 (Coordinated Universal Time) with Vercel.
And for both opensource and closed source, does the router account for provider quality, or catch it when a provider degrades?
Conceptually very similar to Cursor's auto mode. The key distinctions are:
- We plug into any harness (e.g. Claude Code, Codex, OpenCode, Pi)
- We aren't incentivized to route to our own model, we're incentivized to route to the best model whatever it may be