- 18comments
- 37comments
- 45comments
- 64comments
- 185comments
- 139comments
- 3comments
- —discuss
- 12comments
- 799comments
- 12comments
- 16comments
- 69comments
- 110comments
- —discuss
- 1031comments
- 3comments
- 267comments
- 413comments
- 66comments
- 232comments
- 572comments
- 174comments
- 64comments
- 532comments
- 158comments
- 177comments
- 32comments
- 1comments
- 117comments
But… why???
created something similar but specific to llama-server. it takes advantage of logprob output and completes decisions in a single forward pass https://github.com/khimaros/verdict
we also have several jev type models available in seconds built on top of models on our router
mev (based on mercury) gemmev (based on gemma)
also these take images input
zev, lev etc
https://trustedrouter.com/docs/decide