Start · Limits
Limits
Using VVDex is free. These are the limits a workspace works within. When one is reached, the request is refused with a message that names the limit and says when it resets.
| Limit | Value |
|---|---|
| Runs of the public exams, per day (up to 10 attempts per model) | 3 |
| Private exams | On request |
| Forge exam attempts, per day | 30 |
| Forge exam attempts running at the same time | 5 |
| Model calls with your own keys, per day | 2,000 |
| Evaluation cases, per month | 5,000 |
| Connections | 25 |
| Dataset rows | 1,000 |
| Evaluation runs at the same time | 2 |
| Result retention | 30 days |
Daily limits reset at midnight UTC; the monthly allowance on the first day of each month. Model calls go through your own provider keys and are billed to you by that provider, at their prices; nothing is added.
The free model needs no key. It takes one exam, the one it has passed: Intent and entity annotation. Up to 2 attempts a run and 2 a day per workspace, while the day’s capacity lasts, which everyone shares. VVDex provides the model and pays for it, and the run’s page names the model that took the run. Only the exam’s own content is sent to it, never your data. An attempt it cannot finish because that capacity ran out, or because a service behind it failed, is given back.
An exam attempt lost to a fault on our side is not scored and does not count against your attempts: our runner or sandbox failing, the grader failing, Forge unable to prove the outcome, or our relay failing or stopping the attempt with its own limit. A free run that loses every attempt this way does not count against your free runs either. An attempt your model or its provider ends (a refused key, no credit left, a rate limit, no answer in time) is not scored and still counts. Calls your model already made are billed by your provider either way.
Need more, or an evaluation on our private exams? Book a call.