You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When making completions, sometimes we want to constrain the output tokens. Similar to how we control temperature.
Right now, there is no way to do that.
Proposed solution
Add a new parameter similar to temperature.
Why this belongs in RubyLLM
This requires changes to all the underlying providers and the interface in order to work.