Timeouts #795
-
|
What are timeouts in two places for? Do I need to specify in two places or if I specify in one place, timeouts will work? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 3 replies
-
|
The first screenshot shows the timeout at the client level which means it will apply to all requests. The second screenshot shows the timeout at the method level, if you don't specify a timeout here it will use the timeout specified at the client level. This is helpful if you want a different timeout for one specific request as opposed to all requests. Hope that helps! |
Beta Was this translation helpful? Give feedback.
-
|
Is max_retries specified for the entire client? |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
Yes max_retries is specified for the entire client, if you want to override it for a single request you can use this: client.with_options(max_retries=5).chat.completions.create(...) |
Beta Was this translation helpful? Give feedback.
-
|
Thx |
Beta Was this translation helpful? Give feedback.
The first screenshot shows the timeout at the client level which means it will apply to all requests.
The second screenshot shows the timeout at the method level, if you don't specify a timeout here it will use the timeout specified at the client level. This is helpful if you want a different timeout for one specific request as opposed to all requests.
Hope that helps!