docs: Document runsync client timeout behavior#585
Conversation
![promptless[bot]](https://avatars.githubusercontent.com/in/979718?s=60&v=4){kind=small}
| ``` | ||
|
|
||
| <Note> | ||
| The Flash SDK's `runsync()` method uses your `execution_timeout_ms` value as the client-side HTTP timeout. If set to a positive value, the SDK waits that duration for the job to complete. If unset or set to `0`, the SDK defaults to a 60-second timeout. For long-running inference jobs, set `execution_timeout_ms` to prevent premature timeouts. |
There was a problem hiding this comment.
Citation: Bug fix PR that changed runsync() to use executionTimeoutMs / 1000 as client timeout instead of hardcoded 60s. Changes in src/runpod_flash/core/resources/serverless.py show the timeout derivation logic with guard for None and 0 values.
View source
| } | ||
| ``` | ||
|
|
||
| The `/runsync` endpoint has a 60-second client-side timeout by default. If you've configured `execution_timeout_ms` on your endpoint, the client timeout uses that value instead. For jobs that take longer than 60 seconds, set `execution_timeout_ms` to prevent `/runsync` requests from timing out. |
There was a problem hiding this comment.
Citation: PR #272 fixes ServerlessResource.runsync() to respect executionTimeoutMs for client-side HTTP timeout. The PR description explains the prior bug: 60s hardcoded timeout caused GPU inference jobs >1 minute to fail.
View source
|
Preview deployment for your docs. Learn more about Mintlify Previews.
|
|
Just a reminder: If you'd like me to act on any feedback you have via Github comments, just type @Promptless in your suggestion and I'll get right on it! (I won't show up in the user dropdown, but I'll process any request that has @Promptless in the comment body.) |
1 participant
Open this suggestion in Promptless to view citations and reasoning process
Documents that the Flash SDK's
runsync()method usesexecution_timeout_msas the client-side HTTP timeout. This clarifies that long-running jobs (>60 seconds) needexecution_timeout_msconfigured to prevent client-side timeouts.Trigger Events
runpod/flash PR #272: fix(serverless): use executionTimeoutMs as runsync client timeout
Promptless Research (5 files, 1 GitHub PR)
.long_term_context/product_knowledge/product_overview.md.long_term_context/doc_workflow/client_instructions.mdflash/configuration/parameters.mdxflash/apps/requests.mdx.long_term_context/style/client_style_guide.mdAgent Response
Tip: Point @Promptless at some of your docs debt and have it clean them up in the background 🧹