Hello!
I recently switched from Llama 2 to Llama 3, and I’m now getting nothing but 502 Bad Gateway errors. The previous model works fine, but this one consistently times out at the 300-second mark despite my retry logic.
Is there a way to extend the API timeout or a specific configuration to prevent these gateway failures?
Thanks!