I am using claude opus for generating text, and a couple of other workflows which use different models, but sometimes i get overload error or llm error.
Can somebody help resolving this.
This is the model output,
type":“error”,“error”:{“details”:null,“type”:“overloaded_error”,“message”:"Overloaded
Hi @amandayal,
This error message usually shows up when Anthropic’s servers are receiving too many requests at once. If you’re running into it often, you might want to try using a model from another provider or pick an Anthropic model that’s hosted on AWS.
You’ll see a small AWS logo next to the name, like in this screenshot:
Hope this helps!
Thanks for the reply, i’ll try using that.