Recently, responses from mistral have been getting very slow when using Mistral (this is the only provider I use). Today, it’s taking several minutes or more for a response to start generating. Once the text starts generating, it goes at a normal speed, but the same delay occurs for each subsequent response. When I run the same prompt in Chatbox on the came computer, there’s no delay. I’m not sure what the problem is. I’m using the most up to date version of BoltAI on MacOS on an Apple M1 MacBook Pro.
Please authenticate to join the conversation.
In Review
BoltAI Mac v2
About 3 hours ago

MDNull
Get notified by email when there are changes.
In Review
BoltAI Mac v2
About 3 hours ago

MDNull
Get notified by email when there are changes.