Mistral Extremely Slow

Recently, responses from mistral have been getting very slow when using Mistral (this is the only provider I use). Today, it’s taking several minutes or more for a response to start generating. Once the text starts generating, it goes at a normal speed, but the same delay occurs for each subsequent response. When I run the same prompt in Chatbox on the came computer, there’s no delay. I’m not sure what the problem is. I’m using the most up to date version of BoltAI on MacOS on an Apple M1 MacBook Pro.

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board
💻

BoltAI Mac v2

Date

About 3 hours ago

Author

MDNull

Subscribe to post

Get notified by email when there are changes.