Skip to main content

Chat System Prompt being ignored or just not read?

Feature Requests

As you can see in the screenshot below, the system instructions say to tranlsate any text that is in English to Chinese. However in the chat you can see the model responds saying it doesn’t know the answer to the question. Its reading the message I send as if that is a question I want an answer to or something, instead of just translating it verbatim like the system instructions say.

Posted by Rich ·
Status: Rejected4 comments

Log in to comment and vote

Comments4

  • Daniel Nguyen

    Team•

    Apr 22

    Can you share your chat with me. I just did a quick check and it follows the System Prompt just fine. The reason it doesn’t work for you, might be because the LLM just doesn’t follow instructions well. Which model are you using?

    • Rich

      •

      Apr 22

      boltai-chat-1f6ee34a-f8a3-4386-9d5e-3a2ec0e85645.json

      97 KB• Text

      Sure here is the chat. It was Claude Opus 4.5, but I’ve now switched to 4.6

      • Daniel Nguyen

        Team•

        Apr 22

        I just double checked and can confirm BoltAI works correctly. I verified with Proxyman (to inspect the request and response), and BoltAI indeed includes the system prompt correctly in the request (see screenshot).

        I think you should either play more with the system instructions, or try to find a different way to make it a translator. Check out the AI Workflow, there are some examples there where it reliably translate from one language to another.

        Another experiment to take is to change the System Prompt from English to your target language (in this case, simplified chinese).

        I’m going to close this issue as it’s not BoltAI’s issue.

        • Rich

          •

          Apr 22

          Okay, thank you for the advice.