Skip to main content

Chat live stream order is wrong when using Hermes as AI Provider

Description:

When using Hermes as the AI Provider, the chat text and tool calls are streamed back together — which is correct initially. However, after a while the behavior changes: all tool calls get grouped and rendered below the chat text, instead of being interleaved in the correct chronological order.


Expected behavior:
Tool calls should appear inline/mixed with the chat text as they occur during streaming (see screenshot — the arrows show the correct interleaved order).


Actual behavior:
Tool calls are batched and displayed below all chat text, breaking the natural flow of the conversation.


Steps to reproduce:

  1. Add Hermes as AI Provider.

  2. Start a task that triggers multiple tool calls during a response.

  3. Observe that initially the stream order is correct, but it eventually breaks — tool calls fall below the chat text.

Status: Completed1 comment

Log in to comment and vote

Comments1

  • Daniel Nguyen

    Team•

    May 7

    Fixed this in v2.12.1. Also added the grouping in the top if there are continuous tool calls in the beginning.