So I debated on this for awhile. The current functionality is by design, but I’m open to enhancing or modifying it some if it makes sense. To answer your question, yes, you are correct in how it currently works. If chat persistence is disabled the AI chatbot will still maintain chat history context for that entire session (24h), but it will not be shown to the user. This helps because if a user is navigating the website and asking different questions the AI will still have a full understanding of the users session, it’s just the user is not shown the full context. Some people like this because its cleaner. If chat persistence is enabled it shows the chat history to the user instead of hiding it.
Do you have any suggestions on how this flow/logic should be handled? Maybe we should just completely omit the chat history even from the AI when its off or maybe think how we can rework settings related to that give an option to completely omit the history.
Some users have been asking for a way to let users have an entire chat history log and different sessions, so I may be looking at chat history and session context heavily over the next few weeks.
I understand your point of view, and it does make sense 👍
Keeping the full 24h context can definitely help the AI maintain continuity as users navigate and ask related questions.
That said, in my opinion, whatever strategy we choose (current conversation only vs full 24h window), the conversation history shown to the user should always match the one sent to the AI. Otherwise, it can lead to confusing or “unexplained” AI behavior from the user’s perspective, since the model may be reacting to messages the user cannot see.
I also strongly think that we should definitely keep some conversation history, because users very often ask follow-up questions and expect the assistant to remember what was just discussed.
My personal suggestion:
- When chat persistence is off: only show current conversation messages, and only send those to the AI.
- When chat persistence is on: show the full 24h message history to the user and send this history to the AI.
Even more ideal would be to base this on some kind of browser session instead of an arbitrary 24h window, though I understand this may not be an easy task.
-
This reply was modified 3 months, 3 weeks ago by
samymsa.
Thanks @samymsa,
This will be released on Wednesday. Going forward the UI and the Chatbot context will be aligned to alleviate confusing behavior.
hi @samymsa,
This was released today in version 3.0.6.
thanks,
maxwell
Thanks!
Happy to help enhancing the product 🚀