How do i increase the maximum context length for chatbot?

Hi @jacknjilluser

This usually happens when your max token value is too big and you have a huge embedded content.

Could you please share a screenshot of your parameters and context tab?

Senol

Hi @jacknjilluser

There are two issues with your current settings.

1. Max tokens: A value of 8000 for max tokens is excessive for davinci. Please adjust it to a range of 1000-1500. I personally use 1500, and it works well for me. You can use GPT-3.5-Turbo instead of DaVinci.
2. Temperature: A value of 0.1 is too low. I recommend setting it between 0.5 and 0.9. For my bot, I use 0.7.

• Low temperature values (e.g., below 0.5): These values may be appropriate for tasks where you want GPT-3 to complete a sentence or phrase with a single correct answer, or for tasks where you want the output to be more predictable and straightforward.
• Medium temperature values (e.g., between 0.5 and 0.9): These values may be suitable for tasks where you want GPT-3 to generate ideas or content that is somewhat varied and creative, but still relatively grounded in reality.
• High temperature values (e.g., above 0.9): These values may be appropriate for tasks where you want GPT-3 to produce more creative and varied responses, or for tasks where you want the output to be more unpredictable and open-ended.

You can read more on this: https://gptaipower.com/gpt-3-temperature-settings/

• This reply was modified 2 years, 12 months ago by senols.
• This reply was modified 2 years, 12 months ago by senols.

Ok this leave us the last option: your embedded content is probably huge as it doesn’t fit as a context. Recommended embedding size is around 200-300 words.

You can troubleshoot and find out your problematic context:

1. Go to Logs tab under bot settings.
2. Enable save logs and save prompt.
3. Go and ask the same question to your bot.
4. Go to Chat Logs and find that conversation and click on Details. Look for Context:..
5. If possible please share a screenshot of that details.