Support » Plugin: AI Engine » Fine-Tuning Hyperparameters

  • Resolved insiderperks

    (@insiderperks)


    I’m back again, sorry, lol. Will it be possible in the future to set things like num_epochs and batch_size in the plugin? I think this might be related to some of my granular issues related to maps not displaying. Default works well for 95% of queries but this could be the missing link.

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author Jordy Meow

    (@tigroumeow)

    Haha, no problem at all!

    I could do that, but for finetuning a chatbot, I believe the default are good enough and changing the parameters will just open the door to more confusion. So I need to add this but hide it at the same time 🙂

    maps not displaying

    Wait, what kind of maps?

    Thread Starter insiderperks

    (@insiderperks)

    Ignore the maps, they aren’t super relevant to the issue from your end 🙂

    I think the hyperparameters are important for fine-tuning one. Especially for specific use cases outside the pre-trained knowledge. Example being a customer service bot that cannot answer things wrong.

    Controlling the weight on the prompts/completions, and things like epochs and batch size would allow us to play around until it’s almost perfect.

    Thread Starter insiderperks

    (@insiderperks)

    I suppose what might help would be the ability to know what your defaults are. We are really only have two lingering issues, one is with the images and HTML code that no longer works (despite retraining etc). Second is that the bot will sometimes return blank answers still with no text.

    Plugin Author Jordy Meow

    (@tigroumeow)

    No problem, I have added hyperparams to the version 1.0.7. Please give them a try, maybe it will help 🙂

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Fine-Tuning Hyperparameters’ is closed to new replies.