Problem with duplicate indexing

  • Resolved Rich

    (@rlofters)


    1 month, 2 weeks ago

    I’m using Qdrant as my vector database. I have a website with a couple hundred posts and I add about 4 posts a week. The problem is when I Train the vector database weekly (to include the new posts) it duplicates previously indexed posts. This will ultimately impact the retrieval accuracy of the chatbot. My only option is to deleted the collection every week and retrain it from scratch. Does AI Puffer offer an “upsert” (update + insert) capability so it only trains additions/changes?

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author senols

    (@senols)

    1 month, 1 week ago

    Hi @rlofters

    Did you try indexing your content under “Automations” module?

    We have this “Automatically index new & updated content on a schedule.” checkbox which keeps your knowledge base up-to-date by indexing content that is published or updated after the task’s last run.

    Pls see this: https://imgur.com/a/QILh8SE

    Thread Starter Rich

    (@rlofters)

    1 month, 1 week ago

    Perfect. That worked! Amazing product!

    Plugin Author senols

    (@senols)

    1 month, 1 week ago

    Thank you 🙂 pls leave me a review if you like the plugin as it will motivate me a lot.

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this topic.