apparently people still use this. I appreciate that so I will start improving the main repo again. I added a few changes.
added max tokens to env, for kobold the max is 512, so dont go over that or you will get an error
There is now stop token support. Update your .envs based on the new sample env. just list words that you dont want to see the bot say divided by ,
bot will now say your display name and not your username
i modified the endpoint and conversation history to use langchain and soon i will add oobabooga support. i just need to add a line to detect what api you put as the endpoint. (ADDED)
-more to come soon..
This Discord bot utilizes LLMs and character cards for casual chatting. The bot supports JSON files and tavern cards, offering the option to automatically update the bot's image and name.
Please note that Discord only allows bots to be renamed twice per hour.
https://github.com/oobabooga/text-generation-webui#one-click-installers
after you install it you will want to run with the --api parameter, or select it in the webui. Then you can set the .env endpoint as http://127.0.0.1:5000/ assuming that you are running it locally.
Currently, these commands are primarily useful for developers. If you don't see them, use the /sync
command to force their appearance.
Command Name | Slash Command | More Info |
---|---|---|
Sync Commands | /sync |
Forces the slash commands to appear immediately. |
Reload Cog | /reload |
Reloads a specific cog instead of restarting everything. |
Regenerate Last Message | /regenerate |
Removes the last message and generates another one. |
Windows 11:
Windows 10: