gpt j chatbot
1.0.0
此範本的目的是為希望建立 AI 驅動的個人化角色的其他開發人員提供快速入門指南
Jeanie 是基於此儲存庫的 GPT-J 支援的虛擬女友
git clone [email protected]:machaao/gpt-j-chatbot.git
cd gpt-j-chatbot
pip install -r requirements.txtnano -w .env API_TOKEN = <Machaao API Token>
BASE_URL = <Machaao Base Url> ex: https://ganglia.machaao.com
NAME = <Your Bot Display Name> ex: Jess
DASHBOT_KEY = <Your dashbot token> (Optional) (Conversational Analytics)
MODEL_NAME=EleutherAI/gpt-neo-1.3B # for local inference / testing [we recommend using GPT-NEO 1.3B for 16GB ram - load can take up to 1 min and inference avg is about 10 - 20 seconds] See https://huggingface.co/EleutherAI for additional models
NLP_CLOUD_TOKEN = <NLP Cloud Token> # for faster remote inference
# BOT PARAMS - Unset Parameters would use their default values.
# Don't use Top_p and Temperature parameters simultaneously.
# Default Values are mentioned below.
# The higher this value, the less deterministic the result will be
TOP_P="1.0"
# The higher this value, the less deterministic the result will be
TEMPERATURE="0.8"
# The lower this value, the less likely GPT-J is going to generate off-topic text
TOP_K="50"
# The maximum number of tokens that the generated text should contain
MAX_LENGTH="50"
為了更好地理解上述 GPT-J 參數，請查看 nlpcloud.io 文檔
.env檔案中的API_TOKEN條目下.env檔案中的NLP_CLOUD_TOKEN條目下.env檔案中的DASHBOT_KEY條目下 bot_name is a very understanding girl
bot_name and stranger are seeing each other
Here is a recent discussion between stranger and bot_name
###
stranger: hi
bot_name: hello there
def core(self, req: str, user_id: str):
python app.py
ngrok http 5000
使用如下所示提供的 URL 更新 MessengerX.io Portal 上的機器人 Webhook URL，以繼續開發
If you use [Ngrok.io](https://ngrok.io), your webhook URL would be of the format as in the example below
https://1234-115-187-40-104.ngrok.io/machaao/hook
造訪： https://messengerx.io/<bot-name>
我們假設您有權存取 heroku 帳戶並為您的作業系統安裝了 heroku 命令列用戶端。
heroku login
heroku create
git commit -m ".env updated"
git push heroku master
heroku logs --tail
使用 heroku 應用程式 URL 更新 MessengerX.io 入口網站上的機器人 Webhook URL
Webhook Url: <YOUR-HEROKU-APP-URL>/machaao/hook
造訪： https://messengerx.io/<your-character-name>
Tips for MPS on Mac [Use Nightly Build]
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu
