codegen

Kodegen

Kodegen tenaga penjualan, THUDM/ChatGLM-6B dengan server web

Garpu dari https://github.com/salesforce/CodeGen

Tambahkan dukungan server web

Dukung THUDM/ChatGLM-6B Sekarang

Demo daring

https://gitclone.com/aiit/chat/

Ekstensi Kode Visual Studio

https://github.com/git-cloner/codegeeker

referensi

https://zhuanlan.zhihu.com/p/598982945 Buat chatbot tingkat produksi mirip dengan ChatGPT
https://www.zhihu.com/zvideo/1596160335995641856 Robot obrolan berdasarkan gpt-j-6b
https://zhuanlan.zhihu.com/p/594946225 Membangun model gpt-j-6b di host cloud Amazon AWS
https://zhuanlan.zhihu.com/p/588616069 Buat generator kode gratis mirip dengan kopilot github
https://zhuanlan.zhihu.com/p/620233511 Latihan model Tsinghua ChatGLM-6B
https://zhuanlan.zhihu.com/p/620070973 Latihan penalaran ColossalAI
https://zhuanlan.zhihu.com/p/619954588 Latihan Cina-LLaMA-Alpaca
https://zhuanlan.zhihu.com/p/624286959 Penerapan FastChat dan praktik panggilan streaming

penggunaan

Kode klon

git clone https://gitclone.com/github.com/git-cloner/codegen

Memasang

1.instal Kartu Grafis dan Driver Nvidia

2. pasang conda

3.init waktu proses virtual

conda create -n codegen python=3.8
conda activate codegen
pip install pillow -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install torch torchvision torchaudio -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install transformers==4.25.1 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install accelerate -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install aiohttp==3.8.3 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install aiohttp_cors==0.7.0 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
# pip install huggingface for gpt-neo
pip install datasets -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install gradio -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install sentencepiece==0.1.91 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com

Unduh modelnya

wget -P checkpoints https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-nl.tar.gz && tar -xvf checkpoints/codegen-350M-nl.tar.gz -C checkpoints/
wget -P checkpoints https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-multi.tar.gz && tar -xvf checkpoints/codegen-350M-multi.tar.gz -C checkpoints/
wget -P checkpoints https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-mono.tar.gz && tar -xvf checkpoints/codegen-350M-mono.tar.gz -C checkpoints/

dijalankan sebagai server web

conda activate codegen
python codegen.py

tes

posting: http://127.0.0.1:5001/codegen atau posting langsung ke :https://gitclone.com/aiit/codegen

Gunakan kodegen Salesforce

parameter masukan: {"context":"def hello_world():","maxlength":128}

parameter pengembalian: { "hasil": "n print("Halo dunia")n hello_world()n ", "waktu": 1.9620850095525384 }

Gunakan THUDM/ObrolanGLM-6B

parameter masukan: {"context":"Tulis pengurutan array versi python","maxlength":128}