codegen

Codegen

Codegen Salesforce, THUDM/ChatGLM-6B com servidor web

Bifurcação de https://github.com/salesforce/CodeGen

Adicionar suporte a servidor web

Suporte THUDM/ChatGLM-6B agora

Demonstração on-line

https://gitclone.com/aiit/chat/

Extensão de código do Visual Studio

https://github.com/git-cloner/codegeeker

referência

https://zhuanlan.zhihu.com/p/598982945 Crie um chatbot de nível de produção semelhante ao ChatGPT
https://www.zhihu.com/zvideo/1596160335995641856 Robô de bate-papo baseado em gpt-j-6b
https://zhuanlan.zhihu.com/p/594946225 Construa o modelo gpt-j-6b no host de nuvem Amazon AWS
https://zhuanlan.zhihu.com/p/588616069 Faça um gerador de código gratuito semelhante ao copiloto do github
https://zhuanlan.zhihu.com/p/620233511 Prática do modelo Tsinghua ChatGLM-6B
https://zhuanlan.zhihu.com/p/620070973 Prática de raciocínio ColossalAI
https://zhuanlan.zhihu.com/p/619954588 Prática Chinesa-LLaMA-Alpaca
https://zhuanlan.zhihu.com/p/624286959 Implantação FastChat e prática de chamadas de streaming

uso

Clonar código

clone git https://gitclone.com/github.com/git-cloner/codegen

Instalar

1.instale a placa gráfica e o driver Nvidia

2.instale o conda

3.iniciar tempo de execução virtual

conda create -n codegen python=3.8
conda activate codegen
pip install pillow -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install torch torchvision torchaudio -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install transformers==4.25.1 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install accelerate -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install aiohttp==3.8.3 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install aiohttp_cors==0.7.0 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
# pip install huggingface for gpt-neo
pip install datasets -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install gradio -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com
pip install sentencepiece==0.1.91 -i http://pypi.douban.com/simple --trusted-host=pypi.douban.com

Baixar modelo

wget -P checkpoints https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-nl.tar.gz && tar -xvf checkpoints/codegen-350M-nl.tar.gz -C checkpoints/
wget -P checkpoints https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-multi.tar.gz && tar -xvf checkpoints/codegen-350M-multi.tar.gz -C checkpoints/
wget -P checkpoints https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-mono.tar.gz && tar -xvf checkpoints/codegen-350M-mono.tar.gz -C checkpoints/

rodar como servidor web

conda activate codegen
python codegen.py

teste

post: http://127.0.0.1:5001/codegen ou post direto para: https://gitclone.com/aiit/codegen

Use o codegen do Salesforce

parâmetros de entrada: {"context":"def hello_world():","maxlength":128}

return parâmetros: { "resultado": "n print("Olá mundo")n hello_world()n ", "tempo": 1.9620850095525384 }

Usar THUDM/ChatGLM-6B

parâmetros de entrada: {"context":"Escreva uma versão python da classificação de array","maxlength":128}