daily llama
1.0.0
Este projeto apresenta uma estrutura de geração de recuperação aumentada adaptada para conteúdo de notícias. Ao empregar o índice FAISS para uma pesquisa eficiente de similaridade, são recuperados documentos relevantes. Aproveitando o modelo LLAMA-2, esses documentos recuperados servem como base para a geração de respostas abrangentes e contextualmente precisas.
python3 daily-llama.py --dataset_path data/news-small.json --load_in_4bit True --query " What happened with Dimuth's cricket career? "Exemplo de resposta
Based on past newspaper contents, it appears that Dimuth Karunaratne's cricket career has been impacted by recent legal issues. According to a news article from March 2023, he was charged with driving under the influence of liquor and was released on bail after being produced before the Colombo Fort Magistrate Court. Additionally, he has requested the national cricket selection committee to reconsider his request to step down as Sri Lanka's Test captain due to personal reasons. However, it is unclear at this time how these legal issues will affect his playing career moving forward.
git clone https://github.com/Ransaka/daily-llama.git
cd /content/daily-llama
pip install -r requirements.txt --q
python server.py --dataset_path data/news-small.json --load_in_4bit True # you may require `huggingface-cli login` prior to this step 
