bosquet下载 - bosquet源代码下载

bosquet

Ai源码

2024.02.22

下载

用于基于大型语言模型的应用程序的 LLMOps

Bosquet 的使命是让构建人工智能应用变得简单。所有重要的人工智能应用程序都需要使用复杂性快速增长的提示模板，有限的LLM上下文窗口需要内存管理，并且人工智能应用程序需要代理来与外界交互。

Bosquet 提供了用于处理这些人工智能应用概念的工具：

LLM和工具服务管理
通过与优秀的 Selmer 模板库集成来提示模板化
通过强大的 Pathom 图形处理机进行提示链接和组合
用于与外部 API 交互的代理和工具定义抽象
LLM内存处理
其他工具，例如呼叫响应缓存（请参阅文档）

文档

完整的项目文档（WIP）

使用

密钥等秘密存储在secrets.edn文件中，本地参数保存在config.edn中。制作config.edn.sample和config.edn.sample文件的副本。根据需要进行更改。

命令行界面

命令行界面演示

运行以下命令以获取 CLI 选项

 clojure -M -m bosquet.cli

设置默认模型

 clojure -M -m bosquet.cli llms set --service openai --temperature 0 --model gpt-4

不要忘记为您的服务设置 API KEY（如果需要，请将“openai”更改为其他名称）

 clojure -M -m bosquet.cli keys set openai

有了这个集合，您就可以运行几代：

 clojure -M -m bosquet.cli "2+{{x}}="

或者使用文件

 clojure -M -m bosquet.cli -p demo/play-writer-prompt.edn -d demo/play-writer-data.edn

及时完成

简单的提示补全就可以这样完成。

 (require '[bosquet.llm.generator :refer [generate llm]])

(generate "When I was 6 my sister was half my age. Now I’m 70 how old is my sister?")
=>
"When you were 6, your sister was half your age, which means she was 6 / 2 = 3 years old.nSince then, there is a constant age difference of 3 years between you and your sister.nNow that you are 70, your sister would be 70 - 6 = 64 years old."}

从提示图完成

( require '[bosquet.llm :as llm])
( require '[bosquet.llm.generator :refer [generate llm]])

( generate
 llm/default-services
 { :question-answer " Question: {{question}}  Answer: {{answer}} "
  :answer          ( llm :openai )
  :self-eval       [ " Question: {{question}} "
                    " Answer: {{answer}} "
                    " "
                    " Is this a correct answer? "
                    " {{test}} " ]
  :test            ( llm :openai )}
 { :question " What is the distance from Moon to Io? " })
=>

{ :question-answer
 " Question: What is the distance from Moon to Io?  Answer: " ,
 :answer
 " The distance from the Moon to Io varies, as both are orbiting different bodies. On average, the distance between the Moon and Io is approximately 760,000 kilometers (470,000 miles). However, this distance can change due to the elliptical nature of their orbits. " ,
 :self-eval
 " Question: What is the distance from Moon to Io? n Answer: The distance from the Moon to Io varies, as both are orbiting different bodies. On average, the distance between the Moon and Io is approximately 760,000 kilometers (470,000 miles). However, this distance can change due to the elliptical nature of their orbits. nn Is this a correct answer? " ,
 :test
 " No, the answer provided is incorrect. The Moon is Earth's natural satellite, while Io is one of Jupiter's moons. Therefore, the distance between the Moon and Io can vary significantly depending on their relative positions in their respective orbits around Earth and Jupiter. " }

聊天

( require '[bosquet.llm.wkk :as wkk])
( generate
    [[ :system " You are an amazing writer. " ]
     [ :user [ " Write a synopsis for the play: "
             " Title: {{title}} "
             " Genre: {{genre}} "
             " Synopsis: " ]]
     [ :assistant ( llm wkk/openai
                    wkk/model-params { :temperature 0.8 :max-tokens 120 }
                    wkk/var-name :synopsis )]
     [ :user " Now write a critique of the above synopsis: " ]
     [ :assistant ( llm wkk/openai
                    wkk/model-params { :temperature 0.2 :max-tokens 120 }
                    wkk/var-name     :critique )]]
    { :title " Mr. X "
    :genre " Sci-Fi " })
=>

#:bosquet{ :conversation
          [[ :system " You are an amazing writer. " ]
           [ :user
            " Write a synopsis for the play: n Title: Mr. X n Genre: Sci-Fi n Synopsis: " ]
           [ :assistant " In a futuristic world where technology ... " ]
           [ :user " Now write a critique of the above synopsis: " ]
           [ :assistant
            " The synopsis for the play " Mr. X " presents an intriguing premise ... " ]],
          :completions
          { :synopsis
           " In a futuristic world where technology has ... " ,
           :critique
           " The synopsis for the play " Mr. X " presents an intriguing premise set ... " }}