AgentZero is a package that acts as a chat interface, with classes for interacting with OpenAI compatible APIs for inference, both locally and elsewhere.
As of this commit, this is updated to work with Kamiwaza 0.3.1; however, we have a very large in-progress revamp of agentzero that is not yet released; but we wanted to make this work with the latest Kamiwaza, and it also works with openai 1.0+ as the engines generally support that now.
(The key thing was we wanted to support Pydantic 2 in agentzero so you could use the kamiwaza venv also)
Below this installing/running is a quickstart for with & without Kamiwaza community edition.
Largely untested in fresh envs as of release 0 here; but you'll want to:
git clone https://kamiwaza-ai/agentzero
cd agentzero
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
And optionally if you are using it
pip install ./kamiwaza*whl
Or similar. Don't install the kamiwaza libs via pip unless you are also running Kamiwaza community edition (or other, but then you are probably talking to us); we wrapper the imports for Kamiwaza to autodetect.
You should be done
OPENAІ_API_KEY
env variableMODEL = 'model'
line to your preferred model. First PR moves to config?AgentZero has hooks to work with Kamiwaza, leveraging the Distributed Data Engines and Inference Mesh from Kamiwaza.AI - it can leverage Kamiwaza to:
This release is largely focused on AgentZero chat, which is in Modules/Chat
; however, you'll notice there's a bunch of scaffolding here. You can consider
the rest of that as experimentation of sorts;
This is a very early release; it's a usable MVP, and it should work out of the box with Kamiwaza Community Edition 0.2.0+; if you change default ports/etc, modify config.py
While this was basically hacked together in ~2 days, here's some stuff we have planned: