SearchGPT

Connecting ChatGPT with the Internet

You want to try ChatGPT with Internet connectivity so that you can ask about events beyond 2021, but don't have access to AI-enabled Bing and don't want to wait for Google's Bard? SearchGPT gives you this functionality today - it crawls the Internet for information and then feeds it back to ChatGPT.

SearchGPT Demo

Usage

The easiest way to get started with search-gpt is to run the following:

export OPENAI_API_KEY=<REPLACE>
export GOOGLE_SEARCH_API_KEY=<REPLACE>
export GOOGLE_SEARCH_ID=<REPLACE>

npx search-gpt

Alternatively, you can also run:

npm install --global search-gpt

# Run SearchGPT with this command
searchgpt

Ensure you have your own Google Search API key, Programmable Search Engine and OpenAI API key before running the CLI.

Once the CLI starts, it will prompt you to enter a question. Simply type in your query, and the AI assistant will search the web and generate a response.

How it works

This is a proof of concept and is far from a proper implementation (e.g., Microsoft's Prometheus Model) - I wanted to experiment how easy it could be to crawl certain search engines and then feed these results into a large language model (LLM) such as GPT 3.5. Apart from querying Google Search, one could also think about integrating other APIs to crawl data and then feed it into the LLM.

flowchart LR
  A[User enters question] --> B[Search Google]
  A --> C[Search Twitter, not implemented yet]
  A --> D[Search other engines]
  B --> E[Search results handed to ChatGPT]
  E --> F[ChatGPT uses this context to provide an answer]

Please note: the current implementation feeds Google Search results to gpt-3.5-turbo and does not include previous messages in subsequent queries to avoid surpassing the token limit.