Ding Search
A search engine written in Node.js that uses data collected by a web crawler.
Documentation
You can find the documentation for this project on the GitHub Wiki, but it's not quite finished yet.
Presentation
The presentation of Ding search and the web crawler can be found at vojhab.page.link/pva-prezentace.
Project goal
The goal of the Ding Search project is to create a search engine that will be able to search websites and offer users relevant search results based on the queries they enter. The search engine is written in Node.js and uses data collected by a web crawler.
Technologies used
- Node.js: An open-source runtime for running server-side JavaScript code.
- PostgreSQL: A database that offers a wide range of data management and storage functions, allowing users to efficiently store and retrieve data.
- OpenAI API: API to access advanced AI models.
- TensorFlow.js: Is an open-source machine learning and neural network library that can be used in JavaScript both in the browser and on the server side using Node.js.
npm packages
The following npm packages are used in this project:
- node-postgres: Allows access to the PostgreSQL database.
- dotenv: Loads variables from an .env file.
- ejs: Template system for generating HTML pages.
- express: Node.js framework for creating web applications and APIs.
- openai: Allows easy access to the OpenAI API.
- serve-favicon: Provides middleware for website favicons.
- xss: Protection against XSS attacks, i.e. against inserting malicious code into user inputs that are subsequently rendered on the page.
- @tensorflow/tfjs: This is an npm package for using the TensorFlow.js library in a project.
- @tensorflow-models/universal-sentence-encoder: A package to use the Universal Sentence Encoder model.
Planned changes and features
License
This project is licensed under the MIT license.
Creator
Vojtěch Habes
[email protected]
