openfoodfacts ai
v1
This repository is to track and store all our experimental AI endeavours, models training, and wishlists.
The Robotoff repo is the place to integrate them into production, and file more trivial issues.
Most trained Models and useful datasets are attached to releases of this project or releases on robotoff-models.
A Google spreadsheet also tracks active models.
Here are different experiments.
Nutrition table detection and extraction (2018 GSoc work by Sagar) - integrated in Robotoff, used for the detection part by the Graphnet and TableNet models
Nutrition Table Extraction (2020 by Sadok, Yichen and Ramzi) - on Graphnet and TableNet
Basic nutrition extraction for text tables, already in the Robotoff API
deployed
Google.org fellowship (2021) - Category prediction based on ingredients and title - deployed
not deployed:
EM Lyon Category prediction (2020) - not yet evaluated and integrated
Category from OCR prediction, Laure (Laurel16) (2021) - not yet evaluated and integrated - Categories maybe too general
on-going project @ openfoodfacts/off-category-classification#2
We e-meet Mondays at 17:00 Paris Time (16:00 London Time, 21:30 IST, 08:00 AM PT)
Video call link: https://meet.google.com/qvv-grzm-gzb
Join by phone: https://tel.meet/qvv-grzm-gzb?pin=9965177492770
Add the Event to your Calendar by adding the Open Food Facts community calendar to your calendar
Weekly Agenda: please add the Agenda items as early as you can. Make sure to check the Agenda items in advance of the meeting, so that we have the most informed discussions possible.
The meeting will handle Agenda items first, and if time permits, collaborative bug triage.
We strive to timebox the core of the meeting (decision making) to 30 minutes, with an optional free discussion/live debugging afterwards.
We take comprehensive notes in the Weekly Agenda of agenda item discussions and of decisions taken.
Labels and Logo detection (Data 4 Good, by Raphael, Charlotte and Antoine - code is duplicated and integrated in Robotoff
logo-ann (related to logos and labels) - classification using approximate KNN search - deployed in robotoff-ann
Updating the pre-weighted model to recent publications offers a nice no-effort boost
Spellcheck (by Wauplin) - code is duplicated and integrated in Robotoff
ocr-cleaning (please add a description)
object-detection (related to logos and labels)
You can fork this repository and start your own experiments or use a distinct repository. Please use a AGPL or more permissive but compatible license.
Do not hesitate to join us on #robotoff channel (or #computervision for work relating on images). We will be happy to help you get data, insights and other useful tips.
Our Roadmap for AI and Robotoff
Ideas for research projects for Open Food Facts
Ideas for applied ML for Open Food Facts
Proposed ideas for Google's Summer of Code
Get the data to start playing with food (see also datasets in this project releases)
You can see many great analysis of Open Food Facts data in notebooks on Kaggle
