Difference between revisions of "Showstoppers for Ingredients Extraction and Analysis"
Jump to navigation
Jump to search
Line 31: | Line 31: | ||
=== Step 5 - Bad splitting into individual ingredients === | === Step 5 - Bad splitting into individual ingredients === | ||
* Add a multilingual no cut list of words like U.H.T Cat 1… | * Add a multilingual no cut list of words like U.H.T Cat 1… | ||
+ | ** https://wiki.openfoodfacts.org/Unrecognized_ingredients_patterns | ||
+ | |||
=== Step 6 - Bad ingredient properties recognition === | === Step 6 - Bad ingredient properties recognition === | ||
* Processing, Origins, Other properties | * Processing, Origins, Other properties |
Revision as of 15:56, 17 January 2025
Metrics
Step 1 - Remove pet food & Cosmetics
- AI: identify them, especially with ingredients, and move them to OBF, OPFF, OPF
Step 2 - Fix ingredients stored in the wrong language
- AI: automatic image deselection & reselection
- AI: drastic cleanup of bad lists
- AI: Data quality facets about ingredients become errors
Step 3 - Fix errors of ingredients cutting
- Crop/Recrop more tightly: Autocrop ingredient lists - Image recognition & suggested auto-crop
- Add more cutters in more languages
- Add more cutters in French
- Move it to AI/LLM: Extract automatically ingredient list from OCR
Step 4 - Fix errors with Bad OCRs
- Reprocess OCRs
- Done by Raphael Nov 2024
- Overwrite old lists that are very bad
- Perform spellcheck
Step 5 - Bad splitting into individual ingredients
- Add a multilingual no cut list of words like U.H.T Cat 1…
Step 6 - Bad ingredient properties recognition
- Processing, Origins, Other properties
Step 7 - Missing translations or synonyms
- Translate the taxonomies using LLM recipes
- Add synonyms
- https://github.com/openfoodfacts/openfoodfacts-server/blob/main/taxonomies/food/ingredients.txt
Step 8 - Truly untaxonomized ingredients
- Add those to the taxonomy - https://github.com/openfoodfacts/openfoodfacts-server/blob/main/taxonomies/food/ingredients.txt
Step 9 - Missing or Bad CIQUAL associations
- Add CIQUAL matches
- Add matches from other Nutrition databases
Step 10 - Bad or insufficient categorization
- Identify problematic categories
- Play Hunger Games on problematic categories (evaporation categories for instance)
Step 11 - Bad nutrition
- Clean nutrition
Step 12 - Additional data not the ingredient list
- Origins, -25% de sel, …
- Legal constraints added to taxonomies ?