Difference between revisions of "Showstoppers for Ingredients Extraction and Analysis"
Jump to navigation
Jump to search
(One intermediate revision by the same user not shown) | |||
Line 7: | Line 7: | ||
** https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-pet-food-facts | ** https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-pet-food-facts | ||
** https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-products-facts | ** https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-products-facts | ||
+ | ** Products with a given cosmetic ingredient which don't have the OBF category: https://world.openfoodfacts.org/cgi/search.pl?action=process&tagtype_0=categories&tag_contains_0=does_not_contain&tag_0=Open%20Beauty%20Facts&tagtype_1=ingredients&tag_contains_1=contains&tag_1=cocamidopropyl%20betaine&sort_by=unique_scans_n&page_size=20 | ||
=== Step 2 - Fix ingredients stored in the wrong language === | === Step 2 - Fix ingredients stored in the wrong language === |
Latest revision as of 17:10, 17 January 2025
Metrics
Step 1 - Remove pet food & Cosmetics
- AI: identify them, especially with ingredients, and move them to OBF, OPFF, OPF
- https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-beauty-facts
- https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-pet-food-facts
- https://hunger.openfoodfacts.org/questions?type=category&value_tag=en%3Aopen-products-facts
- Products with a given cosmetic ingredient which don't have the OBF category: https://world.openfoodfacts.org/cgi/search.pl?action=process&tagtype_0=categories&tag_contains_0=does_not_contain&tag_0=Open%20Beauty%20Facts&tagtype_1=ingredients&tag_contains_1=contains&tag_1=cocamidopropyl%20betaine&sort_by=unique_scans_n&page_size=20
Step 2 - Fix ingredients stored in the wrong language
- AI: automatic image deselection & reselection
- AI: drastic cleanup of bad lists
- AI: Data quality facets about ingredients become errors
Step 3 - Fix errors of ingredients cutting
- Crop/Recrop more tightly: Autocrop ingredient lists - Image recognition & suggested auto-crop
- Add more cutters in more languages
- Add more cutters in French
- Move it to AI/LLM: Extract automatically ingredient list from OCR
Step 4 - Fix errors with Bad OCRs
- Reprocess OCRs
- Done by Raphael Nov 2024
- Overwrite old lists that are very bad
- Perform spellcheck
Step 5 - Bad splitting into individual ingredients
- Add a multilingual no cut list of words like U.H.T Cat 1…
Step 6 - Bad ingredient properties recognition
- Processing, Origins, Other properties
Step 7 - Missing translations or synonyms
- Translate the taxonomies using LLM recipes
- Add synonyms
- https://github.com/openfoodfacts/openfoodfacts-server/blob/main/taxonomies/food/ingredients.txt
Step 8 - Truly untaxonomized ingredients
- Add those to the taxonomy - https://github.com/openfoodfacts/openfoodfacts-server/blob/main/taxonomies/food/ingredients.txt
- https://wiki.openfoodfacts.org/Untaxonomized_values
Step 9 - Missing or Bad CIQUAL associations
- Add CIQUAL matches
- Add matches from other Nutrition databases
Step 10 - Bad or insufficient categorization
- Identify problematic categories
- Play Hunger Games on problematic categories (evaporation categories for instance)
Step 11 - Bad nutrition
- Clean nutrition
Step 12 - Additional data not the ingredient list
- Origins, -25% de sel, …
- Legal constraints added to taxonomies ?