Showstoppers for Ingredients Extraction and Analysis

From Open Food Facts wiki
Revision as of 12:30, 17 January 2025 by Teolemon (talk | contribs) (Created page with "=== Step 1 - Remove pet food & Cosmetics === * AI: identify them, especially with ingredients, and move them to OBF, OPFF, OPF ** https://hunger.openfoodfacts.org/questions?ty...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Step 1 - Remove pet food & Cosmetics

Step 2 - Fix ingredients stored in the wrong language

  • AI: automatic image deselection & reselection
  • AI: drastic cleanup of bad lists
  • AI: Data quality facets about ingredients become errors

Step 3 - Fix errors of ingredients cutting

  • Add more cutters in more languages
  • Add more cutters in French

Step 4 - Fix errors with Bad OCRs

  • Reprocess OCRs
  • Perform spellcheck

Step 5 - Bad splitting into individual ingredients

  • Add a multilingual no cut list of words like U.H.T Cat 1…

Step 6 - Bad ingredient properties recognition

  • Processing, Origins, Other properties

Step 7 - Missing translations or synonyms

  • Translate the taxonomies using LLM recipes
  • Add synonyms

Step 8 - Truly untaxonomized ingredients

  • Add those to the taxonomy

Step 9 - Missing or Bad CIQUAL associations

  • Add CIQUAL matches
  • Add matches from other Nutrition databases

Step 10 - Bad or insufficient categorization

  • Identify problematic categories
  • Play Hunger Games on problematic categories

Step 11 - Bad nutrition

  • Clean nutrition

Step 12 - Additional data not the ingredient list

  • Origins, -25% de sel, …