Difference between revisions of "Ingredients Analysis Quality Evaluation - January 2025"

From Open Food Facts wiki
Jump to navigation Jump to search
 
(One intermediate revision by the same user not shown)
Line 16: Line 16:
 
* And the second column of number corresponds to the '''number of occurrences''' of those ingredients. e.g., if a specific ingredient appears in 5 products, it is counted 5 times.
 
* And the second column of number corresponds to the '''number of occurrences''' of those ingredients. e.g., if a specific ingredient appears in 5 products, it is counted 5 times.
  
 +
 +
Sampled on 17/01/2024
 +
 +
=== DE - German ===
 +
183880 Inhaltsstoffe:
 +
{| class="wikitable"
 +
!Type
 +
!Unique tags
 +
!Occurrences
 +
|-
 +
|known
 +
|3510 (1.91%)
 +
|1799528 (85.04%)
 +
|-
 +
|unknown
 +
|180370 (98.09%)
 +
|316520 (14.96%)
 +
|-
 +
|all
 +
|183880 (100.00%)
 +
|2116048 (100.00%)
 +
|}
 +
 +
=== ES - Spanish ===
 +
88764 ingredientes:
 +
{| class="wikitable"
 +
!Type
 +
!Unique tags
 +
!Occurrences
 +
|-
 +
|known
 +
|3235 (3.64%)
 +
|780248 (85.90%)
 +
|-
 +
|unknown
 +
|85529 (96.36%)
 +
|128021 (14.10%)
 +
|-
 +
|all
 +
|88764 (100.00%)
 +
|908269 (100.00%)
 +
|}
  
 
=== FR - French ===
 
=== FR - French ===
=== JP - Japanese ===
+
 
 +
450308 ingrédients :
 +
{| class="wikitable"
 +
!Type
 +
!Unique tags
 +
!Occurrences
 +
|-
 +
|known
 +
|4797 (1.07%)
 +
|6438145 (89.58%)
 +
|-
 +
|unknown
 +
|445511 (98.93%)
 +
|749267 (10.42%)
 +
|-
 +
|all
 +
|450308 (100.00%)
 +
|7187412 (100.00%)
 +
|}
 +
 
 +
 
 +
===IT - Italian===
 +
63993 ingredientes:
 +
{| class="wikitable"
 +
!Type
 +
!Unique tags
 +
!Occurrences
 +
|-
 +
|known
 +
|2694 (4.21%)
 +
|466011 (83.75%)
 +
|-
 +
|unknown
 +
|61299 (95.79%)
 +
|90425 (16.25%)
 +
|-
 +
|all
 +
|63993 (100.00%)
 +
|556436 (100.00%)
 +
|}
 +
 
 +
===JP - Japanese===
  
  
Line 40: Line 123:
 
|}
 
|}
  
=== HR - Croatian ===
+
===HR - Croatian===
  
  
Line 62: Line 145:
 
|}
 
|}
  
=== PL - Polish ===
+
===PL - Polish===
  
 
8971 składniki:
 
8971 składniki:
Line 84: Line 167:
  
  
=== UK + English ===
+
===UK + English===
 
 
=== Observations ===
 
  
 +
===Observations===
  
[[Category:Project:Personalized_Search]]
+
[[Category:Project:Personalized Search]]
 
[[Category:Data quality]]
 
[[Category:Data quality]]
 
[[Category:Ingredients]]
 
[[Category:Ingredients]]
 
[[Category:Metrics]]
 
[[Category:Metrics]]

Latest revision as of 16:18, 17 January 2025

Evaluation of the quality of Ingredients Extraction and Analysis so that we can measure the improvements.

Ingredients parsing and recognition

For each product, the ingredients list is parsed to separate each ingredient. Ingredients that we can match to our multilingual ingredients taxonomy as marked as "known", others as "unknown".

There are different reasons an ingredient can be marked as unknown:

  • The input ingredient list is incorrect (misspellings etc.)
  • The ingredients list contains other things than ingredients, and we have not been able to split it at the right place.
  • We have not been able to parse a particular sentence structure or formatting (e.g., "a drop of delicious honey with a shower of powder sugar")
  • The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language)

In the table below,

  • the first column of numbers corresponds to the number of unique ingredients across all products.
  • And the second column of number corresponds to the number of occurrences of those ingredients. e.g., if a specific ingredient appears in 5 products, it is counted 5 times.


Sampled on 17/01/2024

DE - German

183880 Inhaltsstoffe:

Type Unique tags Occurrences
known 3510 (1.91%) 1799528 (85.04%)
unknown 180370 (98.09%) 316520 (14.96%)
all 183880 (100.00%) 2116048 (100.00%)

ES - Spanish

88764 ingredientes:

Type Unique tags Occurrences
known 3235 (3.64%) 780248 (85.90%)
unknown 85529 (96.36%) 128021 (14.10%)
all 88764 (100.00%) 908269 (100.00%)

FR - French

450308 ingrédients :

Type Unique tags Occurrences
known 4797 (1.07%) 6438145 (89.58%)
unknown 445511 (98.93%) 749267 (10.42%)
all 450308 (100.00%) 7187412 (100.00%)


IT - Italian

63993 ingredientes:

Type Unique tags Occurrences
known 2694 (4.21%) 466011 (83.75%)
unknown 61299 (95.79%) 90425 (16.25%)
all 63993 (100.00%) 556436 (100.00%)

JP - Japanese

4487 原材料:

Type Unique tags Occurrences
known 1026 (22.87%) 18832 (80.41%)
unknown 3461 (77.13%) 4587 (19.59%)
all 4487 (100.00%) 23419 (100.00%)

HR - Croatian

6468 sastojci:

Type Unique tags Occurrences
known 1751 (27.07%) 44073 (89.55%)
unknown 4717 (72.93%) 5141 (10.45%)
all 6468 (100.00%) 49214 (100.00%)

PL - Polish

8971 składniki:

Type Unique tags Occurrences
known 2135 (23.80%) 184483 (95.40%)
unknown 6836 (76.20%) 8899 (4.60%)
all 8971 (100.00%) 193382 (100.00%)


UK + English

Observations