Line 9: |
Line 9: |
| There are different reasons an ingredient can be marked as unknown: | | There are different reasons an ingredient can be marked as unknown: |
| | | |
− | * The input ingredient list is incorrect (mispellings etc.) | + | * The input ingredient list is incorrect (misspellings etc.) |
| * The ingredients list contains other things than ingredients and we have not been able to split it at the right place. | | * The ingredients list contains other things than ingredients and we have not been able to split it at the right place. |
− | * We have not been able to parse a particular sentence structure or formating (e.g. "a drop of delicious honey with a shower of powder sugar") | + | * We have not been able to parse a particular sentence structure or formatting (e.g. "a drop of delicious honey with a shower of powder sugar") |
| * The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language) | | * The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language) |
| | | |
| In the table below, | | In the table below, |
− | * the first column of numbers corresponds to the '''number of unique ingredients''' accross all products. | + | * the first column of numbers corresponds to the '''number of unique ingredients''' across all products. |
| * And the second column of number corresponds to the '''number of occurrences''' of those ingredients. e.g. if a specific ingredient appears in 5 products, it is counted 5 times. | | * And the second column of number corresponds to the '''number of occurrences''' of those ingredients. e.g. if a specific ingredient appears in 5 products, it is counted 5 times. |
− |
| |
− | Retrieved on 2020-03-05:
| |
| | | |
| === EN - English - UK === | | === EN - English - UK === |
Line 454: |
Line 452: |
| </pre> | | </pre> |
| |} | | |} |
| + | |
| + | |
| + | |
| + | === RU - Russian - Russia === |
| + | |
| + | {| class="wikitable" |
| + | |- |
| + | ! !! 2021-03-01 |
| + | |- |
| + | | [https://ru.openfoodfacts.org/ingredients?stats=1&nocache=1 All products:] || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 643 (11.92%) 8975 (50.23%) |
| + | unknown 4751 (88.08%) 8893 (49.77%) |
| + | all 5394 (100.00%) 17868 (100.00%) |
| + | </pre> |
| + | |} |
| + | |
| + | |
| + | |
| | | |
| == Ingredients analysis == | | == Ingredients analysis == |
Line 460: |
Line 478: |
| | | |
| To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan. | | To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan. |
− |
| |
− | Retrieved on 2020-03-05:
| |
| | | |
| === EN - English - UK === | | === EN - English - UK === |
Line 560: |
Line 576: |
| May contain palm oil 80 | | May contain palm oil 80 |
| Maybe vegan 56 | | Maybe vegan 56 |
| + | </pre> |
| + | |} |
| + | |
| + | === EN - English - US === |
| + | {| class="wikitable" |
| + | |- |
| + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| + | |- |
| + | | [https://us.openfoodfacts.org/ingredients-analysis All products:] |
| + | | not recorded |
| + | | not recorded |
| + | | <pre> |
| + | Vegetarian status unknown 209636 |
| + | Palm oil content unknown 185965 |
| + | Non-vegan 141735 |
| + | Vegan status unknown 123259 |
| + | Palm oil free 75096 |
| + | Vegetarian 46799 |
| + | Non-vegetarian 43169 |
| + | Vegan 41570 |
| + | Palm oil 37077 |
| + | May contain palm oil 21246 |
| + | Maybe vegetarian 19977 |
| + | Maybe vegan 13015 |
| + | </pre> |
| + | |- |
| + | | [https://us.openfoodfacts.org/popularity/top-10000-us-scans-2019/ingredients-analysis Top 10k most scanned products:] |
| + | | not recorded |
| + | | not recorded |
| + | | <pre> |
| + | Vegetarian status unknown 1467 |
| + | Palm oil content unknown 1285 |
| + | Vegan status unknown 973 |
| + | Non-vegan 746 |
| + | Palm oil free 511 |
| + | Vegetarian 424 |
| + | Vegan 366 |
| + | Palm oil 218 |
| + | Non-vegetarian 154 |
| + | May contain palm oil 130 |
| + | Maybe vegetarian 109 |
| + | Maybe vegan 69 |
| </pre> | | </pre> |
| |} | | |} |
Line 901: |
Line 959: |
| || | | || |
| <pre> | | <pre> |
| + | Palm oil content unknown 119907 |
| + | Vegetarian status unknown 116121 |
| + | Non-vegan 111887 |
| + | Palm oil free 84303 |
| + | Vegan status unknown 73777 |
| + | Vegetarian 56159 |
| + | Non-vegetarian 44779 |
| + | Vegan 42890 |
| + | Maybe vegetarian 20006 |
| + | Palm oil 15542 |
| + | May contain palm oil 13680 |
| + | Maybe vegan 8310 |
| </pre> | | </pre> |
| |- | | |- |
Line 936: |
Line 1,006: |
| || | | || |
| <pre> | | <pre> |
| + | Palm oil free 5116 |
| + | Non-vegan 4656 |
| + | Vegetarian status unknown 3743 |
| + | Vegetarian 3105 |
| + | Palm oil content unknown 2928 |
| + | Vegan 2107 |
| + | Vegan status unknown 2090 |
| + | Maybe vegetarian 1571 |
| + | Non-vegetarian 1090 |
| + | Palm oil 885 |
| + | Maybe vegan 653 |
| + | May contain palm oil 585 |
| </pre> | | </pre> |
| |} | | |} |
Line 978: |
Line 1,060: |
| || | | || |
| <pre> | | <pre> |
| + | Vegetarian status unknown 4057 |
| + | Palm oil content unknown 3739 |
| + | Vegan status unknown 2740 |
| + | Non-vegan 2262 |
| + | Palm oil free 1832 |
| + | Vegetarian 1181 |
| + | Vegan 944 |
| + | Non-vegetarian 514 |
| + | Palm oil 364 |
| + | Maybe vegetarian 343 |
| + | May contain palm oil 321 |
| + | Maybe vegan 147 |
| </pre> | | </pre> |
| |- | | |- |
Line 1,012: |
Line 1,106: |
| || | | || |
| <pre> | | <pre> |
| + | Vegetarian status unknown 1288 |
| + | Palm oil content unknown 1127 |
| + | Vegan status unknown 875 |
| + | Non-vegan 702 |
| + | Palm oil free 646 |
| + | Vegetarian 389 |
| + | Vegan 302 |
| + | Non-vegetarian 141 |
| + | Palm oil 133 |
| + | Maybe vegetarian 115 |
| + | May contain palm oil 95 |
| + | Maybe vegan 52 |
| </pre> | | </pre> |
| |} | | |} |
Line 1,054: |
Line 1,160: |
| || | | || |
| <pre> | | <pre> |
| + | Palm oil content unknown 1540 |
| + | Vegetarian status unknown 1527 |
| + | Vegetarian 1290 |
| + | Vegan 1090 |
| + | Vegan status unknown 1068 |
| + | Non-vegan 1022 |
| + | Palm oil free 906 |
| + | Palm oil 321 |
| + | Non-vegetarian 248 |
| + | Maybe vegetarian 194 |
| + | May contain palm oil 193 |
| + | Maybe vegan 76 |
| </pre> | | </pre> |
| |- | | |- |
Line 1,088: |
Line 1,206: |
| || | | || |
| <pre> | | <pre> |
| + | Vegetarian status unknown 338 |
| + | Palm oil content unknown 304 |
| + | Non-vegan 237 |
| + | Vegetarian 230 |
| + | Vegan status unknown 227 |
| + | Palm oil free 219 |
| + | Vegan 192 |
| + | Palm oil 88 |
| + | Maybe vegetarian 68 |
| + | May contain palm oil 53 |
| + | Non-vegetarian 43 |
| + | Maybe vegan 21 |
| </pre> | | </pre> |
| |} | | |} |
Line 1,131: |
Line 1,261: |
| || | | || |
| <pre> | | <pre> |
| + | Vegetarian status unknown 1036 |
| + | Palm oil content unknown 922 |
| + | Vegan status unknown 726 |
| + | Non-vegan 549 |
| + | Vegetarian 347 |
| + | Palm oil free 333 |
| + | Vegan 287 |
| + | May contain palm oil 159 |
| + | Palm oil 151 |
| + | Non-vegetarian 128 |
| + | Maybe vegetarian 90 |
| + | Maybe vegan 39 |
| </pre> | | </pre> |
| |- | | |- |
Line 1,165: |
Line 1,307: |
| || | | || |
| <pre> | | <pre> |
| + | Vegetarian status unknown 393 |
| + | Palm oil content unknown 333 |
| + | Vegan status unknown 272 |
| + | Non-vegan 190 |
| + | Vegetarian 135 |
| + | Palm oil free 125 |
| + | Vegan 107 |
| + | Palm oil 63 |
| + | May contain palm oil 53 |
| + | Maybe vegetarian 35 |
| + | Non-vegetarian 23 |
| + | Maybe vegan 17 |
| </pre> | | </pre> |
| |} | | |} |
| + | |
| + | === RU - Russian - Russia === |
| + | |
| + | {| class="wikitable" |
| + | |- |
| + | ! !! 2021-03-01 |
| + | |- |
| + | | [https://ru-en.openfoodfacts.org/ingredients-analysis All products:] |
| + | || |
| + | <pre> |
| + | Ingredients analysis Products * |
| + | Vegetarian status unknown 1164 |
| + | Palm oil content unknown 1087 |
| + | Vegan status unknown 952 |
| + | Non-vegan 304 |
| + | Palm oil free 103 |
| + | May contain palm oil 94 |
| + | Vegetarian 90 |
| + | Vegan 82 |
| + | Non-vegetarian 78 |
| + | Palm oil 53 |
| + | Maybe vegetarian 11 |
| + | Maybe vegan 5 |
| + | </pre> |
| + | |
| + | |} |
| + | |
| | | |
| == Evolution of the metrics between early March 2020 and mid May 2020 == | | == Evolution of the metrics between early March 2020 and mid May 2020 == |
Line 1,175: |
Line 1,356: |
| | | |
| Metrics: | | Metrics: |
− | * Ingredients parsing and recognition: % of known ingredients for all ingredients occurences. | + | * Ingredients parsing and recognition: % of known ingredients for all ingredients occurrences. |
| * Ingredients analysis: known vegetarian status | | * Ingredients analysis: known vegetarian status |
| ** = 1 - "Vegetarian status unknown" / ("Vegetarian status unknown" + "Vegetarian" + "Non vegetarian" + "Maybe vegetarian") | | ** = 1 - "Vegetarian status unknown" / ("Vegetarian status unknown" + "Vegetarian" + "Non vegetarian" + "Maybe vegetarian") |
Line 1,181: |
Line 1,362: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! Country !! % known ingredients March 2020 !! % known ingredients May 2020 !! % known vegetarian status March 2020 !! % known vegetarian status May 2020 | + | ! |
| + | ! colspan="3" | % known ingredients |
| + | ! colspan="3" | % known vegetarian status |
| + | |- |
| + | ! Country |
| + | ! March 2020 !! May 2020 !! Oct 2020 |
| + | ! March 2020 !! May 2020 !! Oct 2020 |
| |- | | |- |
− | | UK || 79.75% || 80.82% || 27.20%|| 45.94% | + | | UK || 79.75% || 80.82% || 92.27% |
| + | || 27.20% || 45.94% || 58.72% |
| |- | | |- |
− | | US || 82.12% || 84.67% || not recorded || not recorded | + | | US || 82.12% || 84.67% || 90.52% |
| + | || not recorded || not recorded || 34.40% |
| |- | | |- |
− | | DE || 84.75% || 86.72% || 35.76% || 50.04% | + | | DE || 84.75% || 86.72% || 89.03% |
| + | || 35.76% || 50.04% || 53.30% |
| |- | | |- |
− | | ES || 71.95% || 76.47% || 23.01% || 50.73% | + | | ES || 71.95% || 76.47% || 90.21% |
| + | || 23.01% || 50.73% || 60.95% |
| |- | | |- |
− | | FI || 89.15% || 91.43% || 41.68% || 49.30% | + | | FI || 89.15% || 91.43% || 95.22% |
| + | || 41.68% || 49.30% || 59.31% |
| |- | | |- |
− | | FR || 83.40% || 85.55% || 42.68% || 48.47% | + | | FR || 83.40% || 85.55% || 87.27% |
| + | || 42.68% || 48.47% || 51.02% |
| |- | | |- |
− | | IT || 74.58% || 78.54% || 23.19% || 32.35% | + | | IT || 74.58% || 78.54% || 78.75% |
| + | || 23.19% || 32.35% || 33.44% |
| |- | | |- |
− | | NL || 78.84% || 80.81% || 27.51% || 47.64% | + | | NL || 78.84% || 80.81% || 87.35% |
| + | || 27.51% || 47.64% || 53.15% |
| |- | | |- |
− | | PT || 70.50% || 71.53% || 20.36% || 26.74% | + | | PT || 70.50% || 71.53% || 75.32% |
| + | || 20.36% || 26.74% || 35.29% |
| |} | | |} |
| | | |
Line 1,211: |
Line 1,407: |
| | | |
| [[Category:Project:Personalized_Search]] | | [[Category:Project:Personalized_Search]] |
| + | [[Category:Data quality]] |
| + | [[Category:Ingredients]] |
| + | [[Category:Taxonomies]] |