Line 1: |
Line 1: |
− | In early March 2020, we made an evaluation of the quality of ingredients analysis so that we could measure the improvements made as part of the [[Ingredients analysis and search features extraction]] task of the [[Project:Personalized_Search]]. | + | In early March 2020, we made an evaluation of the quality of [[Ingredients Extraction and Analysis]] so that we could measure the improvements made as part of the [[Ingredients analysis and search features extraction]] task of the [[Project:Personalized_Search]]. |
| | | |
| The metrics have also been recorded in mid May 2020 in order to measure the impact of the improvements we made. | | The metrics have also been recorded in mid May 2020 in order to measure the impact of the improvements we made. |
Line 9: |
Line 9: |
| There are different reasons an ingredient can be marked as unknown: | | There are different reasons an ingredient can be marked as unknown: |
| | | |
− | * The input ingredient list is incorrect (mispellings etc.) | + | * The input ingredient list is incorrect (misspellings etc.) |
| * The ingredients list contains other things than ingredients and we have not been able to split it at the right place. | | * The ingredients list contains other things than ingredients and we have not been able to split it at the right place. |
− | * We have not been able to parse a particular sentence structure or formating (e.g. "a drop of delicious honey with a shower of powder sugar") | + | * We have not been able to parse a particular sentence structure or formatting (e.g. "a drop of delicious honey with a shower of powder sugar") |
| * The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language) | | * The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language) |
| | | |
| In the table below, | | In the table below, |
− | * the first column of numbers corresponds to the '''number of unique ingredients''' accross all products. | + | * the first column of numbers corresponds to the '''number of unique ingredients''' across all products. |
| * And the second column of number corresponds to the '''number of occurrences''' of those ingredients. e.g. if a specific ingredient appears in 5 products, it is counted 5 times. | | * And the second column of number corresponds to the '''number of occurrences''' of those ingredients. e.g. if a specific ingredient appears in 5 products, it is counted 5 times. |
− |
| |
− | Retrieved on 2020-03-05:
| |
| | | |
| === EN - English - UK === | | === EN - English - UK === |
Line 24: |
Line 22: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://uk.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://uk.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 39: |
Line 37: |
| unknown 20099 (91.83%) 29578 (19.18%) | | unknown 20099 (91.83%) 29578 (19.18%) |
| all 21886 (100.00%) 154204 (100.00%) | | all 21886 (100.00%) 154204 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 2262 (14.84%) 197422 (92.27%) |
| + | unknown 12977 (85.16%) 16548 (7.73%) |
| + | all 15239 (100.00%) 213970 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 52: |
Line 57: |
| unknown 3720 (77.91%) 4678 (18.07%) | | unknown 3720 (77.91%) 4678 (18.07%) |
| all 4775 (100.00%) 25894 (100.00%) | | all 4775 (100.00%) 25894 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 1347 (44.87%) 28948 (93.92%) |
| + | unknown 1655 (55.13%) 1874 (6.08%) |
| + | all 3002 (100.00%) 30822 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 61: |
Line 72: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-21 !! 2020-05-14 | + | ! !! 2020-03-21 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://us.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://us.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 70: |
Line 81: |
| all 97278 (100.00%) 3260942 (100.00%) | | all 97278 (100.00%) 3260942 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
| known 2218 (1.79%) 6457065 (84.67%) | | known 2218 (1.79%) 6457065 (84.67%) |
| unknown 122007 (98.21%) 1168962 (15.33%) | | unknown 122007 (98.21%) 1168962 (15.33%) |
− | all 124225 (100.00%) 7626027 (100.00%) | + | all 124225 (100.00%) 7626027 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 2787 (2.11%) 7435946 (90.52%) |
| + | unknown 129044 (97.89%) 778751 (9.48%) |
| + | all 131831 (100.00%) 8214697 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 89: |
Line 107: |
| unknown 4086 (79.48%) 8347 (17.98%) | | unknown 4086 (79.48%) 8347 (17.98%) |
| all 5141 (100.00%) 46415 (100.00%) | | all 5141 (100.00%) 46415 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 1275 (24.46%) 43918 (87.18%) |
| + | unknown 3938 (75.54%) 6456 (12.82%) |
| + | all 5213 (100.00%) 50374 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 96: |
Line 120: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://de.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://de.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 105: |
Line 129: |
| all 39930 (100.00%) 429470 (100.00%) | | all 39930 (100.00%) 429470 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
Line 111: |
Line 135: |
| unknown 37522 (94.38%) 63935 (13.28%) | | unknown 37522 (94.38%) 63935 (13.28%) |
| all 39755 (100.00%) 481539 (100.00%) | | all 39755 (100.00%) 481539 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 2491 (5.97%) 518324 (89.03%) |
| + | unknown 39239 (94.03%) 63880 (10.97%) |
| + | all 41730 (100.00%) 582204 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
− | | [https://de.openfoodfacts.org/popularity/top-10000-de-scans-2019/ingredients?stats=1 Top 10k most scanned products:] || | + | | [https://de.openfoodfacts.org/popularity/top-10000-de-scans-2019/ingredients?stats=1 Top 10k most scanned products:] || |
| <pre> | | <pre> |
| known 1435 (14.73%) 69066 (85.53%) | | known 1435 (14.73%) 69066 (85.53%) |
Line 124: |
Line 155: |
| unknown 7439 (83.12%) 10187 (11.87%) | | unknown 7439 (83.12%) 10187 (11.87%) |
| all 8950 (100.00%) 85840 (100.00%) | | all 8950 (100.00%) 85840 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 1624 (19.65%) 85314 (90.61%) |
| + | unknown 6640 (80.35%) 8845 (9.39%) |
| + | all 8264 (100.00%) 94159 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 131: |
Line 168: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://es.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://es.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 140: |
Line 177: |
| all 46323 (100.00%) 244760 (100.00%) | | all 46323 (100.00%) 244760 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
Line 146: |
Line 183: |
| unknown 45977 (95.71%) 70846 (23.53%) | | unknown 45977 (95.71%) 70846 (23.53%) |
| all 48036 (100.00%) 301053 (100.00%) | | all 48036 (100.00%) 301053 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 2494 (9.14%) 314030 (90.21%) |
| + | unknown 24786 (90.86%) 34086 (9.79%) |
| + | all 27280 (100.00%) 348116 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 159: |
Line 203: |
| unknown 9751 (87.81%) 13134 (19.16%) | | unknown 9751 (87.81%) 13134 (19.16%) |
| all 11105 (100.00%) 68536 (100.00%) | | all 11105 (100.00%) 68536 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 1609 (25.94%) 72353 (92.96%) |
| + | unknown 4593 (74.06%) 5478 (7.04%) |
| + | all 6202 (100.00%) 77831 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 166: |
Line 216: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://fi.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://fi.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 175: |
Line 225: |
| all 1886 (100.00%) 12416 (100.00%) | | all 1886 (100.00%) 12416 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
− |
| |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
| known 910 (45.09%) 15650 (91.43%) | | known 910 (45.09%) 15650 (91.43%) |
| unknown 1108 (54.91%) 1466 (8.57%) | | unknown 1108 (54.91%) 1466 (8.57%) |
| all 2018 (100.00%) 17116 (100.00%) | | all 2018 (100.00%) 17116 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 1285 (56.56%) 25597 (95.22%) |
| + | unknown 987 (43.44%) 1284 (4.78%) |
| + | all 2272 (100.00%) 26881 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 196: |
Line 252: |
| unknown 281 (32.60%) 323 (8.04%) | | unknown 281 (32.60%) 323 (8.04%) |
| all 862 (100.00%) 4017 (100.00%) | | all 862 (100.00%) 4017 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 704 (85.02%) 4276 (96.79%) |
| + | unknown 124 (14.98%) 142 (3.21%) |
| + | all 828 (100.00%) 4418 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 203: |
Line 265: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://fr.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://fr.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 210: |
Line 272: |
| known 3825 (0.85%) 3708820 (83.40%) | | known 3825 (0.85%) 3708820 (83.40%) |
| unknown 446838 (99.15%) 738291 (16.60%) | | unknown 446838 (99.15%) 738291 (16.60%) |
− | all 450664 (100.00%) 4447111 (100.00%) | + | all 450664 (100.00%) 4447111 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
| known 3793 (0.92%) 3832574 (85.55%) | | known 3793 (0.92%) 3832574 (85.55%) |
| unknown 406901 (99.08%) 647239 (14.45%) | | unknown 406901 (99.08%) 647239 (14.45%) |
− | all 410694 (100.00%) 4479813 (100.00%) | + | all 410694 (100.00%) 4479813 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 4149 (1.08%) 4134163 (87.27%) |
| + | unknown 380115 (98.92%) 603291 (12.73%) |
| + | all 384264 (100.00%) 4737454 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 231: |
Line 300: |
| unknown 7044 (75.71%) 9655 (4.92%) | | unknown 7044 (75.71%) 9655 (4.92%) |
| all 9304 (100.00%) 196297 (100.00%) | | all 9304 (100.00%) 196297 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 2360 (26.98%) 193659 (95.71%) |
| + | unknown 6387 (73.02%) 8684 (4.29%) |
| + | all 8747 (100.00%) 202343 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 238: |
Line 313: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://it.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://it.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 247: |
Line 322: |
| all 13989 (100.00%) 71531 (100.00%) | | all 13989 (100.00%) 71531 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
Line 253: |
Line 328: |
| unknown 13976 (90.79%) 18557 (21.46%) | | unknown 13976 (90.79%) 18557 (21.46%) |
| all 15394 (100.00%) 86457 (100.00%) | | all 15394 (100.00%) 86457 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 1568 (8.56%) 86863 (78.75%) |
| + | unknown 16751 (91.44%) 23446 (21.25%) |
| + | all 18319 (100.00%) 110309 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 266: |
Line 348: |
| unknown 5507 (85.10%) 6747 (21.89%) | | unknown 5507 (85.10%) 6747 (21.89%) |
| all 6471 (100.00%) 30819 (100.00%) | | all 6471 (100.00%) 30819 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 1024 (15.27%) 27083 (78.92%) |
| + | unknown 5683 (84.73%) 7233 (21.08%) |
| + | all 6707 (100.00%) 34316 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 273: |
Line 361: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://nl.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://nl.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 282: |
Line 370: |
| all 7658 (100.00%) 39944 (100.00%) | | all 7658 (100.00%) 39944 (100.00%) |
| </pre> | | </pre> |
− | | + | || |
− | ||
| |
| <pre> | | <pre> |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
Line 289: |
Line 376: |
| unknown 6461 (82.28%) 8555 (19.19%) | | unknown 6461 (82.28%) 8555 (19.19%) |
| all 7852 (100.00%) 44574 (100.00%) | | all 7852 (100.00%) 44574 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 1543 (20.16%) 48344 (87.35%) |
| + | unknown 6112 (79.84%) 7004 (12.65%) |
| + | all 7655 (100.00%) 55348 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 302: |
Line 396: |
| unknown 1951 (71.00%) 2379 (20.72%) | | unknown 1951 (71.00%) 2379 (20.72%) |
| all 2748 (100.00%) 11483 (100.00%) | | all 2748 (100.00%) 11483 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 883 (39.42%) 11319 (88.77%) |
| + | unknown 1357 (60.58%) 1432 (11.23%) |
| + | all 2240 (100.00%) 12751 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
Line 309: |
Line 409: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://pt.openfoodfacts.org/ingredients?stats=1 All products:] || | | | [https://pt.openfoodfacts.org/ingredients?stats=1 All products:] || |
Line 318: |
Line 418: |
| all 5719 (100.00%) 22433 (100.00%) | | all 5719 (100.00%) 22433 (100.00%) |
| </pre> | | </pre> |
− | ||
| + | || |
| <pre> | | <pre> |
− |
| |
| Type Unique tags Occurrences | | Type Unique tags Occurrences |
| known 948 (16.10%) 17005 (71.53%) | | known 948 (16.10%) 17005 (71.53%) |
| unknown 4940 (83.90%) 6769 (28.47%) | | unknown 4940 (83.90%) 6769 (28.47%) |
| all 5888 (100.00%) 23774 (100.00%) | | all 5888 (100.00%) 23774 (100.00%) |
− | | + | </pre> |
| + | || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 1081 (16.84%) 21149 (75.32%) |
| + | unknown 5337 (83.16%) 6931 (24.68%) |
| + | all 6418 (100.00%) 28080 (100.00%) |
| </pre> | | </pre> |
| |- | | |- |
Line 339: |
Line 444: |
| unknown 2349 (79.60%) 2775 (29.57%) | | unknown 2349 (79.60%) 2775 (29.57%) |
| all 2951 (100.00%) 9383 (100.00%) | | all 2951 (100.00%) 9383 (100.00%) |
| + | </pre> |
| + | || |
| + | <pre> |
| + | known 652 (23.15%) 7858 (76.02%) |
| + | unknown 2164 (76.85%) 2479 (23.98%) |
| + | all 2816 (100.00%) 10337 (100.00%) |
| + | </pre> |
| + | |} |
| + | |
| + | |
| + | |
| + | === RU - Russian - Russia === |
| + | |
| + | {| class="wikitable" |
| + | |- |
| + | ! !! 2021-03-01 |
| + | |- |
| + | | [https://ru.openfoodfacts.org/ingredients?stats=1&nocache=1 All products:] || |
| + | <pre> |
| + | Type Unique tags Occurrences |
| + | known 643 (11.92%) 8975 (50.23%) |
| + | unknown 4751 (88.08%) 8893 (49.77%) |
| + | all 5394 (100.00%) 17868 (100.00%) |
| </pre> | | </pre> |
| |} | | |} |
| + | |
| + | |
| + | |
| | | |
| == Ingredients analysis == | | == Ingredients analysis == |
Line 347: |
Line 478: |
| | | |
| To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan. | | To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan. |
− |
| |
− | Retrieved on 2020-03-05:
| |
| | | |
| === EN - English - UK === | | === EN - English - UK === |
Line 354: |
Line 483: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://uk.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://uk.openfoodfacts.org/ingredients-analysis All products:] || |
Line 385: |
Line 514: |
| Maybe vegetarian 214 | | Maybe vegetarian 214 |
| Maybe vegan 102 | | Maybe vegan 102 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 4325 |
| + | Vegetarian 4185 |
| + | Palm oil content unknown 4169 |
| + | Non-vegan 4101 |
| + | Palm oil free 3381 |
| + | Vegan status unknown 2980 |
| + | Vegan 2932 |
| + | Palm oil 1528 |
| + | Non-vegetarian 1356 |
| + | Maybe vegetarian 610 |
| + | May contain palm oil 506 |
| + | Maybe vegan 373 |
| </pre> | | </pre> |
| |- | | |- |
Line 417: |
Line 561: |
| Maybe vegetarian 45 | | Maybe vegetarian 45 |
| Maybe vegan 18 | | Maybe vegan 18 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian 710 |
| + | Vegetarian status unknown 659 |
| + | Palm oil content unknown 604 |
| + | Non-vegan 588 |
| + | Palm oil free 555 |
| + | Vegan status unknown 475 |
| + | Vegan 467 |
| + | Palm oil 295 |
| + | Non-vegetarian 119 |
| + | Maybe vegetarian 110 |
| + | May contain palm oil 80 |
| + | Maybe vegan 56 |
| </pre> | | </pre> |
| |} | | |} |
| | | |
| + | === EN - English - US === |
| + | {| class="wikitable" |
| + | |- |
| + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| + | |- |
| + | | [https://us.openfoodfacts.org/ingredients-analysis All products:] |
| + | | not recorded |
| + | | not recorded |
| + | | <pre> |
| + | Vegetarian status unknown 209636 |
| + | Palm oil content unknown 185965 |
| + | Non-vegan 141735 |
| + | Vegan status unknown 123259 |
| + | Palm oil free 75096 |
| + | Vegetarian 46799 |
| + | Non-vegetarian 43169 |
| + | Vegan 41570 |
| + | Palm oil 37077 |
| + | May contain palm oil 21246 |
| + | Maybe vegetarian 19977 |
| + | Maybe vegan 13015 |
| + | </pre> |
| + | |- |
| + | | [https://us.openfoodfacts.org/popularity/top-10000-us-scans-2019/ingredients-analysis Top 10k most scanned products:] |
| + | | not recorded |
| + | | not recorded |
| + | | <pre> |
| + | Vegetarian status unknown 1467 |
| + | Palm oil content unknown 1285 |
| + | Vegan status unknown 973 |
| + | Non-vegan 746 |
| + | Palm oil free 511 |
| + | Vegetarian 424 |
| + | Vegan 366 |
| + | Palm oil 218 |
| + | Non-vegetarian 154 |
| + | May contain palm oil 130 |
| + | Maybe vegetarian 109 |
| + | Maybe vegan 69 |
| + | </pre> |
| + | |} |
| | | |
| === DE - German - Germany === | | === DE - German - Germany === |
Line 425: |
Line 625: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://de-en.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://de-en.openfoodfacts.org/ingredients-analysis All products:] || |
Line 456: |
Line 656: |
| May contain palm oil 1365 | | May contain palm oil 1365 |
| Maybe vegan 462 | | Maybe vegan 462 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Palm oil content unknown 16918 |
| + | Vegetarian status unknown 15208 |
| + | Non-vegan 13551 |
| + | Vegetarian 11130 |
| + | Palm oil free 10254 |
| + | Vegan status unknown 9270 |
| + | Vegan 8894 |
| + | Non-vegetarian 3990 |
| + | Palm oil 2527 |
| + | Maybe vegetarian 2238 |
| + | May contain palm oil 1796 |
| + | Maybe vegan 767 |
| </pre> | | </pre> |
| |- | | |- |
Line 488: |
Line 703: |
| May contain palm oil 279 | | May contain palm oil 279 |
| Maybe vegan 118 | | Maybe vegan 118 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Palm oil content unknown 2376 |
| + | Vegetarian status unknown 2307 |
| + | Non-vegan 2207 |
| + | Vegetarian 1844 |
| + | Palm oil free 1753 |
| + | Vegan 1384 |
| + | Vegan status unknown 1316 |
| + | Palm oil 535 |
| + | Maybe vegetarian 498 |
| + | Non-vegetarian 441 |
| + | May contain palm oil 343 |
| + | Maybe vegan 172 |
| </pre> | | </pre> |
| |} | | |} |
Line 495: |
Line 725: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://es-en.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://es-en.openfoodfacts.org/ingredients-analysis All products:] || |
Line 526: |
Line 756: |
| Maybe vegetarian 664 | | Maybe vegetarian 664 |
| Maybe vegan 286 | | Maybe vegan 286 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian 9956 |
| + | Palm oil content unknown 9683 |
| + | Vegan 8995 |
| + | Vegetarian status unknown 8902 |
| + | Palm oil free 8777 |
| + | Non-vegan 7191 |
| + | Vegan status unknown 5816 |
| + | Non-vegetarian 2356 |
| + | Maybe vegetarian 1584 |
| + | May contain palm oil 1446 |
| + | Palm oil 1353 |
| + | Maybe vegan 765 |
| </pre> | | </pre> |
| |- | | |- |
Line 558: |
Line 803: |
| Maybe vegetarian 209 | | Maybe vegetarian 209 |
| Maybe vegan 100 | | Maybe vegan 100 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 1776 |
| + | Palm oil free 1704 |
| + | Palm oil content unknown 1661 |
| + | Non-vegan 1658 |
| + | Vegetarian 1460 |
| + | Vegan 1186 |
| + | Vegan status unknown 1071 |
| + | Maybe vegetarian 454 |
| + | Non-vegetarian 453 |
| + | May contain palm oil 378 |
| + | Palm oil 365 |
| + | Maybe vegan 225 |
| </pre> | | </pre> |
| |} | | |} |
Line 565: |
Line 825: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://fi-en.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://fi-en.openfoodfacts.org/ingredients-analysis All products:] || |
Line 596: |
Line 856: |
| May contain palm oil 78 | | May contain palm oil 78 |
| Maybe vegan 52 | | Maybe vegan 52 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Non-vegan 559 |
| + | Vegetarian status unknown 481 |
| + | Palm oil free 450 |
| + | Palm oil content unknown 431 |
| + | Vegan status unknown 293 |
| + | Vegetarian 287 |
| + | Vegan 236 |
| + | Non-vegetarian 212 |
| + | Maybe vegetarian 202 |
| + | Palm oil 161 |
| + | May contain palm oil 123 |
| + | Maybe vegan 92 |
| </pre> | | </pre> |
| |- | | |- |
Line 628: |
Line 903: |
| Maybe vegan 15 | | Maybe vegan 15 |
| May contain palm oil 13 | | May contain palm oil 13 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Palm oil free 92 |
| + | Non-vegan 89 |
| + | Vegetarian status unknown 68 |
| + | Palm oil content unknown 66 |
| + | Vegetarian 52 |
| + | Vegan 46 |
| + | Vegan status unknown 39 |
| + | Maybe vegetarian 38 |
| + | Non-vegetarian 38 |
| + | Palm oil 24 |
| + | Maybe vegan 22 |
| + | May contain palm oil 14 |
| </pre> | | </pre> |
| |} | | |} |
Line 635: |
Line 925: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://fr-en.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://fr-en.openfoodfacts.org/ingredients-analysis All products:] || |
Line 666: |
Line 956: |
| May contain palm oil 12870 | | May contain palm oil 12870 |
| Maybe vegan 6712 | | Maybe vegan 6712 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Palm oil content unknown 119907 |
| + | Vegetarian status unknown 116121 |
| + | Non-vegan 111887 |
| + | Palm oil free 84303 |
| + | Vegan status unknown 73777 |
| + | Vegetarian 56159 |
| + | Non-vegetarian 44779 |
| + | Vegan 42890 |
| + | Maybe vegetarian 20006 |
| + | Palm oil 15542 |
| + | May contain palm oil 13680 |
| + | Maybe vegan 8310 |
| </pre> | | </pre> |
| |- | | |- |
Line 698: |
Line 1,003: |
| Maybe vegan 605 | | Maybe vegan 605 |
| May contain palm oil 594 | | May contain palm oil 594 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Palm oil free 5116 |
| + | Non-vegan 4656 |
| + | Vegetarian status unknown 3743 |
| + | Vegetarian 3105 |
| + | Palm oil content unknown 2928 |
| + | Vegan 2107 |
| + | Vegan status unknown 2090 |
| + | Maybe vegetarian 1571 |
| + | Non-vegetarian 1090 |
| + | Palm oil 885 |
| + | Maybe vegan 653 |
| + | May contain palm oil 585 |
| </pre> | | </pre> |
| |} | | |} |
Line 705: |
Line 1,025: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://it-en.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://it-en.openfoodfacts.org/ingredients-analysis All products:] || |
Line 737: |
Line 1,057: |
| May contain palm oil 252 | | May contain palm oil 252 |
| Maybe vegan 102 | | Maybe vegan 102 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 4057 |
| + | Palm oil content unknown 3739 |
| + | Vegan status unknown 2740 |
| + | Non-vegan 2262 |
| + | Palm oil free 1832 |
| + | Vegetarian 1181 |
| + | Vegan 944 |
| + | Non-vegetarian 514 |
| + | Palm oil 364 |
| + | Maybe vegetarian 343 |
| + | May contain palm oil 321 |
| + | Maybe vegan 147 |
| </pre> | | </pre> |
| |- | | |- |
Line 768: |
Line 1,103: |
| May contain palm oil 89 | | May contain palm oil 89 |
| Maybe vegan 37 | | Maybe vegan 37 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 1288 |
| + | Palm oil content unknown 1127 |
| + | Vegan status unknown 875 |
| + | Non-vegan 702 |
| + | Palm oil free 646 |
| + | Vegetarian 389 |
| + | Vegan 302 |
| + | Non-vegetarian 141 |
| + | Palm oil 133 |
| + | Maybe vegetarian 115 |
| + | May contain palm oil 95 |
| + | Maybe vegan 52 |
| </pre> | | </pre> |
| |} | | |} |
Line 775: |
Line 1,125: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://nl-en.openfoodfacts.org/ingredients-analysis All products:] || | | | [https://nl-en.openfoodfacts.org/ingredients-analysis All products:] || |
Line 807: |
Line 1,157: |
| Maybe vegetarian 91 | | Maybe vegetarian 91 |
| Maybe vegan 44 | | Maybe vegan 44 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Palm oil content unknown 1540 |
| + | Vegetarian status unknown 1527 |
| + | Vegetarian 1290 |
| + | Vegan 1090 |
| + | Vegan status unknown 1068 |
| + | Non-vegan 1022 |
| + | Palm oil free 906 |
| + | Palm oil 321 |
| + | Non-vegetarian 248 |
| + | Maybe vegetarian 194 |
| + | May contain palm oil 193 |
| + | Maybe vegan 76 |
| </pre> | | </pre> |
| |- | | |- |
Line 838: |
Line 1,203: |
| Maybe vegetarian 26 | | Maybe vegetarian 26 |
| Maybe vegan 11 | | Maybe vegan 11 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 338 |
| + | Palm oil content unknown 304 |
| + | Non-vegan 237 |
| + | Vegetarian 230 |
| + | Vegan status unknown 227 |
| + | Palm oil free 219 |
| + | Vegan 192 |
| + | Palm oil 88 |
| + | Maybe vegetarian 68 |
| + | May contain palm oil 53 |
| + | Non-vegetarian 43 |
| + | Maybe vegan 21 |
| </pre> | | </pre> |
| |} | | |} |
Line 845: |
Line 1,225: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! !! 2020-03-05 !! 2020-05-14 | + | ! !! 2020-03-05 !! 2020-05-14 !! 2020-10-31 |
| |- | | |- |
| | [https://pt-en.openfoodfacts.org/ingredients-analysis All products:] | | | [https://pt-en.openfoodfacts.org/ingredients-analysis All products:] |
Line 878: |
Line 1,258: |
| Maybe vegetarian 56 | | Maybe vegetarian 56 |
| Maybe vegan 23 | | Maybe vegan 23 |
| + | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 1036 |
| + | Palm oil content unknown 922 |
| + | Vegan status unknown 726 |
| + | Non-vegan 549 |
| + | Vegetarian 347 |
| + | Palm oil free 333 |
| + | Vegan 287 |
| + | May contain palm oil 159 |
| + | Palm oil 151 |
| + | Non-vegetarian 128 |
| + | Maybe vegetarian 90 |
| + | Maybe vegan 39 |
| </pre> | | </pre> |
| |- | | |- |
Line 895: |
Line 1,290: |
| Maybe vegan 8 | | Maybe vegan 8 |
| </pre> | | </pre> |
− |
| |
| || | | || |
| <pre> | | <pre> |
Line 911: |
Line 1,305: |
| Maybe vegan 11 | | Maybe vegan 11 |
| </pre> | | </pre> |
| + | || |
| + | <pre> |
| + | Vegetarian status unknown 393 |
| + | Palm oil content unknown 333 |
| + | Vegan status unknown 272 |
| + | Non-vegan 190 |
| + | Vegetarian 135 |
| + | Palm oil free 125 |
| + | Vegan 107 |
| + | Palm oil 63 |
| + | May contain palm oil 53 |
| + | Maybe vegetarian 35 |
| + | Non-vegetarian 23 |
| + | Maybe vegan 17 |
| + | </pre> |
| + | |} |
| + | |
| + | === RU - Russian - Russia === |
| + | |
| + | {| class="wikitable" |
| + | |- |
| + | ! !! 2021-03-01 |
| + | |- |
| + | | [https://ru-en.openfoodfacts.org/ingredients-analysis All products:] |
| + | || |
| + | <pre> |
| + | Ingredients analysis Products * |
| + | Vegetarian status unknown 1164 |
| + | Palm oil content unknown 1087 |
| + | Vegan status unknown 952 |
| + | Non-vegan 304 |
| + | Palm oil free 103 |
| + | May contain palm oil 94 |
| + | Vegetarian 90 |
| + | Vegan 82 |
| + | Non-vegetarian 78 |
| + | Palm oil 53 |
| + | Maybe vegetarian 11 |
| + | Maybe vegan 5 |
| + | </pre> |
| + | |
| |} | | |} |
| | | |
Line 916: |
Line 1,351: |
| == Evolution of the metrics between early March 2020 and mid May 2020 == | | == Evolution of the metrics between early March 2020 and mid May 2020 == |
| | | |
− | Comparison of key metrics, for all products (not only the most scanned). | + | === Comparison of key metrics === |
| + | |
| + | The comparison table contains the metrics for all products of a country. |
| | | |
− | * Ingredients parsing and recognition: % of known ingredients for all ingredients occurences. | + | Metrics: |
| + | * Ingredients parsing and recognition: % of known ingredients for all ingredients occurrences. |
| * Ingredients analysis: known vegetarian status | | * Ingredients analysis: known vegetarian status |
| ** = 1 - "Vegetarian status unknown" / ("Vegetarian status unknown" + "Vegetarian" + "Non vegetarian" + "Maybe vegetarian") | | ** = 1 - "Vegetarian status unknown" / ("Vegetarian status unknown" + "Vegetarian" + "Non vegetarian" + "Maybe vegetarian") |
Line 924: |
Line 1,362: |
| {| class="wikitable" | | {| class="wikitable" |
| |- | | |- |
− | ! Country !! % known ingredients March 2020 !! % known ingredients May 2020 !! % known vegetarian status March 2020 !! % known vegetarian status May 2020 | + | ! |
| + | ! colspan="3" | % known ingredients |
| + | ! colspan="3" | % known vegetarian status |
| |- | | |- |
− | | UK || 79.75% || 80.82% || 27.20%|| 45.94%
| + | ! Country |
| + | ! March 2020 !! May 2020 !! Oct 2020 |
| + | ! March 2020 !! May 2020 !! Oct 2020 |
| |- | | |- |
− | | US || 82.12% || 84.67% || not recorded || not recorded | + | | UK || 79.75% || 80.82% || 92.27% |
| + | || 27.20% || 45.94% || 58.72% |
| |- | | |- |
− | | DE || 84.75% || 86.72% || 35.76% || 50.04% | + | | US || 82.12% || 84.67% || 90.52% |
| + | || not recorded || not recorded || 34.40% |
| |- | | |- |
− | | ES || - || - || - || - | + | | DE || 84.75% || 86.72% || 89.03% |
| + | || 35.76% || 50.04% || 53.30% |
| |- | | |- |
− | | FI || - || - || - || - | + | | ES || 71.95% || 76.47% || 90.21% |
| + | || 23.01% || 50.73% || 60.95% |
| |- | | |- |
− | | FR || - || - || - || - | + | | FI || 89.15% || 91.43% || 95.22% |
| + | || 41.68% || 49.30% || 59.31% |
| |- | | |- |
− | | IT || - || - || - || - | + | | FR || 83.40% || 85.55% || 87.27% |
| + | || 42.68% || 48.47% || 51.02% |
| |- | | |- |
− | | NL || - || - || - || - | + | | IT || 74.58% || 78.54% || 78.75% |
| + | || 23.19% || 32.35% || 33.44% |
| |- | | |- |
− | | PT || - || - || - || - | + | | NL || 78.84% || 80.81% || 87.35% |
| + | || 27.51% || 47.64% || 53.15% |
| + | |- |
| + | | PT || 70.50% || 71.53% || 75.32% |
| + | || 20.36% || 26.74% || 35.29% |
| |} | | |} |
| | | |
| + | === Observations === |
| + | |
| + | Significant progress has been made on all tested countries. |
| + | |
| + | For ingredients parsing and recognition, it becomes harder and harder to get big increases in the % of known ingredients. It is expected as we have focused first on the improvements that had the biggest impact. But even a "small" increase from 83.40% to 85.55% for known ingredients in France corresponds to a drop of the unknown ingredients from 16.60% to 14.65% which is a 11.7% relative drop. |
| + | |
| + | It is very interesting to see that the improvements in ingredients parsing and recognition translate in much more significant ingredients analysis (knowing the vegetarian status of a product) improvements. All countries had a 5% to 25% absolute increase of products with known vegetarian status. |
| | | |
| [[Category:Project:Personalized_Search]] | | [[Category:Project:Personalized_Search]] |
| + | [[Category:Data quality]] |
| + | [[Category:Ingredients]] |
| + | [[Category:Taxonomies]] |