Difference between revisions of "Data quality issues which can't be fixed"

From Open Food Facts wiki
Jump to navigation Jump to search
(Add folk tag)
 
(28 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
== Issues common to all kind of data quality issues ==
 +
 +
=== There is no picture of the nutrition table ===
 +
Eg. https://world.openfoodfacts.org/product/8480000325242/aroma-de-vainilla-hacendado
 +
 +
'''Solution or workaround''': no workaround. Don't copy data from other sources. Our data should be based on our photos.
 +
 +
'''Action''':
 +
 +
* erase all nutrition facts' values.
 +
* remove nutrition facts' picture if it is not correct.
 +
 +
'''Github issue''': - 
 +
 +
=== The picture of the nutrition table is lacking data ===
 +
'''Solution or workaround''': no workaround. Don't try to put data if there are not displayed on the packaging.
 +
 +
'''Action''': put a hyphen (<code>-</code>) where the data are missing.
 +
 +
'''Github issue''': - 
 +
 
== en:nutrition-value-over-105-fruits-vegetables-nuts-estimate-from-ingredients ==
 
== en:nutrition-value-over-105-fruits-vegetables-nuts-estimate-from-ingredients ==
  
Line 4: Line 25:
 
When the package contains more than one product, each product can have its own list of ingredients. Then fruits and vegetables estimated value from ingredient goes over 105.
 
When the package contains more than one product, each product can have its own list of ingredients. Then fruits and vegetables estimated value from ingredient goes over 105.
  
−
Eg. https://world.openfoodfacts.org/product/3229820141947
+
Eg.:
 +
 
 +
* https://world.openfoodfacts.org/product/3229820141947
 +
* https://world.openfoodfacts.org/product/3608580806141/
 +
* https://world.openfoodfacts.org/product/3021762412464/
 +
* https://world.openfoodfacts.org/product/3560070969852
 +
* https://world.openfoodfacts.org/product/3021762416769
 +
 
 +
'''Solution or workaround''': none.
 +
 
 +
'''Action''': the products can be tagged with [https://wiki.openfoodfacts.org/Folksonomy/Property/ingredients_list:multiple ingredient_list:multiple].
 +
 
 +
'''Github issue''': [to be created?]
 +
 
 +
=== When the data quality error is a bug from Open Food Facts (product opener) ===
 +
Sometimes the data quality error is a parsing bug.
 +
 
 +
Eg. :
 +
* https://world.openfoodfacts.org/cgi/product.pl?type=edit&code=3038354191904#ingredients
 +
* https://world.openfoodfacts.org/product/3281780096040
 +
 
 +
'''Solution or workaround''': none.
 +
 
 +
'''Action''': the product can be tagged with [[Folksonomy Engine]]: <code>data_quality:product_opener_issue => yes</code>
 +
 
 +
'''Github issue''': https://github.com/openfoodfacts/openfoodfacts-server/issues/7816
 +
 
 +
== en:nutrition-value-total-over-105==
 +
 
 +
===When the product density is greater than the water===
 +
When the product density is greater than the water and the weight displayed for 100ml, the total of the ingredients can be greater than 105.
 +
 
 +
Eg.:
 +
 
 +
https://world.openfoodfacts.org/product/20271343/sirop-d-agave-bio-sonne
 +
 
 +
https://world.openfoodfacts.org/product/7501088011375
 +
 
 +
'''Solution or workaround''': [to be discussed]
 +
 
 +
'''Action''': the products can be tagged with [[Folksonomy/Property/nutrition facts:per ml|nutrition_facts:per_ml]]
 +
 
 +
'''Github issue''': [to be created?]
 +
==en:energy-value-in-kj-does-not-match-value-computed-from-other-nutrients & en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients==
 +
 
 +
=== When? Sugar or equivalents? ===
 +
Eg.:
 +
 
 +
* https://world.openfoodfacts.org/product/3329757003735
 +
* https://world.openfoodfacts.org/product/3165437400001
 +
* https://world.openfoodfacts.org/product/3329757003957/
 +
* https://world.openfoodfacts.org/product/0013200000008
 +
* https://world.openfoodfacts.org/product/3256223661215
 +
 
 +
'''Solution or workaround:''' there is no solution. The producer did not mention that the products contains ingredients that should not be counted to compute the energy. For example, if a product is Stevia and contains 99g/100g of carbs, there should not be counted because stevia is not providing any energy.
 +
 
 +
'''Action''': the product could be tagged with [[Folksonomy Engine]]: <code>use data_quality:lack_of_data_to_compute_energy</code> ????
 +
 
 +
'''Github issue''': https://github.com/openfoodfacts/openfoodfacts-server/issues/7789
 +
 
 +
=== When? Soup or equivalents? ===
 +
Eg.:
 +
 
 +
* https://world.openfoodfacts.org/product/4104420137264
 +
* https://world.openfoodfacts.org/product/8480000073136
 +
 
 +
'''Solution or workaround:'''
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''':
 +
 
 +
=== When? Tea or equivalents? ===
 +
Eg. https://world.openfoodfacts.org/product/4056489024354
 +
 
 +
'''Solution or workaround:'''
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''': 
 +
 
 +
=== When? Lemon juices? ===
 +
It seems that many lemon juices are reporting errors: more than '''225''' as of 2022-12-15, which is '''nearly half of all the lemon juices''' (577).
 +
 
 +
* Lemon juice category: https://world.openfoodfacts.org/category/lemon-juice
 +
* Data quality errors related to lemon juice category: https://world.openfoodfacts.org/category/lemon-juice/data-quality-errors
 +
 
 +
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/8009490000561/jus-de-citron-siracuse
 +
*https://world.openfoodfacts.org/product/8009490001087/jus-de-citron-siracuse
 +
*https://world.openfoodfacts.org/product/26001142
 +
 
 +
'''Solution or workaround''':
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''': 
 +
 
 +
===When? Vinegar or equivalents?===
 +
It seems that many vinagers are reporting errors: more than '''608''' as of 2022-12-15, which is '''nearly 20% of all the vinegars''' (3528).
 +
 
 +
* https://world.openfoodfacts.org/category/vinegars (3528 products)
 +
*https://world.openfoodfacts.org/category/vinegars/data-quality-errors (608 products)
 +
 
 +
Eg. https://world.openfoodfacts.org/product/3182384011012
 +
 
 +
'''Solution or workaround''':
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''': 
 +
 
 +
===When? Chewing gum or equivalents?===
 +
 
 +
Eg.
 +
 
 +
* https://world.openfoodfacts.org/product/26038360
 +
* https://world.openfoodfacts.org/product/27031247
 +
* https://world.openfoodfacts.org/product/4009900517430/extra-professional-white-strawberry-wrigley
 +
 
 +
'''Solution or workaround''':
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''': 
 +
 
 +
===When?===
 +
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/4056489123514/
 +
 
 +
'''Solution or workaround:'''
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''':
 +
 
 +
==en:energy-value-in-kcal-does-not-match-value-in-kj==
 +
 
 +
===When energy values are low (1-10 Kcal)===
 +
When energy values are low, there are often matching issues between the energy in Kcal and KJ. This often because producers are rounding the values.
 +
 
 +
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/3502110008459: In this example, 1 Kcal (rounded) => 6 KJ. Because 6 / 4.2 = '''1.428''', the producer is probably '''rounding 1.42 to 1'''.
 +
*https://world.openfoodfacts.org/product/3564700460887
 +
 
 +
'''Solution or workaround''': use the values per serving if the serving is higher than 100g/100ml.
 +
 
 +
'''Action''': -
 +
 
 +
'''Github issue''': [https://github.com/openfoodfacts/openfoodfacts-server/issues/7811 energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values]
 +
 
 +
===When?===
 +
Error maybe?
 +
 
 +
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/3770014034205
 +
 
 +
'''Solution or workaround''': ?
 +
 
 +
'''Action''': -
 +
 
 +
'''Github issue''': [https://github.com/openfoodfacts/openfoodfacts-server/issues/7811 energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values]
 +
 
 +
 
 +
==en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients==
 +
 
 +
===When it is a beer?===
 +
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/0018200250002
  
−
Solution or workaround: none.
+
'''Solution or workaround''': delete?
  
−
The products can be tagged with [https://world.openfoodfacts.org/property/ingredient_list:multiple ingredient_list:multiple].
+
'''Action''': -
  
−
Github issue: [to be created?]
+
'''Github issue''':
 +
[[Category:Data quality]]

Latest revision as of 12:41, 30 November 2023

Issues common to all kind of data quality issues

There is no picture of the nutrition table

Eg. https://world.openfoodfacts.org/product/8480000325242/aroma-de-vainilla-hacendado

Solution or workaround: no workaround. Don't copy data from other sources. Our data should be based on our photos.

Action:

  • erase all nutrition facts' values.
  • remove nutrition facts' picture if it is not correct.

Github issue: -

The picture of the nutrition table is lacking data

Solution or workaround: no workaround. Don't try to put data if there are not displayed on the packaging.

Action: put a hyphen (-) where the data are missing.

Github issue: -

en:nutrition-value-over-105-fruits-vegetables-nuts-estimate-from-ingredients

When the package contains more than one product

When the package contains more than one product, each product can have its own list of ingredients. Then fruits and vegetables estimated value from ingredient goes over 105.

Eg.:

Solution or workaround: none.

Action: the products can be tagged with ingredient_list:multiple.

Github issue: [to be created?]

When the data quality error is a bug from Open Food Facts (product opener)

Sometimes the data quality error is a parsing bug.

Eg. :

Solution or workaround: none.

Action: the product can be tagged with Folksonomy Engine: data_quality:product_opener_issue => yes

Github issue: https://github.com/openfoodfacts/openfoodfacts-server/issues/7816

en:nutrition-value-total-over-105

When the product density is greater than the water

When the product density is greater than the water and the weight displayed for 100ml, the total of the ingredients can be greater than 105.

Eg.:

https://world.openfoodfacts.org/product/20271343/sirop-d-agave-bio-sonne

https://world.openfoodfacts.org/product/7501088011375

Solution or workaround: [to be discussed]

Action: the products can be tagged with nutrition_facts:per_ml

Github issue: [to be created?]

en:energy-value-in-kj-does-not-match-value-computed-from-other-nutrients & en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients

When? Sugar or equivalents?

Eg.:

Solution or workaround: there is no solution. The producer did not mention that the products contains ingredients that should not be counted to compute the energy. For example, if a product is Stevia and contains 99g/100g of carbs, there should not be counted because stevia is not providing any energy.

Action: the product could be tagged with Folksonomy Engine: use data_quality:lack_of_data_to_compute_energy ????

Github issue: https://github.com/openfoodfacts/openfoodfacts-server/issues/7789

When? Soup or equivalents?

Eg.:

Solution or workaround:

Action:

Github issue:

When? Tea or equivalents?

Eg. https://world.openfoodfacts.org/product/4056489024354

Solution or workaround:

Action:

Github issue:

When? Lemon juices?

It seems that many lemon juices are reporting errors: more than 225 as of 2022-12-15, which is nearly half of all the lemon juices (577).

Eg.

Solution or workaround:

Action:

Github issue:

When? Vinegar or equivalents?

It seems that many vinagers are reporting errors: more than 608 as of 2022-12-15, which is nearly 20% of all the vinegars (3528).

Eg. https://world.openfoodfacts.org/product/3182384011012

Solution or workaround:

Action:

Github issue:

When? Chewing gum or equivalents?

Eg.

Solution or workaround:

Action:

Github issue:

When?

Eg.

Solution or workaround:

Action:

Github issue:

en:energy-value-in-kcal-does-not-match-value-in-kj

When energy values are low (1-10 Kcal)

When energy values are low, there are often matching issues between the energy in Kcal and KJ. This often because producers are rounding the values.

Eg.

Solution or workaround: use the values per serving if the serving is higher than 100g/100ml.

Action: -

Github issue: energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values

When?

Error maybe?

Eg.

Solution or workaround: ?

Action: -

Github issue: energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values


en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients

When it is a beer?

Eg.

Solution or workaround: delete?

Action: -

Github issue:

Retrieved from "https://wiki.openfoodfacts.org/index.php?title=Data_quality_issues_which_can%27t_be_fixed&oldid=20161"