Difference between revisions of "Data quality issues which can't be fixed"

From Open Food Facts wiki
Jump to navigation Jump to search
(added issue)
 
(12 intermediate revisions by 2 users not shown)
Line 38: Line 38:
  
 
'''Github issue''': [to be created?]
 
'''Github issue''': [to be created?]
 +
 +
=== When the data quality error is a bug from Open Food Facts (product opener) ===
 +
Sometimes the data quality error is a parsing bug.
 +
 +
Eg. :
 +
* https://world.openfoodfacts.org/cgi/product.pl?type=edit&code=3038354191904#ingredients
 +
* https://world.openfoodfacts.org/product/3281780096040
 +
 +
'''Solution or workaround''': none.
 +
 +
'''Action''': the product can be tagged with [[Folksonomy Engine]]: <code>data_quality:product_opener_issue => yes</code>
 +
 +
'''Github issue''': https://github.com/openfoodfacts/openfoodfacts-server/issues/7816
  
 
== en:nutrition-value-total-over-105==
 
== en:nutrition-value-total-over-105==
Line 44: Line 57:
 
When the product density is greater than the water and the weight displayed for 100ml, the total of the ingredients can be greater than 105.
 
When the product density is greater than the water and the weight displayed for 100ml, the total of the ingredients can be greater than 105.
  
−
Eg. https://world.openfoodfacts.org/product/20271343/sirop-d-agave-bio-sonne
+
Eg.:
 +
 
 +
https://world.openfoodfacts.org/product/20271343/sirop-d-agave-bio-sonne
 +
 
 +
https://world.openfoodfacts.org/product/7501088011375
  
 
'''Solution or workaround''': [to be discussed]
 
'''Solution or workaround''': [to be discussed]
Line 59: Line 76:
 
* https://world.openfoodfacts.org/product/3165437400001
 
* https://world.openfoodfacts.org/product/3165437400001
 
* https://world.openfoodfacts.org/product/3329757003957/
 
* https://world.openfoodfacts.org/product/3329757003957/
 +
* https://world.openfoodfacts.org/product/0013200000008
 +
* https://world.openfoodfacts.org/product/3256223661215
  
 
'''Solution or workaround:''' there is no solution. The producer did not mention that the products contains ingredients that should not be counted to compute the energy. For example, if a product is Stevia and contains 99g/100g of carbs, there should not be counted because stevia is not providing any energy.  
 
'''Solution or workaround:''' there is no solution. The producer did not mention that the products contains ingredients that should not be counted to compute the energy. For example, if a product is Stevia and contains 99g/100g of carbs, there should not be counted because stevia is not providing any energy.  
  
−
'''Action''': the product could be tagged with <code>use data_quality:lack_of_data_to_compute_energy</code> ????  
+
'''Action''': the product could be tagged with [[Folksonomy Engine]]: <code>use data_quality:lack_of_data_to_compute_energy</code> ????  
  
 
'''Github issue''': https://github.com/openfoodfacts/openfoodfacts-server/issues/7789
 
'''Github issue''': https://github.com/openfoodfacts/openfoodfacts-server/issues/7789
Line 78: Line 97:
 
'''Github issue''':  
 
'''Github issue''':  
  
−
=== When? Vinegar or equivalents? ===
+
=== When? Tea or equivalents? ===
 +
Eg. https://world.openfoodfacts.org/product/4056489024354
 +
 
 +
'''Solution or workaround:'''
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''': 
 +
 
 +
=== When? Lemon juices? ===
 +
It seems that many lemon juices are reporting errors: more than '''225''' as of 2022-12-15, which is '''nearly half of all the lemon juices''' (577).
 +
 
 +
* Lemon juice category: https://world.openfoodfacts.org/category/lemon-juice
 +
* Data quality errors related to lemon juice category: https://world.openfoodfacts.org/category/lemon-juice/data-quality-errors
 +
 
 +
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/8009490000561/jus-de-citron-siracuse
 +
*https://world.openfoodfacts.org/product/8009490001087/jus-de-citron-siracuse
 +
*https://world.openfoodfacts.org/product/26001142
 +
 
 +
'''Solution or workaround''':
 +
 
 +
'''Action''':
 +
 
 +
'''Github issue''': 
 +
 
 +
===When? Vinegar or equivalents?===
 +
It seems that many vinagers are reporting errors: more than '''608''' as of 2022-12-15, which is '''nearly 20% of all the vinegars''' (3528).
 +
 
 +
* https://world.openfoodfacts.org/category/vinegars (3528 products)
 +
*https://world.openfoodfacts.org/category/vinegars/data-quality-errors (608 products)
 +
 
 
Eg. https://world.openfoodfacts.org/product/3182384011012
 
Eg. https://world.openfoodfacts.org/product/3182384011012
  
−
'''Solution or workaround:'''  
+
'''Solution or workaround''':
  
 
'''Action''':
 
'''Action''':
Line 87: Line 138:
 
'''Github issue''':   
 
'''Github issue''':   
  
−
=== When? Tea or equivalents? ===
+
===When? Chewing gum or equivalents?===
−
Eg. https://world.openfoodfacts.org/product/4056489024354
+
 
 +
Eg.  
 +
 
 +
* https://world.openfoodfacts.org/product/26038360
 +
* https://world.openfoodfacts.org/product/27031247
 +
* https://world.openfoodfacts.org/product/4009900517430/extra-professional-white-strawberry-wrigley
  
−
'''Solution or workaround:'''
+
'''Solution or workaround''':
  
 
'''Action''':
 
'''Action''':
Line 96: Line 152:
 
'''Github issue''':   
 
'''Github issue''':   
  
−
=== When? ===
+
===When?===
−
Eg. https://world.openfoodfacts.org/product/4056489123514/
+
Eg.
 +
 
 +
*https://world.openfoodfacts.org/product/4056489123514/
  
 
'''Solution or workaround:'''  
 
'''Solution or workaround:'''  
Line 105: Line 163:
 
'''Github issue''':  
 
'''Github issue''':  
  
−
== en:energy-value-in-kcal-does-not-match-value-in-kj ==
+
==en:energy-value-in-kcal-does-not-match-value-in-kj==
  
−
=== When energy values are low (1-10 Kcal) ===
+
===When energy values are low (1-10 Kcal)===
 
When energy values are low, there are often matching issues between the energy in Kcal and KJ. This often because producers are rounding the values.
 
When energy values are low, there are often matching issues between the energy in Kcal and KJ. This often because producers are rounding the values.
  
 
Eg.
 
Eg.
  
−
* https://world.openfoodfacts.org/product/3502110008459: In this example, 1 Kcal (rounded) => 6 KJ. Because 6 / 4.2 = '''1.428''', the producer is probably '''rounding 1.42 to 1'''.
+
*https://world.openfoodfacts.org/product/3502110008459: In this example, 1 Kcal (rounded) => 6 KJ. Because 6 / 4.2 = '''1.428''', the producer is probably '''rounding 1.42 to 1'''.
 +
*https://world.openfoodfacts.org/product/3564700460887
  
 
'''Solution or workaround''': use the values per serving if the serving is higher than 100g/100ml.  
 
'''Solution or workaround''': use the values per serving if the serving is higher than 100g/100ml.  
Line 120: Line 179:
 
'''Github issue''': [https://github.com/openfoodfacts/openfoodfacts-server/issues/7811 energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values]
 
'''Github issue''': [https://github.com/openfoodfacts/openfoodfacts-server/issues/7811 energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values]
  
−
=== When? ===
+
===When?===
 
Error maybe?
 
Error maybe?
  
 
Eg.
 
Eg.
  
−
* https://world.openfoodfacts.org/product/3770014034205
+
*https://world.openfoodfacts.org/product/3770014034205
  
 
'''Solution or workaround''': ?  
 
'''Solution or workaround''': ?  
Line 134: Line 193:
  
  
−
== en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients ==
+
==en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients==
  
−
=== When it is a beer? ===
+
===When it is a beer?===
 
Eg.
 
Eg.
  
−
* https://world.openfoodfacts.org/product/0018200250002
+
*https://world.openfoodfacts.org/product/0018200250002
  
 
'''Solution or workaround''': delete?  
 
'''Solution or workaround''': delete?  

Latest revision as of 12:41, 30 November 2023

Issues common to all kind of data quality issues

There is no picture of the nutrition table

Eg. https://world.openfoodfacts.org/product/8480000325242/aroma-de-vainilla-hacendado

Solution or workaround: no workaround. Don't copy data from other sources. Our data should be based on our photos.

Action:

  • erase all nutrition facts' values.
  • remove nutrition facts' picture if it is not correct.

Github issue: -

The picture of the nutrition table is lacking data

Solution or workaround: no workaround. Don't try to put data if there are not displayed on the packaging.

Action: put a hyphen (-) where the data are missing.

Github issue: -

en:nutrition-value-over-105-fruits-vegetables-nuts-estimate-from-ingredients

When the package contains more than one product

When the package contains more than one product, each product can have its own list of ingredients. Then fruits and vegetables estimated value from ingredient goes over 105.

Eg.:

Solution or workaround: none.

Action: the products can be tagged with ingredient_list:multiple.

Github issue: [to be created?]

When the data quality error is a bug from Open Food Facts (product opener)

Sometimes the data quality error is a parsing bug.

Eg. :

Solution or workaround: none.

Action: the product can be tagged with Folksonomy Engine: data_quality:product_opener_issue => yes

Github issue: https://github.com/openfoodfacts/openfoodfacts-server/issues/7816

en:nutrition-value-total-over-105

When the product density is greater than the water

When the product density is greater than the water and the weight displayed for 100ml, the total of the ingredients can be greater than 105.

Eg.:

https://world.openfoodfacts.org/product/20271343/sirop-d-agave-bio-sonne

https://world.openfoodfacts.org/product/7501088011375

Solution or workaround: [to be discussed]

Action: the products can be tagged with nutrition_facts:per_ml

Github issue: [to be created?]

en:energy-value-in-kj-does-not-match-value-computed-from-other-nutrients & en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients

When? Sugar or equivalents?

Eg.:

Solution or workaround: there is no solution. The producer did not mention that the products contains ingredients that should not be counted to compute the energy. For example, if a product is Stevia and contains 99g/100g of carbs, there should not be counted because stevia is not providing any energy.

Action: the product could be tagged with Folksonomy Engine: use data_quality:lack_of_data_to_compute_energy ????

Github issue: https://github.com/openfoodfacts/openfoodfacts-server/issues/7789

When? Soup or equivalents?

Eg.:

Solution or workaround:

Action:

Github issue:

When? Tea or equivalents?

Eg. https://world.openfoodfacts.org/product/4056489024354

Solution or workaround:

Action:

Github issue:

When? Lemon juices?

It seems that many lemon juices are reporting errors: more than 225 as of 2022-12-15, which is nearly half of all the lemon juices (577).

Eg.

Solution or workaround:

Action:

Github issue:

When? Vinegar or equivalents?

It seems that many vinagers are reporting errors: more than 608 as of 2022-12-15, which is nearly 20% of all the vinegars (3528).

Eg. https://world.openfoodfacts.org/product/3182384011012

Solution or workaround:

Action:

Github issue:

When? Chewing gum or equivalents?

Eg.

Solution or workaround:

Action:

Github issue:

When?

Eg.

Solution or workaround:

Action:

Github issue:

en:energy-value-in-kcal-does-not-match-value-in-kj

When energy values are low (1-10 Kcal)

When energy values are low, there are often matching issues between the energy in Kcal and KJ. This often because producers are rounding the values.

Eg.

Solution or workaround: use the values per serving if the serving is higher than 100g/100ml.

Action: -

Github issue: energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values

When?

Error maybe?

Eg.

Solution or workaround: ?

Action: -

Github issue: energy-value-in-kcal-does-not-match-value-in-kj: false positive for low values


en:energy-value-in-kcal-does-not-match-value-computed-from-other-nutrients

When it is a beer?

Eg.

Solution or workaround: delete?

Action: -

Github issue:

Retrieved from "https://wiki.openfoodfacts.org/index.php?title=Data_quality_issues_which_can%27t_be_fixed&oldid=20161"