Difference between revisions of "Data quality"

From Open Food Facts wiki
Jump to navigation Jump to search
(Added "Energy value in kcal greater than in kJ" issue)
(3 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
Some important things to know:
 
Some important things to know:
* Quality does not make sense for itself.
+
* Quality does not make sense for itself: quality depends on usages.
* Quality depends on usages.
 
 
* No database at all can pretend to zero-default.
 
* No database at all can pretend to zero-default.
* With more than 1 200 000 products, there are quality concerns: our goal is to lower the impacts of the issues.
+
* With more than 1 600 000 products, there are quality concerns: our goal is to lower the impacts of the issues.
  
 
== Data quality: how to help? ==
 
== Data quality: how to help? ==
 +
 +
=== Nutrition values issues ===
 +
Open Food Facts identifies some issues related to nutrition values. Some of them are '''very easy to solve''':
 +
* [https://world.openfoodfacts.org/data-quality/energy-value-in-kcal-greater-than-in-kj Energy value in kcal greater than in kJ]
 +
* [https://world.openfoodfacts.org/data-quality/nutrition-value-over-105-salt Nutrition Salt is higher than 100g per 100g]
 +
* [https://world.openfoodfacts.org/data-quality/nutrition-value-over-105-carbohydrates Carbohydrate is higher than 100g per 100g]
 +
* [https://world.openfoodfacts.org/data-quality/nutrition-value-over-105-fat Fat is higher than 100g per 100g]
  
 
=== Nutri-Score quality ===
 
=== Nutri-Score quality ===
Line 28: Line 34:
 
* it can be a software issue (quite rare but possible)
 
* it can be a software issue (quite rare but possible)
  
=== Nutrition values issues ===
+
=== Cleaning up the consequences of an old Android bug ===
Open Food Facts identifies some issues related to nutrition values. We should take care of it:
+
The word "Loading…" replaced the correct product name. 99% of phones have been updated with the fix, but we still have some unfixed products.
* [https://world.openfoodfacts.org/data-quality/energy-value-in-kcal-greater-than-in-kj Energy value in kcal greater than in kJ]
+
* [https://world.openfoodfacts.org/cgi/search.pl?action=process&search_terms=Caricamento%E2%80%A6&sort_by=unique_scans_n&page_size=24&page=1&sort_by=unique_scans_n Italian]
* [https://world.openfoodfacts.org/data-quality/nutrition-value-over-105-salt Nutrition Salt is higher than 100g per 100g]
+
* [https://world.openfoodfacts.org/cgi/search.pl?action=process&search_terms=Loading%E2%80%A6&sort_by=unique_scans_n&page_size=24&page=1&sort_by=unique_scans_n English]
* [https://world.openfoodfacts.org/data-quality/nutrition-value-over-105-carbohydrates Carbohydrate is higher than 100g per 100g]
+
* [https://world.openfoodfacts.org/cgi/search.pl?action=process&search_terms=chargement%E2%80%A6&sort_by=unique_scans_n&page_size=24&page=1&sort_by=unique_scans_n French]
* [https://world.openfoodfacts.org/data-quality/nutrition-value-over-105-fat Fat is higher than 100g per 100g]
+
* [https://world.openfoodfacts.org/cgi/search.pl?search_terms=laden%E2%80%A6&search_simple=1&action=process German]
  
 
=== Non-Food Products ===
 
=== Non-Food Products ===

Revision as of 11:48, 18 February 2021

Some important things to know:

  • Quality does not make sense for itself: quality depends on usages.
  • No database at all can pretend to zero-default.
  • With more than 1 600 000 products, there are quality concerns: our goal is to lower the impacts of the issues.

Data quality: how to help?

Nutrition values issues

Open Food Facts identifies some issues related to nutrition values. Some of them are very easy to solve:

Nutri-Score quality

Some products now have Nutri-Score printed on the front of pack. Some differs from our Nutri-Score calculation. We should take care about that:

There are many reasons why it can differ:

  • the label in Open Food Facts does not represent the label printed on the package (easy to solve)
  • the label is correct but our calculation doesn't provide the same result:
    • check the category,
    • then check the nutrition facts: the issue is sometimes the lack of "fibers" information or the lack of "Fruits, vegetables, nuts and rapeseed, walnut and olive oils" percentage.
  • it can be a software issue (quite rare but possible)

Cleaning up the consequences of an old Android bug

The word "Loading…" replaced the correct product name. 99% of phones have been updated with the fix, but we still have some unfixed products.

Non-Food Products

Some people are adding products which are not food: beauty products, books, pet food, etc. These products have to be moved to Open Food Facts side projects. Our AI (artificial intelligence) already identifies many cases. These cases are published in the #bot-image-alerts channel on our slack space.

How to move these products?

  • identify a product in the #bot-image-alerts channel
  • clic on the link after "edit:"
  • if you have the rights to so, you will see "If the barcode is not correct, please correct it here"
    • enter "obf" to move beauty products to Open Beauty Facts
    • enter "opff" to move products to Open Pet Food Facts
    • enter "opf" to move products to Open Product Facts
  • save (if "A product already exists with the new code" message appear, move it manually, and delete it)
  • in #bot-image-alerts channel, annotate the product with a "checked" icon to tell others that the product has been moved