Difference between revisions of "Monitoring added products - en"

From Open Food Facts wiki
Jump to navigation Jump to search
(+ Data quality category)
 
(32 intermediate revisions by 2 users not shown)
Line 4: Line 4:
  
 
If you feel like doing this for your country use this url: https://nl.openfoodfacts.org/entry-date/2022-09-27. Adapt the country prefix to your situation. And edit the date for the one you want to use.
 
If you feel like doing this for your country use this url: https://nl.openfoodfacts.org/entry-date/2022-09-27. Adapt the country prefix to your situation. And edit the date for the one you want to use.
 +
 +
It is also possible to monitor product which have added images. These image might provide new information. For products sold in the Netherlands use: [http://mirabelle.openfoodfacts.org/products?sql=--+list+of+products+in+the+Netherlands+ordered+by+the+date+of+the+last+image+uploaded%0D%0Aselect+code%2C+url%2C+creator%2C+created_datetime%2C+last_modified_datetime%2C+last_image_datetime%2C+product_name+from+%5Ball%5D%0D%0Awhere+countries_en+like+%22%25netherlands%25%22+and+last_image_datetime+%21%3D+%22%22%0D%0Aorder+by+last_image_datetime+desc%0D%0Alimit+200 Dutch products with new images]
 +
 +
Before starting your process, answer the questions that Robotoff proposes.
 +
 +
== Non-food products ==
 +
Sometimes you will find a non-food product on OFF. You can move this product to either Open Beauty Facts, Open PetFood Facts or Open Product Facts. Edit the product and in the field where you can change the barcode, enter '''obf''', '''opff''' or '''opf''', respectively.
  
 
== Products with no data ==
 
== Products with no data ==
Line 10: Line 17:
 
We have no way to ascertain whether these empty products do really exist, or are even food products. Sometimes non-product barcodes can be seen, i.e. barcode lengths other than 8,12 or 13 numbers.
 
We have no way to ascertain whether these empty products do really exist, or are even food products. Sometimes non-product barcodes can be seen, i.e. barcode lengths other than 8,12 or 13 numbers.
  
Having these empty products in the database has no value and thus they can be deleted. A user can always add them later again.
+
Having these empty products in the database has no value and thus they can be deleted. A user can always add them later again. You might double check by scrolling to the bottom of the page, which will show the status '''Empty'''.
 +
 
 +
Add the reason for removal: '''Empty'''
  
 
== Products without images ==
 
== Products without images ==
Line 16: Line 25:
 
===== Category =====
 
===== Category =====
 
* empty: it can be derived from the product name (if present). Or maybe you recognise the product name.
 
* empty: it can be derived from the product name (if present). Or maybe you recognise the product name.
 +
===== Strange data =====
 +
Sometimes one finds products with strange data. These are products that can be deleted:
 +
* Only a title, add the removal reason: '''Nonsense'''
 +
 
== Products with images ==
 
== Products with images ==
 +
===== Strange Images =====
 +
* Non relevant images might indicate a test (I am friendly) by a user. And can be deleted. Add the reason '''Wrong Image'''.
 
===== Main language =====
 
===== Main language =====
* filled: check wether the main language is correct. It should be the same as the language found on the ingredients or nutritional values. If not change the main language and transpose all the corresponding data. Save and continue editing.
+
* filled: check wether the main language is correct. It should be the same as the language found on the ingredients or nutritional values. If not change the main language and transpose all the corresponding data. Do NOT forget the transpose, otherwise you will have more work correcting things. Save and continue editing.
 +
 
 
===== Multiple languages =====
 
===== Multiple languages =====
 
* filled: do the other languages really exist. If yes check their data. If not remove the images, product name and ingredients for the non-existing language.
 
* filled: do the other languages really exist. If yes check their data. If not remove the images, product name and ingredients for the non-existing language.
Line 24: Line 40:
 
* filled: does it correspond to what can be found on the images?
 
* filled: does it correspond to what can be found on the images?
 
* not filled: try to find it on the images, or maybe you recognise it.
 
* not filled: try to find it on the images, or maybe you recognise it.
 +
===== Generic product name =====
 +
The product name is often a marketing name, which does not describe the product. Check above the ingredients for the generic name (sometimes it is found elsewhere on the packaging).
 +
 
===== Front image =====
 
===== Front image =====
* filled: does it show the front of the product?
+
* filled: does it show the front of the product? You might need to rotate or crop.
 
* not filled: is a front image available? Assign that one and crop to highlight the image.
 
* not filled: is a front image available? Assign that one and crop to highlight the image.
 +
===== Quantity =====
 +
Put the total weight first. Then add details like found on [[Products quantities|Product quantities]].
 +
 
===== Packaging =====
 
===== Packaging =====
 
* not filled: you might recognise the packaging (glass, tin, plastic)
 
* not filled: you might recognise the packaging (glass, tin, plastic)
 +
* filled: there might be a language prefix, like '''en:''' in front of the packaging. Correct and add the same in your language. Use the OFF suggestions on the website interface.
 +
 +
===== Categories =====
 +
* filled: check and add more specific categories. Also check whether no categories for specific ingredients have been added. They should be product categories.
 +
* not filled: try to add and use the suggestions presented by the application/site you use.
 +
 +
===== Labels =====
 +
You have to look at all sides of the packaging to find all possible labels.
 +
 
===== Brand =====
 
===== Brand =====
 
* filled: is it correct?
 
* filled: is it correct?
 
* not filled: can you find it on the images?
 
* not filled: can you find it on the images?
 +
===== Shops =====
 +
* filled: is it a show that exists?
 +
* not filled: for shop brands you might be able to enter the shop name.
 +
===== Countries =====
 +
* filled: is the product really sold in your country? Products that contain ingredients, etc in a language not used your country, are probably not sold. I had issues with products in Finnish and Russian.
 +
 
===== Ingredients image =====
 
===== Ingredients image =====
 
* not filled: add it if available.
 
* not filled: add it if available.
 
===== Ingredients =====
 
===== Ingredients =====
 
* filled: you might want to check it against the image (if available). Try to correct any typos. If it is bad you might want to restart.
 
* filled: you might want to check it against the image (if available). Try to correct any typos. If it is bad you might want to restart.
* not filled: has the ingredients image been properly cropped, so that it shows only the ingredients?
+
* not filled: has the ingredients image been properly cropped, so that it shows only the ingredients? Use the extract button the extract the ingredients, edit if needed. Try to do this also for languages and scripts you do not know. If the extraction does not work you can do it by hand. Sometimes the ingredients image only shows the ingredients partially. Then you might be able to fill the gaps, or add only the ingredients you do see. Check also word breakings.
 +
 
 +
===== Traces =====
 +
* filled: check. be sure that these are the traces and not the allergens found on the ingredients.
 +
* not filled: can you find it on an image?
 +
===== Portion size =====
 +
Often can be found in or under the nutritional values table.
  
 
===== Nutritional table image =====
 
===== Nutritional table image =====
 
* not filled: add and crop it if available. Try to use the colour correction to get a better image
 
* not filled: add and crop it if available. Try to use the colour correction to get a better image
===== Nutritional values =====
+
===== Nutritional values" =====
* filled: check if possible. You might want to correct the rounding issues.
+
* filled: check if possible. You might want to correct the rounding issues. If the fiber is missing on the product, write the "-" (hyphen) symbol.
* not filled: copy it from the image, if available.
+
* not filled: copy it from the image, if available. Sometimes the front image gives a summary for energy or fat.
 +
===== Recycling instructions image =====
 +
Try to find any instructions on the packaging.
 +
 
 +
== Final check ==
 +
Look at the product page and see if the ingredients are recognised. Edit if required. Report any unrecognised ingredients or try to work on the ingredients taxonomy.
 +
[[Category:Quality]]
 +
 
 +
== Statistics ==
 +
Aleene registered all new product edits for a while in a [https://docs.google.com/spreadsheets/d/1PPLJhJS3J2PhXr8WqtxL7EQp8nZugGM-pKzOsYBEO28/edit#gid=0 spreadsheet].
 +
[[Category:Data quality]]

Latest revision as of 18:21, 15 February 2023

Introduction

The guidelines presented here are based on my work on products added on the OpenFoodFacts-page for the Netherlands.

If you feel like doing this for your country use this url: https://nl.openfoodfacts.org/entry-date/2022-09-27. Adapt the country prefix to your situation. And edit the date for the one you want to use.

It is also possible to monitor product which have added images. These image might provide new information. For products sold in the Netherlands use: Dutch products with new images

Before starting your process, answer the questions that Robotoff proposes.

Non-food products

Sometimes you will find a non-food product on OFF. You can move this product to either Open Beauty Facts, Open PetFood Facts or Open Product Facts. Edit the product and in the field where you can change the barcode, enter obf, opff or opf, respectively.

Products with no data

Quite often one sees products where no data at all has been entered, all fields are empty and there are no images. These products are mostly created by third party apps. They are due to a quirk in the api-calls. Whenever an api interrogates the database with a barcode number and the barcode is not present, the corresponding product is created.

We have no way to ascertain whether these empty products do really exist, or are even food products. Sometimes non-product barcodes can be seen, i.e. barcode lengths other than 8,12 or 13 numbers.

Having these empty products in the database has no value and thus they can be deleted. A user can always add them later again. You might double check by scrolling to the bottom of the page, which will show the status Empty.

Add the reason for removal: Empty

Products without images

For these products we can only check the fields that have been filled in and infer the data of other fields. Do not worry to make a mistake here, these can always be corrected. You might have a look at the following fields:

Category
  • empty: it can be derived from the product name (if present). Or maybe you recognise the product name.
Strange data

Sometimes one finds products with strange data. These are products that can be deleted:

  • Only a title, add the removal reason: Nonsense

Products with images

Strange Images
  • Non relevant images might indicate a test (I am friendly) by a user. And can be deleted. Add the reason Wrong Image.
Main language
  • filled: check wether the main language is correct. It should be the same as the language found on the ingredients or nutritional values. If not change the main language and transpose all the corresponding data. Do NOT forget the transpose, otherwise you will have more work correcting things. Save and continue editing.
Multiple languages
  • filled: do the other languages really exist. If yes check their data. If not remove the images, product name and ingredients for the non-existing language.
Product name
  • filled: does it correspond to what can be found on the images?
  • not filled: try to find it on the images, or maybe you recognise it.
Generic product name

The product name is often a marketing name, which does not describe the product. Check above the ingredients for the generic name (sometimes it is found elsewhere on the packaging).

Front image
  • filled: does it show the front of the product? You might need to rotate or crop.
  • not filled: is a front image available? Assign that one and crop to highlight the image.
Quantity

Put the total weight first. Then add details like found on Product quantities.

Packaging
  • not filled: you might recognise the packaging (glass, tin, plastic)
  • filled: there might be a language prefix, like en: in front of the packaging. Correct and add the same in your language. Use the OFF suggestions on the website interface.
Categories
  • filled: check and add more specific categories. Also check whether no categories for specific ingredients have been added. They should be product categories.
  • not filled: try to add and use the suggestions presented by the application/site you use.
Labels

You have to look at all sides of the packaging to find all possible labels.

Brand
  • filled: is it correct?
  • not filled: can you find it on the images?
Shops
  • filled: is it a show that exists?
  • not filled: for shop brands you might be able to enter the shop name.
Countries
  • filled: is the product really sold in your country? Products that contain ingredients, etc in a language not used your country, are probably not sold. I had issues with products in Finnish and Russian.
Ingredients image
  • not filled: add it if available.
Ingredients
  • filled: you might want to check it against the image (if available). Try to correct any typos. If it is bad you might want to restart.
  • not filled: has the ingredients image been properly cropped, so that it shows only the ingredients? Use the extract button the extract the ingredients, edit if needed. Try to do this also for languages and scripts you do not know. If the extraction does not work you can do it by hand. Sometimes the ingredients image only shows the ingredients partially. Then you might be able to fill the gaps, or add only the ingredients you do see. Check also word breakings.
Traces
  • filled: check. be sure that these are the traces and not the allergens found on the ingredients.
  • not filled: can you find it on an image?
Portion size

Often can be found in or under the nutritional values table.

Nutritional table image
  • not filled: add and crop it if available. Try to use the colour correction to get a better image
Nutritional values"
  • filled: check if possible. You might want to correct the rounding issues. If the fiber is missing on the product, write the "-" (hyphen) symbol.
  • not filled: copy it from the image, if available. Sometimes the front image gives a summary for energy or fat.
Recycling instructions image

Try to find any instructions on the packaging.

Final check

Look at the product page and see if the ingredients are recognised. Edit if required. Report any unrecognised ingredients or try to work on the ingredients taxonomy.

Statistics

Aleene registered all new product edits for a while in a spreadsheet.