4,124
edits
Changes
Jump to navigation
Jump to search
Line 1:
Line 1: − + − We talked about ingredients list extraction on last Data Quality meeting (by the way, DQ meetings are every first Tuesday of the month at 18:00 CEST, everyone can join). − We would like to improve the extraction. − Everybody can help there. + − all text that are before the ingredients list, that need to be removed.+ + + − the traces should be extracted, but when you click on "Details of the analysis of the ingredients" they should not appear as ingredient (except if one trace-ingredient is not recognized, see previous discussion with Moon Rabbit https://openfoodfacts.slack.com/archives/C06A7LENM/p1690126832563859).+ + − that would be text that is after ingredient list and should be ignored but you keep it because you have allergens list after+ − Currently all possible occurences are not yet referenced for all languages. Hence, if you if you see some text that you have to remove when you extract the text, just write in this thread: − the text − if it is %phrases_after_ingredients_list or %may_contain_regexps or something else − the link to the product + +
Ingredients List Cutting (view source)
Revision as of 07:49, 14 October 2023
, 07:49, 14 October 2023no edit summary
The page details the Ingredients List Cutting procedure and implementation.
The page details the [[Ingredients List Cutting]] procedure and implementation.
== Procedure ==
== Procedure ==
When you edit a product, if you extract text from the picture and you see some parts of the text that you have to remove by yourself. "store in a cold place", "after opening blablabla", for examples.
When you edit a product, if you extract text from the picture and you see some parts of the text that you have to remove by yourself. "store in a cold place", "after opening blablabla", for examples.
This part can be done automatically by Open Food Facts when you click on the button to extract.
This part can be done automatically by Open Food Facts when you click on the button to extract.
We just need to list all possible occurences.
We just need to list all possible occurences.
So, we can start with the 4 followings:
So, we can start with the 4 followings:
== Phrases before the ingredients list ==
%phrases_before_ingredients_list
%phrases_before_ingredients_list
All text that are before the ingredients list, that need to be removed. Usually this is a word like "ingredients".
== Phrases after the ingredients list ==
%phrases_after_ingredients_list
%phrases_after_ingredients_list
all text that are after the ingredients list, that need to be removed ("store in a cold place", for example).
all text that are after the ingredients list, that need to be removed ("store in a cold place", for example).
== May contain phrases ==
%may_contain_regexps
%may_contain_regexps
The traces should be extracted, but when you click on "Details of the analysis of the ingredients" they should not appear as ingredient (except if one trace-ingredient is not recognized, see previous discussion with Moon Rabbit https://openfoodfacts.slack.com/archives/C06A7LENM/p1690126832563859).
== Ignore phrases ==
%ignore_regexps
%ignore_regexps
That would be text that is after ingredient list and should be ignored but you keep it because you have allergens list after
Currently all possible occurences are not yet referenced for all languages. Hence, if you if you see some text that you have to remove when you extract the text, mention it on Slack in the conversation #ingredients
== Implementation ==
== Implementation ==
This is now in ingredients.pm?
== Examples ==
== Examples ==
Some example to illustrate which words refer to what part of the raw ingredients extraction.
Some example to illustrate which words refer to what part of the raw ingredients extraction.