Changes

This page explains how we measure and monitor the quality of ingredients analysis.

This page explains how we measure and monitor the quality of ingredients analysis.

= Metrics for ingredients analysis =

== Metrics for ingredients analysis ==

== Ingredients parsing and recognition metrics ==

=== Ingredients parsing and recognition metrics ===

For each product, the ingredients list is parsed to separate each ingredient. Ingredients that we can match to our multilingual ingredients taxonomy as marked as "known", others as "unknown".

For each product, the ingredients list is parsed to separate each ingredient. Ingredients that we can match to our multilingual ingredients taxonomy as marked as "known", others as "unknown".

* The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language)

* The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language)

=== Percentage of known ingredients ===

==== Percentage of known ingredients ====

The metric we use to assess the quality of ingredients parsing and recognition is the % of known ingredients over all ingredients.

The metric we use to assess the quality of ingredients parsing and recognition is the % of known ingredients over all ingredients.

*** This is the most representative metric for ingredients parsing and recognition

*** This is the most representative metric for ingredients parsing and recognition

=== How to see the percentage of known ingredients ===

==== How to see the percentage of known ingredients ====

For one specific product, on the product page on the Open Food Facts web site, you can click on "Details of the ingredients analysis" to see how many ingredients have been recognized.

For one specific product, on the product page on the Open Food Facts web site, you can click on "Details of the ingredients analysis" to see how many ingredients have been recognized.

== Ingredients analysis at the product level ==

=== Ingredients analysis at the product level ===

For each product, once we have parsed the ingredients list to separate each ingredient and match them to our taxonomy, we can analyze if the products are vegan, vegetarian, without palm oil etc.

For each product, once we have parsed the ingredients list to separate each ingredient and match them to our taxonomy, we can analyze if the products are vegan, vegetarian, without palm oil etc.

To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan.

To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan.

=== Percentage of known values for each property ===

==== Percentage of known values for each property ====

For a property (e.g. is the product vegetarian, vegan or palm oil free), we can have different values, for instance for the vegetarian property:

For a property (e.g. is the product vegetarian, vegan or palm oil free), we can have different values, for instance for the vegetarian property:

The metric we use is the percentage of known values over all values.

The metric we use is the percentage of known values over all values.

=== How to see the percentage of known values ===

==== How to see the percentage of known values ====

For one specific product, the product page shows the results of the ingredients analysis with icons for vegetarian products, vegan products and palm oil free products (red, orange or green depending on the value). If the property has an unknown value, the icon is not displayed.

For one specific product, the product page shows the results of the ingredients analysis with icons for vegetarian products, vegan products and palm oil free products (red, orange or green depending on the value). If the property has an unknown value, the icon is not displayed.

</pre>

</pre>

= Ingredients Analysis Quality Evaluation - March 2020 =

== Ingredients Analysis Quality Evaluation - March 2020 ==

An initial evaluation of the quality of ingredients analysis for major European languages was done in March 2020 as part of the first task [[Ingredients analysis and search features extraction]] of the [[Project:Personalized_Search]]

An initial evaluation of the quality of ingredients analysis for major European languages was done in March 2020 as part of the first task [[Ingredients analysis and search features extraction]] of the [[Project:Personalized_Search]]