Difference between revisions of "Verification/Roadmap"
Jump to navigation
Jump to search
m (Teolemon moved page Project:Error detection to Error detection/Roadmap) |
|||
| (6 intermediate revisions by 2 users not shown) | |||
| Line 5: | Line 5: | ||
== Ideas to automatically detect products that contain errors entering information == | == Ideas to automatically detect products that contain errors entering information == | ||
| − | + | === Rules === | |
* Sum of components of nutritional table well above 100g | * Sum of components of nutritional table well above 100g | ||
* Sum of ingredients well over 100g (detection and complicated products ) | * Sum of ingredients well over 100g (detection and complicated products ) | ||
| Line 16: | Line 16: | ||
* Quantity of "sugars" greater than the amount of "carbohydrate" | * Quantity of "sugars" greater than the amount of "carbohydrate" | ||
* Sum of fatty acids greater than the amount of "lipids" | * Sum of fatty acids greater than the amount of "lipids" | ||
| + | * Use the EU Organic codes to check whether the certification country is the same as the production country | ||
| + | * Year in a label is 2 or more greater than best before. | ||
* etc. | * etc. | ||
| + | |||
| + | === Methods === | ||
| + | * Consistency checks within a category | ||
| + | * Consistency checks with logical or biological rules | ||
| + | * Consistency checks with Laws | ||
| + | * Consistency checks with outside corpora | ||
| + | * Consistency checks of contributed data with [[OCR]] results | ||
| + | |||
| + | * [[Bots]] : several bots already exist. | ||
== Note == | == Note == | ||
Each track (each rule) must have a unique number associated clearly: Once an accurate method of error detection is translated computer (is implemented), then this method becomes a rule. The automatically assigned number to this rule allows contributors to designate it unambiguously. | Each track (each rule) must have a unique number associated clearly: Once an accurate method of error detection is translated computer (is implemented), then this method becomes a rule. The automatically assigned number to this rule allows contributors to designate it unambiguously. | ||
| − | [[category: | + | [[category:Project]] |
| − | + | [[category:Verification]] | |
[[category:Roadmap]] | [[category:Roadmap]] | ||
| + | [[category:Data quality]] | ||
Latest revision as of 12:19, 30 July 2024
Objectives
- Detect potential errors in order to correct them and prevent them
- Do not take into account the products whose information is questionable in the calculations of averages
Ideas to automatically detect products that contain errors entering information
Rules
- Sum of components of nutritional table well above 100g
- Sum of ingredients well over 100g (detection and complicated products )
- Confusion between "l" ( lowercase letter L ) and 1 (one) in the list of ingredients because of the OCR, which gives: nom_de_l'ingrédient l5 %
- Sum of " that sugar / starch / etc . " than carbohydrates (and the same for fat etc.).
- Energy over 4000 kJ
- Height from the upper portion to the size of package
- "CO2 Carbon Footprint" greater than 3 000g
- Over 12 additives
- Quantity of "sugars" greater than the amount of "carbohydrate"
- Sum of fatty acids greater than the amount of "lipids"
- Use the EU Organic codes to check whether the certification country is the same as the production country
- Year in a label is 2 or more greater than best before.
- etc.
Methods
- Consistency checks within a category
- Consistency checks with logical or biological rules
- Consistency checks with Laws
- Consistency checks with outside corpora
- Consistency checks of contributed data with OCR results
- Bots : several bots already exist.
Note
Each track (each rule) must have a unique number associated clearly: Once an accurate method of error detection is translated computer (is implemented), then this method becomes a rule. The automatically assigned number to this rule allows contributors to designate it unambiguously.