Ingredients analysis and search features extraction

Summary

Ingredients analysis and search features extraction is one of the 4 sub-tasks of the Project:Personalized_Search funded by the NGI0 Discovery Fund managed by NlNet.

This page documents the progress made in Q1 and Q2 2020.

Methods and infrastructure

Ingredients analysis has been gradually added to Open Food Facts in a very organic way (the first versions of additives and palm oil detections in French ingredients lists date from 2012). A lot of progress has been made over the years, but ingredients analysis has remained a complex, undocumented, and artisanal effort mostly focused on French, with only one developer coding it and very few people able to improve it.

The first focus of the project as thus been to develop methods and infrastructure to industrialize ingredients analysis and bring it to the next level for many more languages.

Documentation

Metrics definition

Metrics reporting and exploring

Metrics monitoring

Visibility of ingredients analysis results and internals

Testing tool

Assessment of the Ingredients Analysis Quality for major EU languages

Improvements to ingredients analysis

Ingredients list cleaning

Wrong languages

Ingredients list cropping and new OCR extraction

Spelling correction

Ingredients taxonomy improvements

Ingredients processing taxonomy

Ingredients parsing features

Report, dissemination and next steps

Report

Blog post

Next steps

Call for help to continue to improve ingredients analysis in more and more languages