Nutrition facts table data extraction/Hackathon

Back to Nutrition facts table data extraction

Introduction

A team of Microsofties is working on using Microsoft Form Recognizer to extract data from nutrition facts table pictures to pre-populate Open Food Facts' Hunger Game data entry and validation form.

Prototype

• https://world.openfoodfacts.org/hunger-game?type=nutrition

Code

Issue to port to V2, with a link to the current prototype code: https://github.com/openfoodfacts/openfoodfacts-hungergames/issues/47

Form recognizer

• Previous work on Form Recognizer by Ramzi: https://github.com/openfoodfacts/openfoodfacts-ai/tree/master/nutrition-table-extraction/notebooks
• Can we do the form recognizer query on the fly from the page ?
• Should we do it server side ?
• We already have an OFF API for extraction nutrition data from text that we can also use.