Line 17:
Line 17:
The whole database can be downloaded at https://world.openfoodfacts.org/data
The whole database can be downloaded at https://world.openfoodfacts.org/data
−
It's very big. Open Food Facts hosts more than 2,800,000 products (as of April 2023). So you will probably need skills to reuse the data.
+
It's very big. Open Food Facts hosts more than 3,700,000 products (as of April 2025). So you will probably need skills to reuse the data.
You'll be able to find here different kinds of data.
You'll be able to find here different kinds of data.
−
==== The MongoDB daily export ====
+
==== a. The MongoDB daily export ====
It represents the most complete data; it's very big and you have to know how to deal with MongoDB. It's very big! More than 30GB uncompressed.
It represents the most complete data; it's very big and you have to know how to deal with MongoDB. It's very big! More than 30GB uncompressed.
−
==== The JSONL daily export ====
+
==== b. The JSONL daily export ====
There is a daily export of the whole database in [https://jsonlines.org/ JSONL format] (sometimes called LDJSON or NDJSON) where each line is a JSON object. It represents the same data as the MongoDB export. The file is 4,8GB (2022-10), compressed with gzip. It takes more than 14GB uncompressed.
There is a daily export of the whole database in [https://jsonlines.org/ JSONL format] (sometimes called LDJSON or NDJSON) where each line is a JSON object. It represents the same data as the MongoDB export. The file is 4,8GB (2022-10), compressed with gzip. It takes more than 14GB uncompressed.
You can find it at https://static.openfoodfacts.org/data/openfoodfacts-products.jsonl.gz
You can find it at https://static.openfoodfacts.org/data/openfoodfacts-products.jsonl.gz
−
==== The CSV daily export ====
+
==== c. The CSV daily export ====
−
It contains all the products, but with a subset of the database fields. [https://world.openfoodfacts.org/data/data-fields.txt This subset is very large] and include main characteristics (EAN, name, brand...), many tags (such as categories, origins, labels, packaging...), ingredients and nutrition facts. Thus, it is generally fitted to the majority of usages. It's a 2.3GB file (as of April 2020), so it can't be opened by Libre Office or Excel with an 8GB machine.
+
It contains all the products, but with a subset of the database fields. [https://world.openfoodfacts.org/data/data-fields.txt This subset is very large] and include main characteristics (EAN, name, brand...), many tags (such as categories, origins, labels, packaging...), ingredients and nutrition facts. Thus, it is generally fitted to the majority of usages. As of April 2025, it's a 1GB gziped file, leading to a 10GB+ CSV, so it can't be opened by Libre Office or Excel, even with an 32GB machine.
+
+
==== d. The Parquet daily export ====
+
It's similar to the CSV export. It contains all the products, but with a subset of the database fields. It includes main characteristics (EAN, name, brand...), many tags (such as categories, origins, labels, packaging...), ingredients and nutrition facts. Thus, it is generally fitted to the majority of usages. It's a 4GB file (as of April 2025), you'll need special tools to read it, such as DuckDB (see below), [https://www.tadviewer.com/ TAD], R stat or Python.
== How to reuse? ==
== How to reuse? ==