Changes

Jump to navigation Jump to search
Line 1: Line 1:  
The goal of this project is to establish a list of food establishments, to gather data about those establishments, to map food products to food establishments (using identifying codes and/or company names and street addresses), to use the data in the Open Food Facts applications and to enable other applications.
 
The goal of this project is to establish a list of food establishments, to gather data about those establishments, to map food products to food establishments (using identifying codes and/or company names and street addresses), to use the data in the Open Food Facts applications and to enable other applications.
 +
 +
== Current Uses on Open Food Facts ==
 +
* Map made with this data: http://madenear.me/
 +
* Product page: http://world.openfoodfacts.org/packager-code/fr-40-288-002-ec
    
==Regulation==
 
==Regulation==
Line 14: Line 18:  
* French EMB codes: http://agriculture.gouv.fr/liste-des-etablissements-agrees-ce
 
* French EMB codes: http://agriculture.gouv.fr/liste-des-etablissements-agrees-ce
 
* Greek GR codes: http://www.efet.gr/portal/page/portal/efetnew/enterprises/facilities
 
* Greek GR codes: http://www.efet.gr/portal/page/portal/efetnew/enterprises/facilities
 +
* Spanish RGSEAA codes: http://rgsa-web-aesan.msssi.es/rgsa/formulario_ue_js.jsp
 
* other countries packaging codes
 
* other countries packaging codes
    
== Aggregated list of food establishments ==
 
== Aggregated list of food establishments ==
 +
* Code repository for lists, scripts and tools: https://github.com/openfoodfacts/eu-food-data
 +
=== Technical details ===
   −
* Code repository for lists, scripts and tools: https://github.com/openfoodfacts/eu-food-data
+
**Files are here: https://bitbucket.org/openfoodfacts/product-opener/src/b2b3e84d40182d1162ec4060894a20f133a870b7/packager-codes/?at=master
 +
**Script used to merge files:https://bitbucket.org/openfoodfacts/product-opener/src/3942937fec34ecda9bfc88a1c9cef0d55a4a9d27/cgi/update_packager_codes.pl?at=master&fileviewer=file-view-default
 
===How to process official lists===
 
===How to process official lists===
 
*Use of french Agriculture Ministry files (hosted at https://github.com/openfoodfacts/eu-food-data/blob/master/fr/urls-fr.txt) to extract list of certification (CE Approval number).
 
*Use of french Agriculture Ministry files (hosted at https://github.com/openfoodfacts/eu-food-data/blob/master/fr/urls-fr.txt) to extract list of certification (CE Approval number).
Line 38: Line 46:  
*Update list with other official lists, such as derogatory approvals, ...
 
*Update list with other official lists, such as derogatory approvals, ...
   −
===France===
+
===France (DONE) ===
 
*Complete list of approved processes (as of July 2014): https://raw.githubusercontent.com/pmainguet/eu-food-data/master/fr/140802_Liste_Certif_EMB_CE_MinAgri
 
*Complete list of approved processes (as of July 2014): https://raw.githubusercontent.com/pmainguet/eu-food-data/master/fr/140802_Liste_Certif_EMB_CE_MinAgri
 
*Complete list of approved companies (as of July 2014): https://raw.githubusercontent.com/pmainguet/eu-food-data/master/fr/140802_Liste_EMB_CE_MinAgri.csv
 
*Complete list of approved companies (as of July 2014): https://raw.githubusercontent.com/pmainguet/eu-food-data/master/fr/140802_Liste_EMB_CE_MinAgri.csv
===United Kingdom===
+
===United Kingdom (DONE) ===
 
To-do list:
 
To-do list:
 
*find a way to manage the data available there http://www.food.gov.uk/enforcement/sectorrules
 
*find a way to manage the data available there http://www.food.gov.uk/enforcement/sectorrules
Line 77: Line 85:  
*https://opencorporates.com/
 
*https://opencorporates.com/
   −
==France==
+
 
 +
{| class="wikitable"
 +
! Country
 +
! Owner
 +
! Source format
 +
! Status
 +
! Output
 +
! Deployed ?
 +
! Remarks
 +
|-
 +
| Austria
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Belgium
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Bulgaria
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Croatia
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Cyprus
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
|Czech Republic
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
|Denmark
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Estonia
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Finland
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| France
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Germany
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Greece
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Hungary
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Ireland
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Italy
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Latvia
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
|Lithuania
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Luxembourg
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Malta
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Netherlands
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Poland
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Portugal
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Romania
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Slovakia
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Slovenia
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|-
 +
| Spain
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|}
 +
 
 +
 
 +
==Albania==
 +
 
 +
==Andorra==
 +
==Austria==
 +
==Belarus==
 +
==Belgium==
 +
==Bosnia and Herzegovina==
 +
==Bulgaria==
 +
==Croatia==
 +
==Cyprus==
 +
==Czech Republic==
 +
==Denmark==
 +
==Estonia==
 +
==Faroe Islands==
 +
==Finland==
 +
==France (DONE) ==
 
*I just build a script that takes all the french agreement info from Agriculture Ministry and concatenate them in one file. Next step is to do the same for UK. The step after that is to cleverly agregate the duplicates (some companies have several health agreements under the same agreement number)
 
*I just build a script that takes all the french agreement info from Agriculture Ministry and concatenate them in one file. Next step is to do the same for UK. The step after that is to cleverly agregate the duplicates (some companies have several health agreements under the same agreement number)
 
https://github.com/openfoodfacts/eu-food-data/blob/master/scripts/FR-script.py
 
https://github.com/openfoodfacts/eu-food-data/blob/master/scripts/FR-script.py
Line 83: Line 326:  
*If nominatim limits queries, you can use data files from wikipedia for lat/lng for each zipcode https://www.data.gouv.fr/fr/datasets/listes-des-communes-geolocalisees-par-regions-departements-circonscriptions-nd/
 
*If nominatim limits queries, you can use data files from wikipedia for lat/lng for each zipcode https://www.data.gouv.fr/fr/datasets/listes-des-communes-geolocalisees-par-regions-departements-circonscriptions-nd/
   −
==UK==
+
==Germany (DONE) ==
 +
*@vince has performed a first extraction based on file in https://github.com/openfoodfacts/eu-food-data/tree/master/de with the help of the following script
 +
    cat export.csv | awk -F';' '{print "\"" $4 "\"; Deutschland"}' | sed "1d" | sort -u | iconv -f ISO-8859-15 -t UTF-8 > to_geocode.csv
 +
==Gibraltar==
 +
==Greece==
 +
==Hungary==
 +
==Iceland==
 +
==Ireland==
 +
==Isle of Man==
 +
==Italy==
 +
Geocoded version by Tacite : https://openfoodfacts.slack.com/archives/C02LB7AV0/p1494497561131004 <br/>
 +
Source (no geocoding) is at http://www.salute.gov.it/consultazioneStabilimenti/ConsultazioneStabilimentiServlet?ACTION=gestioneSingoloPaese&naz=CL <br/>
 +
Note: There is an alternative version with more than 6500 codes available that includes artisan raw milk codes that we're not likely to see on OFF for now. In an effort to get a working version with geocoding quickly, I didn't use it.
 +
 
 +
==Kosovo==
 +
==Latvia==
 +
==Liechtenstein==
 +
==Lithuania==
 +
==Luxembourg==
 +
==Macedonia==
 +
==Malta==
 +
==Moldova==
 +
==Monaco==
 +
==Montenegro==
 +
==Netherlands (DONE) ==
 +
*Data from NWA (Netherlands Food & Consumer Product Safety Authority)
 +
**English (site): https://english.nvwa.nl/topics/approved-establishments
 +
* EU
 +
**English EU: https://webgate.ec.europa.eu/tracesnt/directory/publication/establishment/index#!/search?classificationSectionChapter=food&countryCode=NL&sort=classificationSection.translation
 +
 
 +
==Norway==
 +
==Poland==
 +
==Portugal==
 +
==Romania==
 +
@lucaa is doing it
 +
==Russia==
 +
==San Marino==
 +
==Serbia==
 +
https://openfoodfacts.slack.com/files/bojackhorseman/F59PY4CR1/version1.csv
 +
 
 +
==Slovakia==
 +
==Slovenia==
 +
==Spain==
 +
==Sweden==
 +
==Switzerland==
 +
==Ukraine==
 +
==United Kingdom (DONE) ==
 +
 
 
*As UK is divided in 4 regions (Ireland, England, Wales and Scotland) and because they have different file format, we use a 3-file script
 
*As UK is divided in 4 regions (Ireland, England, Wales and Scotland) and because they have different file format, we use a 3-file script
 
**https://github.com/openfoodfacts/eu-food-data/blob/master/scripts/UK-urls.txt => all UK urls
 
**https://github.com/openfoodfacts/eu-food-data/blob/master/scripts/UK-urls.txt => all UK urls
Line 89: Line 379:  
**https://github.com/openfoodfacts/eu-food-data/blob/master/scripts/UK-script.py => the script itself
 
**https://github.com/openfoodfacts/eu-food-data/blob/master/scripts/UK-script.py => the script itself
 
*Source: Food Standards Agency - http://www.food.gov.uk/business-industry/meat/audit
 
*Source: Food Standards Agency - http://www.food.gov.uk/business-industry/meat/audit
 +
==Vatican city==
 +
==Yugoslavia==
 +
   −
==DE==
  −
*@vince has performed a first extraction based on file in https://github.com/openfoodfacts/eu-food-data/tree/master/de with the help of the following script
  −
    cat export.csv | awk -F';' '{print "\"" $4 "\"; Deutschland"}' | sed "1d" | sort -u | iconv -f ISO-8859-15 -t UTF-8 > to_geocode.csv
  −
==NL==
  −
*Data from NWA (Netherlands Food & Consumer Product Safety Authority)
  −
**English (PDF): https://english-acc.nvwa.nl/documents/document/approved-establishments1/animal-byproducts
  −
*A nice map with all the companies with approval from Netherlands under the EU regulation: http://www.alteconomics.fr/Leaflet
      
==Inspiration==
 
==Inspiration==
3,393

edits

Navigation menu