Changes

Jump to navigation Jump to search
593 bytes removed ,  15:50, 10 October 2015
no edit summary
Line 230: Line 230:  
=Methodology to extract data for European Food Establishments=
 
=Methodology to extract data for European Food Establishments=
 
==General==
 
==General==
===Get Data Files===
+
===Build URL Data Files===
* All data (url list and data files) can be found here https://github.com/openfoodfacts/eu-food-data
+
* All root directories for EU Approval list by country can be found here https://github.com/openfoodfacts/eu-food-data
**There is a general csv file with the general link to the data repository for each country: https://github.com/openfoodfacts/eu-food-data/blob/master/list-eu-and-partner-countries.csv
+
* Build a url listing all needed url. It is best to use FR template (FR-urls.txt to be uploaded), to identify missing data. It is also important to match country specific denomination with OFF taxonomy for EU Approval Section.
**There are individual folders for each target country (specific url-list for each European Agreement Section and data files)
+
 
* A google sheet document is used to map all files available in the target countries. It also map the section name for every country in its own language (or translation in English) and the related European Section, which is used as a general taxonomy. This Google Sheet can be found here: https://docs.google.com/spreadsheets/d/1egdo58Ds8PNi5G_4F2UtWOWC1V0k3tXBgPhZXs5FRqM/edit?usp=sharing
  −
*We can usually find txt or csv file but for some countries the data is only available in PDF. Those need OCR treatment before data extraction.
   
===Build CSV/TXT files===
 
===Build CSV/TXT files===
 
*Several formats are used in EU countries. A specific approach is needed for each of them. Refer below for details for each country.
 
*Several formats are used in EU countries. A specific approach is needed for each of them. Refer below for details for each country.

Navigation menu