Line 234:
Line 234:
* Build a url listing all needed url. It is best to use FR template (FR-urls.txt to be uploaded), to identify missing data. It is also important to match country specific denomination with OFF taxonomy for EU Approval Section.
* Build a url listing all needed url. It is best to use FR template (FR-urls.txt to be uploaded), to identify missing data. It is also important to match country specific denomination with OFF taxonomy for EU Approval Section.
−
===Build CSV/TXT files===
+
===Build Raw CSV/TXT files===
*Several formats are used in EU countries. A specific approach is needed for each of them. Refer below for details for each country.
*Several formats are used in EU countries. A specific approach is needed for each of them. Refer below for details for each country.
*For non text-PDF files, use Tesseract and this Python script https://github.com/virantha/pypdfocr to get text PDF
*For non text-PDF files, use Tesseract and this Python script https://github.com/virantha/pypdfocr to get text PDF
*For text PDF files, use Tabula and use the command line tool to create scripts https://github.com/tabulapdf/tabula-extractor/wiki/Using-the-command-line-tabula-extractor-tool
*For text PDF files, use Tabula and use the command line tool to create scripts https://github.com/tabulapdf/tabula-extractor/wiki/Using-the-command-line-tabula-extractor-tool
−
*Cleanup is needed to ensure data accuracy => an XLS file is available for some countries (eg France) to speed up the process
+
===Get Templated CSV/TXT file===
+
*Cleanup is needed to ensure data accuracy
+
*an XLS file is available for some countries (eg France) to speed up the process
+
*Section needs to be normalize to make comparisons between countries
===Geocode===
===Geocode===