Changes

Jump to navigation Jump to search
no edit summary
Line 234: Line 234:  
* Build a url listing all needed url. It is best to use FR template (FR-urls.txt to be uploaded), to identify missing data. It is also important to match country specific denomination with OFF taxonomy for EU Approval Section.
 
* Build a url listing all needed url. It is best to use FR template (FR-urls.txt to be uploaded), to identify missing data. It is also important to match country specific denomination with OFF taxonomy for EU Approval Section.
   −
===Build CSV/TXT files===
+
===Build Raw CSV/TXT files===
 
*Several formats are used in EU countries. A specific approach is needed for each of them. Refer below for details for each country.
 
*Several formats are used in EU countries. A specific approach is needed for each of them. Refer below for details for each country.
 
*For non text-PDF files, use Tesseract and this Python script https://github.com/virantha/pypdfocr to get text PDF
 
*For non text-PDF files, use Tesseract and this Python script https://github.com/virantha/pypdfocr to get text PDF
 
*For text PDF files, use Tabula and use the command line tool to create scripts https://github.com/tabulapdf/tabula-extractor/wiki/Using-the-command-line-tabula-extractor-tool
 
*For text PDF files, use Tabula and use the command line tool to create scripts https://github.com/tabulapdf/tabula-extractor/wiki/Using-the-command-line-tabula-extractor-tool
*Cleanup is needed to ensure data accuracy => an XLS file is available for some countries (eg France) to speed up the process
+
===Get Templated CSV/TXT file===
 +
*Cleanup is needed to ensure data accuracy
 +
*an XLS file is available for some countries (eg France) to speed up the process
 +
*Section needs to be normalize to make comparisons between countries
    
===Geocode===
 
===Geocode===

Navigation menu