Difference between revisions of "Product Opener/Installation/Issues"

From Open Food Facts wiki
Jump to navigation Jump to search
(tesseract issue (prod is using v2, debian 7 installs v3))
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
  
 +
[[Category:ProductOpener]]
 +
== Issues on Mac ==
 +
Invalid version format (version required) at /Library/Perl/5.18/Module/Runtime.pm line 386.
 +
See:
 +
http://blogs.perl.org/users/ovid/2014/02/moose-dying-with-invalid-version-format-version-required.html
 +
 +
== Issues on Debian jessie ==
 +
== Issues (old) on Debian wheezy ==
 
=== Dotted fields in MongoDB ===
 
=== Dotted fields in MongoDB ===
  
Line 172: Line 180:
 
  apt-cache show tesseract-ocr | grep -i version
 
  apt-cache show tesseract-ocr | grep -i version
 
Version: 2.04-2+squeeze1
 
Version: 2.04-2+squeeze1
 +
</pre>
 +
 +
Solution:
 +
 +
In fact tesseract was just missing dictionaries for French "fra".
 +
 +
<pre>
 +
apt-get install tesseract-ocr-fra
 +
</pre>
 +
 +
 +
=== Apache 2.4 reverse proxy configure error "Bundled APR requested but not found" ===
 +
 +
<pre>
 +
configure: error: Bundled APR requested but not found at ./srclib/. Download and unpack the corresponding apr and apr-util packages to ./srclib/.
 +
</pre>
 +
 +
Solution: install APR
 +
 +
<pre>
 
</pre>
 
</pre>

Latest revision as of 11:01, 29 January 2018

Issues on Mac

Invalid version format (version required) at /Library/Perl/5.18/Module/Runtime.pm line 386. See: http://blogs.perl.org/users/ovid/2014/02/moose-dying-with-invalid-version-format-version-required.html

Issues on Debian jessie

Issues (old) on Debian wheezy

Dotted fields in MongoDB

Problem:

MongoDB 2.6 complains about fields that contains dots. Before 2015, Product Opener stored some backup versions of some fields by appending a dot and some string.

"The dotted field 'countries.20131226' in 'countries.20131226' is not valid for storage."

Resolution:

Those fields can be safely removed. (done in update_all_products_from_dir_in_mongodb.pl)

List of tag values (e.g. list of categories)

Problem:

With MongoDB 2.6, the aggregate command used to list all values of tags such as categories does not return the same structure.

in Display.pm:

        eval {
                $results = $products_collection->aggregate( $aggregate_parameters );
        };
 -e: Not an ARRAY reference at /home/off/cgi//Blogs/Display.pm line 789.
display.pl : query_string: /lieux-de-fabrication
analyze_request : query_string 1 : /lieux-de-fabrication
analyze_request : query_string 2 : /lieux-de-fabrication
analyze_request : query_string 3 : lieux-de-fabrication
Display::analyze_request - last component - lieux-de-fabrication - plural? manufacturing_places
Display::analyze_request - list of tags - groupby: manufacturing_places
Display::analyze_request - lc: fr lang: fr text:  - product:  - tagtype/tagid: / - tagtype2/tagid2: / - groupby: manufacturing_places
display.pl blogid:  tagid:  urlsdate:  urlid:  user:  query:
Display.pm - display_list_of_tags - query:
$VAR1 = {
          'countries_tags' => 'en:france',
          '_tags' => undef
        };

Display.pm - display_list_of_tags - aggregate_parameters:
$VAR1 = [
          {
            '$match' => {
                          'countries_tags' => 'en:france',
                          '_tags' => undef
                        }
          },
          {
            '$unwind' => '$manufacturing_places_tags'
          },
          {
            '$group' => {
                          'count' => {
                                       '$sum' => 1
                                     },
                          '_id' => '$manufacturing_places_tags'
                        }
          },
          {
            '$sort' => {
                         'count' => -1
                       }
          }
        ];

Display.pm - display_list_of_tags - aggregate query done
Display.pm - display_list_of_tags - results:
$VAR1 = bless( {
                 '_database' => bless( {
                                         '_connection' => bless( {
                                                                   'w' => 1,
                                                                   'query_timeout' => 30000,
                                                                   'find_master' => 0,
                                                                   'db_name' => 'admin',
                                                                   'auto_reconnect' => 1,
                                                                   '_servers' => {},
                                                                   'ts' => 0,
                                                                   'right_port' => 27017,
                                                                   'wtimeout' => 1000,
                                                                   'port' => 27017,
                                                                   'left_port' => 27017,
                                                                   'host' => 'localhost:27017',
                                                                   'max_bson_size' => 16777216,
                                                                   'timeout' => 20000,
                                                                   'auto_connect' => 1
                                                                 }, 'MongoDB::Connection' ),
                                         'name' => 'off'
                                       }, 'MongoDB::Database' ),
                 'name' => 'products.aggregate'
               }, 'MongoDB::Collection' );

[Tue Jan 20 10:23:20 2015] [error] [Tue Jan 20 10:23:20 2015] -e: Not an ARRAY reference at /home/off/cgi//Blogs/Display.pm line 789.\n

Expected:

Display.pm - display_list_of_tags - aggregate query done
Display.pm - display_list_of_tags - results:
$VAR1 = [
          {
            'count' => 3055,
            '_id' => 'france'
          },
          {
            'count' => 542,
            '_id' => 'bretagne'
          },
..


Cause : old version of MongoDB Perl Module

Debian 7.6 has a very old version of the module:

root@ns431999:/home/off/logs# cat /etc/debian_version
7.6
root@ns431999:/home/off/logs# apt-get install libmongodb-perl
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances
Lecture des informations d'état... Fait
libmongodb-perl est déjà la plus récente version disponible.
0 mis à jour, 0 nouvellement installés, 0 à enlever et 75 non mis à jour.
root@ns431999:/home/off/logs# perl -MMongoDB -e 'print $MongoDB::VERSION . "\n"'
0.45

Solution: use CPAN

cpan install MongoDB

root@ns431999:/home/off/logs# perl -MMongoDB -e 'print $MongoDB::VERSION . "\n"'
v0.707.2.0


Tesseract OCR / segmentation fault

sh : ligne 1 : 18042 Erreur de segmentation  /usr/bin/tesseract /home/off/html/images/products/324/541/299/9925/ingredients.8.full.jpg.tmp.14217494077210.tif /home/off/html/images/products/324/541/299/9925/ingredients.8.full.jpg.tmp.14217494077210.tif -l fra 2> /dev/null

Running manually:

 tesseract --version
tesseract 3.02

off@ns431999:~/cgi$ /usr/bin/tesseract /home/off/html/images/products/324/541/299/9925/ingredients.8.full.jpg.tmp.14217494077210.tif /home/off/html/images/products/324/541/299/9925/ingredients.8.full.jpg.tmp.14217494077210.tif -l fra
Error opening data file /usr/share/tesseract-ocr/tessdata/fra.traineddata
Please make sure the TESSDATA_PREFIX environment variable is set to the parent directory of your "tessdata" directory.
Failed loading language 'fra'
Tesseract couldn't load any languages!
Tesseract Open Source OCR Engine v3.02 with Leptonica
Page 0
Erreur de segmentation

As of January 2015, OFF is running an older version of tesseract:

 apt-cache show tesseract-ocr | grep -i version
Version: 2.04-2+squeeze1

Solution:

In fact tesseract was just missing dictionaries for French "fra".

apt-get install tesseract-ocr-fra


Apache 2.4 reverse proxy configure error "Bundled APR requested but not found"

configure: error: Bundled APR requested but not found at ./srclib/. Download and unpack the corresponding apr and apr-util packages to ./srclib/.

Solution: install APR