View Single Post
Posts: 106 | Thanked: 205 times | Joined on Dec 2015 @ Spain
#196
During the process I get this error. Any ideas?

Code:
[ferlanero@ferlanero-XPS ~]$ export CORPUS_DIR=/home/ferlanero/okboard/langs
[ferlanero@ferlanero-XPS ~]$ export WORK_DIR=/home/ferlanero/okboard/langs
[ferlanero@ferlanero-XPS ~]$ cd /home/ferlanero/okb-engine-master/
[ferlanero@ferlanero-XPS okb-engine-master]$ db/build.sh esBuilding for languages:  es
~/okb-engine-master/ngrams ~/okb-engine-master/db
running build
running build_ext
running build
running build_ext
~/okb-engine-master/db
~/okb-engine-master/cluster ~/okb-engine-master/db
g++ -c -pipe -g -Wall -W -D_REENTRANT -fPIC -DQT_GUI_LIB -DQT_CORE_LIB -I. -isystem /usr/include/qt -isystem /usr/include/qt/QtGui -isystem /usr/include/qt/QtCore -Ibuild -I/usr/lib/qt/mkspecs/linux-g++ -o build/cluster.o cluster.cpp
g++  -o build/cluster build/cluster.o   -lQt5Gui -lQt5Core -lGL -lpthread 
~/okb-engine-master/db
«/home/ferlanero/okb-engine-master/db/lang-en.cf» -> «/home/ferlanero/okboard/langs/lang-en.cf»
«/home/ferlanero/okb-engine-master/db/lang-es.cf» -> «/home/ferlanero/okboard/langs/lang-es.cf»
«/home/ferlanero/okb-engine-master/db/lang-fr.cf» -> «/home/ferlanero/okboard/langs/lang-fr.cf»
«/home/ferlanero/okb-engine-master/db/lang-nl.cf» -> «/home/ferlanero/okboard/langs/lang-nl.cf»
«/home/ferlanero/okb-engine-master/db/add-words-fr.txt» -> «/home/ferlanero/okboard/langs/add-words-fr.txt»
«/home/ferlanero/okb-engine-master/db/db.version» -> «/home/ferlanero/okboard/langs/db.version»
make: '.depend-es' está actualizado.
( [ -f "add-words-es.txt" ] && cat "add-words-es.txt" ; aspell -l es dump master | aspell -l es expand | tr ' ' '\n') | sort | uniq > es-full.dict
lbzip2 -d < /home/ferlanero/okboard/langs/corpus-es.txt.bz2 | /home/ferlanero/okb-engine-master/db/../tools/corpus-splitter.pl 200 50 es-learn.tmp.bz2 es-test.tmp.bz2
mv -vf es-learn.tmp.bz2 es-learn.txt.bz2
«es-learn.tmp.bz2» -> «es-learn.txt.bz2»
mv -vf es-test.tmp.bz2 es-test.txt.bz2
«es-test.tmp.bz2» -> «es-test.txt.bz2»
set -o pipefail ; lbzip2 -d < es-learn.txt.bz2 | /home/ferlanero/okb-engine-master/db/../tools/import_corpus.py es-full.dict | sort -rn | lbzip2 -9 > grams-es-full.csv.bz2.tmp
[5] 18889/885412 words, 315866 n-grams, read 1 MB
...
[1155] 135339/885412 words, 22358980 n-grams, read 244 MB
Traceback (most recent call last):
  File "/home/ferlanero/okb-engine-master/db/../tools/import_corpus.py", line 209, in <module>
    ci.parse_line(line)
  File "/home/ferlanero/okb-engine-master/db/../tools/import_corpus.py", line 76, in parse_line
    if re.match(r'[\.:;\!\?]', mo.group(0)): self.next_sentence()
  File "/home/ferlanero/okb-engine-master/db/../tools/import_corpus.py", line 167, in next_sentence
    self.count(roll)
  File "/home/ferlanero/okb-engine-master/db/../tools/import_corpus.py", line 180, in count
    self.count2(elts)
  File "/home/ferlanero/okb-engine-master/db/../tools/import_corpus.py", line 189, in count2
    if key not in self.grams: self.grams[key] = 0
MemoryError
/home/ferlanero/okb-engine-master/db/makefile:43: fallo en las instrucciones para el objetivo 'grams-es-full.csv.bz2'
make: *** [grams-es-full.csv.bz2] Error 1