Notices


Reply
Thread Tools
Posts: 697 | Thanked: 137 times | Joined on Jul 2012 @ Hillerød, DK
#1471
Have same problem as 'nodevel'.
When will 0.43.4 be ready for Openrepos.net?
__________________
OK
 

The Following User Says Thank You to Garp For This Useful Post:
Posts: 159 | Thanked: 217 times | Joined on Oct 2011
#1472
I tried to download the offline routing data for Finland at

http://modrana.org/data/monav/

But the pack is only 61 bytes in size and the package seems to be empty. I also noted that the packages of other countries were also very small in size. The whole Europe pack seems to be correct size, (4.3gigs), but I'd rather download only the countries I need? Is there something funny going on with the offline packs?
 

The Following 3 Users Say Thank You to Kossuth For This Useful Post:
Posts: 1,548 | Thanked: 7,510 times | Joined on Apr 2010 @ Czech Republic
#1473
Originally Posted by Kossuth View Post
I tried to download the offline routing data for Finland at

http://modrana.org/data/monav/

But the pack is only 61 bytes in size and the package seems to be empty. I also noted that the packages of other countries were also very small in size. The whole Europe pack seems to be correct size, (4.3gigs), but I'd rather download only the countries I need? Is there something funny going on with the offline packs?
I known about this and I'm working on a fix.

How did it happen ?
While updating the repository, all extracts present on downloads.geofabrik.de are are downloaded (in sequence by a single thread) and processed (by many, MANY threads ) into Monav routing data packs. The size of the input data downloaded for each repository update is about ~100 GB and each update takes about 5 hours from start to finish.

After running an update recently, I've noticed it took just about 2 hours. I've investigated and found that downloads from Geofabrik started to fail with a 503 error after a certain amount of the data needed was downloaded - I've contacted Geofabrik and indeed, the download was tripping some overuse protection they have (recently ?) added to their repository.

I've cleared the situation with them and they granted the modRana repository a usage exception.

Still, I agree that downloading about 100GB from their repository is not very efficient and I've started working on a better long term solution.

Plan of action
The repository needs regional extract that it can turn into Monav routing data packs (and hopefully in the future also other kinds of useful geodata). Geofabrik obtains those extract by splitting the master database dump periodically released by the OpenStreetMap project, the so called Planet.osm file.

So I've decided to to implement the same procedure for the modRana data repository. A the planet file is about 25GB in gzip compressed PBF format and about 45 in uncompressed PBF. Thankfully, it can be updated incrementally using the osmupdate utility, so the amount per repository update should be drastically reduced from the previous ~100GB to maximally a few hundred megabytes per update.

Splitting the Planet.osm file can be quite demanding, but can be very efficiently parallelized. Thankfully, the machine that has been so kindly provided for shared used by the Natural Language Processing laboratory of the Masaryk University in Brno (Thanks! ) the modRana routing repository has about 48 logical CPU units, so it can do the Planet-cracking very well.

All in all, local splitting should both massively spare download bandwidth and make the modRana repository independent on Geofabrik.

The work is already about 50% done and I plan to finish it in the next few days. Of course I'll let you know in this thread once the first new update run is done.
__________________
modRana: a flexible GPS navigation system
Mieru: a flexible manga and comic book reader
Universal Components - a solution for native looking yet component set independent QML appliactions (QtQuick Controls 2 & Silica supported as backends)

Last edited by MartinK; 2013-10-07 at 18:15.
 

The Following 15 Users Say Thank You to MartinK For This Useful Post:
Posts: 1,548 | Thanked: 7,510 times | Joined on Apr 2010 @ Czech Republic
#1474
The modRana Harmattan package has been finally updated to 0.43.4 !

I how again have a scratchbox using Harmattan packaging script, so in future the Harmattan package should be always released together with the other packages.

Link:
http://modrana.org/packages/harmatta...43.4_armel.deb

Also the modRana package in OpenRepos has been updated.
__________________
modRana: a flexible GPS navigation system
Mieru: a flexible manga and comic book reader
Universal Components - a solution for native looking yet component set independent QML appliactions (QtQuick Controls 2 & Silica supported as backends)
 

The Following 9 Users Say Thank You to MartinK For This Useful Post:
Posts: 697 | Thanked: 137 times | Joined on Jul 2012 @ Hillerød, DK
#1475
Still no reaction on route button!
__________________
OK
 
Posts: 728 | Thanked: 1,217 times | Joined on Oct 2011
#1476
MartinK, any cheat script/advice for migrating all the tiles that are in files to the sqlite format? :-)
 
Posts: 728 | Thanked: 1,217 times | Joined on Oct 2011
#1477
One thing I notice after switching to sqlite is that if I select an area, download all the tiles (max up and max down) and then start navigating that area, modrana keeps downloading maps (and the sqlite DB keeps growing).
 
Posts: 16 | Thanked: 14 times | Joined on May 2012
#1478
Hi Martin,

After updating modrana and installing the updated map from here: [URL="http://data.modrana.org/monav/europe/europe_car.tar.gz[/URL] offline routing doesn’t works.

It only shows loading but not the internal map. I did the adjustments found here: [URL="http://wiki.maemo.org/ModRana_offline_routing_guide[/URL]

Also the map (Germany big) comes with the same behavior after updating modrana.

I installed this one half a year ago from here: [URL="http://monav.openstreetmap.de/mapsets/Germany_big.zip[/URL] and bfore updating modrana it works pretty fine.

Please find Xterm output attached.
Any help is appreciated.
Attached Files
File Type: txt Modrana_Xterm.txt (6.0 KB, 100 views)
 

The Following 2 Users Say Thank You to anab For This Useful Post:
Posts: 1,548 | Thanked: 7,510 times | Joined on Apr 2010 @ Czech Republic
#1479
Originally Posted by Garp View Post
Still no reaction on route button!
Don't worry I'm working on it - but it is kinda complicated and will still take some time. But I sure make you all aware once routing is implemented in the QML GUI on Harmattan.

Originally Posted by ggabriel View Post
MartinK, any cheat script/advice for migrating all the tiles that are in files to the sqlite format? :-)
Sure, there is the sqlite import script by Beermad:
http://modrana.org/trac/wiki/SQLiteT...rtPerlScriptEN
Looks like Beermad changes his site, so use the modrana.org mirror for the script:
https://nlp.fi.muni.cz/trac/gps_navi...tEN/mapconvert

And eventually, I would like to integrate this functionality as a modRana CLI option, but have no timetable for that yet.

Originally Posted by ggabriel View Post
One thing I notice after switching to sqlite is that if I select an area, download all the tiles (max up and max down) and then start navigating that area, modrana keeps downloading maps (and the sqlite DB keeps growing).
That looks like a bug, I'll investigate it.

BTW, were there any download errors during the download ? Could be that you got banned during the download for downloading too much tiles (some tileservers do that) and some tiles didn't get downloaded.

Also try to do the batch download with "redownload ON", which can be set from the "edit" menu. This makes sure that all tiles are downloaded for the given area, even if there are already some (corrupted ?) tiles present. Might help.

Originally Posted by anab View Post
Hi Martin,

After updating modrana and installing the updated map from here: [URL="http://data.modrana.org/monav/europe/europe_car.tar.gz[/URL] offline routing doesn’t works.

It only shows loading but not the internal map. I did the adjustments found here: [URL="http://wiki.maemo.org/ModRana_offline_routing_guide[/URL]

Also the map (Germany big) comes with the same behavior after updating modrana.

I installed this one half a year ago from here: [URL="http://monav.openstreetmap.de/mapsets/Germany_big.zip[/URL] and bfore updating modrana it works pretty fine.

Please find Xterm output attached.
Any help is appreciated.
This is probably caused by the botched Monav data repository update described above. I'll be ready to do a new update run in a few days that will hopefully fix this corrupted data issue. So please hang on until then.
__________________
modRana: a flexible GPS navigation system
Mieru: a flexible manga and comic book reader
Universal Components - a solution for native looking yet component set independent QML appliactions (QtQuick Controls 2 & Silica supported as backends)

Last edited by MartinK; 2013-10-13 at 11:09.
 

The Following 7 Users Say Thank You to MartinK For This Useful Post:
Posts: 650 | Thanked: 497 times | Joined on Oct 2008 @ Ghent, Belgium
#1480
Martin, can modRana do retries for on-demand downloads (during driving)? Yesterday I seemed to have a crappy connection and from time to time a tile was missing (showing an error tile).

Might be a good idea to try to redownload on failure *if* the other tiles are downloading fine. No need to retry if they all fail (except maybe at a slow rate for when the network connection dropped for a slightly longer time).

Or maybe this is already present somewhere? I'm running a clean install after my complete device got corrupted
__________________
Affordable mobile internet in Belgium: Try Mobile Vikings
2 GB, 1000 SMS and 15 euro of talk time for.... 15 euro
 

The Following 2 Users Say Thank You to petur For This Useful Post:
Reply

Tags
bada rox, martin_rocks, modrana, navigation, openstreetmap, the best, wehasgps


 
Forum Jump


All times are GMT. The time now is 09:47.