maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Applications (https://talk.maemo.org/forumdisplay.php?f=41)
-   -   [SFOS] [Announce] Native offline maps: OSM Scout Server (https://talk.maemo.org/showthread.php?t=97823)

rinigus 2020-05-07 10:09

Re: [Announce] Native offline maps: OSM Scout Server
 
All sounds good. Testing includes:

- does it start - looks like this is OK

- map scrolling - that's trickier as Pure Maps caches, but it is usually not a problem. We can assume that its OK now

- route calculation - sounds like that is fine too

- search - probably OK, but not sure whether @pichlo searched for end-point.

For piece in mind, if someone can check whether search works in Pure Maps offline (or modRana offline) that would be great

ggabriel 2020-05-07 10:21

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567364)
- map scrolling - that's trickier as Pure Maps caches, but it is usually not a problem. We can assume that its OK now

I made sure I zoomed in a place that I've never been before (or at least in the last n years). Pure Maps does get significantly slower when it's pulling from osm scout server so you can tell when it's cache and when it's offline maps.
Quote:

- route calculation - sounds like that is fine too
OK - I gave this a go (with currentposition=accurate GPS location). You can walk from London to the peak district in just under 52 hours!
Quote:

- search - probably OK, but not sure whether @pichlo searched for end-point.
Just tried an offline search of the "lake district" (since summer is here and why not try a place in the UK where it always rains) - but I got no results back, and an error in osm scout server: Valhalla: (stat): tiles.tar no such file or directory. This could be, however, a problem with my filesystem. I'll check it and report back.
A more conservative UK post code search works ok.
EDIT: search for "lake district" works without me doing anything, so it's probably an issue with the fact that the maps are in an SD card, which is also encrypted. Maybe something times out in the stack. This is working as usual in general.

rinigus 2020-05-07 10:33

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by ggabriel (Post 1567365)
I made sure I zoomed in a place that I've never been before (or at least in the last n years). Pure Maps does get significantly slower when it's pulling from osm scout server so you can tell when it's cache and when it's offline maps.

OK - I gave this a go (with currentposition=accurate GPS location). You can walk from London to the peak district in just under 52 hours!

Just tried an offline search of the "lake district" (since summer is here and why not try a place in the UK where it always rains) - but I got no results back, and an error in osm scout server: Valhalla: (stat): tiles.tar no such file or directory. This could be, however, a problem with my filesystem. I'll check it and report back.
A more conservative UK post code search works ok.
EDIT: search for "lake district" works without me doing anything, so it's probably an issue with the fact that the maps are in an SD card, which is also encrypted. Maybe something times out in the stack. This is working as usual in general.

Thanks, I think we are good then.

As for search getting stuck in UK, that's unfortunate and known issue

https://github.com/rinigus/geocoder-nlp/issues/57

Already opened more than a year ago :( - when Theresa was still trying to get her deal through...

peterleinchen 2020-05-07 13:18

Re: [Announce] Native offline maps: OSM Scout Server
 
@rinigus
Will you check with this version that it does not want to install on SFOS <3.3?
I did not yet (and maybe wont) update...

pichlo 2020-05-07 13:28

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567364)
For piece in mind, if someone can check whether search works in Pure Maps offline (or modRana offline) that would be great

I always use maps offline. As they were meant to be used.

rinigus 2020-05-07 16:54

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by peterleinchen (Post 1567367)
@rinigus
Will you check with this version that it does not want to install on SFOS <3.3?
I did not yet (and maybe wont) update...

For older SFOS versions we have bunch of repositories as listed on the right of https://build.merproject.org/project...e:rinigus:maps . Just checked and the corresponding server version worked for SFOS 3.2

However, note that it is an effort to keep all the old SFOS versions and I may drop it soon. Reason is simple, right now we can stat using up-to-date gcc compiler and I don't have to do all these extra steps to compile recent code with the compiler installed in /opt/gcc. So, having new gcc is major improvement in SFOS 3.3 and you may get it more difficult to get updated software without it.

There is also an option for interested users to take over maintenance of these older versions. I am keeping opt-gcc available for older SFOS at its repository and, as it is, it would mainly require reverting one commit from today. But let's see if there is an interest at all ...

rinigus 2020-05-07 17:42

Re: [Announce] Native offline maps: OSM Scout Server
 
1.16.1 includes SFOS compatibility with 3.3.0.x and updated translations.

Edited to state the correct version - mixed up with the earlier one. atlochowski , thanks for correcting it

atlochowski 2020-05-07 18:26

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567373)
1.16.1 includes SFOS compatibility with 3.3.0.20 and updated translations.

I thought that the latest version is 3.3.0.16

rinigus 2020-05-07 18:28

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by atlochowski (Post 1567375)
I thought that the latest version is 3.3.0.16

Thanks, corrected.

rinigus 2020-05-18 17:47

Re: [Announce] Native offline maps: OSM Scout Server
 
New maps are out and uploaded. Enjoy.

seiichiro0185 2020-05-18 18:09

Re: [Announce] Native offline maps: OSM Scout Server
 
Thanks for the Update as always, unfortunately I did find a bug in the maps or OSM Scout Server: Bicycle routing doesn't seem to work for me. Regardless of the route I try to calculate. I always just get "No Results" in Pure Maps while OSM Scout Server has the Warning "Exception in Valhalla: No suitable edges near location". The further settings for bycicle-routing make no difference. Car or Foot navigation for the same start/destination works fine. This is with the Germany/Sachsen Map if it matters.
Unfortunately I can't tell how long this might not be working, I haven't used bycicle routing in quite a while.

rinigus 2020-05-18 18:20

Re: [Announce] Native offline maps: OSM Scout Server
 
I can reproduce it over here in Estonia as well. Too bad, didn't check that before and it may have happened some time ago. Will look into it when I get time, hopefully this week.

rinigus 2020-05-18 18:22

Re: [Announce] Native offline maps: OSM Scout Server
 
... Would be great if users could check whether bicycle routing worked for the older maps. I have them stored, but its easier to check if you have it already on device

seiichiro0185 2020-05-18 18:45

Re: [Announce] Native offline maps: OSM Scout Server
 
I found that I have older Maps (from the file dates Oktober 2019) on my Jolla Tablet, there the bycicle-routing works. OSM Scout Server is version 1.16.1 on both devices, so it seems to be the newer map on the phone that causes the problem

Edit: Also copied over the old maps from the tablet to the phone, which works as well.

rinigus 2020-05-18 20:48

Re: [Announce] Native offline maps: OSM Scout Server
 
If anyone has Jan 2020 edition of maps, you are welcome to test bicycle routing on them. There could have been some update in the import stack which killed it.

peterleinchen 2020-05-18 20:55

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567530)
If anyone has Jan 2020 edition of maps, you are welcome to test bicycle routing on them. There could have been some update in the import stack which killed it.

Works for me.
1.16.0-1.127.1
Maps from 22 Jan 2020

--
SFOS 3.2.1.20

rinigus 2020-05-19 09:00

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by peterleinchen (Post 1567531)
Works for me.
1.16.0-1.127.1
Maps from 22 Jan 2020

--
SFOS 3.2.1.20

Thanks! Looks like minor version Valhalla update on import induced it. Had to make it to make it include compilation fixes, now will have to investigate the issue. Thanks for checking and fast reporting!

peterleinchen 2020-05-19 10:57

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567534)
Thanks! Looks like minor version Valhalla update on import induced it. Had to make it to make it include compilation fixes, now will have to investigate the issue. Thanks for checking and fast reporting!

My pleasure (and benefit :))!

Amboss 2020-05-19 13:15

Re: [Announce] Native offline maps: OSM Scout Server
 
I have maps from January as well.
OSM 1.16.1-1.129.1.jolla
Valhalla 21.01.20
OSM Scout library 22.01.20 - deactivated (whatever that means)
Sailfish 3.3.0.16 on Sony X

Short test was:

local track in Bavaria (Frankonia) from home about 4 km - found it right away

track from Torgau (northern Saxony) to Bad Schandau (southeastern Saxony) - OSM error: "Exception in Valhalla: Path distance exceeds the max distnace limit"
Accoring to openrouteservice it is supposed to be 141 km

pichlo 2020-05-19 16:11

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567525)
... Would be great if users could check whether bicycle routing worked for the older maps. I have them stored, but its easier to check if you have it already on device

Both old (November 2019) and new (May 2020) maps work fine for bicycle routing in the UK.

rinigus 2020-05-20 06:49

Re: [Announce] Native offline maps: OSM Scout Server
 
From these tests, it looks like it became more "moody" in selection of bicycle routes. I will look into it.

As for longer routes, 100km+, those have been disabled for bicycle and walking. Otherwise you may end up with long calculations running on your phone.

pichlo 2020-05-20 07:17

Re: [Announce] Native offline maps: OSM Scout Server
 
Yea, mine was only about 10 km.

peterleinchen 2020-05-20 08:55

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by pichlo (Post 1567566)
Yea, mine was only about 10 km.

So was mine, too.
But limiting bycicling to 100km is too hard.
We have a rallye over here from Ruhrgebiet, especially Duisburg, to Bensersiel at the North Sea, which is about 300km on one day. :D
And for normal people a 100km (and more) day route is also doable. So maybe just a warning that longer routes may take looong time calculating? (not that I request it ;))

rinigus 2020-05-20 09:43

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by peterleinchen (Post 1567570)
So was mine, too.
But limiting bycicling to 100km is too hard.
We have a rallye over here from Ruhrgebiet, especially Duisburg, to Bensersiel at the North Sea, which is about 300km on one day. :D
And for normal people a 100km (and more) day route is also doable. So maybe just a warning that longer routes may take looong time calculating? (not that I request it ;))

You can change the distance as you prefer:

In OSM Scout Settings, select Valhalla, find the corresponding distance and it should be fixed next time you call the route.

peterleinchen 2020-05-20 18:49

Re: [Announce] Native offline maps: OSM Scout Server
 
Yes, you can.
But to no joy :(
SFOS dies after some not-too-long calculations, maybe 30-60 s.
I just thought hmm maybe add some more swap but then it even did not shut down and I needed to hard boot it.

So better stay with the given values...

rinigus 2020-05-20 18:56

Re: [Announce] Native offline maps: OSM Scout Server
 
I guess it will depend on device, location (amount of roads). But yes, as you can go by bicycle and by foot in many places, calculations are probably way larger.

rinigus 2020-05-25 20:50

Re: [Announce] Native offline maps: OSM Scout Server
 
Import issues were caused by incompatibility with Lua parser used by Valhalla. New maps are out (only routing updated) with cycling fixed.

I had to drop Transit component (public transport). Data was old and leading to some issues with Valhalla. Trying now to get in touch with the project that collects and distributes the data, let's see if we can get it running better.

seiichiro0185 2020-05-26 17:13

Re: [Announce] Native offline maps: OSM Scout Server
 
I tried the updated Maps and bicycle routing works fine again. Thanks @rinigus for the fix!

rinigus 2020-07-25 16:49

Re: [Announce] Native offline maps: OSM Scout Server
 
New maps are out as well as new OSM Scout Server. Main changes in the server were related to import of Mapbox GL tiles and styling them. It is recommended to use new server with the new maps. In the new import and style:

* features at lower zooms are imported with the higher precision

* buildings are painted better (in my opinion)

* POIs are shown in the order of their local (partially random) ranking. This should allow to avoid POI explosion where too many POIs are shown at lower zooms.

In addition, I had issues with Valhalla import, but found a workaround which I hope will work for some time.

cy8aer 2020-10-01 19:53

Re: [Announce] Native offline maps: OSM Scout Server
 
With 3.4.0.22 there is a dependency problem when I tried to install it again (after reflashing...): It cannot find libicuuc.so.63

rinigus 2020-10-01 19:57

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by cy8aer (Post 1569485)
With 3.4.0.22 there is a dependency problem when I tried to install it again (after reflashing...): It cannot find libicuuc.so.63

It was raised at OpenRepos as well. Not much I will be able to do about it until OBS targets will be pushed to 3.4.0.x. That should arrive at some point, as confirmed today at the community meeting.

Part of "EA", I guess, is to sit home without offline maps and figuring out why all is breaking in the phone.

rinigus 2020-10-20 19:29

Re: [Announce] Native offline maps: OSM Scout Server
 
New OSM maps are imported and available. Cannot say the same regarding 3.4.0.x support - OBS still lacks the target.

ggabriel 2020-10-31 12:12

Re: [Announce] Native offline maps: OSM Scout Server
 
Perhaps something that has been asked/documented/explained in the past, but I cannot find it relatively easily: how feasible is to build OSM Scout Server for SFOS with their SDK? Is it a matter of performing the following?
- Installing all dependencies in the SDK Build Engine (for all required sb2 targets)
- For the ones not available in the step above, build them too
- Finally build OSM Scout Server

I do understand that this is not a simple and quick endeavour, but would I be missing anything critical and/or is there any dependency that is difficult to build+install in such way?

rinigus 2020-10-31 13:31

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by ggabriel (Post 1569986)
Perhaps something that has been asked/documented/explained in the past, but I cannot find it relatively easily: how feasible is to build OSM Scout Server for SFOS with their SDK? Is it a matter of performing the following?
- Installing all dependencies in the SDK Build Engine (for all required sb2 targets)
- For the ones not available in the step above, build them too
- Finally build OSM Scout Server

I do understand that this is not a simple and quick endeavour, but would I be missing anything critical and/or is there any dependency that is difficult to build+install in such way?

Yes, you should be able to build it on SDK. You may have to increase allocated RAM for it, though.

Installation of dependencies available at SFOS repos is done automatically by `mb2`. So, you will have to only compile and install the missing ones into SDK.

I would start from OSM Scout Server and then work backwards to fulfill dependencies.

Packages are available at https://build.merproject.org/project...e:rinigus:maps and some at https://build.merproject.org/project...inigus:toolbox . Note that opt-gcc (plain and 6) are not needed.

But it will take a while to compile. Expect spending significant amount of time (hours) on it.

OBS, as far as I understood, is bit broken due to some infra breakage. Hopefully, it will be fixed soon. But that is out of our control.

cy8aer 2020-10-31 14:35

Re: [Announce] Native offline maps: OSM Scout Server
 
@rinigus: sooner or later (with working sdk) you will swap to SFOS 3.4 too. And - according to actual restrictions in most european countries ;-) - I might have the time for this...

By the way: does someone have recipes to tune up compilation times for stuff like that? I get problems with the compilation of my projects now too, thought it is only 10 minutes by now...

rinigus 2020-10-31 15:07

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by cy8aer (Post 1569988)
@rinigus: sooner or later (with working sdk) you will swap to SFOS 3.4 too. And - according to actual restrictions in most european countries ;-) - I might have the time for this...

By the way: does someone have recipes to tune up compilation times for stuff like that? I get problems with the compilation of my projects now too, thought it is only 10 minutes by now...

My swap will come with OBS target, as I have to update a port of Sony Tama (6 variants) before that. Compared to that, maps stack update should be way easier.

As for lockdowns, on the basis of the previous one, I would expect less time for hobby projects than I have when all works normally.

ggabriel 2020-11-01 13:03

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1569987)
Yes, you should be able to build it on SDK. You may have to increase allocated RAM for it, though.

Sure, already up, and upped CPU's too. No reason to leave defaults when there is processing power available :)

Quote:

Originally Posted by rinigus (Post 1569987)
Installation of dependencies available at SFOS repos is done automatically by `mb2`. So, you will have to only compile and install the missing ones into SDK.

I've been using qtcreator for now - will investigate mb2 as I prefer the CLI.

Quote:

Originally Posted by rinigus (Post 1569987)
I would start from OSM Scout Server and then work backwards to fulfill dependencies.

Right, so I started this and it's as fun as it is. However, before I dig deeper into my current rabbit hole, mapnik needs libicuuc.so.63, but SFOS 3.4 target has version 66 (confusingly, libicu package) - will this be a matter of cloning pkg-mapnik and creating another rpm for mapnik (adjusting whatever version needed, of course)? mapnik says it prefers libicuuc >= 4.2, I believe 66 is significantly bigger than 4.2, unless I have something categorically wrong - mathematics or package names :)

Thanks!

rinigus 2020-11-01 14:17

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by ggabriel (Post 1570006)
Right, so I started this and it's as fun as it is. However, before I dig deeper into my current rabbit hole, mapnik needs libicuuc.so.63, but SFOS 3.4 target has version 66 (confusingly, libicu package) - will this be a matter of cloning pkg-mapnik and creating another rpm for mapnik (adjusting whatever version needed, of course)? mapnik says it prefers libicuuc >= 4.2, I believe 66 is significantly bigger than 4.2, unless I have something categorically wrong - mathematics or package names :)

Thanks!

I suggest to get the same packages as referred to by OBS. Keep an eye on selected branch, it is not always "master". For all packages, make sure that you clone recursively or ensure that submodules are pulled and synced

I expect that you don't need to alter anything in RPM SPEC. Unless they changed ICU packages names - happens once in a while to keep us on the toes

ggabriel 2020-11-03 09:05

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1570007)
I suggest to get the same packages as referred to by OBS. Keep an eye on selected branch, it is not always "master". For all packages, make sure that you clone recursively or ensure that submodules are pulled and synced

This is kind of working, and making slow progress as I'm honestly playing around with this :) I do appreciate a bit more why we need OBS and updated targets for the community.

Quick question (while I hack): OBS has valhalla-lite 3.0.9 http://repo.merproject.org/obs/home:...jolla.i486.rpm - but your pkg-valhalla-lite repository's RPM spec is 3.0.8, am I missing something? I'll be hacking the version for now, but was just wondering whether I am on the wrong track. For context, I am rebuilding that as (I think) it needs to be relinked with at least protobuf in 3.4 targets.

UPDATE: success, and whoever bumps into this post, history has gone on and a proper RPM is in openrepos.

rinigus 2020-11-03 11:49

Re: [Announce] Native offline maps: OSM Scout Server
 
Re 3.0.9: it's probably I forgot to change in the SPEC. OBS makes that automatically while compiling

Re OBS importance: I guess we need to point everyone asking why do we have to wait for OBS to repeat your exercise. :)

Easy test - switch Pure Maps to offline and try to search for something. Search results are not cached between runs, so it should work only if the server is working.


All times are GMT. The time now is 05:59.

vBulletin® Version 3.8.8