maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Applications (https://talk.maemo.org/forumdisplay.php?f=41)
-   -   [SFOS] [Announce] Native offline maps: OSM Scout Server (https://talk.maemo.org/showthread.php?t=97823)

atlochowski 2019-10-30 06:47

Re: [Announce] Native offline maps: OSM Scout Server
 
@rinigus at transifex there is string "Banner photo by %1 (%2 licanse).". I think it should be "Banner photo by %1 (%2 license)."

rinigus 2019-10-30 07:11

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by atlochowski (Post 1561336)
@rinigus at transifex there is string "Banner photo by %1 (%2 licanse).". I think it should be "Banner photo by %1 (%2 license)."

:) that's a typo in the source code, thanks for reporting

BGK 2019-11-11 16:10

Re: [Announce] Native offline maps: OSM Scout Server
 
Using Pure Maps 1.26.1 and OSMSS 1.15.5-1.120.1.jolla something strange is happening at the moment:

When searching for adresses in PM (since upgrading to the current versions of PM, OSMSS and maps), I always get the feedback "no results" ("Keine Ergebnisse") (so that I'm not able to calculate any routes), whereas defining the destination via long press on the map and using the navigation on the bottom of the screen the navigation to this point is possible.

When starting OSMSS via terminal ("harbour-osmscout-server") and searching for an adress in PM, OSMSS obviousely gets killed by a segmentation fault ("Speicherzugriffsfehler") without any further information.

Profile in PM is "Offline", in OSMSS "standard" ("Vorgabe"), all other settings should be default. Reboots didn't help.

Any ideas? :confused: :rolleyes:

rinigus 2019-11-11 16:27

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1561820)
Using Pure Maps 1.26.1 and OSMSS 1.15.5-1.120.1.jolla something strange is happening at the moment:

When searching for adresses in PM (since upgrading to the current versions of PM, OSMSS and maps), I always get the feedback "no results" ("Keine Ergebnisse") (so that I'm not able to calculate any routes), whereas defining the destination via long press on the map and using the navigation on the bottom of the screen the navigation to this point is possible.

When starting OSMSS via terminal ("harbour-osmscout-server") and searching for an adress in PM, OSMSS obviousely gets killed by a segmentation fault ("Speicherzugriffsfehler") without any further information.

Profile in PM is "Offline", in OSMSS "standard" ("Vorgabe"), all other settings should be default. Reboots didn't help.

Any ideas? :confused: :rolleyes:

Which SFOS version do you have?

BGK 2019-11-11 16:43

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1561821)
Which SFOS version do you have?

3.1.0.11 (settings -> product information tells "build: 3.1.0.11+omp0.1.3.13"), no patch manager or other patches, device is INOI R7.

Just noticed, there's an update available to 3.2.0.12...

rinigus 2019-11-11 16:53

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1561822)
3.2.0.12 (settings -> product information tells "build: 3.1.0.11+omp0.1.3.13"), device is INOI R7.

I am still on SFOS 3.1. maybe there are some changes in libs that lead to it. But then I would expect segmentation fault in OSMSS to occur on start.

If you are up to it, try to run harbour-osmscout-server from debugger and get backtrace. Or, alternatively, try to get strace

BGK 2019-11-11 17:12

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1561823)
I am still on SFOS 3.1.

So am I (had to correct the last post) at the moment...

Quote:

Originally Posted by rinigus (Post 1561823)
If you are up to it, try to run harbour-osmscout-server from debugger and get backtrace.

How to do this?

rinigus 2019-11-11 17:41

Re: [Announce] Native offline maps: OSM Scout Server
 
If its on 3.1, it should work. Try to move maps data away or make new folder and see if download of maps data will help

BGK 2019-11-11 18:54

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1561829)
If its on 3.1, it should work.

It is. I'm trying to suppress the wish to update to 3.2, which would be possible since today... :)

Quote:

Originally Posted by rinigus (Post 1561829)
Try to move maps data away or make new folder and see if download of maps data will help

Any other chance to look under the hood without re-downloading all maps (poor connection at the moment)?

I'm trying to debug via IDE (device connected via USB, developer mode activated on device, connection can be established, processes can be selected) but get

"Cannot attach to process [PID]: Operation not permitted (1)
Exiting"

rinigus 2019-11-11 19:27

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1561832)
It is. I'm trying to suppress the wish to update to 3.2, which would be possible since today... :)



Any other chance to look under the hood without re-downloading all maps (poor connection at the moment)?

I'm trying to debug via IDE (device connected via USB, developer mode activated on device, connection can be established, processes can be selected) but get

"Cannot attach to process [PID]: Operation not permitted (1)
Exiting"

You could run OSMSS from gdb. See gdb manuals how. On crash, get backtrace for all the threads (quick search should tell you how).

As for debugging from IDE/... , never used it and cannot help

BGK 2019-11-11 19:41

Re: [Announce] Native offline maps: OSM Scout Server
 
Got the address search in PM working again (without debugging via IDE) - here's what I did:

  • connected device via USB with developer mode on
  • opened a remote shell (within IDE)
  • started "harbour-osmscout-server" via remote shell and PM on device
  • (when trying to search for an address in PM) terminal output of started OSMSS told me: "ERR Error loading transliteration module, dir=/run/media/nemo/[sdcard-ID}/Maps.OSM/postal/global-v1/transliteration/transliteration.dat
    at libpostal_setup_datadir (libpostal.c:266) errno: None"
  • made a backup of "transliteration.dat" and deleted the original file
  • closed OSMSS in terminal and restarted it again
  • OSMSS's map manager told me "Missing data: Adress parsing language support (106,527,869 [sic!])", downloaded this by clicking "start download"
  • yeah, address search in PM is working again... ;)

BTW: when starting OSMSS via shell I get

"library "/vendor/lib/egl/libGLESv2S3D_adreno.so" not found"

as well as

"[W] unknown:57 - file:///usr/share/harbour-osmscout-server/qml/platform/PagePL.qml:57:9: QML Loader: Binding loop detected for property "active""

(but seem no negative effect)

rinigus 2019-11-11 19:51

Re: [Announce] Native offline maps: OSM Scout Server
 
So, it seems that the issue was due to the corrupted file. Thanks for reporting!

As for other issues:

binding loop is probably some smaller bug of mine;

GLES lib - that's something on your platform.

Don't think that they are that critical :)

BGK 2019-11-11 19:56

Re: [Announce] Native offline maps: OSM Scout Server
 
As I'm always trying to learn: Could you explain
  • what transliteration.dat is for and how could it be corrupted?
  • what the other issues are about?

rinigus 2019-11-11 20:58

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1561836)
As I'm always trying to learn: Could you explain
  • what transliteration.dat is for and how could it be corrupted?
  • what the other issues are about?

Sure. transliteration.dat is one of the datasets used by libpostal to parse addresses. For illustrations of what does it do, go to https://github.com/openvenues/libpos...les-of-parsing and scroll down to normalization as well.

fun fact: OSMSS was, to my knowledge, the first on mobile to use this library.

we use libpostal as a core for geocoder - the library that finds coordinates on the basis of your string. out of these datasets used by libpostal, transliteration is, as far as I can guess, used to make from Привет to privet. As a result, you can search for addresses even if you don't have the same chars on your keyboard.


Issues are many:

https://github.com/rinigus/osmscout-server/issues
https://github.com/rinigus/geocoder-nlp/issues
https://github.com/rinigus/mapbox-gl-styles/issues

to name few places.

BGK 2019-11-11 21:22

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1561842)
Sure. transliteration.dat is one of the datasets used by libpostal to parse addresses. For illustrations of what does it do, go to https://github.com/openvenues/libpos...les-of-parsing and scroll down to normalization as well.

Great, thank you!

Quote:

Originally Posted by rinigus (Post 1561842)
Issues are many:

I had binding loop and GLES lib in mind... :) But thanx for hinting anyway...

BGK 2019-11-18 17:24

Re: [Announce] Native offline maps: OSM Scout Server
 
Hi rinigus,

seems I found a bug in version 1.15.5-1.120.1.jolla:

Using OSMSS in german language, it is possible to switch profile from "Vorgabe" (standard) to "Benutzerdefiniert" (user defined?).

But if you try to switch back to standard profile, this isn't possible - if you open the profile page again, it still tells you "Benutzerdefiniert".

rinigus 2019-11-18 17:51

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1562215)
Hi rinigus,

seems I found a bug in version 1.15.5-1.120.1.jolla:

Using OSMSS in german language, it is possible to switch profile from "Vorgabe" (standard) to "Benutzerdefiniert" (user defined?).

But if you try to switch back to standard profile, this isn't possible - if you open the profile page again, it still tells you "Benutzerdefiniert".

yes, can reproduce it in English as well. thanks for reporting.

pacman 2019-11-18 17:57

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1562215)
Hi rinigus,

seems I found a bug in version 1.15.5-1.120.1.jolla:

Using OSMSS in german language, it is possible to switch profile from "Vorgabe" (standard) to "Benutzerdefiniert" (user defined?).

But if you try to switch back to standard profile, this isn't possible - if you open the profile page again, it still tells you "Benutzerdefiniert".

I can confirm this in English as well: after switching from "Default" to "Custom", I can't change back to "Default". I can change to any of the other profiles, but there seems to be no path back to "Default". I tried stopping and starting OSM Scout again, and also unsubscribing from everything and cleaning up, but I can't get back to default. I also tried to 'rm -rf' from .cache/harbor-osmscout-server, but it didn't help.

rinigus 2019-11-18 17:59

Re: [Announce] Native offline maps: OSM Scout Server
 
For those looking for tmp resolution and wishing to go back to the default profile:

* close osm scout server
* open a terminal or (better) login into phone with ssh
* vi ~/.config/harbour-osmscout-server/harbour-osmscout-server.conf
* scroll towards the end and change to `profile=0` under [server-general] section

Profile should be back to default

BGK 2019-11-18 18:20

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1562218)
For those looking for tmp resolution and wishing to go back to the default profile:

Thanks - that worked!

rinigus 2019-11-18 21:09

Re: [Announce] Native offline maps: OSM Scout Server
 
Bug found and fixed. Unfortunately, looks like there is some issue with Valhalla build for latest SFOS at OBS. So, I cannot even produce tmp package with the fix. Will have to look into it and see why it is

pacman 2019-11-19 07:09

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1562221)
Thanks - that worked!

And for me too!

rinigus 2019-11-23 18:25

Re: [Announce] Native offline maps: OSM Scout Server
 
Maps update may take some time. Just finished an import and, while testing, got some crashes with Valhalla. I will have to look into it before rolling out.

In addition, public transport data import triggered a crash in Valhalla importer. Turned out that I stumbled on a bug in Valhalla that's not fixed yet. Due to that crash which required me to restart the import as well as relatively slow Valhalla import, all got delayed. But I am looking into it.

rinigus 2019-11-30 13:18

Re: [Announce] Native offline maps: OSM Scout Server
 
Bugfix release with updated translations is out - 1.15.6. It fixes a bug with profile selection, as reported over here.

rinigus 2019-12-01 14:13

Re: [Announce] Native offline maps: OSM Scout Server
 
"New" maps are out. Still without transit data, working on it. Planet.pbf is from the end of October with the delays described above.

rinigus 2019-12-27 09:00

Re: [Announce] Native offline maps: OSM Scout Server
 
Looks like transit data will have to wait. In short, current Valhalla doesn't find transit routes even if the data are there. I opened the corresponding issue with the commit that broke it for us at https://github.com/valhalla/valhalla/issues/2126 .

In theory, I can cook together something with patches that will resolve that issue with Valhalla. However, as there are other issues preventing building Valhalla at OBS if I use older Valhalla releases, I prefer to wait till the transit problem will get resolved upstream and use the time for something more productive.

To fix it myself will require digging into Valhalla's code - which will take quite some time, I suspect.

So, I suggest we wait and see if the transit routing will get fixed upstream and focus on other projects/issues meanwhile.

rinigus 2020-01-23 16:54

Re: [Announce] Native offline maps: OSM Scout Server
 
New release is out 1.16.0

For SFOS users its update for translations only. However, its the first release which is going to be released on Ubuntu Touch.

Interesting note regarding Ubuntu Touch. For the latest Pure Maps version, we have 2200 downloads in Ubuntu Open Store and 3000 for SFOS OpenRepos. Not sure how much is users and how much is caused by bots though.

In addition, translations should work in Flatpak as well. Flatpak packages are building right now.

New maps are uploaded right now, probably will get ready for distribution in 24-48 hours.

BGK 2020-02-03 16:32

Re: [Announce] Native offline maps: OSM Scout Server
 
Hi rinigus!

The problem with searching adresses is back again...

If I open OSMSS (1.15.5-1.120.1.jolla) before starting PM (1.26.1), I can see OSMSS processing PMs search requests, but it throws errors like

"ERROR: [Time] Error while Analysing through libpostal. Maybe there are no libpostal-databases available." (translated from german to english)

OSMSS settings / map management tells me that everything's all right... :confused:

Rinigus, could you please tell me where the libpostal databases are located and how I could correct this problem (without having to download all maps again)?

rinigus 2020-02-03 17:47

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by BGK (Post 1565023)
Hi rinigus!

The problem with searching adresses is back again...

If I open OSMSS (1.15.5-1.120.1.jolla) before starting PM (1.26.1), I can see OSMSS processing PMs search requests, but it throws errors like

"ERROR: [Time] Error while Analysing through libpostal. Maybe there are no libpostal-databases available." (translated from german to english)

OSMSS settings / map management tells me that everything's all right... :confused:

Rinigus, could you please tell me where the libpostal databases are located and how I could correct this problem (without having to download all maps again)?

Really odd. Sorry, should have mentioned earlier. Databases for libpostal are in maps folder, under "postal" subfolder. If you delete them, they will be redownloaded.

After new download, find the hashes of the files and store them. Later you could check which file gets corrupted

BGK 2020-02-03 18:54

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1565026)
Really odd. Sorry, should have mentioned earlier. Databases for libpostal are in maps folder, under "postal" subfolder. If you delete them, they will be redownloaded.

After new download, find the hashes of the files and store them. Later you could check which file gets corrupted

Thank's for pointing me to the obvious... ;) Will try and report.

Veraendert 2020-03-04 07:03

Re: [Announce] Native offline maps: OSM Scout Server
 
Hi,

I seem to be unable to retrieve the country list on Jolla Phone. It stays empty. I use the SD card to store the files. Everything else is standard. Newest SFOS version. Am i missing something? Where should i look for error messages?

Thanks.

rinigus 2020-03-04 07:06

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by Veraendert (Post 1565899)
Hi,

I seem to be unable to retrieve the country list on Jolla Phone. It stays empty. I use the SD card to store the files. Everything else is standard. Newest SFOS version. Am i missing something? Where should i look for error messages?

Thanks.

Looks like data.modrana.org is down. Let's hope that @MartinK will see this message...

Veraendert 2020-03-04 07:38

Re: [Announce] Native offline maps: OSM Scout Server
 
Thanks. At least it's not my fault ;-)

rinigus 2020-03-07 07:26

Re: [Announce] Native offline maps: OSM Scout Server
 
Looks like MartinK fixed it - there was a move of the server, as far as I understood, out of his reach... All should be up and running now.

Thank you MartinK!

rinigus 2020-04-20 17:11

Re: [Announce] Native offline maps: OSM Scout Server
 
I haven't updated maps early April, while it was planned originally. Assuming that we all sit at home, fresh maps are not the highest priority. Hence postponing the update as well. If it is hitting you negatively, let me know. Note it may take ~2 weeks to generate new maps (and bit extra for bugfixes if needed).

Veraendert 2020-04-20 19:27

Re: [Announce] Native offline maps: OSM Scout Server
 
Just wanted to confirm that MartinK indeed fixed it. Thanks.

rinigus 2020-05-07 08:24

Re: [Announce] Native offline maps: OSM Scout Server
 
OSM Scout Server has been rebuilt for SFOS 3.3.0.x using its updated compiler. Would someone mind to grab RPM from http://repo.merproject.org/obs/home:...mv7hl/armv7hl/

(currently http://repo.merproject.org/obs/home:...la.armv7hl.rpm )

and test it before I update it at OpenRepos? This is expected to work on SFOS 3.3.0.x and will fail on earlier versions.

pichlo 2020-05-07 08:41

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567359)

Wow! My ISP's "child safe settings" blocked it :eek:

ggabriel 2020-05-07 09:04

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by rinigus (Post 1567359)
OSM Scout Server has been rebuilt for SFOS 3.3.0.x using its updated compiler. Would someone mind to grab RPM from http://repo.merproject.org/obs/home:...mv7hl/armv7hl/

Installs, map manager works, check for updates works, Pure Maps reads maps (doing very basic scrolling). Let me know if you want me to test something more specific. I'm on SFOS 3.3.0.16.

pichlo 2020-05-07 09:07

Re: [Announce] Native offline maps: OSM Scout Server
 
Quote:

Originally Posted by pichlo (Post 1567361)
Wow! My ISP's "child safe settings" blocked it :eek:

I added repo.merproject.org to allowed sites in my ISP control panel and now I can access it.

Downloaded and installed 1.16.0+master etc. Started Pure Maps. The rendering seems fine but I cannot test any more since a) Pure Maps does not know where I am (probably because the GPS location got lost when I wiped the phone after a bodged update to Rokua) and b) I cannot go out anyway to play with it due to the lockdown.

EDIT:
The phone found itself after I put it in the window. Located a random route. In its usual style, it underestimated the travel time (Google and Bing say 45 minutes, Pure Maps says 39), but the route is as expected.

Anything else I can try?


All times are GMT. The time now is 05:54.

vBulletin® Version 3.8.8