Re: [Announce] Native offline maps: OSM Scout Server
 

* Which backend do you use, Mapnik or libosmscout?
i use mapnik, in libscount look same.

* If Mapnik, did you install fonts module?
yes, 2 modules

* When viewing with Poor Maps or modRana, do you see jobs submitted to OSM Scout Server?
starting sending, but look like not complete a request

* What do the logs of the server say?
the unique error logs is: Tile extract could be not loaded

* Does Map Manager show that your maps are fine (nothing listed as incompatible/needs download)?
yes

Re: [Announce] Native offline maps: OSM Scout Server
 

Let's focus on Mapnik first. I assume you use Guatemala, right?

So, do you see requests as INFO messages in the server's Events log?

This is Valhalla's message and its nothing to worry about (I am planning to cleanup messages a bit later).

OK, if there are no "strange" messages, then maybe I could take a look on full log. For that, go to Settings/in the end of Settings, select "Log messages into session log file" and select "Log info messages" above it/Accept. Close the server, open it up again. Go to Poor Maps, clear cache, close Poor Maps, open Poor Maps and try to move around on the map.

While you move, the server should have displayed number of jobs and that there are requests coming in as Events on the main window. If you still don't have any map, close the server and send me the file

.cache/harbour-osmscout-server/harbour-osmscout-server/session.log

from your phone. Probably best is to use pastebin (or alike, https://ptpb.pw/f ) with some reasonable expiry date (few days should be fine). Then I can check the logs and see if something comes up.

There is a bug which I should fix and may have something to do with your problem. Do you have world coastlines and language parser downloaded?

Maybe the error is somewhere else. I have just tested Guatemala on my device and it shows the map fine. So, its probably not an importer bug (if you use that country map).

Re: [Announce] Native offline maps: OSM Scout Server
 

rinigus I traveled here for a few days, check the map ("georgia US" it is not work) guatemala map work nicely.

thanks

Re: [Announce] Native offline maps: OSM Scout Server
 

Georgia (US) has very suspiciously small Mapnik database (3MB) when compared to OSM Scout (165MB). So, something has happened with its import. And, indeed, on testing, map is rather "sad" over there. I'll take a look into it (will file an issue in github).

Re: [Announce] Native offline maps: OSM Scout Server
 

For those facing issues with RAM consumption in Jolla One, see https://github.com/rinigus/osmscout-server/issues/153 ( @a-dekker thank you for reporting and feedback). Try to reduce cache size for Valhalla and see if it helps

Re: [Announce] Native offline maps: OSM Scout Server
 

Its possible that it was "an operator" error, i.e. mine, during the import. I might have stopped Georgia import accidentally. I'll write a script to check for such strange imports and maybe I can catch these cases before publishing them.

Anyway, when I re-imported Georgia, all seemed to be fine. Any other territories that are problematic?

If no-one needs Georgia/US right now, I would update it together with the full update later, probably in 2-3 weeks. So, if there are some places which are imported wrongly and you need them before, let me know.

Re: [Announce] Native offline maps: OSM Scout Server
 

From the analysis of the import sizes, it looks like the following territories had issues with Mapnik import:

europe/france/provence-alpes-cote-d-azur
north-america/canada/new-brunswick
north-america/canada/nunavut
north-america/canada/ontario
north-america/canada/quebec
north-america/canada/saskatchewan
north-america/mexico
north-america/us/georgia
north-america/us/idaho
north-america/us/indiana
north-america/us/kentucky
north-america/us/maine
north-america/us/montana
north-america/us/north-carolina
north-america/us/ohio
north-america/us/oklahoma
north-america/us/region/midwest
north-america/us/wyoming

On the next planet import, I'll check for Mapnik import errors by comparing import sizes. If I have missed anything, please let me know. If you need these maps within 2 weeks, please tell me.

Re: [Announce] Native offline maps: OSM Scout Server
 

Yes i need georgia US fixed almost right know ... if do , Is appreciated

Re: [Announce] Native offline maps: OSM Scout Server
 

Should have guessed that myself. I am uploading and, hopefully, timezone differences would work for the benefit this time. It would take few hours, maybe 6-8, until all is in data.modrana.org due to the distribution model that we use. I'll update this post when its all up and ready.

Edit Uploads done and Georgia (US) should be fine. Go to Map Manager, press "Check for updates", you should get the message with Georgia listed as a candidate for updates; accept and wait till it finishes the download. Hopefully, not too late.

Re: [Announce] Native offline maps: OSM Scout Server
 

\0/ Thank you: everything work perfectly. I will also say that with the integration of Mapnik and Valhalla, it looks same that "Here Map" or others.

I also want to add that some is missing in PoorMap ,when i search a POI PoorMap has give first result according to the location a gps, will usefull.

Re: [Announce] Native offline maps: OSM Scout Server
 

Well, intension is to make it as good as any, if not better.

Re POI search: I added POI search support to the geocoder-nlp and it will be available with the next release update (0.11.x).

Re: [Announce] Native offline maps: OSM Scout Server
 

Tnk , but add POI search support to the geocoder-nlp only resolve POI the case sensitive right? then i am talk about ,that if i search something(POI) the first results of the search would have to be according to the GPS location in PoorMap. Modrana is already Implemented this features. I think this feature corresponds to PoorMap project because is responsible for handling the GPS, not the server i guess. Note: I'm talking about PooMaps and ModRana because somehow are related to this thread indirectly . . .

Re: [Announce] Native offline maps: OSM Scout Server
 

Poor Maps does support it. You go to main menu, select "Nearby" and then search next to your location. Note that while you are searching for "type", its actually looking for names as well in online backends, if I understand it correctly. Starting from 0.11.x, the same will be for OSM Scout Server.

Re: [Announce] Native offline maps: OSM Scout Server
 

I am planning to push soon for a next update. Since it would change the database format for the geocoder, the service could be disturbed for 1-2 days after the maps hit the data.modrana.org server. If you need the maps working within this period, please ensure that you have them on device.

I am planning to start pushing new update later today, unless anything else comes out during final testing.

Edit: Please do not download maps right now, until 0.11.x release. I have to re-upload Valhalla's tiles due to a mistake in import and that may take some time. Right now, due to Valhalla's packages inconsistency, the downloading could result in a forever loop.

Re: [Announce] Native offline maps: OSM Scout Server
 

New release - 0.11.1 - is out together with the corresponding maps update.

The main changes are "under the hood". Geocoder-NLP has now support for reverse geocoding (rather primitive-but-works approach for simple searches). This required database format adjustments, so only compatible database can be used (available on data.modrana.org). As a result, Guide/Nearby search should work with this geocoder and you don't have to rely on libosmscout for that. Note that while you are looking for "type", it searches also "name" record in the database with all libpostal goodness.

An important change was adaptation of Valhalla's router request API to get routes by libosmscout. As a result, the map clients can have just one routing provider corresponding to OSM Scout Server and send requests / process replies via single code. For users, it means that they just need to specify routing engine in the server and the client will figure it out. Upcoming Poor Maps (0.30.x) would have support for that. With modRana, we would have to implement Valhalla's API first and then join the current OSM Scout Server processing with the new one.

Few changes were introduced to help users to avoid situations that could lead to excessive RAM use. I would like to thank here @a-dekker for help!

Valhalla's limits for maximal distance between target and origin were reduced from defaults for walking and cycling. These limits can be adjusted under Settings/Valhalla. Note that as a result of these changes, Router module 2.2.8 requires the server 0.11.x or later.

In addition, if you have not selected languages for parsing by Geocoder-NLP, you will be warned about it on the main screen.

The start of the server has been changed with the delayed Mapnik processing. It should start faster, but the required processing will delay your first rendered tile. This change is required for supporting day/night styles as well as other styles suggested by @Thra11 (issue https://github.com/rinigus/osmscout-server/issues/150).

Translators have been really fast and I would like to thank them all! Some strings may have not made it into this release, but we can make a new one as soon as more translations will be finished.

Special thanks and attached screenshot for our own Valhalla's translator - @eson! With the upcoming 0.30 Poor Maps localized Valhalla routes have been requested and you should be able to use your translation as well.

For those who cannot wait and have Linux desktop - Poor Maps (and probably modRana) are really easy to package yourself. Just clone the source and run "make rpm". You may require rpm, but it should be available on non-rpm distros as well (running on Gentoo without problems).

Re: [Announce] Native offline maps: OSM Scout Server
 

@rinigus I made a fresh start with last release and found the text shown below, untranslated.

Btw... Swedish translation's looking good on your screen. Looking forward to try it out.
.

Re: [Announce] Native offline maps: OSM Scout Server
 

It looks like this string is untranslated (just English version copied over to the Swedish one). It was introduced at commit https://github.com/rinigus/osmscout-...t-server-sv.ts and I can see the same for String 344 in transifex.

Don't know if its some bug that I introduced or it came from transifex...

Re: [Announce] Native offline maps: OSM Scout Server
 

OK, fixed it at Transifex, along with some minor adjustments.
It might even be my own mistake, although it is not very likely. :rolleyes:

Re: [Announce] Native offline maps: OSM Scout Server
 

Poor Maps 0.30 is out now.

Re: [Announce] Native offline maps: OSM Scout Server
 

Works fine with OSM Scout Server/Valhalla, so far. Thanks!

Re: [Announce] Native offline maps: OSM Scout Server
 

New release is out - 0.12.0

This release introduces Mapnik styles (@Thra11, thank you for suggestion) and night mode as well. The available styles are "default" and "car" . The styles are almost the same with the gas stations dropped in pecking order for the default and shown at lower zooms for car. However, the base is there and, if someone is interested, its possible to adjust available styles to show pedestrian/bicycle/transport layers more prominently (or coffee shops, for that matter).

For styles to show up in the clients, one has to add them into the list of basemaps. Which brings me to the question: Poor Maps users - do you use @1 OSM Scout Server layer or should we just remove it and simplify the matter by keeping @2 only? Note that larger tiles lead to more efficient rendering.

From this release, Mapnik supports day/night styles as well. It should be all configured and supported by modRana and Poor Maps via different basemaps already.

This release fixes a bug that slowed down Mapnik rendering by over sizing buffer around each tile. It should increase rendering speed for all clients. The increase would be more significant for clients requesting small tiles, such as modRana.

Re: [Announce] Native offline maps: OSM Scout Server
 

The new release is out - 0.13.0, code name Beta 1

This release is mainly about polishing GUI and simplification of configuration settings.

This release introduces profiles that allow you to simply select the backends that you wish and configures storage and settings accordingly. Default profile is set to Mapnik/Geocoder-NLP/Valhalla. So, here is a shift of the default settings as suggested earlier in this thread. You can still select each backend individually if you wish by setting profile to Custom.

On the first start (and should be only for one time), you are greeted with the wizard that guides you through selection of profiles and languages for address parsing. If the wizard comes back on other program starts as the small-town leader of French resistance (only for those who get the joke), please file it as a bug.

I have implemented all the functionality that I was planning for 1.0 release. The remaining bugs/issues that I am aware of are at https://github.com/rinigus/osmscout-...ilestone%3A1.0 . In addition, I may work on https://github.com/rinigus/osmscout-server/issues/163 before making 1.0 release. If there is something more that should be adjusted before that release, please let me know.

I hope that you enjoy using it!

Edit: 0.13.1 has updated translations and a bugfix related to POI search (thank you @MartinK for reporting it).

Re: [Announce] Native offline maps: OSM Scout Server
 

Hi all,

I get a corrupted file when downloading "europe-france" which is a pity after the 9Gb download. In fact the mapnik.sqlite is broken, said the log file.

Re: [Announce] Native offline maps: OSM Scout Server
 

Thank you for reporting, I will look into it ASAP. Until its resolved, I suggest to get regions of France that you are interested in. It may even end up as a faster solution for rendering than getting France as a single package. As it is, map drawing, search, and routing all support databases that are split into sub-regions in the default profile (mapnik/geocoder-nlp/valhalla).

I'll get back here when I get France downloaded and tested.

Re: [Announce] Native offline maps: OSM Scout Server
 

I just managed to download France on PC and mapnik seems to be fine with France nicely drawn. So, the file on the server shouldn't be corrupted.

What's exactly in the corrupted message? Does it state that the territory is subscribed or that it still needs to download it?

If you still need to download it, put the device on charger to prevent it going to sleep while downloading and use as reliable connection as you can (usually WiFi).

Re: [Announce] Native offline maps: OSM Scout Server
 

Hello rinigus,

Sorry for the delay, but I finally managed to update the French translations. It should be ok to include it in your next release.


Thanks for you work again !

Re: [Announce] Native offline maps: OSM Scout Server
 

Thank you very much!. The next release would need few more strings to be translated since there is a bit of new functionality. But those strings should be easy. I still have to finish few things and then will be ready for the next cycle.

Re: [Announce] Native offline maps: OSM Scout Server
 

I am planning to update the server in 1-2 days. As a part of the update, the database formats for Mapnik, Geocoder-NLP, and libosmscout will change and become incompatible with the earlier versions. So, if you critically depend on the server, please grab the maps that you would need this week to be sure that you would not be hit with any bug unprepared.

Re: [Announce] Native offline maps: OSM Scout Server
 

New release and new maps are out: 0.14.0, 0.14.1 (Beta 2).

This release adds ability to search and draw maps in English, instead of the local language. Thus, for you who are in Asia and are struggling with the local script, you can fetch new maps and new version and would see names of the places in English, if available. For that, you would have to set "Preferred language" to English in Settings. I am expecting this to be the last new feature before 1.0.

Since Valhalla adds large number of files, I have rewrote cleanup code to use separate thread for deletion of files. It should not lock GUI while deleting.

As usual, translators have been working hard - thank you very much! I pulled translations this morning and will make new point release when more translations will be updated.

Edit: 0.14.1 increased the number of allowed queries done internally by geocoder-nlp in accordance with the number of languages. Without this, I was missing few search results that were working earlier.

Re: [Announce] Native offline maps: OSM Scout Server
 

User's manual coveeing setup of the server and clients (Poor Maps and modRana) is out and available at https://rinigus.github.io/osmscout-server/ .

Hopefully, I covered the most important aspects. Let me know if I missed something. Look by CSS/HTML experts is welcome to get the fonts shown a bit bigger on Jolla browser in tutorials.

Re: [Announce] Native offline maps: OSM Scout Server
 

Would be great if you could make those pages translatable, too.

Re: [Announce] Native offline maps: OSM Scout Server
 

I actually don't know how to do that. All I can suggest, at present, to fork https://github.com/rinigus/osmscout-server , make a new subfolder under docs, like

docs/fr

and insert translated index.md together with html files and screenshots under that directory (docs/fr). Styles and used JS can be all linked from there.

I guess we need the first brave translator to do that and all others would follow. Not as simple as for the main app, but should be doable.

Or is there a better way?

Re: [Announce] Native offline maps: OSM Scout Server
 

After updating to OSM scout server to 0.14.1-1, search and navigating returns "no results" in Poor maps. i'm using default profile and Norwegian map. Is there a bug in the latest build?

Re: [Announce] Native offline maps: OSM Scout Server
 

@PamNor, looks like its a bug during import. I am looking into it now. I'll let you know via this thread when its fixed. Sorry for it.

Re: [Announce] Native offline maps: OSM Scout Server
 

That's a huge work you have done here ! :eek: You rock !:cool:

I'll take a try tonight at translating the main markdown part, but I'm not sure to have the courage right now to start taking all the screenshots in French...
Have you done those screenshots on the SDK emulator, or did you take those on the device with lbt's screenshot app ?


Seeing how the app starts to be user friendly, if I can get that tutorial running in French, I could give the link to the French Jolla community (JollaFr.org) to try to enhance its visibility. What do you think of this ? Is it too soon ? Does the map server can handle some more users right now ?

Re: [Announce] Native offline maps: OSM Scout Server
 

Rinigus,

I started translation of the english user manual to French.

So far, I have only translated the index.md (https://github.com/Sagittarii/osmsco...01b02a3f51d286).


I also tried to reorder the docs directory to make it easier to navigate when there will be several translations, along the original english files :
* move the english pages to docs/en (to locate easily what needs to be translated, and because even if it is the default one, it is still a language among all)
* move the css file to docs/assets/ (that is the name I usually find in web stuff, but I am opened to suggestion)
* added the html files for french (not yet translated), but keeping the same filenames as in english, to easily check if some files are missing/new when doing translations, and so that only the /en/, /fr/,... part has to change in the url to make it easy to point to other languages without having to translate the filenames.

This can be seen in the following commit: https://github.com/Sagittarii/osmsco...01b02a3f51d286
which gives the tree seen in : https://github.com/Sagittarii/osmsco...ee/master/docs

I updated the path to js and css stuff in the new /en/ directory, so that the html files there should run correctly after these moves.

I kept the fullPage.js dir at the docs root, but we could put it in assets/ too ?

Also, there is a missing index at the docs root to select the language now.


What do you think of this ? If you like it, I can put a pull request for you to integrate this changed structure before other translators start working on it.

Web is not my specialty, so if someone knows better than me, please help us !:)

Re: [Announce] Native offline maps: OSM Scout Server
 

@PamNor, I think that the bug is in libosmscout location index code and I have submitted the issue to the library. It seems that it's not very common bug and I haven't been influenced by it when testing with several other countries. I know that Norway used to work just recently since I have been in Oslo and used it. So, it looks like its a rather specific case.

In case of geocoder-nlp import, I am using libosmscout to import data from OSM-based PBF and, after that, transverse location index to feed geocoder-nlp importer. So, even if we don't use libosmscout in the default profile, I am using it for the import.

One option is to to downgrade to libosmscout version that was used earlier. If it works and I or libosmscout developers cannot fix the issue fast, I'll make new map import for libosmscout and geocoder-nlp with the older version.

Let me look into it a bit longer, may take few days.

If anyone has seen degradation in the recent version, please let me know.

@Zeta: thank you! The screenshots were made using lbt's screenshot app on device. That way it can be done with the morning coffee.

It would be great to get tutorials and manual translated - that should help the users. Whether its too soon to advertise in the wider audience, I don't know. I presume many know already and I guess the server should hold it, there have been no feedback from @MartinK.

However, before advertising, I must fix the import bug as seen for Norway. (see more specific replies below)

Excellent, lets move these.

Would be good to move it too, just note that its submodule.

Yes, that's needed too. It could be also redirect to English with en/index.md listing all languages. But I am open to any option.

I think its a great way and let's optimize the directory tree to make it simple for others.

Re: [Announce] Native offline maps: OSM Scout Server
 

@PamNor, I am going to revert to older libosmscout version that used to work. When testing with Norway, all seemed fine.

So, I will be reimporting planet for libosmscout and geocoder-nlp. Then I will have to push it all to @MartinK's server and release new version of OSM Scout Server (0.15). Should be all done in 1-2 days if nothing unexpected will come out during testing. [While typing, Faroe Islands are imported already]

Looks like the Netherlands were hit as well: https://github.com/rinigus/osmscout-server/issues/174

If anyone has observed similar degradation in search performance (or anything else), please report.

Re: [Announce] Native offline maps: OSM Scout Server
 

Thanks for your hard work and premium support. it's then time for me to speed up the Norwegian translation. :)

Re: [Announce] Native offline maps: OSM Scout Server
 

0.15.0 is packaged already and I am uploading maps right now. The version will be released on OpenRepos tomorrow morning, assuming that maps will be transferred fully during a night.