maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Applications (https://talk.maemo.org/forumdisplay.php?f=41)
-   -   [Announce] Snuggle : Geolocation using CellID and Google APIs (https://talk.maemo.org/showthread.php?t=72497)

Saturn 2011-12-19 21:31

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by Julien_2006 (Post 1139622)
Hello there !

any news about using snuggle with smscon ?
it could be great if your friends could send you a sms with eg the word "cell" and in return get the picture and/or browser link send by mail/sms

I think this is already well covered with all these apps that share your location in several services.

SMSCON is kind of private app between you and your phone. Nevertheless, it is in our plan to use some code from snuggle to allow a cheaper on battery tracking or as a fall back when GPS is not available (like inside a building etc).

On Snuggle, I have worked a lot and add many more features in the backend like a daemon logging movements and an sql database for storing and extracting the movements in files that can be uploaded to sites that give you your tracks in a map for a given period of time.
At the moment all is not that user friendly and need some time to make some UI for configuring and initiating those actions.

It is just that I am such a slow coder..

Julien_2006 2011-12-19 22:13

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Thanks for the quick responses.

If the gps do not fix eg cinema (in silent mode of course) it use my battery and don't do the job. That's why Snuggle could be a good alternative as you already said.

Yes i know about all the stuff like google latitude, FB and co but I don't use it.
I've understand and agree that sms con is a thing between me and my N900. In fact if this feature can be donne only my brother, sister and girlfriend would now about this fonction to locate me. As i don't want to receive 10 sms a day just to locate me (lol)
As I am patient, I will wait for you accomplished your (great) work.
I very thank you for this app and for having considerring my demand on this thread.
Many Thanks due to you.

pulketo 2011-12-22 00:26

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Does this do some kind of inter-extra polation to better locate position between multiple antennas?

lardman 2011-12-22 13:43

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Looks cool. It would be especially useful if you cached and stored the location of known cellids so that it could be used without switching on a network device. Along these lines, being able to populate the database from online would be a good feature.

Regarding sources of information, have you looked at this source?: http://openbmap.org/

It also contains WiFI AP location data, which would be another nice thing to integrate and give access to in order to narrow down the device location without needing to start up the GPS (not sure about the power-location trade offs here, but certainly if you're in a building it might be worthwhile, and equally if you are connected to a WiFi AP anyway no need to start GPS).

Saturn 2011-12-22 16:27

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by lardman (Post 1140811)
Looks cool. It would be especially useful if you cached and stored the location of known cellids so that it could be used without switching on a network device. Along these lines, being able to populate the database from online would be a good feature.

Regarding sources of information, have you looked at this source?: http://openbmap.org/

It also contains WiFI AP location data, which would be another nice thing to integrate and give access to in order to narrow down the device location without needing to start up the GPS (not sure about the power-location trade offs here, but certainly if you're in a building it might be worthwhile, and equally if you are connected to a WiFi AP anyway no need to start GPS).

Thanks for the source; I didn't know about it. The interesting part is that they share the DBs they already have for local usage. Might be useful.
ATM, I'm using a not yet public API from google to make the translation from cell to location.

I will upload the non published code in the next days and maybe someone else would like to contribute. There are plenty of "glue" parts missing..

Saturn 2011-12-22 16:31

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by pulketo (Post 1140574)
Does this do some kind of inter-extra polation to better locate position between multiple antennas?

No (and don't plan to atm). Recording the current cell connection is quite cheap since it is already available in the system. Asking the system to get all adjacent cells is quite expensive and comparable to GPS.

Saturn 2011-12-22 17:25

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
OK, I skipped a few corners (i.e. all of the intermediate commits):

The latest development code can be found in the garage SVN part of the project.
https://garage.maemo.org/scm/?group_id=2156

Some of the changes I've recorded for version snuggle_2.7-2 (that is, since 1.9-1 which is in the downloads page):

* Added a daemon to log the cell info data.
* Added missing dependencies on the python libraries for gobject, dbus, location and httplib2.
* Removed logging of all info from the main application.
* Added a sudoers file for the daemon.
* Modified the postinstall and postrm scripts.
* Created helper to populate geolocation data from the cell info and transform it to a kml file.
* Changed the timestamping to fit with the kml code; WARNING: old logs are not backwards compatible.
* Added new menu fields for creating the kml file and configuring the daemon.
* Modified the UI to expand on all the available screen.
* Added daemonHelper file to start/stop the deamon.
* Added database to store the info.
* Added a start-up screen.

lardman 2011-12-22 17:39

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by Saturn (Post 1140882)
Thanks for the source; I didn't know about it. The interesting part is that they share the DBs they already have for local usage. Might be useful.
ATM, I'm using a not yet public API from google to make the translation from cell to location.

Yes access to the raw data dumps is one of the reasons it appealed to me, plus the wifi data. From looking quickly at opencellid I couldn't see any way of getting hold of the raw data, plus it only seems to cover the USA.

Quote:

Originally Posted by Saturn (Post 1140882)
I will upload the non published code in the next days and maybe someone else would like to contribute. There are plenty of "glue" parts missing..

I'll certainly do some work to integrate OpenBMAP over the Christmas break as I could do with a daemon that provides location information of a given accuracy within given power constraints (for use by another daemon, hence the wish to reduce network access and running the GPS unless necessary).

dattadude 2012-01-23 13:43

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
hi,

firstly Great app, it worked for a while but now whenever i select get cordinates it gives me an error.

Warning : Could not get a responce from the MMAP API!!!

Any idea how to fix this???

Estel 2012-01-23 23:13

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Saturn, it seems that Snuggle saves (and never deletes) all map "snapshots". so, after just few weeks of usage, I had plentora of unnecessary old map image files in snuggle directory. Could it automatically purge outdated ones?

/Estel

ade 2014-02-18 20:13

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
1 Attachment(s)
Not that long ago I found out about this program.

What interested me most where the features in the never released version 2.7-2.

Having a daemon running which detects celltower changes provides an very energy efficient global tracking system (with the emphasis on global).

Unfortunally, the basic setup done in version 2.7-2 has not seen further development for years now.

So I decided to pick up from there to address the missing parts. The main change is visible in an extra screen to manage the cellid data.

The "de-duplicate log" button is useful for eliminating redundant data, as you can have a ping-pong effect between celltowers when you are not on the move. Then you can decide to import into an (sqlite) database for "permanent" storage. You will need an internet connection at that moment, as related positioning info is collected using the google api.

From the data in the database, you can create a KML file for a certain time period. The file can be loaded in Marble on the device, but the best result can be seen in for example google earth.

If there is interest, I could try to contact Saturn, the original developer. If not, we leave things as they are :)

handaxe 2014-02-19 01:04

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Your call effort-wise of course. But surely loc stuff aside, this is so much a duplication of cellnet-info?

Estel 2014-02-19 03:34

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by ade (Post 1413277)
If there is interest, I could try to contact Saturn, the original developer. If not, we leave things as they are :)

Of course, there is (interest) :) Just get that maintainership already!

Seriously though, I can't imagine why you would ever think about putting your contribution to drawer and never release it. Some really nice ideas you got there. Out of curiosity: why "best results would be achieved using, fort example, Google Earth", as opposed to Marble on-device? Shouldn't accuracy be exactly the same (low)?

/Estel

hugh.jf.chen 2014-02-19 08:54

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Wow,that sounds great. I'd just installed this program but it's only 1.9. Could you please push the 2.7 package to the repo?

ade 2014-02-19 17:37

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by handaxe (Post 1413291)
Your call effort-wise of course. But surely loc stuff aside, this is so much a duplication of cellnet-info?

Not entirely imho. The goal of cellnet-info was to provide as much cellular info as possible, while snuggle has focused on geolocation solely. As snuggle already has some features I like, I didn't want to recreate them in cellnet-info, but it crossed my mind :)

Quote:

Originally Posted by Estel (Post 1413295)
Out of curiosity: why "best results would be achieved using, fort example, Google Earth", as opposed to Marble on-device? Shouldn't accuracy be exactly the same (low)?

The data is the same of course. It is just that Marble seems to remove more details.


Quote:

Originally Posted by hugh.jf.chen (Post 1413313)
Wow,that sounds great. I'd just installed this program but it's only 1.9. Could you please push the 2.7 package to the repo?

2.7 was a development version, not entirely ready for a release in Saturns view. I hope we can release version 2.8.
I will send Saturn a pm shortly to see where to go next.

Saturn 2014-02-20 13:58

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by ade (Post 1413391)
2.7 was a development version, not entirely ready for a release in Saturns view. I hope we can release version 2.8.
I will send Saturn a pm shortly to see where to go next.

True, I've spent some time to further develop features. Some of them were complete but not all of the goals set came to end (here is what was completed at the time of the SVN upload http://talk.maemo.org/showpost.php?p...8&postcount=47). Thus, it wasn't a good version for casual users and for this I decided to upload it only in the SVN (when i saw I run out of time) for people to make use of them if needed but never hoped for contribution.

This is great news!! I've answered to Ade's PM and hopefully we make a release soon. I haven't seen the code yet but from the screenshot he posted looks like he completed all todos and added a couple of features more!

Saturn 2014-02-23 18:47

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Uploaded new version 2.8-1 in extras-devel.

This is a combined version of the changes ade made (ver. 2.8-0) on top of the previous unreleased version (ver. 2.7-2).
Many thanks to ade for making this happen.

Changelog:

Changes in ver. 2.7-2
  • Added a daemon to log the cell info data.
  • Added missing dependencies on the python libraries for gobject, dbus, location and httplib2.
  • Removed logging of all info from the main application.
  • Added a sudoers file for the daemon.
  • Modified the postinstall and postrm scripts.
  • Created helper to populate geolocation data from the cell info and transform it to a kml file.
  • Changed the timestamping to fit with the kml code; WARNING: old logs are not backwards compatible.
  • Added new menu fields for creating the kml file and configuring the daemon.
  • Modified the UI to expand on all the available screen.
  • Added daemonHelper file to start/stop the deamon.
  • Added database to store the info.
  • Added a start-up screen.

Changes in ver. 2.8-0
  • Added screen for data management.
  • Select time period for KML file generation.
  • Option to remove duplicate cellids.
  • Option to clear cellid log.
  • Option to load data in database.
  • Make sure busybox ps is used.
  • Move config data inside .config directory.

This is a preliminary version and (in the next couple of weeks) one more will come with cleanups, some last features missing and better credits for ade's work.

ade 2014-02-23 19:28

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
A few changes got lost. One of them is that you can't de-duplicate/clear the log. To fix that for now:
Code:

root
chmod 755 /opt/snuggle/cellid_unique.sh


Saturn 2014-02-23 19:57

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by ade (Post 1413977)
A few changes got lost. One of them is that you can't de-duplicate/clear the log. To fix that for now:
Code:

root
chmod 755 /opt/snuggle/cellid_unique.sh


Thanks, (even though I don't really have time) I was making the other changes we discussed and my testing was failing on this.
Good to know it was never working on my release!

While checking on this, I realise that moving the log data to the .config folder it might not be ideal from the security point of view at least. Now they are accessible by all.
If you don't have an objection, in the next version I will move it and protect it to need root privileges for viewing or modification.

ade 2014-02-23 20:26

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by Saturn (Post 1413982)
Thanks, (even though I don't really have time) I was making the other changes we discussed and my testing was failing on this.
Good to know it was never working on my release!

I send you two mails on the two files you forgot to modify about half a day ago.

Quote:

While checking on this, I realise that moving the log data to the .config folder it might not be ideal from the security point of view at least. Now they are accessible by all.
If you don't have an objection, in the next version I will move it and protect it to need root privileges for viewing or modification.
As it was located in /home/user/.snuggle instead of /home/user/.config/snuggle, it did not change anything in this context imho.
If you want root access only (log/db), I am afraid snuggle itself needs to be running using root for viewing/modifying, unless you have another solution for that. Of course I have no objections if you can do it in a transparent way.

Saturn 2014-02-23 20:50

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by ade (Post 1413991)
I send you two mails on the two files you forgot to modify about half a day ago.

Sorry, I did't checked mails today and missed those.

I think it needs this too:
Code:

chown -R user:users /home/user/.config/snuggle
Don't know if you already had it. I promise in a couple of days to do a better comparison of the files and all this should be corrected.

Quote:

As it was located in /home/user/.snuggle instead of /home/user/.config/snuggle, it did not change anything in this context imho.
If you want root access only (log/db), I am afraid snuggle itself needs to be running using root for viewing/modifying, unless you have another solution for that. Of course I have no objections if you can do it in a transparent way.
Yes, the files though belonged to root. Now it is to user:users.
I don't mind the re-location but the access.

Saturn 2014-02-23 20:54

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Just uploaded version 2.8-2 in extras-devel.

Hope it fixes the clean-up and removal of the logfile actions.

Sorry for this, I missed some configuration settings that ade had in the files.

handaxe 2014-02-24 12:46

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
There may still be permission errors. I had to chown ~/users/.config/snuggle to user:users for it to work. Was that legacy setting from previous install - perhaps? Did a purge before re-installing but that of course will leave non-empty folders... Will test again.

Secondly, de-duplicating will not work because it asks for a "yes" to overwrite, as seen in terminal.

Thirdly, for user friendliness the kml file should IMO be saved somewhere other than a hidden folder.

Thanks for this versions to both.

handaxe 2014-02-24 14:01

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
No need to test again, I reviewed my shell history :-) I deleted all snuggle related folders after purging, so the install was clean and thus permission errors persist.

One question: if there is no wifi or data connection, will the cell info be stored and the location determined later when internet access becomes available?

Saturn 2014-02-24 15:40

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by handaxe (Post 1414082)
There may still be permission errors. I had to chown ~/users/.config/snuggle to user:users for it to work. Was that legacy setting from previous install - perhaps? Did a purge before re-installing but that of course will leave non-empty folders... Will test again.

Secondly, de-duplicating will not work because it asks for a "yes" to overwrite, as seen in terminal.

Thirdly, for user friendliness the kml file should IMO be saved somewhere other than a hidden folder.

Thanks for this versions to both.

Hi, thanks for the report.

Could you please clarify if you have been testing the 2.8-1 or 2.8-2 version?

handaxe 2014-02-24 16:19

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Ah, sorry - the obvious and necessary forgotten: latest 2.8-2.

Saturn 2014-02-24 19:27

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Just uploaded version 2.8-3 in extras-devel.

This is the second try to fix my mess with the privileges.
Those who test, please report if it works for you too.

Changes:
* Added creation and setup of the logging folder at installation script.
* Corrections in the postrm script to use busybox ps command.

ade 2014-02-24 19:52

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by handaxe (Post 1414090)
One question: if there is no wifi or data connection, will the cell info be stored and the location determined later when internet access becomes available?


It works like this:
celltower changes are collected by the daemon continuously, without using wifi or a data connection. When you choose "import in db", an internet connection is needed to find the related coordinates. Snuggle will report if an internet connection is missing during import.

Quote:

Thirdly, for user friendliness the kml file should IMO be saved somewhere other than a hidden folder.
I agree it is not the best place. But I could not think of a better place. MyDocs perhaps?

handaxe 2014-02-25 02:00

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by ade (Post 1414166)
...When you choose "import in db", an internet connection is needed to find the related coordinates. Snuggle will report if an internet connection is missing during import.

I agree it is not the best place. But I could not think of a better place. MyDocs perhaps?

Thanks for info - now confirmation as I figured this when I tested the function after a walk. Truly a lovely proggie.

IMO it must be a folder readily accessible to the stock file-manager and other progs like marble that can display .kml, so MyDocs? Yes, you, I and most reading here can cope but there are others.....

handaxe 2014-02-25 03:15

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by Saturn (Post 1414159)
Just uploaded version 2.8-3 in extras-devel.

This is the second try to fix my mess with the privileges.
Those who test, please report if it works for you too.

Works for me installing over my chown'ed folder etc. Tnx

peterleinchen 2014-02-25 05:51

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
What I had to do:
apt-get install --reinstall snuggle
and even
apt-get purge snuggle
left the .snuggle folder as user:root, so I deleted them manually after removal
rm -fr /home/user/.snuggle
rm -fr /home/user/.config/snuggle
apt-get install snuggle

The location of that csv file is hmm, I would say 90/10. It is really private information so I would like to keep it on hidden folder (maybe change again to /home/user/.snuggle owned by root? so it is separated from config files?) and file owned by root. Easier acces would of course be on MyDocs (iStyle)...

Estel 2014-02-25 10:53

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by peterleinchen (Post 1414220)
The location of that csv file is hmm, I would say 90/10. It is really private information so I would like to keep it on hidden folder (maybe change again to /home/user/.snuggle owned by root? so it is separated from config files?) and file owned by root. Easier acces would of course be on MyDocs (iStyle)...

Maybe just make it user configurable? People carrying for iStyle would be able to put it on MyDocs (it may be even default), and people like you or me would put it on hidden partition embedded on another hidden partition and encrypted by keys 16384 bits long (minus the overstatement part ;) )

/Estel

handaxe 2014-02-25 12:07

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by peterleinchen (Post 1414220)
The location of that csv file is hmm, I would say 90/10. It is really private information so...

Are you referring here to the file Ade and I discussed? That was the generated .kml and I don't think that is any more private than much of what I have in MyDocs.

peterleinchen 2014-02-25 19:39

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
No.
I was talking about the log (csv) and the database (db) itself, which may contain a full location spy.
The kml is an on-user action generated file, so this might go to MyDocs/snuggles.

But above mentioned I would like to have at least owned by root (in /home/user/.snuggle).

--
but maybe I am just a bit too alerted :)
As anybody could also use snuggle itself to fetch that data from root-owned file, right? ;)

So Saturn (and ade) whatever you will do: thanks for that proggie!


--
privacy:
I just remembered that the cbs-operator-name applet did similar (speaking of the logging cell tower info into a plain txt file in /home/user). I personally disabled it (as well as syslog: too many write accesses to mmc), but it contained also priva

Kossuth 2014-02-26 06:20

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Hello

I installed Snuggle and updated it to the latest version, but both versions seem to give warning with hildon banner when enabling the coordinate function:

Warning : Could not get valid responce from the MMAP API!!!

I noticed that someone else asked this in year 2012, but never got answer. Is this location specific, because nobody else is reporting this (I'm in Finland) or am I missing some package or library from my system?

Here is the cell-info from the mainpage:
Cell: 6998132 LAC 141
MCC 244 MNC 12

peterleinchen 2014-02-26 07:27

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
As Saturn (or was it ade?) said earlier, the cell tower database is far from being complete.
So I guess your cell is just not yet known. At least I could reproduce that message with your cell info and internet access (and same message without inet).

handaxe 2014-02-26 13:16

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by peterleinchen (Post 1414380)
As Saturn (or was it ade?) said earlier, the cell tower database is far from being complete.
So I guess your cell is just not yet known.

Veering o/t: that is one thing I would like cellnet-info to be able to contribute back is cell loc data to for eg. opencellid (via user choice). Ade moved away from that service as they required registration. It would be good however, to have the choice of contributing data so as to overcome the blanks on the map.

handaxe 2014-03-02 19:06

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
BUG: it appears that the "disable at boot" button does not register. No error appears when app started from CLI, so I wonder if it is a place holder for the mo'.

I like this application.....

ade 2014-03-02 20:13

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by handaxe (Post 1415140)
BUG: it appears that the "disable at boot" button does not register. No error appears when app started from CLI, so I wonder if it is a place holder fro the mo'.

I like this application.....

It is not implemented yet. I asked Saturn if he would pick that up, but did not get an explicit answer on that. Stop Daemon does work but only until a reboot of course.

If Saturn is not interested in this part, I will address it.

Saturn 2014-03-03 15:26

Re: [Announce] Snuggle : Geolocation using CellID and Google APIs
 
Quote:

Originally Posted by ade (Post 1415146)
It is not implemented yet. I asked Saturn if he would pick that up, but did not get an explicit answer on that. Stop Daemon does work but only until a reboot of course.

If Saturn is not interested in this part, I will address it.

Hi ade,

I did already implement it (together with a couple more small stuff) during the weekend but haven't released it yet.

I did also some testing and there are a few things that i don't like.

- I would like to implement a notification when the locationGetter is working. ATM, when it interrogates google for the location the application look like it is frozen.

- I have tried with a file I collected a year ago when on holidays for a week. It took something like 5-10 minutes to complete and really didn't know at what stage it was. Before I was doing this in the command line and I could see each query and it's result.
I think in a future version I will make it to launch a new window and see the same results.

- I would like to add an option to automate the push of the collected data in the database on regular intervals (and additional option to restrict it only when the wifi is available).


The list is longer, but if you like to work on any of these or other ideas just let me know and i will upload the latest version.

thanks,
Chris


All times are GMT. The time now is 08:13.

vBulletin® Version 3.8.8