maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Applications (https://talk.maemo.org/forumdisplay.php?f=41)
-   -   [ANNOUNCE] Columbus Navigation Toolkit (https://talk.maemo.org/showthread.php?t=67276)

handaxe 2013-04-18 12:40

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by avidscavenger (Post 1336889)
Great - can you tell me how or give me a reference on setting up core dumps?

[UPDATE]My phone is unbricked. :) The problem was somehow caused by columbus - its install scripts removed some library directories from /etc/ld.so.conf which mean that core apps (modest) wouldn't load which sent the phone into a reboot loop.

Given your experience and that columbus never did that to me, I think I will pass on your debug builds, no offence :-) Anyhow, I am pressed for space and installing all of gdb, dev libs is unattractive.

BUT, I have 2 core-dumps from columbus under different usages, one streaming one not. So lets see if this helps at all. Details of file access sent via PM.

Setting up core dumps is simple:

(as user)
Code:

mkdir ~/MyDocs/core-dumps
(as root) add the following repos to /etc/apt/sources.list

Code:

deb http://repository.maemo.org/ fremantle/sdk free non-free
deb http://repository.maemo.org/ fremantle/tools free non-free

then
Code:

apt-get update && apt-get install sp-rich-core
And then you wait for misbehaviour..... whereupon core-dumps folder will offer what ye seek.

PS: remember that the dumps will accummulate as programs misbehave, and if you forget that, you may be surprised by diminishing storage over time. Bit like enabling syslog....

avidscavenger 2013-04-18 13:43

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by handaxe (Post 1336990)
Given your experience and that columbus never did that to me, I think I will pass on your debug builds, no offence :-) Anyhow, I am pressed for space and installing all of gdb, dev libs is unattractive.

Although I can understand your misgivings I'm quite certain the problems are totally unrelated. All I did to build a debug version was change a single build option so that compilation and linking is done with a debug flag and without optimisation. The problem with bricking was, by the only explanation I can come up with, caused by a postinstall script.

Quote:

BUT, I have 2 core-dumps from columbus under different usages, one streaming one not. So lets see if this helps at all. Details of file access sent via PM.
I will take a look at them in the morning. It's late evening my time.

Quote:

Setting up core dumps is simple:
Thank you for that info. I saw some references to sp-rich-core but wasn't sure in which repository it could be found. I'll check it out too.

Estel 2013-04-19 00:05

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by avidscavenger (Post 1337001)
The problem with bricking was, by the only explanation I can come up with, caused by a postinstall script.

More details on that, please? What it exactly deletes, and why the hell would it do it? I have Columbus installed, and my modest works OK, not to mention no bootloops.

If postinst script is really fubar, it would require immediate fixing and uploading new version to -devel.

/Estel

avidscavenger 2013-04-19 00:10

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by Estel (Post 1337179)
If postinst script is really fubar, it would require immediate fixing and uploading new version to -devel.

Agreed! I've checked out the scripts and they look fine to me. All I know is I was messing around with building, installing, uninstalling various versions of columbus. At some point modest started returning an error. Naively I thought that rebooting would help - in fact it did the opposite and I had to learn a bit more about bootloader options before I could get it back on track.

My best explanation at this point is that I may have interrupted an install or uninstall process at an inopportune moment. In any case I'm still messing about with columbus so I'll be extra careful to check if it happens again.

Jonathan

avidscavenger 2013-04-19 01:07

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by handaxe (Post 1336990)
BUT, I have 2 core-dumps from columbus under different usages, one streaming one not. So lets see if this helps at all.

They don't give me much extra information, but there is one good piece of news which is the segfault seems to be the same in each case, which is also the same as what I found running gdb on a non-debug build, which is a crash in QString::fromLatin1_helper

One thing I notices is that you have more versions of a few libraries compared with me. I thought my apt sources were up to date but apparently this is not the case. Can you show me what you have?

handaxe 2013-04-20 01:10

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
2 more crash logs if you want them on my site.

Here is my sources.list (well actually "hildon-application-manager-list" given how maemo works):

I can try for a gdb log if you want; let me know....

avidscavenger 2013-04-20 01:26

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Ah OK I see I was missing the community-testing repo.

I don't think I need any more core dumps, since they all look pretty much the same:

Quote:

Program terminated with signal 11, Segmentation fault.
#0 0x40e7d098 in QString::fromLatin1_helper(char const*, int) () from /usr/lib/libQtCore.so.4
0x40e7d098 <_ZN7QString17fromLatin1_helperEPKci+76>: ldrb r3, [r8]
(gdb) bt
#0 0x40e7d098 in QString::fromLatin1_helper(char const*, int) () from /usr/lib/libQtCore.so.4
#1 0x40e8710c in QString::fromAscii_helper(char const*, int) () from /usr/lib/libQtCore.so.4
#2 0x00015c24 in ?? ()
#3 0x00015c24 in ?? ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)
I don't really know enough about arm architecture to say with any certainty whether this really is likely to be a corrupt stack, a bug in gdb or something else.

What I do notice however is that if columbus is compiled with optimisation level 2 or higher then it crashes while with level 1 or lower it seems to be OK. Possibly the code does something weird that doesn't work when the compiler tries to optimise it?

But this does suggest an ugly work-around... just build it with a lower level of compiler optimisation.

handaxe 2013-04-20 01:49

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by avidscavenger (Post 1337464)
Ah OK I see I was missing the community-testing repo.

OK, make sure you get the CSSU-testing installed as you can read here:
http://wiki.maemo.org/Community_SSU

What are the implications of a lower level compilation?

Would a gdb trace with dbg versions of libraries (incl. QT) and the binary not provide more detail?

avidscavenger 2013-04-20 11:47

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

What are the implications of a lower level compilation?
More intensive CPU usage and/or a larger executable.

Quote:

Would a gdb trace with dev versions of libraries (incl. QT) and the binary not provide more detail?
I think that gdb already has the symbols from the qt libraries.

The issue seems to be that the stack is either corrupted or gdb thinks that it is rather than we can't see where the process finally dies.

I also tried valgrind which gave a bit of extra information but not enough that I can see where the problem is:

Code:

==1875== Invalid read of size 1
==1875==    at 0x5697098: QString::fromLatin1_helper(char const*, int) (in /usr/lib/libQtCore.so.4.7.4)
==1875==  Address 0x73 is not stack'd, malloc'd or (recently) free'd


freemangordon 2013-04-20 12:33

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
@avidscavenger - install qt -dbg packages and get some useful backtrace :).

Keep in mind that before install them you should move /usr/lib/debug to /opt or sdcard and symlink back, otherwise your rootfs will become full, qt debug symbols are about 200 MB or so

avidscavenger 2013-04-20 12:53

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by freemangordon (Post 1337544)
@avidscavenger - install qt -dbg packages and get some useful backtrace :).

Thanks.

Unfortunately doesn't really tell me what I didn't already know. Two valid stack frames then nothing but question marks. Some buffer over- or under-run has destroyed the stack? Any suggestions?

Note that turning off compiler optimisation makes the problem go away. And valgrind didn't find anything.

Not too sure where to go from here.

freemangordon 2013-04-20 14:06

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by avidscavenger (Post 1337547)
Thanks.

Unfortunately doesn't really tell me what I didn't already know. Two valid stack frames then nothing but question marks. Some buffer over- or under-run has destroyed the stack? Any suggestions?

Note that turning off compiler optimisation makes the problem go away. And valgrind didn't find anything.

Not too sure where to go from here.

You are missing debug symbols for /usr/lib/libQtCore.so.4, that is why gdb says "Backtrace stopped: previous frame identical to this frame (corrupt stack?)". Just install libqt4-core-dbg and you'll see. I can't say it clearer than that :)

avidscavenger 2013-04-20 23:08

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by freemangordon (Post 1337563)
You are missing debug symbols for /usr/lib/libQtCore.so.4, that is why gdb says "Backtrace stopped: previous frame identical to this frame (corrupt stack?)". Just install libqt4-core-dbg and you'll see. I can't say it clearer than that :)

That is what I did. :)

Here is some output:

Code:

user@Nokia-N900:~/MyDocs/core-dumps/columbus-3E77-11-2005$ dpkg -l libqt4-core-dbg
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Cfg-files/Unpacked/Failed-cfg/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name                  Version              Description
+++-=====================-=====================-==========================================================
ii  libqt4-core-dbg      1:4.7.4~git20110505+c Qt 4 library debugging symbols
user@Nokia-N900:~/MyDocs/core-dumps/columbus-3E77-11-2005$ gdb /opt/usr/bin/columbus ./coredump
GNU gdb (GDB) 6.8.50.20090417-debian
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "arm-linux-gnueabi".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
(no debugging symbols found)
Reading symbols from /opt/usr/lib/librxsupport.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/usr/lib/librxsupport.so.1
Reading symbols from /opt/usr/lib/libcolumbus.so.1...(no debugging symbols found)...done.

<snip>

Code:

Reading symbols from /usr/lib/libQtCore.so.4...Reading symbols from /opt/usr/lib/debug/usr/lib/libQtCore.so.4.7.4...done.
done.
Loaded symbols for /usr/lib/libQtCore.so.4

<snip>

Code:

Core was generated by `/opt/usr/bin/columbus'.
Program terminated with signal 11, Segmentation fault.
#0  QString::fromLatin1_helper (str=0x73 <Address 0x73 out of bounds>, size=-1) at tools/qstring.cpp:3743
3743    tools/qstring.cpp: No such file or directory.
        in tools/qstring.cpp
(gdb) bt
#0  QString::fromLatin1_helper (str=0x73 <Address 0x73 out of bounds>, size=-1) at tools/qstring.cpp:3743
#1  0x40e7910c in QString::fromAscii_helper (str=0x73 <Address 0x73 out of bounds>, size=1088917772)
    at tools/qstring.cpp:3809
#2  0x00015ad0 in ?? ()
#3  0x00015ad0 in ?? ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)
Current language:  auto; currently c++
(gdb)

As you can see, we get a bit more information about the line numbers and variable names, but nothing more on the stack.

handaxe 2013-04-20 23:17

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
[OT] @avidscavenger: southern hemisphere + good command of English: OZ, NZ, SA?

HA (ex SA)

avidscavenger 2013-04-20 23:26

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by handaxe (Post 1337641)
[OT] @avidscavenger: southern hemisphere + good command of English: OZ, NZ, SA?

HA (ex SA)

If you consider Australian English to be good English ;)

handaxe 2013-04-20 23:30

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by avidscavenger (Post 1337642)
If you consider Australian English to be good English ;)

Honest mistake! :)

avidscavenger 2013-04-21 01:26

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
@handaxe - also OT but I can't find any threads that mention this. Since I included community-testing among my repos and did an upgrade, my hald_addon_bme has stopped working. That is, when I plug my phone into a USB source it doesn't give a pop-up message and start charging at 500mA/1000mA depending on the source. Instead it just charges at 100mA and I have to manually tweak the charge rate. Any clues?

freemangordon 2013-04-21 09:08

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by avidscavenger (Post 1337640)
That is what I did. :)

Here is some output:

Code:

user@Nokia-N900:~/MyDocs/core-dumps/columbus-3E77-11-2005$ dpkg -l libqt4-core-dbg
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Cfg-files/Unpacked/Failed-cfg/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name                  Version              Description
+++-=====================-=====================-==========================================================
ii  libqt4-core-dbg      1:4.7.4~git20110505+c Qt 4 library debugging symbols
user@Nokia-N900:~/MyDocs/core-dumps/columbus-3E77-11-2005$ gdb /opt/usr/bin/columbus ./coredump
GNU gdb (GDB) 6.8.50.20090417-debian
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "arm-linux-gnueabi".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
(no debugging symbols found)
Reading symbols from /opt/usr/lib/librxsupport.so.1...(no debugging symbols found)...done.
Loaded symbols for /opt/usr/lib/librxsupport.so.1
Reading symbols from /opt/usr/lib/libcolumbus.so.1...(no debugging symbols found)...done.

<snip>

Code:

Reading symbols from /usr/lib/libQtCore.so.4...Reading symbols from /opt/usr/lib/debug/usr/lib/libQtCore.so.4.7.4...done.
done.
Loaded symbols for /usr/lib/libQtCore.so.4

<snip>

Code:

Core was generated by `/opt/usr/bin/columbus'.
Program terminated with signal 11, Segmentation fault.
#0  QString::fromLatin1_helper (str=0x73 <Address 0x73 out of bounds>, size=-1) at tools/qstring.cpp:3743
3743    tools/qstring.cpp: No such file or directory.
        in tools/qstring.cpp
(gdb) bt
#0  QString::fromLatin1_helper (str=0x73 <Address 0x73 out of bounds>, size=-1) at tools/qstring.cpp:3743
#1  0x40e7910c in QString::fromAscii_helper (str=0x73 <Address 0x73 out of bounds>, size=1088917772)
    at tools/qstring.cpp:3809
#2  0x00015ad0 in ?? ()
#3  0x00015ad0 in ?? ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)
Current language:  auto; currently c++
(gdb)

As you can see, we get a bit more information about the line numbers and variable names, but nothing more on the stack.

Phew, finally :P.

Now, you have 2 options from here:

1. Start application, attach gdb and wait it to SEGFAULT.
2. Start application, start gdb, load the coredump and attach to the application

Either will work and will give you the real backtrace.

BTW I am on #maemo IRC @ freenode.net, better join there to speedup the communication.

Estel 2013-04-21 12:00

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by freemangordon (Post 1337695)
BTW I am on #maemo IRC @ freenode.net, better join there to speedup the communication.

[OT]I would rather suggest #maemo-alternatives - this was the channel, where I managed to get freemangordon's attention to this thread, and, in particular, to coredump interpretation problems.

Official #maemo channels got one pesky, ego-problems focused admin, who lately feels very trigger-happy to ban people (probably, due to feeling like owning Maemo Community and being irreplaceable, thanks to some politic twists).

#maemo-alternatives sounds like better place for friendly, uncensored discussion - channel is managed by normal, responsible people. While originally meant to discuss alternative (to #maemo) operating systems on N900, lately it started to become alternative to "official" maemo channels (that were hostily taken over, long time ago) as a whole, and #maemo-alternatives staff doesn't have anything against it (AIUI).

Just suggestin' [/OT]

/Estel

handaxe 2013-04-21 12:18

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
@estel: can you help avidscavenger with his question about charging? I admit I get confused as to the bme replacement status.

EDIT: bme replacement is not yet distributed but available for testing on Pali's site.

AFAIK, that is a kernel-power issue, and charging works for me with kp52. Unclear whether avidscavenger has kp installed. Could CSSU-T interfere with charging? Bad install?

Stay cool on the comments :)

PS looking at his post, he may have installed via apt.

Estel 2013-04-24 22:30

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by handaxe (Post 1337723)
@estel: can you help avidscavenger with his question about charging? I admit I get confused as to the bme replacement status.

No freakin' idea what's going on his device, at least, wihout more info. But, this and two following posts:
http://talk.maemo.org/showpost.php?p...&postcount=216

...is a good example how to debug problems with bme-replacement. Honestly, I'm not even sure, if avidscavenger is using it, and if yes if he is using required kernel-power (like you've said).

Considering that I use cssu-thumb and kernel-power on every device I manage (from mine, through my mother's one, up to N900 owned by my 4 years old son, with a dozen other in between), I totally lost track about cssu-<whatever> <-> bme-replacement relations.

/Estel

avidscavenger 2013-04-27 23:57

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by freemangordon (Post 1337695)
1. Start application, attach gdb and wait it to SEGFAULT.

I tried that for a while, but it runs so slowly under gdb and I gave up waiting for it to segfault. Maybe more patience is all that is required.

Quote:

2. Start application, start gdb, load the coredump and attach to the application
I don't quite follow what that means. Starting the application and loading a coredump - doesn't that mean you have two instances of the app: the one you started and the segfaulted one in the coredump? Anyway, if you can explain how to do what you suggest, I'd be grateful.

I've never had issues like this with gdb before although I've used it for many years (but only on i386 not arm). Is there a reason why invoking it in one way would give you an accurate stack dump but in another way the stack appears corrupted?

Quote:

BTW I am on #maemo IRC @ freenode.net, better join there to speedup the communication.
As you might have guessed from my slow reply, there really is no hurry from my perspective. I'm away from my development box in any case, so can't run gdb. (Staying on my boat - the reason why I want to be able to use my N900 as a backup GPS for OpenCPN!) But I do have my N900 so I can still collect coredumps.

Cheers!

avidscavenger 2013-04-28 01:17

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by Estel (Post 1338661)
No freakin' idea what's going on his device, at least, wihout more info. But, this and two following posts:
http://talk.maemo.org/showpost.php?p...&postcount=216

Thank you. FYI I am using kernel version 2.6.28.10-power52 and pali's BME replacement.

I'm having trouble doing as pali suggests in that post because I'm getting various package signing errors that I can't figure out how to make go away: 'KEYEXPIRED 1349249546' and 'BADSIG E40DC434616730BD'

So I just went straight to pali's repository manually and although his Packages.gz is dated 6 April, the .deb files are all older than that, and they are the same ones I have installed anyway. So I give up for now, my battery life is about 4 hours but that's OK because I can leave the phone on charge almost permanently.

Quote:

Considering that I use cssu-thumb and kernel-power on every device I manage (from mine, through my mother's one, up to N900 owned by my 4 years old son, with a dozen other in between), I totally lost track about cssu-<whatever> <-> bme-replacement relations.
That's fantastic! I only have 3 N900s - mine, my girlfriend's (a present from me) and a water-damaged one that I got for free.

nokiabot 2013-05-18 03:25

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Whats up on the project:)

chemist 2013-11-25 16:34

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Would be nice to have Columbus on N9 and Jolla...
I am using it on my N900, actually the only purpose it has apart of testing new CSSU releases^^
Pretty please, I was so amazed when you asked for testers and a neat piece of software with minor bugs got passed over, claiming alpha stage but being RC already. (One of the reasons I'd like to have the original developer on it and not asking someone else or even try to port it myself...)

nokiabot 2015-04-03 04:46

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
the only app that supplies gps data over bt to the dumb android tablet but crashes out of the blue sometimes and app is slow though battry life seems be ok
was wondering if only the gps tx be ripped off out of the cruft that did be awsome :D

handaxe 2015-04-03 08:54

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by nokiabot (Post 1465656)
the only app that supplies gps data over bt to the dumb android tablet but crashes out of the blue sometimes and app is slow though battry life seems be ok
was wondering if only the gps tx be ripped off out of the cruft that did be awsome :D

Or someone smart could fix gpsd for Fremantle. It is in the repos but lacks certain BT libs that are not in Fremantle but were there in the previous iteration of Maemo.

Android_808 2015-04-03 11:41

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
it would be nice (in the long run) if functionality could be enable via Settings>Connectivity>Location if/when some one decides to replace it.

Do you know what libs are missing for gpsd? if i get time i'll take a quick look at some stage, take a break from going over sdl2 patches.

nokiabot 2015-04-03 18:27

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by Android_808 (Post 1465678)
it would be nice (in the long run) if functionality could be enable via Settings>Connectivity>Location if/when some one decides to replace it..

yep thats the way these utilites are supposed to be intregated ;)

handaxe 2016-01-02 23:48

Re: [ANNOUNCE] Columbus Navigation Toolkit
 
Quote:

Originally Posted by Android_808 (Post 1465678)
it would be nice (in the long run) if functionality could be enable via Settings>Connectivity>Location if/when some one decides to replace it.

Do you know what libs are missing for gpsd? if i get time i'll take a quick look at some stage, take a break from going over sdl2 patches.

I realise now this is not actually related to gpsd as known on 'nix systems but is a hack developed on the earlier maemo devices.... I fiddled and I do not think it is worth attention - porting gpsd sensu stricto might be....


All times are GMT. The time now is 12:12.

vBulletin® Version 3.8.8