maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Community (https://talk.maemo.org/forumdisplay.php?f=16)
-   -   [Testing Squad] - February 2010 (https://talk.maemo.org/showthread.php?t=44143)

VDVsx 2010-02-11 18:18

[Testing Squad] - February 2010
 
The thread will help coordinating the activities of the Testing Squad during February, feel free to ask questions about the Testing Squad or packages in testing during this month.

Originally posted at the Testing Squad mailing list.

Quote:

Hi all,

Welcome to the Testing Squad!!

Let me start with some clarifications about the Testing Squad, this team is intended to test software done inside the community by volunteers, not software done by Nokia or new FW images(this can happens, if Nokia continue picking beta testers inside the community), so if someone have questions about that please shout :).

I've started a page for the Testing Squad[1], feel free to add more relevant information, I also started a quick check list to help developers preparing their applications for testing[2], please help improving these pages.

My initial plan is very simple, we'll start this way, and keep improving our way of working with your suggestions:

* Each week a member of the Testing Squad posts a list of applications that should be tested during that week.(here and in a appropriated thread at talk.maemo.org)
* The testers test the applications freely in their free time.
* In the end of the week a evaluation is made and any pending issue is discussed among the team.


My initial plan is to test 15 apps per week(3-A-Day) in the beginning in order to clean the testing queue, I expect that this number will decrease a bit in the next weeks.

Please read carefully the Testing Squad page[1] before start, if you've questions feel free to ask them here or in the relevant thread at talk.maemo.org.

In the next hours I'll post the list of apps for this weekend(only 5), will do the same next Sunday, then this task will rotate among the members of the Testing Squad, it's a very simple task.

[1] - http://wiki.maemo.org/Testing_Squad
[2] - http://wiki.maemo.org/Prepare_your_a...on_for_testing


VDVsx 2010-02-11 23:30

Re: [Testing Squad] - February 2010
 
Hi,

here's the list of applications under testing this week:

http://maemo.org/packages/package_in...er/1.0-maemo7/ - Promoted
http://maemo.org/packages/package_in...bledict/0.1-2/ - Demoted
http://maemo.org/packages/package_in...omeip/1.0.0-4/ - Demoted
http://maemo.org/packages/package_in...systray/0.0.1/ - Demoted
http://maemo.org/packages/package_in...erule/1.0.4-1/ - Promoted

I intentionally left out some applications because these are Command Line Applications(new rules will be announced) or I contacted the developers and they don't want to promote the current version in testing.
Please evaluate&vote all of them, even if the application already has enough votes(10), voting down will help to clean the testing queue, the applications with a karma < -5 will be automatically demoted, so some of the applications above can disappear from the testing queue before you evaluate them (not a problem).
Please always consider the comments made by other users and try to reproduce any issue reported, also if you find bug, report them in the proper place.
Always leave a comment when you vote down an application.

Happy testing !!

Sasler 2010-02-12 15:33

Re: [Testing Squad] - February 2010
 
Can I have two different versions of the same app in Extras-testing at the same time? If possible, is it recommended?

The reason I'm asking is that I have a version in Extras-testing, which is only a minor update compared to the version in Extras. It already has enough votes. I just need to wait for the quarantine time to end before I can promote it.

But now I made a new version which has pretty major changes in Extras-devel. While I tested as well as I can by myself, I need feedback. However, I can't seem to get enough of tester in Extras-devel, so I though of promoting it to Extras-testing for having more people testing it. Is this recommended?

dwould 2010-02-12 15:44

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by Sasler (Post 523131)
Can I have two different versions of the same app in Extras-testing at the same time? If possible, is it recommended?

The reason I'm asking is that I have a version in Extras-testing, which is only a minor update compared to the version in Extras. It already has enough votes. I just need to wait for the quarantine time to end before I can promote it.

But now I made a new version which has pretty major changes in Extras-devel. While I tested as well as I can by myself, I need feedback. However, I can't seem to get enough of tester in Extras-devel, so I though of promoting it to Extras-testing for having more people testing it. Is this recommended?

From my experience promoting one version to extras-testing appears to 'unpromote' the verison that was there, or something like that. So I don't think you can co-exist two versions.

RipTorn 2010-02-12 15:53

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by VDVsx (Post 522120)
I intentionally left out some applications because these are Command Line Applications(new rules will be announced)

so command line programs aren't tested in these testing squad?

VDVsx 2010-02-12 16:29

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by RipTorn (Post 523184)
so command line programs aren't tested in these testing squad?

Will be when all the rules for these apps are decided and in place(should be soon).

VDVsx 2010-02-12 16:32

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by dwould (Post 523157)
From my experience promoting one version to extras-testing appears to 'unpromote' the verison that was there, or something like that. So I don't think you can co-exist two versions.

Exactly, you can't have apps with the same name in testing, unless there's some bug in the system.
If the version currently in -testing is just a small fix why not promote the version in -devel now ?

fatalsaint 2010-02-12 16:44

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by VDVsx (Post 523260)
Will be when all the rules for these apps are decided and in place(should be soon).

Would that include GUI apps that depend on other command line apps?

Take Bratag's and my Pianobar front-ends... pianobar is a command line app that would be exempted from your testing.. but the GUI's wouldn't be.. but if I understand the current system properly: if either of our GUI apps gets tested and voted up.. then when we promote it drags the dependencies too (since it's assumed that if an app that depends on another app worked fine.. then the other must have as well)..

So would you guys not be currently testing things like those?

VDVsx 2010-02-12 16:50

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by fatalsaint (Post 523303)
Would that include GUI apps that depend on other command line apps?

Take Bratag's and my Pianobar front-ends... pianobar is a command line app that would be exempted from your testing.. but the GUI's wouldn't be.. but if I understand the current system properly: if either of our GUI apps gets tested and voted up.. then when we promote it drags the dependencies too (since it's assumed that if an app that depends on another app worked fine.. then the other must have as well)..

Exactly, this only affects standalone CLI apps, if the CLI app is a dependency from a GUI app, it will be treated like a library.

Sasler 2010-02-12 17:35

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by VDVsx (Post 523269)
Exactly, you can't have apps with the same name in testing, unless there's some bug in the system.
If the version currently in -testing is just a small fix why not promote the version in -devel now ?

The current version in Extras-testing has some changes that are very minor code-wise, but adds some nice functionality. So I better wait till I can promote it, which is only 3 days more. :)

mikkov 2010-02-12 18:46

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by Sasler (Post 523397)
The current version in Extras-testing has some changes that are very minor code-wise, but adds some nice functionality. So I better wait till I can promote it, which is only 3 days more. :)

I'm still wondering what happened to 5 days 5 votes decision

VDVsx 2010-02-12 19:36

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by mikkov (Post 523516)
I'm still wondering what happened to 5 days 5 votes decision

After more pondering we didn't reached a final consensus on that, so the current rules will be kept.

VDVsx 2010-02-14 00:09

Re: [Testing Squad] - February 2010
 
Hi,

here's the list of applications under testing this week.

Week 7:

http://maemo.org/packages/package_in...cs/20070225-2/ - Demoted
http://maemo.org/packages/package_in...n/2.6-1maemo5/ - Demoted
http://maemo.org/packages/package_in...ra/20070225-2/ - Demoted
http://maemo.org/packages/package_in...witcher/0.3.6/ - Demoted
http://maemo.org/packages/package_in.../0.9.3-maemo7/ - Demoted
http://maemo.org/packages/package_in...eragent/0.3.7/ - Demoted
http://maemo.org/packages/package_in.../ejpi/0.9.7-1/ - Promoted
http://maemo.org/packages/package_in...eltests/0.1.1/ - Demoted
http://maemo.org/packages/package_in...apier/1.0.5-3/
http://maemo.org/packages/package_in.../0.73-7maemo5/ - Demoted
http://maemo.org/packages/package_in...ager/0.9.30-1/ - Demoted
http://maemo.org/packages/package_in...light/0.2.0-2/
http://maemo.org/packages/package_in...ilblogg/0.9.0/ - Demoted
http://maemo.org/packages/package_in...920.2-3maemo1/ - Demoted
http://maemo.org/packages/package_in...atch-home/0.3/ - Demoted

Results from week 6(2 promoted, 3 demoted):

http://maemo.org/packages/package_in...er/1.0-maemo7/ - Promoted
http://maemo.org/packages/package_in...bledict/0.1-2/ - Demoted
http://maemo.org/packages/package_in...omeip/1.0.0-4/ - Demoted
http://maemo.org/packages/package_in...systray/0.0.1/ - Demoted
http://maemo.org/packages/package_in...erule/1.0.4-1/ - Promoted

Just two remarks since some have asked:

* The bugtracker field is now mandatory, as you can see by the system notifications, apps without that field can't be promoted to extras, please also check if the field is valid, some developers just put there bugs.maemo.org without a product, e-mail addresses are valid for small apps(themes, widgets,...).
* You don't need to comment if you don't have anything to add to the discussion, for example is someone already commented that the package needs a bugtracker or is not optified, you don't need to repeat the same, just vote down.

I appreciate if someone with time add these two points to the faq(I'll be traveling this week): http://wiki.maemo.org/Testing_Squad

Great job so far.

VDVsx 2010-02-22 00:30

Re: [Testing Squad] - February 2010
 
Hi,

here's the list of applications under testing this week, there's a couple of applications with clear faults/bug that prevent the promotion, these only need your thumb down to be demoted :)

from week 7:

http://maemo.org/packages/package_in...light/0.2.0-2/ - (Need more testing)

New:

http://maemo.org/packages/package_in...atitude/0.3-9/
http://maemo.org/packages/package_in...colem/2.6.0-2/ - Promoted
http://maemo.org/packages/package_in...creator/2.1-1/
http://maemo.org/packages/package_in...5.maemo5v1.5b/ - Demoted
http://maemo.org/packages/package_in...note/0.7.10-2/ - Promoted
http://maemo.org/packages/package_in...eeper/0.2.0-1/
http://maemo.org/packages/package_in...agnetic/2.3-4/
http://maemo.org/packages/package_in...oapplet/0.2-9/
http://maemo.org/packages/package_in....2.20100104-2/ - Promoted
http://maemo.org/packages/package_in....2.20100104-2/
http://maemo.org/packages/package_in....4.20100104-4/ - Demoted
http://maemo.org/packages/package_in....9.20100104-2/
http://maemo.org/packages/package_in....4.20100104-2/
http://maemo.org/packages/package_in....9.20100104-2/
http://maemo.org/packages/package_in....2.20100104-2/

With clear faults/bugs (can be voted down):

http://maemo.org/packages/package_in...e2control/0.3/ - Demoted
http://maemo.org/packages/package_in...2.8.6-maemo14/ - Demoted
http://maemo.org/packages/package_in...opbear/0.52-2/ - Demoted
http://maemo.org/packages/package_in.../2.12-4maemo1/ - Demoted
http://maemo.org/packages/package_in...speak/1.42.04/ - Demoted
http://maemo.org/packages/package_in...1.55.0-maemo1/ - Demoted
http://maemo.org/packages/package_in...2.1.29-maemo1/ - Demoted


Results from week 7(1 promoted, 12 demoted, 2 unchanged):

http://maemo.org/packages/package_in...cs/20070225-2/ - Demoted
http://maemo.org/packages/package_in...n/2.6-1maemo5/ - Demoted
http://maemo.org/packages/package_in...ra/20070225-2/ - Demoted
http://maemo.org/packages/package_in...witcher/0.3.6/ - Demoted
http://maemo.org/packages/package_in.../0.9.3-maemo7/ - Demoted
http://maemo.org/packages/package_in...eragent/0.3.7/ - Demoted
http://maemo.org/packages/package_in.../ejpi/0.9.7-1/ - Promoted
http://maemo.org/packages/package_in...eltests/0.1.1/ - Demoted
http://maemo.org/packages/package_in...apier/1.0.5-3/ - (has enough votes for promotion)
http://maemo.org/packages/package_in.../0.73-7maemo5/ - Demoted
http://maemo.org/packages/package_in...ager/0.9.30-1/ - Demoted
http://maemo.org/packages/package_in...light/0.2.0-2/ - (Need more testing)
http://maemo.org/packages/package_in...ilblogg/0.9.0/ - Demoted
http://maemo.org/packages/package_in...920.2-3maemo1/ - Demoted
http://maemo.org/packages/package_in...atch-home/0.3/ - Demoted

Happy Testting!!

Sasler 2010-02-22 18:32

Re: [Testing Squad] - February 2010
 
When the new firmware (PR1.2) with the Qt 4.6 is released, there is a possibility that current Qt apps don't work well or at all. If I understood correctly, a repacking might be enough. My question is, would it be possible to release updates to these apps, if only repacking was needed, as soon as possible without waiting for the usual 10 days?

slender 2010-02-22 18:41

Re: [Testing Squad] - February 2010
 
VDVsx,
Links broken in last category

VDVsx 2010-02-22 18:54

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by slender (Post 541484)
VDVsx,
Links broken in last category

Thanks fixed.
Damn copy&paste ;)

VDVsx 2010-02-22 18:56

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by Sasler (Post 541476)
When the new firmware (PR1.2) with the Qt 4.6 is released, there is a possibility that current Qt apps don't work well or at all. If I understood correctly, a repacking might be enough. My question is, would it be possible to release updates to these apps, if only repacking was needed, as soon as possible without waiting for the usual 10 days?

That's a good question, the current system doesn't allow that(proposed improvements allow), but I'll ask the responsible about that.

mikkov 2010-02-24 00:13

Re: [Testing Squad] - February 2010
 
Quote:

Originally Posted by VDVsx (Post 525373)
Hi,

* The bugtracker field is now mandatory, as you can see by the system notifications, apps without that field can't be promoted to extras, please also check if the field is valid, some developers just put there bugs.maemo.org without a product, e-mail addresses are valid for small apps(themes, widgets,...).

Bugtracker link has no real value. IMHO better system would that there is a default bugtracker for all packages (including libraries) and if maintainer wants to use some other bugtracker it can be marked with bugtracker field. Optimally bugzilla would be the default bugtracker, but since bugmaster clearly doesn't want that, packages interface can be used instead.

torpedo48 2010-02-28 18:23

Re: [Testing Squad] - February 2010
 
Hi,
here's the list of applications under testing this week. There are also a lot of apps needing more testing from Week 8, come on guys!


Apps needing more testing from week 8:
http://maemo.org/packages/package_in...atitude/0.3-9/
http://maemo.org/packages/package_in....2.20100104-2/
http://maemo.org/packages/package_in....9.20100104-2/
http://maemo.org/packages/package_in....4.20100104-2/
http://maemo.org/packages/package_in....9.20100104-2/
http://maemo.org/packages/package_in....2.20100104-2/
http://maemo.org/packages/package_in...oapplet/0.2-9/
http://maemo.org/packages/package_in...agnetic/2.3-4/
http://maemo.org/packages/package_in...agnetic/2.3-4/


New:

http://maemo.org/packages/package_in...olders/0.23-3/
http://maemo.org/packages/package_in...t/4.0-4maemo1/
http://maemo.org/packages/package_in...uplot/4.2.6-7/
http://maemo.org/packages/package_in...mpris/8.4.5-9/
http://maemo.org/packages/package_in...isk/1.6.2.1-1/
http://maemo.org/packages/package_in...eader/0.0.2-1/
http://maemo.org/packages/package_in...tmpdump/1.9-1/
http://maemo.org/packages/package_in...ppcards/1.1-1/
http://maemo.org/packages/package_in...opwatch/0.2-6/
http://maemo.org/packages/package_in...reemoe/0.15-1/
http://maemo.org/packages/package_in...tronome/0.1.0/
http://maemo.org/packages/package_in...0.9.0-0maemo3/
http://maemo.org/packages/package_in...golang/4476-5/
http://maemo.org/packages/package_in.../1.0.0-maemo2/
http://maemo.org/packages/package_in...aemo5/1.0.0-5/


With clear faults/bugs (can be voted down):
http://maemo.org/packages/package_in....4.20100104-4/
http://maemo.org/packages/package_in...creator/2.1-1/
http://maemo.org/packages/package_in...atitude/0.3-9/
http://maemo.org/packages/package_in...ain/1.6.2.1-1/
http://maemo.org/packages/package_in...fig/1.6.2.1-1/
http://maemo.org/packages/package_in...llpaper/1.1-1/
http://maemo.org/packages/package_in...llpaper/1.1-1/


Results from week 8 (3 promoted, 12 unchanged):
http://maemo.org/packages/package_in....2.20100104-2/ - Promoted
http://maemo.org/packages/package_in...note/0.7.10-2/ - Promoted
http://maemo.org/packages/package_in...colem/2.6.0-2/ - Promoted

Hope I've done it well!

VDVsx 2010-03-08 02:15

Re: [Testing Squad] - February 2010
 
FYI: March thread: http://talk.maemo.org/showthread.php?p=559360

Texrat 2010-03-08 02:52

Re: [Testing Squad] - February 2010
 
Valerio, you have been highlighted!

http://tabulacrypticum.wordpress.com...ning-to-meego/

:D


All times are GMT. The time now is 22:17.

vBulletin® Version 3.8.8