maemo.org - Talk - tracking issues and events with maemo.org infra migration#2

maemo.org - Talk (https://talk.maemo.org/index.php)

- Community (https://talk.maemo.org/forumdisplay.php?f=16)

- - tracking issues and events with maemo.org infra migration#2 (https://talk.maemo.org/showthread.php?t=89273)

Re: tracking issues and events with maemo.org infra migration#2

xes and me modified some broken details around import of users from garage to midgard (www)
The user that used to run that script

Code:

crontab on www

# Garage accounts sync

#*/30 * * * *  root  date >>/var/log/midgard/garage_sync.log && /usr/local/bin/garage_sync.sh >>/var/log/midgard/garage_sync.log

0 2 * * *  root  date >>/var/log/midgard/garage_sync.log && /usr/local/bin/garage_sync.sh >>/var/log/midgard/garage_sync.log && date >>/var/log/midgard/garage_sync.log

for unclear reasons didn't authenticate against midgard anymore

We changed that script so it's
a) safe for publishing now ;-D

Code:

#!/bin/bash







# sync garage accounts to midgard. Using org.maemo.garagesync



source /etc/scriptadmin/credentials

source /usr/local/bin/packages/pid.sh





pid_check /var/tmp/garage_sync.pid



lynx -dump -auth=$scriptadmin:$password http://local.maemo.org/midcom-exec-org.maemo.garagesync/import.php?confirm=1 | sed '/^$/d'



RET=$?



rm -f /tmp/get_garage_csvs.pid



pid_cleanup /var/tmp/garage_sync.pid



exit $RET

and
b) the user "scriptadmin" used now actually does work (I created a dedicated user in midgard for that purpose)

Code:

see login failure on monday 24.7. while tue 25.7. it worked. The test runs that processed all backlog (#83310 - #83430) got lost in logfile since invoked "manually"

Mon Jun 24 02:00:01 UTC 2013

   [1]Maemo.org

   __________________ Search

     * [2]Create account

     * [3]Intro

     * [4]Downloads

     * [5]Community

     * [6]Development

     * [7]News

   maemo.org

Login

   You have reached a page, which requires you to be authenticated. Please

   login on the form below.

   User name

   ____________________

   Password

   ____________________

   Login

   Please enter your username and password.

     * Copyright © 2002-2008 Nokia Corporation

     * [8]Terms of Use

     * [9]Privacy Policy

     * Powered by [10]Midgard CMS

   sponsored by Nokia Corporation

References

   1. http://maemo.org/

   2. https://garage.maemo.org/account/register.php

   3. http://local.maemo.org/intro/

   4. http://local.maemo.org/downloads/

   5. http://local.maemo.org/community/

   6. http://local.maemo.org/development/

   7. http://local.maemo.org/news/

   8. http://maemo.org/legal/terms_of_use.html

   9. http://maemo.org/legal/privacy_policy.html

  10. http://www.midgard-project.org/

Mon Jun 24 02:00:01 UTC 2013

Tue Jun 25 02:00:01 UTC 2013

Tue Jun 25 02:05:34 UTC 2013

Wed Jun 26 02:00:01 UTC 2013

   INFO: Created new user 'eco' (#83431)

Wed Jun 26 02:06:10 UTC 2013

Thu Jun 27 02:00:01 UTC 2013

   INFO: Created new user 'andersonsampaio' (#83432)

Thu Jun 27 02:05:56 UTC 2013

according to /var/log/midgard/garage_sync.log this been broken since

Code:

Wed Apr 24 13:30:01 UTC 2013

Wed Apr 24 14:00:01 UTC 2013

Wed Apr 24 14:30:01 UTC 2013

Thu Apr 25 02:00:01 UTC 2013

   INFO: Created new user 'n900-dk' (#83303)

   INFO: Created new user 'alecsandru' (#83304)

   INFO: Created new user 'xavierxcvii' (#83305)

   INFO: Created new user 'youthanasia' (#83306)

Fri Apr 26 02:00:01 UTC 2013

   INFO: Created new user 'testimonyii' (#83308)

Sat Apr 27 02:00:01 UTC 2013

   INFO: Created new user 'sathishrocks39' (#83309)

Sun Apr 28 02:00:01 UTC 2013

   [1]Maemo.org

   Register

Register

     * [2]Intro

     * [3]Downloads

     * [4]Community

     * [5]Development

     * [6]News

     * [7]TALK

   maemo.org

Login

   Access denied: You need administrator privileges.

I hope some of the broken stuff around autobuilder/accounts et al will now normalize

cheers
/j

Re: tracking issues and events with maemo.org infra migration#2

Official welcome to
Ivo aka freemangordon
who started on his daunting new duty as our new autobuilder maintainer today.

Many thanks freemangordon!

/j

Re: tracking issues and events with maemo.org infra migration#2

we found a flaw/bug/issue in "core of" maemo.org. Midgard/MidCOM introduced a r/o issue that's incompatible to the old maemo midgard code we run. This had impact to a multitude of maemo.org services since ~2012-12-28.

We're going to apply a patch and see if that gives our beloved infra a good boost towards a decently operating system. Before we do, we need to do complete backups which might cause a few hours of service downtime for everything except this very forum - the actual starting time of service downtime will get pusblished on rather short notice (expect it to happen during next 24h), duration up to a few hours..

Sorry for the inconvenience!
jOERG
(maemo infra administration coordinator)

Re: tracking issues and events with maemo.org infra migration#2

Talking about early,

I'll shutdown garage, www and db in 30 minutes, around 21:15 (GMT+2) for about 2-3 hours.

Re: tracking issues and events with maemo.org infra migration#2

Quote:

Originally Posted by joerg_rw (Post 1364135)

Downtime ended, patches applied. Please report on stuff that suddenly works as expected! ;-)

A special extra-bold THANK YOU to freemangordon. Also thanks to Falk, Merlin1991, shawnjefferson.

cheers
jOERG

ps. we're going to have some champagne now, and a fat cigar each! we earned it.

Code:

[2013-08-01 00:09:55] <freemangordon> http://maemo.org/packages/view/autobuildertest/

[2013-08-01 00:10:17] <freemangordon> /usr/bin/php5 /usr/local/bin/packages/package-promote.php fremantle extras-devel extras-testing autobuildertest 0.1-1Signing repo

[2013-08-01 00:10:19] <freemangordon> Touching changed file: /var/repository/staging/extras-testing/.fremantle.changed

[2013-08-01 00:10:21] <freemangordon> Touching changed file: /var/tmp/.extras.sync.needed

[2013-08-01 00:10:23] <freemangordon> Syncing fremantle extras-testing

[2013-08-01 00:10:25] <freemangordon> Done

[2013-08-01 00:10:37] <freemangordon> still missing in the package interface

[2013-08-01 00:10:52] <freemangordon> but I guess it needs some time

[2013-08-01 00:11:36] * freemangordon needs coffee

[2013-08-01 00:12:47] <DocScrutinizer05> \o/

Re: tracking issues and events with maemo.org infra migration#2

Unfortunately promotion devel->testing still doesn't work, but it shouldn't be that hard to fix it. Will look at it today(hopefully)

Re: tracking issues and events with maemo.org infra migration#2

Quote:

Originally Posted by joerg_rw (Post 1364167)

ps. we're going to have some champagne now, and a fat cigar each! we earned it.

You certainly deserve it, all of you guys. I'm sending a further donation to techstaff ** for private use ** right now.

Re: tracking issues and events with maemo.org infra migration#2

http://maemo.org/packages/package_in...dertest/0.1-2/

:D

Please test if promotion works for those of you who got their packages stuck in extras-devel or extras-testing. Promote the 386 package if armel one is already promoted(and stuck).

Re: tracking issues and events with maemo.org infra migration#2

Sent over the mailinglist, repeating it here:

Hi all,

As many of you know Maemo autobuilder and package interface were not fully functional for more than half an year.

I am officially announcing those are back in full service. Please those of you who have packages stuck in extras-devel because promotion was not working, to promote them now. The same goes for those packages that are stuck in extras-testing - promotion to extras should be fine too.

So far I fixed and did test fremantle autobuilder only, I suspect package promotion is still semi-broken for the older distributions. If anyone still has problems with promotion, please inform me - by either sending an email or on #maemo, I will fix it ASAP.

Please, all of you who were using extras-devel as a replacement to extras, disable extras-devel and extras-testing repositories. Now our packages infra is(or at least looks like) functional, we should revert to the way all this is supposed to work. Testers/users - please do your job and vote for the packages in testing. Developers - promote the stuff to extras.

Many, many thanks for the great support I had/have (as autobuilder maintainer) from the other members of the Maemo crew in the course of fixing all the broken bits.

Regards,
Ivo (freemangordon@TMO)

Re: tracking issues and events with maemo.org infra migration#2

now that it feels like we changed ship's heading towards the more comfortable shores, I announce an outtime for personal reasons. All account related stuff and hardware maintenance and addons will get handled by warfare aka Falk Stern. In *urgent* cases I'm available via email or other channels for those who know those. Donations are available to those who are entitled to draft from those. The duration of such outtime is undetermined, something between a week and several months. I'm confident maemo.org won't suffer from this measure, which been inevitable and long pending.

Good luck!
jOERG