maemo.org - Talk
Page 2 of 3 1 2 3
Show 40 post(s) from this thread on one page

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Community (https://talk.maemo.org/forumdisplay.php?f=16)
-   -   maemo.org server move Friday 15.1 08:00 UTC -> (https://talk.maemo.org/showthread.php?t=40496)

qole 2010-01-16 18:44
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by X-Fade (Post 475862)
This issue should now be resolved.
Still getting the error; filed a bug.

Bug 8127

msa 2010-01-16 19:09
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
maemo.org repository

http://repository.maemo.org/extras/d...le/release.gpg
Could not connect to repository.maemo.org:80 (80.258.164.237), connection timed out.

i am disappoint... :D

BruceL 2010-01-16 19:30
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
With the maemo 5 push to have all apps moved to maemo repos it is imperative that the repos be reliable. It doesn't work to ask us to put all our apps on a central repo and then have that repo be unreliable. There should be a back-up repo or mirrors. Changing servers isn't a good excuse; especially just before a weekend. Maemo guys, please ask your ISP to provide location redundancy and more than one machine at each location. Even my own web page has this redundancy. If not, then please drop the request that developers abandon their own repositories for maemo extras.

mikkov 2010-01-16 20:14
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by tekojo (Post 476147)
Can't reproduce. Has X-Fade done something? :)
I am still getting timeout at least from these pages:

http://maemo.org/packages/package_in...0.8.1-3maemo1/
http://maemo.org/packages/package_in...allpaper/1.0-3
http://maemo.org/packages/package_in...catorise/0.0.5

Texrat 2010-01-16 20:25
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
To those providing detailed info on errors, offering useful suggestions and filing bugs: thank YOU! very helpful.

To anyone that chooses to simply complain: this is a normal consequence of growth and change. The maemo.org team has been bending over backwards, putting in incredible hours to minimize the impact and ultimately improve your experience here.

To all: your patience and consideration are appreciated, and will be rewarded by a better infrastructure. ;)

maxximuscool 2010-01-16 20:40
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
The server is still down here.
Ping it and got back bad address.

$ ping http://repository.maemo.org/extras/
ping: bad port spec 'http://repository.maemo.org/extras/'
~ $ ping repository.maemo.org
ping: bad address 'repository.maemo.org'

jebba 2010-01-16 22:04
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
You can use my mirror in the interim:

http://espejo.freemoe.org/

It doesn't mirror the Nokia binaries, just the Free Software in Extras, Extras-testing, etc.

jjx 2010-01-16 22:15
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
I really appreciate the effort that is put in behind the scenes to make the service work. I've done those sort of "oh ****" very long days myself. Thanks guys!

Nonetheless, it is important infrastructure and it's funded. Akamai isn't cheap. Isn't having everything depend on one server machine a bit... inappropriate?

Quote:
Originally Posted by BruceL (Post 476674)
There should be a back-up repo or mirrors. Changing servers isn't a good excuse; especially just before a weekend. Maemo guys, please ask your ISP to provide location redundancy and more than one machine at each location. Even my own web page has this redundancy.
They have excellent geographic replication in the form of Akamai, (although that caused a problem by being a bit too clever... hopefully solved now).

Unfortunately it sounds like despite the replication, there is still a single point of failure which brings the whole tumbling down when it fails.

I am quite surprised they moved repository.maemo.org to the new system all at once, instead of a gradual cut-over over a few weeks to limit the impact of faults. (Last time I moved a server I had old and new running in tandem for a couple of months, moving parts of the service one at a time.)

Also in retrospect perhaps Monday is a better day to cut-over to a new system and give it real load for the first time :)

Quote:
Originally Posted by BruceL (Post 476674)
With the maemo 5 push to have all apps moved to maemo repos it is imperative that the repos be reliable. It doesn't work to ask us to put all our apps on a central repo and then have that repo be unreliable. There should be a back-up repo or mirrors. Changing servers isn't a good excuse; especially just before a weekend. [...] please drop the request that developers abandon their own repositories for maemo extras.
+1 interesting.

If it can happen now, it can happen again. Having seen this happen today, and been unable to do a couple of things myself today because of needing some apps I couldn't install, I think if I publish anything of note for Maemo, especially if it's commercial, I'll be looking at hosting a copy outside maemo.org as well as inside, and providing instructions for both ways of getting it.

Blackbeard 2010-01-16 22:18
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by maxximuscool (Post 476797)
The server is still down here.
Ping it and got back bad address.

$ ping http://repository.maemo.org/extras/
ping: bad port spec 'http://repository.maemo.org/extras/'
~ $ ping repository.maemo.org
ping: bad address 'repository.maemo.org'
~$ host repository.maemo.org

returns NXDOMAIN. Looks a DNS problem to me.

guaka 2010-01-16 22:56
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Still down.

$ dig repository.maemo.org
[snip]
;; ANSWER SECTION:
repository.maemo.org. 12392 IN A 80.248.164.237


We should probably expect instability for a while once it's back since everybody will be hitting the host at once. I hope you're using something lightweight like nginx or lighttpd :)
Anyway, good luck getting it back!

jjx 2010-01-17 02:49
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by Blackbeard (Post 476990)
~$ host repository.maemo.org

returns NXDOMAIN. Looks a DNS problem to me.
Yes. Not just a DNS problem, though.

When it did resolve, I noted the IP. 80.248.164.237. I tried fetching a package by http using wget, from my N900 over the 3G and from a server in a UK data centre. Neither was able to establish a http connection. So there's a HTTP problem too, unless that IP was to the old server.

(I have no idea if it would have been possible to mitigate the problems, revert to the old server quickly, or hide the DNS transition by reducing TTL and forwarding requests between servers, due to Akamai's involvement which no doubt complicates things.)

jebba 2010-01-17 03:29
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
I wish I could bring up my thread on maemo-devel about how mirrors are needed, but that server is down too....

Here's google's cache of part of it at least:
http://tinyurl.com/y8jheyz

In it, I was 'splained to about how unnecessary such a thing would be. Mirrors? With akamai and the luck we have? Stupid me.


Quote:
Originally Posted by jebba
As far as I can tell, there are no mirrors of the repositories.

Most large (and even small!) free software projects have complete mirrors of their archives. There are a good number of reasons:

* Faster access to users that are far away on the network from the main repo.

* Failover, in case something should happen to the main repository.

* Distributes the load, so poor *.maemo.org doesn't get hit so hard.

* Distributes the bandwidth (costs) so it doesn't all fall on Maemo's shoulders.

Projects with mirrors include the kernel, kde, gnome, Fedora, Debian, etc. Basically every single distribution of note has a mirror--even the tiny ones.

All that would need to be done on the *.maemo.org infrastructure side would be to set up an rsync daemon. This is like 3 lines of configuration and can literally be done in minutes by a good admin.

Then someone could email a few of the big mirrors such as mirrors.kernel.org and ibiblio and voila! done.
Response snippets:

Quote:
Originally Posted by david greaves
Pretty sure Nokia/maemo.org went with a CDN which satisfies all the points you raised.

The maemo.org infrastructure problems are more to do with dynamic content and build services and are being addressed AFAIUI.
And

Quote:
Originally Posted by Jeremiah Foster
David is right on both counts. Most free software projects do have mirrors but we are lucky in having Nokia as a partner in Maemo because they have taken on the significant cost of pushing maemo.org content to mirrors. In this case the mirrors are a top notch Content Delivery Network.
...

That said, Jeremiah did encourage setting up a mirror later....

ydossow 2010-01-17 03:31
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by jjx (Post 477405)
Yes. Not just a DNS problem, though.
Actually, is also a DNS problem. try a query to ns.nokia.com, repository.maemo.com doesn't exists.

jebba 2010-01-17 03:38
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by ydossow (Post 477439)
Actually, is also a DNS problem. try a query to ns.nokia.com, repository.maemo.com doesn't exists.
Ya, true of all of their nameservers:

NS.NOKIA.COM
NS2.NOKIA.COM
NS3.NOKIA.COM
NS4.NOKIA.COM
NS5.NOKIA.COM
NS6.NOKIA.COM

But they have other problems as well. For instanace lists.maemo.org resolves, but is still down.

No updates here since yesterday (this is what I've found to usually have the "latest" info from admins):
http://www.qaiku.com/channels/show/maemork/

Jerryzhao26 2010-01-17 04:18
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
still not working, now. Sad...I can't get my input method,,,

jjx 2010-01-17 04:40
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
In a way analogous to "RAID is not a backup", today's lesson is "CDN is not a mirror". Thanks all for teaching it to me :)

qole 2010-01-17 05:10
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
jebba: you can also find a copy of the mailing lists on Nabble.

Here's the thread you were talking about...

qole 2010-01-17 05:15
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Sigh...

X-Fade on maemork:

"We have SAN issues on the machine hosting the repositories and the mail/list server. Work on bringing things back is ongoing."

ferenc's reply: "We did not survive the weekend.. Damn, things were too smooth yesterday."

jebba 2010-01-17 05:19
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by Jerryzhao26 (Post 477481)
still not working, now. Sad...I can't get my input method,,,
Gah, i just tried building wpasupplicant for someone. I built x86 version fine, but went to build ARMEL but I couldn't because NON-FREE SOFTWARE STRIKES AGAIN.

Can't install libqt4-dev because it needs libqt4-webkit.

Can't install libqt4-webkit because it needs libqt4-phonon.

Can't install libqt4-phonon because it needs libqt4-opengl.

Can't install libqt4-opengl because it needs libgles2

Can't install libgles2 (and other "open" GL foo) because it is NON-FREE SOFTWARE that's not in my mirror. And I can't get it from the non-free Nokia binaries repo, because it is dead.

Hence, no wpasupplicant.

I can't count how many times I have been thwarted developing for N900 because of down servers and non-free software. :(

Ciao.

tekojo 2010-01-17 06:47
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Actually we had two issues going on.

The repository server is down and the DNS started pointing to the wrong place and had to be cleared.

The DNS is now being changed back to Akamai, and the ISP is working to get stage (that's the origin for repository) back. However the weekend isn't apparently their best time.

jebba 2010-01-17 07:50
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
I set up a second mirror since the first one was pegging 100Mbit more or less. It's doing crude round-robin DNS to "load balance".

Netdepot was nice enough to do an OS install for lazy me at 10pm Saturday night, and directnic DNS changes are propagating already. :)

roney711 2010-01-17 09:52
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
i was trying to get repository( apps) but no luck its still giving me Error ... is it fix or something wrong with my phone ?

Thiis 2010-01-17 12:16
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
anyone who has an idea 'bout how much longer it's gonna take?
cuz i thought it'd be done by now but my repo's aren't working yet.

tekojo 2010-01-17 12:32
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by Thiis (Post 477906)
anyone who has an idea 'bout how much longer it's gonna take?
cuz i thought it'd be done by now but my repo's aren't working yet.
The ISP didn't give a time for the fix.
However tomorrow morning it has to come back.

And I'll have a pretty angry phone call with them as soon as there is someone else to talk to except their help desk. (no point yelling to those guys, as they aren't to blame)

The DNS should also be updated at the same time as the machine comes online.

jebba 2010-01-17 15:36
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
I brought up a third mirror at a second data center doing round robin DNS for "load balancing". The first two are in Dallas, the third in Atlanta. All hosted with http://netdepot.com . :)

For details on setting up your N900 to use the mirrors see:

http://espejo.freemoe.org/

Ali 2010-01-17 15:37
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by tekojo (Post 474703)
Except for that the repositories just started suffering from a problem called 'last mile acceleration'. Akamai is being helpful and opening the packages.gz files on the fly, which confuses the application manager and apt-get.

The visible result is an error in trying to update any repository.

Incident has been reported. Hope akamai reacts quickly.
when is the problem solved of the repositories???
have someone info about that?

Ali 2010-01-17 15:41
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
my internet pages taking to long to load the full page!!!
can anyone tll me why it does that??

mullf 2010-01-17 15:57
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by Ali (Post 478206)
my internet pages taking to long to load the full page!!!
can anyone tll me why it does that??
Time dilation? How fast are you moving?

fpp 2010-01-17 16:21
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by jebba (Post 478201)
I brought up a third mirror at a second data center doing round robin DNS for "load balancing". The first two are in Dallas, the third in Atlanta. All hosted with http://netdepot.com . :)
For details on setting up your N900 to use the mirrors see:
http://espejo.freemoe.org/
Again, thanks for this. Your mirrors work really well, and have saved many of us from a boring weekend without any apps to test on ou N900s! :-)

jebba 2010-01-17 16:32
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
The curious can see really basic webstats of the mirrors here:

http://mas.freemoe.org/cgi-bin/anlgform.cgi
http://masymas.freemoe.org/cgi-bin/anlgform.cgi
http://masymasymas.freemoe.org/cgi-bin/anlgform.cgi

Ali 2010-01-17 16:50
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by mullf (Post 478223)
Time dilation? How fast are you moving?
i sit and dont move but even then it takes too muvh time to load the hole page!
is it maybe related to the internetconnection which i use??? or is it something else what can be solved?
can u tell me how?

fpp 2010-01-17 16:55
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by jebba (Post 478271)
Wow, almost 70 GB... not bad :-)

jebba 2010-01-17 16:57
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by Ali (Post 478299)
i sit and dont move but even then it takes too muvh time to load the hole page!
is it maybe related to the internetconnection which i use??? or is it something else what can be solved?
can u tell me how?
They are playing with you, and perhaps you, us. Read this thread. The servers are broken. As a workaround, you can read this to use a mirror:

http://espejo.freemoe.org/

Wikipedia describes what a "mirror" is in computer language:
http://en.wikipedia.org/wiki/Mirror_%28computing%29

chargen 2010-01-17 16:57
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
I'm trying to install syslog, klog and the bluez tools. They don't show up in the application manager after enabling the 'tools' respository on a mirror. Is this only a partial mirror, or can the packages I need only be installed from the command line? (I have not enabled root access on this device yet)

jebba 2010-01-17 17:00
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Quote:
Originally Posted by chargen (Post 478311)
I'm trying to install syslog, klog and the bluez tools. They don't show up in the application manager after enabling the 'tools' respository on a mirror. Is this only a partial mirror, or can the packages I need only be installed from the command line? (I have not enabled root access on this device yet)
syslog is in extras-devel, not tools.

The mirrors are full but of free software only.

trin20t 2010-01-17 17:02
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Can someone direct me in backup repositories for Bora that work? I need Python 2.5.armel and Mplayer.

Coopa129 2010-01-17 17:34
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Anyone have any idea when the repositories are gonna be back up? I reinstalled the last update and I got a back of my app list but i gotta redownload and reinstall them all. It's annoying not having any of my apps!!!

Ali 2010-01-17 17:44
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
i sttill have the same problem with my internet!!!
it doesnt load the hole page the loading line stuck at the end and sometimes wile i'm on internet doing my things it just crash for no reason and then appear internal fault application web closed!!

can some one help me to solve this problem???Please

N900!!! the best a man can get!

jscribble 2010-01-17 17:48
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
First, a big thank you to everyone who has been working on the server move, and now hounding the provider for a solution.

As of now, I am still unable to refresh repos, in the us. I also was one of the lucky ones who reflashed just about the time it seems the repos went down, so I am fervently reading any and all new information here. Thanks again to everyone busting *** to get this fixed, and to all that are posting (applicable) info as it comes.

Moz 2010-01-17 17:59
Re: maemo.org server move Friday 15.1 08:00 UTC ->
 
Mirrors can't take the load? 1st and 2nd can not be reached by me.


All times are GMT. The time now is 05:48.
Page 2 of 3 1 2 3
Show 40 post(s) from this thread on one page

vBulletin® Version 3.8.8