maemo.org - Talk - wiki.maemo.org : current archive and future

maemo.org - Talk (https://talk.maemo.org/index.php)

- Community (https://talk.maemo.org/forumdisplay.php?f=16)

- - wiki.maemo.org : current archive and future (https://talk.maemo.org/showthread.php?t=87808)

Re: wiki.maemo.org : current archive and future

so good so far:
http://maemo-archive.wedrop.it/

Thanks Sebastian Lauwers aka Crashanddie aka teotwaki.

Much needed: a way to create a semi-decent backup of wiki.maemo.org. Mere wget will fail since there are too many pages/links like "edit", "history", etc. I seem to recall somebody talking about a script that uses http://wiki.maemo.org/Special:AllPages and http://wiki.maemo.org/Special:Export.

/j

[edit]
[2012-11-11 03:32:09] <Skry> I did wget --convert-links for pages in AllPages, then, cat ./* | grep -o '<a .*href=.*>' | sed -e 's/<a/\n<a/g' | sed -e 's/<a .*href=['"'"'"]//' -e 's/["'"'"'].*$//' -e '/^$/ d' | grep http\:\/\/wiki.maemo.org\/ | sed 's/^http\:\/\/wiki.maemo.org\///' | sed '/index.php/d' | sed -n 'G; s/\n/&&/; /^$[ -~]*\n$.*\n\1/d; s/\n//; h; P' | sort | xclip and pasted the result in export page

[2012-11-11 04:10:05] <Skry> merlin1991: https://dl.dropbox.com/u/49989728/maemo_wiki_main.txt
[2012-11-11 04:16:22] <Skry> https://dl.dropbox.com/u/49989728/maemo_wiki_file.txt
[2012-11-11 04:19:17] <Skry> https://dl.dropbox.com/u/49989728/maemo_wiki_user.txt
[2012-11-11 04:21:45] <Skry> https://dl.dropbox.com/u/49989728/maemo_wiki_talk.txt
[2012-11-11 04:25:08] <merlin1991> curl -X POST -d catname= -d curonly=1 -d wpDownload=1 --data-urlencode pages@$PAGESFILE -o $OUTFILE http://wiki.maemo.org/index.php?titl...&action=submit

Re: wiki.maemo.org : current archive and future

If one wants to grab the media files aswell, this snipped worked for me (all the media files are in the xml that comes from maemo_wiki_file.txt):

Code:

egrep "<title>File:[^<]+</title>" $XMLFILEFROMFILETXT | cut -d ':' -f 2 | cut -d '<' -f 1 > $SOMEFILE



while read line; do curl -GL -o "$line" "http

://wiki.maemo.org/index.php?title=Special:FilePath&file=$line"; done < $SOMEFILE

Re: wiki.maemo.org : current archive and future

im willing to help to create backup but i don't know how to create backup. if anyone can guide me then im more than happy to help you people.

Re: wiki.maemo.org : current archive and future

well there are several options yet ...

how big a such archive would be ?

may we release it for the end of the world day , around 20th december 2012 ? or let's say for jan 2013 ?

this snapshot archive could be mirrored then ....

Re: wiki.maemo.org : current archive and future

Need to backup also:
http://repository.maemo.org/stable/ (there is scratchbox instalaltion)
http://tablets-dev.nokia.com/MADDE.php (there is madde installation + n900 virtual qemu image)

Re: wiki.maemo.org : current archive and future

Quote:

Originally Posted by pali (Post 1292945)

Need to backup also:
http://repository.maemo.org/stable/ (there is scratchbox instalaltion)
http://tablets-dev.nokia.com/MADDE.php (there is madde installation + n900 virtual qemu image)

Lets keep this thread for the wiki and use that one for other actions :

http://talk.maemo.org/showthread.php?t=87815

Re: wiki.maemo.org : current archive and future

Please don't panic.

We haven't received any notification about these systems going down, so it's more probably that it's simply problems of availability.

Maemo's wiki and Garage problems during this week happened while X-Fade was travelling, now he's looking into it. However, I'm not so sure about Meego's wiki.

If everyone starts doing their own backups, it's probably that we overload servers.

During last Council, it was decided to form a group of system administrators to take care of the infrastructure once it gets migrated, so it would be better if the backups where made by them in a coordinated and organised way.

Re: wiki.maemo.org : current archive and future

Quote:

Originally Posted by ivgalvez (Post 1292976)

Please don't panic.

If everyone starts doing their own backups, it's probably that we overload servers.

During last Council, it was decided to form a group of system administrators to take care of the infrastructure once it gets migrated, so it would be better if the backups where made by them in a coordinated and organised way.

That's the reason of my threads

http://talk.maemo.org/showthread.php?t=87815# How to be efficient on this survival plan ? #MaemO #MeeGo #HarmattaN !n950club #n900 #n9 #mer

Re: wiki.maemo.org : current archive and future

we're improving ;

http://talk.maemo.org/showthread.php?t=87815# How to be efficient on this survival plan ? #MaemO #MeeGo #HarmattaN !n950club #n900 #n9 #mer