Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

I did comparison between KPv48 and KPv48_Compcache and it seems that RAM and swap usages are both higher with compcache.

What I did: openend microb and did some surfing and monitored Conky. Then left only Conky running and checked RAM and swap after some 5min of idle.

KPv48
RAM: ~170MB
Swap: 90MB

KPv48_Compcache (disksize 98304)
RAM: ~200MB
Swap: 120MB

Wonder why RAM and swap usage is so much higher? I tried to do excatly same things in both cases.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Swap use is higher...Because you now have less RAM...

I imagine the 'swap settings for high I/O' or whatever that thread was called has more appropriate swap settings than say swappolube defaults.

Reasoning is swappolube optimises for minimal swapping (hence low swappiness) and the 'high I/O' settings optimise for lots of little swaps.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Exactly, bellow are my settings

... and swap on microsd

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Of cource, what was I thinking :o

If we run out of RAM, could this cause lack of responsiveness due to heavy swapping activity? Just trying to understand what is causing quite big loading conditions in my system when using Compcache.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

I did the following as root in xterm and got errors

insmod /lib/modules/current/ramzswap.ko disksize_kb=120512 = -1 invalid module format
swapon /dev/ramzswap0 = no such file/dir

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

use the kernel from the first post, ok?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

when swap full, phone become laggy

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

what disksize_kb are you using. Also do you use some speedpatches?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

use yours recommend size 120512, speedpatch? I removed

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

And you are sure speedpatch uninstalls correctly? No remnants? Anyway we are still trying to discover what are the best settings to be used with compcache.
For now you may try (in xterm as root)

echo 20 > /proc/sys/vm/swappiness
echo 2 > /proc/sys/vm/page-cluster

hoping that other vm settings are stock. if that not help then I can bet you have some remnants from some optimization script that have messed your /proc/sys/vm/ (and who knows what else) values. In case lagging continues would you please do cat /proc/sys/vm/* and copy the result here

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

ok, I try that setting now, see whether lagging for not
by the way, would you mind make a startup script for that??
thx

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Lets first find which are the best values, making startup script is easy.

And BTW you can try lowering disksize_kb to 98304 if swapinness and page-cluster does not have effect.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

no need test other setting i think....because the laggy is seem solved , thanks!

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Create this file /etc/event.d/compcache

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

after boot up, hanged...

DEL

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Thanks,but,but...

WTF is that? Where did you get this settings from?

Realy, you (and others with "optimizations") don't help much with testing compcache using in parallel /proc/sys/vm settings different from stock (excluding swappiness and page-cluster). laptop_mode == 1. And we are testing swap?!?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Are you still unable to boot?

If you are able may I have your /proc/sys/vm settings please.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

everything is fine, no more bad lagging. By the way, here is the result, wonder which I could be set to improve more. I reinstalled the speedpatch, still working fine! swapiness to 20 and page cluster to 2, help a lot

0
10
500
40
500
0
0
59326
30000 30001 30002 30003 0 0 0 0
45
32768
208840
-66
98304
-121
131072
1024
32
0
65536
2039
4096
2
0
0
0
50
2
0
0
20
100

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

@TMavica - and do you thing there is an improvement on responsiveness, or things are just the same?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

swapiness = 10
runs smooth enough except switching from task manager to app due to io load 50-75%, managed to open about 5 XTerms, 6 Browser tabs, Contacts, Messaging, FBReader, MediaBox, Modest, RSS, File Browser, Calendar with noticable lag in switching (due to high io load).
I've also got a bit tuned syspart (/usr/share/policy/etc/rx51/syspart.conf)
looking forward getting memory free fully working as it's a big stopper at the moment IMO.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Ok, swapolube optimisations removed set to stock values.
Speedpatch removed.

Still lagging a bit once cache is full.
Since I'm not exactly knowledgable on this are there any more values I need to correct?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Will you try page-cluster values 0,1,2 to see if there is any difference?

Re memory free - it is working OK, trust me on that. My understanding is that what happens is the best possible scenario, i.e. instead of notification for a page that was just marked as unused it is immediately overwritten. While we have notifications for the pages that are not immediately overwritten.
For sure there are optimizations to be done, if you look at the code there is a mutex used on write operations.

And for the amount of applications you are testing with - try that on your laptop and tell me how it went :p

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Responsiveness MUCH improved with page-cluster set to 0 and swappiness set to 10

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Yes, I feel the responsiveness is improved, but not a lot

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Intrigued as to how phone-ui is with this added. I'm in the middle of a prepping a reflash to end all reflashes of my phone. Off topic, but so far, the best "feel" gains have been eMMC fully ext3 and swap only on SD card (things like Fapman zip along and I can fuddle with the phone doing other stuff while it's doing it's thing) but the phone-ui still remains a stuttering mess.

Either way, will give this a shot later after work, unless someone has beaten me too it.

Cheers @freemangordon et al, for your continued efforts towards this community and unique piece of hardware :)

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

@gregoranderson - I would recommend to wait before trying it a little bit, today I will try to make optimizations to the way swap read/write/free requests are handled, at this point compcache does not bring much improvement, while could lead to laggy system from time to time. The "testing" so far was to prove that it is working at all, without oops and hangs.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Hey, start a new thread on 'the flash to end all re-flashes', this could lead to some interesting discussion!

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

OK guys, my conclusions so far:

1 - compcache works :D
2 - Anything above (lets's say) 64-96 MBs for disksize_kb results in a massive swap trashing at some point in time. Yesterday it was the first time for maybe an year I missed a call because the UI was stuck (because of the swap trashing)
3 - using the above size should not harm , only can improve things, but no wonders. I setup my primary phone that way, so will see how it will progress with time.
4- The only viable option so far to get rid of the UI lag is to move swap on SD card. Even if it is class 2 you forget about lagging.

I don't think I can do much more on that, sorry.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

I havent swap on sd card, let me trytry

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

sorry for disturbance..
how to swap on sd card..cant find the wiki

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

And you MUST use setting from here.

Anyway, this is going OT

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

that was my finding also. not a good idea to grab more than half available physical ram for swapz. you don't want to pass each and every call for ram allocation through the swap mechanism. I have such a low disksize for a frew days now and it works, no lags, no crashes, no wonders.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Did you try with 96MB?

And would you share your other settings:

where is your swap located at
/proc/sys/vm changes
io scheduler changes (if any)

what else?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

I tried with 96mb only for a while and while I did not see heavy lags, I noticed nokia maps to take too long to start. Swappiness to 30 and laptop mode to 0 as is default. Nothing else changed. No magic script nor magic carpets. Swap is the default p3 cause I can’t get bothered to repartition my sd card although since you say it’s the best bet for improved performance I will try it when I find the time.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

And:

...seems to be impossible to fix, currently?

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Should be posible, but I don't think we will gain anything but additional overhead. You can check upstream zram, they are not using notifications at all, does not seem to have much negative effect. The problem is that SW running on n900 needs lots of RAM and not having it (because it is used by compcache) leads to constant swapping (swap trash).

Anyway there is definitely improvement from using compcahe, just not so much that was probably expected. Use disksize_kb in range 64MB to 96MB and you will see it.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Thanks for all your effort - I've not had any "exaggerated" expectations, and it's already great thing that you've bring it to us. I think it's closest of what we can get, to actual higher RAM amount :)

So, thanks for doing something, that no one else was able/interested to bring us.

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Friends, I tried swap on SD:

ramzswap (120504), mmcblk0p3, mmcblk1p2 (796472) with priority 1, 0, 0 and with your setting recommanded, but still sometimes the UI got some laggy.

Moreover, I made a script for bootup, only can swapon ramzswap and mmcblk0p3, mmcblk1p2 cant swapon at bootup
from added a more line here, http://talk.maemo.org/showpost.php?p...8&postcount=95

Re: [ANNOUNCE] COMPCACHE on kernel-power (now with notifications)
 

Use only 64-96 MBs for ramzswap. And do not use mmcblk0p3, only SD card swap partition. And just to make sure put /sbin/ in front of swapon/swapoff commands

EDIT: and change first line of your script to "start on started rcS-late"