Thread: Glype CPU Usage

I'm running a HP DL-380 G5 here, so I don't normally worry about CPU usage. But suddenly CPU usage is forcing me to take notice.

A quick look at `top` shows (unsurprisingly) that httpd is the troublemaker.

Code:

last pid:  2794;  load averages: 20.33, 18.57, 16.47                                                     up 2+00:44:17  03:41:10
551 processes: 21 running, 530 sleeping
CPU states: 10.4% user,  0.0% nice, 88.4% system,  0.3% interrupt,  0.9% idle
Mem: 12G Active, 9534M Inact, 584M Wired, 77M Cache, 214M Buf, 1215M Free
Swap: 4096M Total, 1610M Used, 2486M Free, 39% Inuse, 1408K In

  PID USERNAME    THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
81219 www           1 103    0  3156M  2107M RUN    0  45:56 35.50% httpd
77911 www           1 103    0  1903M  1169M CPU1   1  21:59 32.47% httpd
91402 www           1 103    0   905M   749M RUN    1   5:19 32.08% httpd
91429 www           1 103    0  1404M   979M RUN    6  12:20 31.59% httpd
77824 www           1 103    0   340M 89336K RUN    7   1:00 31.49% httpd
77844 www           1 103    0   921M   329M RUN    7   6:36 31.05% httpd
91075 www           1 103    0  1428M   439M RUN    5  24:26 30.66% httpd
91206 www           1 102    0  1226M   425M RUN    5  20:08 30.57% httpd
77772 www           1 102    0   591M   363M RUN    1   4:06 30.27% httpd
87212 www           1 102    0   686M   137M RUN    7   6:10 29.98% httpd
77962 www           1 102    0   913M   761M CPU5   5  10:41 29.69% httpd
91463 www           1 102    0  2099M  1082M RUN    7  24:07 29.30% httpd
77891 www           1 102    0  1987M  1102M CPU7   3  23:35 28.86% httpd
91211 www           1 102    0  3209M   984M RUN    1  45:44 28.76% httpd
77927 www           1 102    0  2118M  1054M CPU4   4  25:41 28.27% httpd
77955 www           1 102    0  1712M   956M RUN    6  19:35 28.27% httpd
91438 www           1 102    0   801M   549M RUN    4   7:57 27.88% httpd
77967 www           1 102    0  1547M  1214M CPU3   3  27:12 27.78% httpd
 1427 mysql        10  46    0   498M 72956K ucond  7   2:03 23.97% mysqld
91005 www           1   4    0   164M 18704K sbwait 6   0:18 18.65% httpd
77961 www           1  58    0   165M 18732K select 0   0:35 10.60% httpd
...

But what are those httpd procession doing? Well, if we look through Apache Server Status, we see that all of the top processes are running Glype's browse.php:

Code:

298-3  81219 2/1296/1296  W 12.16   4927 0     29.5  5.66   5.66   213.190.158.162                 www.abeboproxy.com              GET /browse.php?u=ff45b3baeee7Oi8vcy5iZWJvLmNvbS9qcy9zd2ZvYmplY

171-3  77911 2/2107/2107  W 22.82   2836 0     6.7   8.90   8.90   62.6.169.133                    www.abeboproxy.com              GET /browse.php?u=5a84eb991af7Oi8vcy5iZWJvLmNvbS9qcy9zd2ZvYmplY

1001-3 91402 1/876/876    W 11.48   1000 0     0.0   4.72   4.72   195.7.43.146                    www.abeboproxy.com              GET /browse.php?u=fa02cbf070b5cd31cdOi8vcy5iZWJvLmNvbS9qcy9zd2Z

1027-3 91429 0/840/840    W 12.09   1801 0     0.0   3.86   3.86   213.190.158.162                 www.abeboproxy.com              GET /browse.php?u=bac3841d721f11baOi8vcy5iZWJvLmNvbS9qcy9zd2ZvY

86-3   77824 2/1349/1349  W 21.41   70   0     6.7   6.41   6.41   62.6.169.133                    www.abeboproxy.com              GET /browse.php?u=fbea00149def772Oi8vcy5iZWJvLmNvbS9qcy9zd2ZvYm

106-3  77844 2/2329/2329  W 30.22   1120 0     6.7   9.28   9.28   62.6.169.133                    www.abeboproxy.com              GET /browse.php?u=1cba217a5ffe6054e6Oi8vcy5iZWJvLmNvbS9qcy9zd2Z

694-3  91075 2/533/533    W 7.32    3259 0     6.7   1.38   1.38   62.6.169.133                    www.abeboproxy.com              GET /browse.php?u=fdcbac7539406Oi8vcy5iZWJvLmNvbS9qcy9zd2ZvYmpl

815-3  91206 18/564/564   W 7.15    2462 0     54.9  2.69   2.69   77.108.110.26                   www.abeboproxy.com              GET /browse.php?u=7b16b0ada59e4cOi8vYWQuZ2xvYmFsaW50ZXJhY3RpdmU

34-3   77772 3/1652/1652  W 18.56   646  0     67.7  6.62   6.62   194.210.105.81                  www.abeboproxy.com              GET /browse.php?u=0d40ebfa9fad0Oi8vYWQueWllbGRtYW5hZ2VyLmNvbS9z

Is anyone else seeing this?

What do you do to manage and optimize your Glype proxies?

My PHP error log is also being spammed with this error several times a second:

Code:

16-Feb-2009 03:53:16] PHP Notice:  Undefined variable: url in /usr/local/www/data/abeboproxy.com/includes/init.php on line 527

I don't know if that's related.

What do you think?

Will I can't even fake that I know what I am doing here the guy who configures my servers installed bcompiler and APC I know that increased performance by a large amount went 33%CPU usage on surfunblocked to 8%CPU he tried to explain it all but I dont get it I just know it uses caching which is great for any of these "encoded scripts" which I think glype does have some encoded things.
Prior to this I apache was hanging a lot and was in need of constant rebooting. Now it runs without the need for apache reboots.
Even though mine are not Glype might be something to look into

It seems Mr.Bill is running an old version of Acio. Acio worked very well with bcompiler but I dropped it as the developer went missing.

Can you give us more info Will? What version of glype with what specific settings? YouTube enabled or not?

It seems Mr.Bill is running an old version of Acio

It's actually the newest and using a different encoding then the others. Owners not missing he is around. Just talked with him the other day if you visit acioscript.com the home site you will see its hosted on my server.

Originally Posted by nessie

Can you give us more info Will? What version of glype with what specific settings? YouTube enabled or not?

I'm running 1.1.

I am running it with all the defaults, except that I just set unique_urls to true.

Where do I enable YouTube? I don't see an option in settings.php.

Originally Posted by Mr.Bill

It's actually the newest and using a different encoding then the others. Owners not missing he is around. Just talked with him the other day if you visit acioscript.com the home site you will see its hosted on my server.

Glad to hear that. I tried pm'ing him twice within three months time at DP. Then i emailed his hotmail email found from domain whois. Got a reply after a two or three weeks but no reply after that. May be he has lost interest in Acio He didn't sound like another pepsipunk though

I like his script. It's a shame if he drops it. It had lot of potential.

Originally Posted by Will.Spencer

I'm running 1.1.

I am running it with all the defaults, except that I just set unique_urls to true.

Where do I enable YouTube? I don't see an option in settings.php.

I was thinking about Glype YouTube plugin. You should install it manually.

Things you can try;
1. In apache configuration [httpd.conf] set KeepAlive off.
2. Check the sizes of your apache logfiles. Make logrotate to rotate apache logs daily instead of weekly/monthly.

It's very odd for httpd processes to consume ~1GB memeory. Something has definitely gone wrong there.

Originally Posted by nessie

I was thinking about Glype YouTube plugin. You should install it manually.

This proxy is targeted towards Bebo , so YouTube isn't all that important.

Originally Posted by nessie

Things you can try;
1. In apache configuration [httpd.conf] set KeepAlive off.
2. Check the sizes of your apache logfiles. Make logrotate to rotate apache logs daily instead of weekly/monthly.

I just turned KeepAlive off as a test.

I've had all Apache access logs disabled for the last few days.

Originally Posted by nessie

It's very odd for httpd processes to consume ~1GB memeory. Something has definitely gone wrong there.

It appears to be limited to httpd processes which are running Glype's browse.php.

I notice occasionally I see a process sit at high cpu usage. I haven't really dug into it with strace or anything, but my assumption is that someone is downloading a file.

Do you have any max file sizes in place? How about a bandwidth limit? I'm not sure on this, just guessing though.

What you can do is actually attach to the PID of the httpd with strace to see exactly what it is doing. At high cpu usage it might flood ya so piping to a file to read later might be useful.