New stacker performance results

From: serue@private
Date: Wed May 18 2005 - 08:51:01 PDT


Hi,

I've completed a set of stacker performance tests using our automated test
platform.  The machine I'm using right now will go away soon, but we're
working on a set of (ppc64) partitions for selinux testing under the same
platform.  I am reporting on one particular set of results, but if you
want anything changed - ie if you want profiling info - I should be able
to run more/new tests during the rest of this week at least.

I used a 2xamd64 machine with smp enabled, preemption disabled, running
fedora core 3 enforcing a custom dummy selinux policy.  The kernel was
2.6.12-rc2.  The sets of tests were run twice each on kernels with
	selinux and capability enabled
and
	stacker, selinux, and the stacking capability module enabled

Each of this was done once with two cpus, and once with "max_cpus=1"
specified on the command line.

Tests run were dbench, reaim, fsx-linux, and tbench.   fsx-linux appears
to be purely a stability test, and all runs succeeded.  Results for the
other benchmarks are included in this message.

In addition I also ran kernbench.  For the 2-cpu results, these were
part of a run with profiling enabled (affecting performance).  For the
1-cpu results, they were done along with the other benchmarks, without
profiling.

Following are the summarized results.  Of course, 'nostack' refers to a
kernel compiled without stacker, and 'stack' refers to a kernel with
stacker.  The 2-cpu results come first, followed by the 1-cpu results.

Finally, the stacking patches applied are the ones currently on
sf.net/projects/lsm-stacker in the stacking-patches.tar.gz file.  The
file called 'series' lists the order in which they are applied.

thanks,
-serge

PS - I just need to add a bit of boot time checking for non-selinux
kernels to relabel filesystem after reboot, then will be ready to use
the test platform to do selinux vs non-selinux performance testing as
well.  Our partitions will be 1, 4, 8, and 16 cpus providing for smp
testing as well - hopefully those will be ready by next week.


******************************************************************
******************************************************************
**************************  SMP RESULTS **************************
******************************************************************
******************************************************************

******************************************************************
dbench:
******************************************************************
nostack:
4 clients started
2     59047  1315.65 MB/sec
0     62477  1296.84 MB/sec
Throughput 1296.79 MB/sec 4 procs

4 clients started
   2     59162  1319.01 MB/sec
   0     62477  1304.69 MB/sec
Throughput 1304.61 MB/sec 4 procs

stack:

4 clients started
   2     59181  1320.55 MB/sec
   0     62477  1264.77 MB/sec
Throughput 1264.72 MB/sec 4 procs

4 clients started
   2     57840  1293.95 MB/sec
   0     62477  1241.75 MB/sec
Throughput 1241.7 MB/sec 4 procs

******************************************************************
reaim
******************************************************************
nostack

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.05     0.02    0.01    122400.00  122400.00  0.00     0.00     100  
3       0.05     0.04    0.04    367200.00  122400.00  0.01     20.41    79   
5       0.07     0.06    0.07    437142.86  87428.57   0.01     12.90    87   
7       0.11     0.08    0.11    389454.55  55636.36   0.02     23.15    76   
9       0.13     0.10    0.13    423692.31  47076.92   0.02     22.96    77   
Max Jobs per Minute 437142.86

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.06     0.01    0.01    102000.00  102000.00  0.00     0.00     100  
3       0.06     0.04    0.04    306000.00  102000.00  0.01     26.73    73   
5       0.07     0.06    0.07    437142.86  87428.57   0.01     14.29    85   
7       0.11     0.09    0.09    389454.55  55636.36   0.01     14.66    85   
9       0.14     0.10    0.13    393428.57  43714.29   0.02     19.57    80   
Max Jobs per Minute 437142.86

stack

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.06     0.01    0.02    102000.00  102000.00  0.00     0.00     100  
3       0.04     0.04    0.04    459000.00  153000.00  0.00     12.86    87   
5       0.08     0.06    0.07    382500.00  76500.00   0.01     15.65    84   
7       0.11     0.09    0.10    389454.55  55636.36   0.01     8.45     91   
9       0.14     0.12    0.12    393428.57  43714.29   0.03     23.47    76   
Max Jobs per Minute 459000.00

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.07     0.01    0.02    87428.57   87428.57   0.00     0.00     100  
3       0.05     0.04    0.04    367200.00  122400.00  0.01     20.41    79   
5       0.07     0.06    0.08    437142.86  87428.57   0.01     20.11    79   
7       0.10     0.09    0.10    428400.00  61200.00   0.02     18.11    81   
9       0.15     0.12    0.12    367200.00  40800.00   0.03     21.52    78   
Max Jobs per Minute 437142.86


******************************************************************
tbench
******************************************************************
nostack

1 clients started
   1     41049  236.11 MB/sec
   0     62477  230.37 MB/sec
Throughput 230.368 MB/sec 1 procs

1 clients started
   1     41418  236.52 MB/sec
   0     62477  232.07 MB/sec
Throughput 232.068 MB/sec 1 procs

stack

1 clients started
   1     41029  236.10 MB/sec
   0     62477  230.75 MB/sec
Throughput 230.742 MB/sec 1 procs

1 clients started
   1     41463  236.53 MB/sec
   0     62477  231.87 MB/sec
Throughput 231.86 MB/sec 1 procs

******************************************************************
kernbench  (different set of testruns)
******************************************************************
nostack (run 1)
169.13user 30.91system 1:40.91elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.55user 30.44system 1:40.81elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.36user 30.67system 1:40.86elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k

(run 2)
169.40user 30.39system 1:40.89elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.32user 30.44system 1:40.76elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.16user 30.59system 1:40.63elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k

sys average: 30.573333 stdev .178948

stack (run 1):
169.36user 31.18system 1:41.23elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.38user 31.34system 1:41.26elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.50user 31.09system 1:41.17elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k

(run 2)
169.32user 30.90system 1:40.91elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.12user 31.11system 1:40.93elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
169.25user 30.92system 1:40.87elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k

sys average: 31.090000 stdev .150555

******************************************************************
******************************************************************
*************************  1-cpu RESULTS *************************
******************************************************************
******************************************************************

(smp compiled in, but boot param "max_cpus=1" specified.)

******************************************************************
dbench:
******************************************************************
nostack

4 clients started
   2     58485  1305.96 MB/sec
   0     62477  1280.57 MB/sec
Throughput 1280.5 MB/sec 4 procs

4 clients started
   2     55942  1253.94 MB/sec
   0     62477  1189.63 MB/sec
Throughput 1189.58 MB/sec 4 procs

stack

4 clients started
   2     54967  1233.77 MB/sec
   0     62477  1157.91 MB/sec
Throughput 1157.87 MB/sec 4 procs

4 clients started
   2     54330  1215.41 MB/sec
   0     62477  1193.88 MB/sec
Throughput 1193.83 MB/sec 4 procs

******************************************************************
reaim
******************************************************************
nostack

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.06     0.01    0.01    102000.00  102000.00  0.00     0.00     100  
3       0.06     0.04    0.04    306000.00  102000.00  0.01     35.36    64   
5       0.08     0.06    0.07    382500.00  76500.00   0.01     21.19    78   
7       0.09     0.09    0.09    476000.00  68000.00   0.02     24.81    75   
9       0.14     0.12    0.12    393428.57  43714.29   0.02     22.38    77   
Max Jobs per Minute 476000.00

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.06     0.02    0.01    102000.00  102000.00  0.00     0.00     100  
3       0.05     0.03    0.04    367200.00  122400.00  0.00     10.88    89   
5       0.08     0.05    0.08    382500.00  76500.00   0.01     21.40    78   
7       0.11     0.09    0.09    389454.55  55636.36   0.01     11.17    88   
9       0.14     0.11    0.12    393428.57  43714.29   0.02     18.07    81   
Max Jobs per Minute 393428.57


stack

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.05     0.01    0.01    122400.00  122400.00  0.00     0.00     100  
3       0.05     0.04    0.04    367200.00  122400.00  0.01     20.41    79   
5       0.08     0.07    0.06    382500.00  76500.00   0.00     5.56     94   
7       0.12     0.10    0.09    357000.00  51000.00   0.01     13.52    86   
9       0.13     0.13    0.12    423692.31  47076.92   0.02     20.40    79   
Max Jobs per Minute 423692.31

Num     Parent   Child   Child  Jobs per   Jobs/min/  Std_dev  Std_dev  JTI
Forked  Time     SysTime UTime   Minute     Child      Time     Percent 
1       0.06     0.02    0.02    102000.00  102000.00  0.00     0.00     100  
3       0.05     0.04    0.04    367200.00  122400.00  0.01     20.41    79   
5       0.08     0.07    0.06    382500.00  76500.00   0.01     18.81    81   
7       0.11     0.10    0.09    389454.55  55636.36   0.01     7.73     92   
9       0.14     0.11    0.13    393428.57  43714.29   0.02     18.07    81   
Max Jobs per Minute 393428.57

******************************************************************
tbench
******************************************************************
nostack

1 clients started
   1     41485  236.59 MB/sec
   0     62477  232.49 MB/sec
Throughput 232.489 MB/sec 1 procs

1 clients started
   1     42198  238.51 MB/sec
   0     62477  235.67 MB/sec
Throughput 235.659 MB/sec 1 procs

stack

1 clients started
   1     43927  250.33 MB/sec
   0     62477  240.07 MB/sec
Throughput 240.061 MB/sec 1 procs

1 clients started
   1     40385  233.38 MB/sec
   0     62477  227.70 MB/sec
Throughput 227.694 MB/sec 1 procs

******************************************************************
kernbench  (different set of testruns)
******************************************************************
nostack

169.07user 29.27system 1:39.99elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
168.83user 29.69system 1:40.10elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
168.84user 29.46system 1:40.07elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k

sys average: 29.473333 stdev 0.171723

stack

168.60user 29.42system 1:40.05elapsed 197%CPU (0avgtext+0avgdata 0maxresident)k
168.42user 29.52system 1:39.78elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k
168.85user 29.28system 1:39.87elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k

sys average: 29.406667 stdev 0.098432



This archive was generated by hypermail 2.1.3 : Wed May 18 2005 - 08:51:20 PDT