Hi, I've completed a set of stacker performance tests using our automated test platform. The machine I'm using right now will go away soon, but we're working on a set of (ppc64) partitions for selinux testing under the same platform. I am reporting on one particular set of results, but if you want anything changed - ie if you want profiling info - I should be able to run more/new tests during the rest of this week at least. I used a 2xamd64 machine with smp enabled, preemption disabled, running fedora core 3 enforcing a custom dummy selinux policy. The kernel was 2.6.12-rc2. The sets of tests were run twice each on kernels with selinux and capability enabled and stacker, selinux, and the stacking capability module enabled Each of this was done once with two cpus, and once with "max_cpus=1" specified on the command line. Tests run were dbench, reaim, fsx-linux, and tbench. fsx-linux appears to be purely a stability test, and all runs succeeded. Results for the other benchmarks are included in this message. In addition I also ran kernbench. For the 2-cpu results, these were part of a run with profiling enabled (affecting performance). For the 1-cpu results, they were done along with the other benchmarks, without profiling. Following are the summarized results. Of course, 'nostack' refers to a kernel compiled without stacker, and 'stack' refers to a kernel with stacker. The 2-cpu results come first, followed by the 1-cpu results. Finally, the stacking patches applied are the ones currently on sf.net/projects/lsm-stacker in the stacking-patches.tar.gz file. The file called 'series' lists the order in which they are applied. thanks, -serge PS - I just need to add a bit of boot time checking for non-selinux kernels to relabel filesystem after reboot, then will be ready to use the test platform to do selinux vs non-selinux performance testing as well. Our partitions will be 1, 4, 8, and 16 cpus providing for smp testing as well - hopefully those will be ready by next week. ****************************************************************** ****************************************************************** ************************** SMP RESULTS ************************** ****************************************************************** ****************************************************************** ****************************************************************** dbench: ****************************************************************** nostack: 4 clients started 2 59047 1315.65 MB/sec 0 62477 1296.84 MB/sec Throughput 1296.79 MB/sec 4 procs 4 clients started 2 59162 1319.01 MB/sec 0 62477 1304.69 MB/sec Throughput 1304.61 MB/sec 4 procs stack: 4 clients started 2 59181 1320.55 MB/sec 0 62477 1264.77 MB/sec Throughput 1264.72 MB/sec 4 procs 4 clients started 2 57840 1293.95 MB/sec 0 62477 1241.75 MB/sec Throughput 1241.7 MB/sec 4 procs ****************************************************************** reaim ****************************************************************** nostack Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.05 0.02 0.01 122400.00 122400.00 0.00 0.00 100 3 0.05 0.04 0.04 367200.00 122400.00 0.01 20.41 79 5 0.07 0.06 0.07 437142.86 87428.57 0.01 12.90 87 7 0.11 0.08 0.11 389454.55 55636.36 0.02 23.15 76 9 0.13 0.10 0.13 423692.31 47076.92 0.02 22.96 77 Max Jobs per Minute 437142.86 Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.06 0.01 0.01 102000.00 102000.00 0.00 0.00 100 3 0.06 0.04 0.04 306000.00 102000.00 0.01 26.73 73 5 0.07 0.06 0.07 437142.86 87428.57 0.01 14.29 85 7 0.11 0.09 0.09 389454.55 55636.36 0.01 14.66 85 9 0.14 0.10 0.13 393428.57 43714.29 0.02 19.57 80 Max Jobs per Minute 437142.86 stack Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.06 0.01 0.02 102000.00 102000.00 0.00 0.00 100 3 0.04 0.04 0.04 459000.00 153000.00 0.00 12.86 87 5 0.08 0.06 0.07 382500.00 76500.00 0.01 15.65 84 7 0.11 0.09 0.10 389454.55 55636.36 0.01 8.45 91 9 0.14 0.12 0.12 393428.57 43714.29 0.03 23.47 76 Max Jobs per Minute 459000.00 Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.07 0.01 0.02 87428.57 87428.57 0.00 0.00 100 3 0.05 0.04 0.04 367200.00 122400.00 0.01 20.41 79 5 0.07 0.06 0.08 437142.86 87428.57 0.01 20.11 79 7 0.10 0.09 0.10 428400.00 61200.00 0.02 18.11 81 9 0.15 0.12 0.12 367200.00 40800.00 0.03 21.52 78 Max Jobs per Minute 437142.86 ****************************************************************** tbench ****************************************************************** nostack 1 clients started 1 41049 236.11 MB/sec 0 62477 230.37 MB/sec Throughput 230.368 MB/sec 1 procs 1 clients started 1 41418 236.52 MB/sec 0 62477 232.07 MB/sec Throughput 232.068 MB/sec 1 procs stack 1 clients started 1 41029 236.10 MB/sec 0 62477 230.75 MB/sec Throughput 230.742 MB/sec 1 procs 1 clients started 1 41463 236.53 MB/sec 0 62477 231.87 MB/sec Throughput 231.86 MB/sec 1 procs ****************************************************************** kernbench (different set of testruns) ****************************************************************** nostack (run 1) 169.13user 30.91system 1:40.91elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.55user 30.44system 1:40.81elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.36user 30.67system 1:40.86elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k (run 2) 169.40user 30.39system 1:40.89elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.32user 30.44system 1:40.76elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.16user 30.59system 1:40.63elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k sys average: 30.573333 stdev .178948 stack (run 1): 169.36user 31.18system 1:41.23elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.38user 31.34system 1:41.26elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.50user 31.09system 1:41.17elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k (run 2) 169.32user 30.90system 1:40.91elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.12user 31.11system 1:40.93elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 169.25user 30.92system 1:40.87elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k sys average: 31.090000 stdev .150555 ****************************************************************** ****************************************************************** ************************* 1-cpu RESULTS ************************* ****************************************************************** ****************************************************************** (smp compiled in, but boot param "max_cpus=1" specified.) ****************************************************************** dbench: ****************************************************************** nostack 4 clients started 2 58485 1305.96 MB/sec 0 62477 1280.57 MB/sec Throughput 1280.5 MB/sec 4 procs 4 clients started 2 55942 1253.94 MB/sec 0 62477 1189.63 MB/sec Throughput 1189.58 MB/sec 4 procs stack 4 clients started 2 54967 1233.77 MB/sec 0 62477 1157.91 MB/sec Throughput 1157.87 MB/sec 4 procs 4 clients started 2 54330 1215.41 MB/sec 0 62477 1193.88 MB/sec Throughput 1193.83 MB/sec 4 procs ****************************************************************** reaim ****************************************************************** nostack Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.06 0.01 0.01 102000.00 102000.00 0.00 0.00 100 3 0.06 0.04 0.04 306000.00 102000.00 0.01 35.36 64 5 0.08 0.06 0.07 382500.00 76500.00 0.01 21.19 78 7 0.09 0.09 0.09 476000.00 68000.00 0.02 24.81 75 9 0.14 0.12 0.12 393428.57 43714.29 0.02 22.38 77 Max Jobs per Minute 476000.00 Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.06 0.02 0.01 102000.00 102000.00 0.00 0.00 100 3 0.05 0.03 0.04 367200.00 122400.00 0.00 10.88 89 5 0.08 0.05 0.08 382500.00 76500.00 0.01 21.40 78 7 0.11 0.09 0.09 389454.55 55636.36 0.01 11.17 88 9 0.14 0.11 0.12 393428.57 43714.29 0.02 18.07 81 Max Jobs per Minute 393428.57 stack Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.05 0.01 0.01 122400.00 122400.00 0.00 0.00 100 3 0.05 0.04 0.04 367200.00 122400.00 0.01 20.41 79 5 0.08 0.07 0.06 382500.00 76500.00 0.00 5.56 94 7 0.12 0.10 0.09 357000.00 51000.00 0.01 13.52 86 9 0.13 0.13 0.12 423692.31 47076.92 0.02 20.40 79 Max Jobs per Minute 423692.31 Num Parent Child Child Jobs per Jobs/min/ Std_dev Std_dev JTI Forked Time SysTime UTime Minute Child Time Percent 1 0.06 0.02 0.02 102000.00 102000.00 0.00 0.00 100 3 0.05 0.04 0.04 367200.00 122400.00 0.01 20.41 79 5 0.08 0.07 0.06 382500.00 76500.00 0.01 18.81 81 7 0.11 0.10 0.09 389454.55 55636.36 0.01 7.73 92 9 0.14 0.11 0.13 393428.57 43714.29 0.02 18.07 81 Max Jobs per Minute 393428.57 ****************************************************************** tbench ****************************************************************** nostack 1 clients started 1 41485 236.59 MB/sec 0 62477 232.49 MB/sec Throughput 232.489 MB/sec 1 procs 1 clients started 1 42198 238.51 MB/sec 0 62477 235.67 MB/sec Throughput 235.659 MB/sec 1 procs stack 1 clients started 1 43927 250.33 MB/sec 0 62477 240.07 MB/sec Throughput 240.061 MB/sec 1 procs 1 clients started 1 40385 233.38 MB/sec 0 62477 227.70 MB/sec Throughput 227.694 MB/sec 1 procs ****************************************************************** kernbench (different set of testruns) ****************************************************************** nostack 169.07user 29.27system 1:39.99elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 168.83user 29.69system 1:40.10elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 168.84user 29.46system 1:40.07elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k sys average: 29.473333 stdev 0.171723 stack 168.60user 29.42system 1:40.05elapsed 197%CPU (0avgtext+0avgdata 0maxresident)k 168.42user 29.52system 1:39.78elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k 168.85user 29.28system 1:39.87elapsed 198%CPU (0avgtext+0avgdata 0maxresident)k sys average: 29.406667 stdev 0.098432
This archive was generated by hypermail 2.1.3 : Wed May 18 2005 - 08:51:20 PDT