Trace number 3191206

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.34 1201.71

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v550-c2343-S1554089933-067.UNKNOWN.cnf
MD5SUMfa2c840574747ca3ff8efe8a9137bb94
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables550
Number of clauses2343
Sum of the clauses size7029
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32343
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.83	This is pico-portfolio, a naive parallel portfolio
0.00/0.83	Copyright (C) 2011 Olivier Roussel
0.00/0.83	Using 4 processing units
0.00/0.83	This portfolio uses the following solvers:
0.00/0.83	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.83	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.83	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.83	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.83	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.83	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.83	Starting clasp 1.3.6 on core(s) 4
0.00/0.83	Starting TNM 2009 on core(s) 6
0.00/0.83	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.83	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191206-1304066315/watcher-3191206-1304066315 -o /tmp/evaluation-result-3191206-1304066315/solver-3191206-1304066315 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191206-1304066315.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.57 5.56 6.85 2/175 31714
/proc/meminfo: memFree=30946220/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) R 31712 31714 29944 0 -1 4194304 506 0 0 0 0 0 0 0 25 0 1 0 518229400 18763776 387 33554432000 4194304 4287625 140735146275120 18446744073709551615 271549935579 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/31714/statm: 4581 387 339 23 0 91 0

[startup+0.027523 s]
/proc/loadavg: 5.57 5.56 6.85 2/175 31714
/proc/meminfo: memFree=30946220/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) R 31712 31714 29944 0 -1 4194304 506 0 0 0 0 0 0 0 25 0 1 0 518229400 18763776 387 33554432000 4194304 4287625 140735146275120 18446744073709551615 271549935579 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/31714/statm: 4581 387 339 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100505 s]
/proc/loadavg: 5.57 5.56 6.85 2/175 31714
/proc/meminfo: memFree=30946220/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) R 31712 31714 29944 0 -1 4194304 506 0 0 0 0 0 0 0 25 0 1 0 518229400 18763776 387 33554432000 4194304 4287625 140735146275120 18446744073709551615 271549935579 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/31714/statm: 4581 387 339 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300469 s]
/proc/loadavg: 5.57 5.56 6.85 2/175 31714
/proc/meminfo: memFree=30946220/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) R 31712 31714 29944 0 -1 4194304 506 0 0 0 0 0 0 0 25 0 1 0 518229400 18763776 387 33554432000 4194304 4287625 140735146275120 18446744073709551615 271549935579 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/31714/statm: 4581 387 339 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700397 s]
/proc/loadavg: 5.57 5.56 6.85 2/175 31714
/proc/meminfo: memFree=30946220/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) R 31712 31714 29944 0 -1 4194304 506 0 0 0 0 0 0 0 25 0 1 0 518229400 18763776 387 33554432000 4194304 4287625 140735146275120 18446744073709551615 271549935579 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/31714/statm: 4581 387 339 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50126 s]
/proc/loadavg: 5.57 5.56 6.85 7/181 31720
/proc/meminfo: memFree=30937120/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) R 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 22 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1111240 CPUtime=1.48 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 3812 0 0 0 148 0 0 0 20 0 1 0 518229401 1137909760 2584 33554432000 4194304 4587354 140733851557264 18446744073709551615 4388279 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 277810 2584 337 96 0 274372 0
[pid=31716] ppid=31714 vsize=14292 CPUtime=1.49 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 1044 0 0 0 149 0 0 0 25 0 1 0 518229401 14635008 931 33554432000 4194304 4785740 140735617296352 18446744073709551615 4544131 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 3573 931 340 145 0 618 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=1.17 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 117 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=6664 CPUtime=1.49 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 1160 0 0 0 149 0 0 0 20 0 1 0 518229401 6823936 833 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328047 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 1666 833 127 39 0 746 0
[pid=31720] ppid=31714 vsize=7848 CPUtime=0.31 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 561 0 0 0 31 0 0 0 25 0 1 0 518229483 8036352 454 33554432000 4194304 4331988 140734456594464 18446744073709551615 4211579 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 1962 454 172 34 0 404 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 1614328

[startup+3.10097 s]
/proc/loadavg: 5.57 5.56 6.85 6/181 31720
/proc/meminfo: memFree=30928812/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1113188 CPUtime=3.08 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 5365 0 0 0 308 0 0 0 25 0 1 0 518229401 1139904512 3230 33554432000 4194304 4587354 140733851557264 18446744073709551615 4357642 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 278297 3230 337 96 0 274859 0
[pid=31716] ppid=31714 vsize=15096 CPUtime=3.09 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 1220 0 0 0 309 0 0 0 25 0 1 0 518229401 15458304 1107 33554432000 4194304 4785740 140735617296352 18446744073709551615 4553029 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 3774 1107 341 145 0 819 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=1.97 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 197 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=6600 CPUtime=3.09 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 1496 0 0 0 309 0 0 0 25 0 1 0 518229401 6758400 849 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328205 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 1650 849 127 39 0 730 0
[pid=31720] ppid=31714 vsize=8052 CPUtime=1.1 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 633 0 0 0 110 0 0 0 25 0 1 0 518229483 8245248 526 33554432000 4194304 4331988 140734456594464 18446744073709551615 4211487 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 2013 526 173 34 0 455 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 1617220

[startup+6.3004 s]
/proc/loadavg: 5.52 5.55 6.84 6/181 31720
/proc/meminfo: memFree=30921564/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1114736 CPUtime=6.29 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 7539 0 0 0 628 1 0 0 25 0 1 0 518229401 1141489664 3719 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238576 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 278684 3719 337 96 0 275246 0
[pid=31716] ppid=31714 vsize=16188 CPUtime=6.29 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 1513 0 0 0 629 0 0 0 25 0 1 0 518229401 16576512 1400 33554432000 4194304 4785740 140735617296352 18446744073709551615 4287104 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 4047 1400 341 145 0 1092 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=3.64 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 364 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134530598 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=8144 CPUtime=6.29 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 2458 0 0 0 629 0 0 0 25 0 1 0 518229401 8339456 1235 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 2036 1235 127 39 0 1116 0
[pid=31720] ppid=31714 vsize=8304 CPUtime=2.61 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 691 0 0 0 261 0 0 0 25 0 1 0 518229483 8503296 584 33554432000 4194304 4331988 140734456594464 18446744073709551615 4229633 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 2076 584 173 34 0 518 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 1621656

[startup+12.7012 s]
/proc/loadavg: 5.48 5.54 6.83 6/181 31720
/proc/meminfo: memFree=30914668/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1117932 CPUtime=12.69 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 11743 0 0 0 1267 2 0 0 25 0 1 0 518229401 1144762368 4309 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 279483 4309 337 96 0 276045 0
[pid=31716] ppid=31714 vsize=17856 CPUtime=12.69 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 1896 0 0 0 1269 0 0 0 25 0 1 0 518229401 18284544 1783 33554432000 4194304 4785740 140735617296352 18446744073709551615 4286982 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 4464 1783 341 145 0 1509 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=6.81 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 681 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=8852 CPUtime=12.69 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 3739 0 0 0 1269 0 0 0 25 0 1 0 518229401 9064448 1412 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328032 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 2213 1412 127 39 0 1293 0
[pid=31720] ppid=31714 vsize=9116 CPUtime=5.8 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 835 0 0 0 580 0 0 0 25 0 1 0 518229483 9334784 728 33554432000 4194304 4331988 140734456594464 18446744073709551615 4226460 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 2279 728 173 34 0 721 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 1628040

[startup+25.5009 s]
/proc/loadavg: 5.37 5.52 6.80 6/181 31721
/proc/meminfo: memFree=30905756/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1123028 CPUtime=25.49 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 17813 0 0 0 2546 3 0 0 25 0 1 0 518229401 1149980672 5631 33554432000 4194304 4587354 140733851557264 18446744073709551615 4248752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 280757 5631 337 96 0 277319 0
[pid=31716] ppid=31714 vsize=19404 CPUtime=25.49 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 2267 0 0 0 2549 0 0 0 25 0 1 0 518229401 19869696 2154 33554432000 4194304 4785740 140735617296352 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 4851 2154 341 145 0 1896 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=13.14 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 1314 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134529080 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=11160 CPUtime=25.49 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 6748 0 0 0 2549 0 0 0 25 0 1 0 518229401 11427840 1989 33554432000 4194304 4352236 140736944948416 18446744073709551615 4327859 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 2790 1989 127 39 0 1870 0
[pid=31720] ppid=31714 vsize=10772 CPUtime=12.2 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 1145 0 0 0 1220 0 0 0 25 0 1 0 518229483 11030528 1007 33554432000 4194304 4331988 140734456594464 18446744073709551615 271554067246 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 2693 1007 173 34 0 1135 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 1638648

[startup+51.1013 s]
/proc/loadavg: 5.38 5.50 6.77 6/181 31721
/proc/meminfo: memFree=30890028/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1125128 CPUtime=51.09 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 27244 0 0 0 5105 4 0 0 25 0 1 0 518229401 1152131072 8012 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 281282 8012 337 96 0 277844 0
[pid=31716] ppid=31714 vsize=22224 CPUtime=51.09 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 2950 0 0 0 5109 0 0 0 25 0 1 0 518229401 22757376 2837 33554432000 4194304 4785740 140735617296352 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 5556 2837 341 145 0 2601 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=25.9 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 2590 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=12960 CPUtime=51.08 cores=2

################
# More data... #
################

/proc/31720/statm: 20845 15846 173 34 0 19287 0
Current children cumulated CPU time (s) 3764.11
Current children cumulated vsize (KiB) 1800240

[startup+1002.3 s]
/proc/loadavg: 5.19 5.16 5.69 6/181 31747
/proc/meminfo: memFree=30744252/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1169276 CPUtime=1002.31 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 147072 0 0 0 100180 51 0 0 25 0 1 0 518229401 1197338624 18292 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 292319 18292 337 96 0 288881 0
[pid=31716] ppid=31714 vsize=42704 CPUtime=1002.32 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 7705 0 0 0 100231 1 0 0 25 0 1 0 518229401 43728896 7592 33554432000 4194304 4785740 140735617296352 18446744073709551615 4309533 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 10676 7592 341 145 0 7721 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=498.91 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 49891 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134530533 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=36680 CPUtime=1002.31 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 91744 0 0 0 100218 13 0 0 25 0 1 0 518229401 37560320 8369 33554432000 4194304 4352236 140736944948416 18446744073709551615 4329205 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 9170 8369 127 39 0 8250 0
[pid=31720] ppid=31714 vsize=83380 CPUtime=497.92 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 16879 0 0 0 49785 7 0 0 25 0 1 0 518229483 85381120 16741 33554432000 4194304 4331988 140734456594464 18446744073709551615 4226407 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 20845 16741 173 34 0 19287 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 1806324

[startup+1062.3 s]
/proc/loadavg: 5.20 5.16 5.66 6/181 31748
/proc/meminfo: memFree=30757868/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1173332 CPUtime=1062.32 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 153600 0 0 0 106177 55 0 0 25 0 1 0 518229401 1201491968 17278 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 293333 17278 337 96 0 289895 0
[pid=31716] ppid=31714 vsize=43324 CPUtime=1062.32 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 7807 0 0 0 106231 1 0 0 25 0 1 0 518229401 44363776 7694 33554432000 4194304 4785740 140735617296352 18446744073709551615 4553027 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 10831 7694 341 145 0 7876 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=528.76 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 52876 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=24904 CPUtime=1062.32 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 93536 0 0 0 106218 14 0 0 25 0 1 0 518229401 25501696 5425 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 6226 5425 127 39 0 5306 0
[pid=31720] ppid=31714 vsize=83380 CPUtime=527.75 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 17736 0 0 0 52767 8 0 0 25 0 1 0 518229483 85381120 17598 33554432000 4194304 4331988 140734456594464 18446744073709551615 4229592 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 20845 17598 173 34 0 19287 0
Current children cumulated CPU time (s) 4243.47
Current children cumulated vsize (KiB) 1799224

[startup+1122.3 s]
/proc/loadavg: 5.20 5.16 5.62 6/181 31750
/proc/meminfo: memFree=30726956/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=1175440 CPUtime=1122.32 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 160856 0 0 0 112175 57 0 0 25 0 1 0 518229401 1203650560 20510 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 293860 20510 337 96 0 290422 0
[pid=31716] ppid=31714 vsize=43804 CPUtime=1122.32 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 7917 0 0 0 112231 1 0 0 25 0 1 0 518229401 44855296 7804 33554432000 4194304 4785740 140735617296352 18446744073709551615 4416791 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 10951 7804 341 145 0 7996 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=558.57 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 55857 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528652 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=36680 CPUtime=1122.31 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 97824 0 0 0 112217 14 0 0 25 0 1 0 518229401 37560320 8369 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328102 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 9170 8369 127 39 0 8250 0
[pid=31720] ppid=31714 vsize=83380 CPUtime=557.61 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 18706 0 0 0 55753 8 0 0 25 0 1 0 518229483 85381120 18568 33554432000 4194304 4331988 140734456594464 18446744073709551615 4226407 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 20845 18568 173 34 0 19287 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 1813588

[startup+1182.3 s]
/proc/loadavg: 5.18 5.16 5.59 6/181 31752
/proc/meminfo: memFree=30727172/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=3887580 CPUtime=1182.31 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 165080 0 0 0 118173 58 0 0 25 0 1 0 518229401 3980881920 20534 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 971895 20534 337 96 0 968457 0
[pid=31716] ppid=31714 vsize=44140 CPUtime=1182.32 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 8003 0 0 0 118231 1 0 0 25 0 1 0 518229401 45199360 7890 33554432000 4194304 4785740 140735617296352 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 11035 7890 341 145 0 8080 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=588.45 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 58845 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=31304 CPUtime=1182.32 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 101216 0 0 0 118217 15 0 0 25 0 1 0 518229401 32055296 7025 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 7826 7025 127 39 0 6906 0
[pid=31720] ppid=31714 vsize=99600 CPUtime=587.41 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 19604 0 0 0 58732 9 0 0 25 0 1 0 518229483 101990400 19466 33554432000 4194304 4331988 140734456594464 18446744073709551615 4211420 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 24900 19466 173 34 0 23342 0
Current children cumulated CPU time (s) 4722.81
Current children cumulated vsize (KiB) 4536908



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.13 5.14 5.58 6/181 31752
/proc/meminfo: memFree=30716368/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=3902768 CPUtime=1201.73 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 166559 0 0 0 120114 59 0 0 25 0 1 0 518229401 3996434432 21854 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 975692 21854 337 96 0 972254 0
[pid=31716] ppid=31714 vsize=44140 CPUtime=1201.73 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 8017 0 0 0 120172 1 0 0 25 0 1 0 518229401 45199360 7904 33554432000 4194304 4785740 140735617296352 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 11035 7904 341 145 0 8080 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=598.05 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 59805 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134530515 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=36680 CPUtime=1201.72 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 102560 0 0 0 120157 15 0 0 25 0 1 0 518229401 37560320 8369 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 9170 8369 127 39 0 8250 0
[pid=31720] ppid=31714 vsize=129068 CPUtime=597.11 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 19898 0 0 0 59701 10 0 0 25 0 1 0 518229483 132165632 19760 33554432000 4194304 4331988 140734456594464 18446744073709551615 4240535 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 32267 19760 173 34 0 30709 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 4586940

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 5.13 5.14 5.58 6/181 31752
/proc/meminfo: memFree=30716368/32951124 swapFree=67111344/67111528
[pid=31714] ppid=31712 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31714/stat : 31714 (ppfolio) S 31712 31714 29944 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 518229400 18763776 389 33554432000 4194304 4287625 140735146275120 18446744073709551615 271550557711 0 0 4096 65536 13429267487866748927 0 0 17 2 0 0 0
/proc/31714/statm: 4581 389 341 23 0 91 0
[pid=31715] ppid=31714 vsize=3902768 CPUtime=1201.73 cores=0
/proc/31715/stat : 31715 (cryptominisat) R 31714 31714 29944 0 -1 4202496 166559 0 0 0 120114 59 0 0 25 0 1 0 518229401 3996434432 21854 33554432000 4194304 4587354 140733851557264 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31715/statm: 975692 21854 337 96 0 972254 0
[pid=31716] ppid=31714 vsize=44140 CPUtime=1201.73 cores=4
/proc/31716/stat : 31716 (clasp) R 31714 31714 29944 0 -1 4202496 8017 0 0 0 120172 1 0 0 25 0 1 0 518229401 45199360 7904 33554432000 4194304 4785740 140735617296352 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31716/statm: 11035 7904 341 145 0 8080 0
[pid=31717] ppid=31714 vsize=455960 CPUtime=598.05 cores=6
/proc/31717/stat : 31717 (TNM) R 31714 31714 29944 0 -1 4202496 344 0 0 0 59805 0 0 0 25 0 1 0 518229401 466903040 241 33554432000 134512640 134534564 4286818144 18446744073709551615 134530515 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31717/statm: 113990 241 95 6 0 112656 0
[pid=31718] ppid=31714 vsize=36680 CPUtime=1201.72 cores=2
/proc/31718/stat : 31718 (lingeling) R 31714 31714 29944 0 -1 4202496 102560 0 0 0 120157 15 0 0 25 0 1 0 518229401 37560320 8369 33554432000 4194304 4352236 140736944948416 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31718/statm: 9170 8369 127 39 0 8250 0
[pid=31720] ppid=31714 vsize=129068 CPUtime=597.11 cores=6
/proc/31720/stat : 31720 (march_hi) R 31714 31714 29944 0 -1 4202496 19898 0 0 0 59701 10 0 0 25 0 1 0 518229483 132165632 19760 33554432000 4194304 4331988 140734456594464 18446744073709551615 4240535 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31720/statm: 32267 19760 173 34 0 30709 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 4586940

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31714 and gives
#  childrusage.ru_utime.tv_sec=2403
#  childrusage.ru_utime.tv_usec=303642
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=178972
# CPU time returned by wait4() is 2403.48
# while last known CPU time is 4800.34
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.34
CPU user time (s): 4799.49
CPU system time (s): 0.85
CPU usage (%): 399.458
Max. virtual memory (cumulated for all children) (KiB): 8377064

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2403.3
system time used= 0.178972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 111115
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 486
involuntary context switches= 3822

runsolver used 2.06069 second user time and 4.50232 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 10:38:35
IDJOB=3191206
IDBENCH=82937
IDSOLVER=1612
FILE ID=node133/3191206-1304066315
RUNJOBID= node133-1304064249-31164
PBS_JOBID= 13170442
Free space on /tmp= 71896 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v550-c2343-S1554089933-067.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191206-1304066315/watcher-3191206-1304066315 -o /tmp/evaluation-result-3191206-1304066315/solver-3191206-1304066315 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191206-1304066315.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fa2c840574747ca3ff8efe8a9137bb94
RANDOM SEED=145948044

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30946376 kB
Buffers:        720188 kB
Cached:         864292 kB
SwapCached:        124 kB
Active:         575576 kB
Inactive:      1072260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30946376 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:           10344 kB
Writeback:           0 kB
AnonPages:       62576 kB
Mapped:          14332 kB
Slab:           294492 kB
PageTables:       4224 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187624 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71888 MiB
End job on node133 at 2011-04-29 10:58:39