Trace number 3372678

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 160004 5012.56

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top22.cnf
MD5SUMe822739302a2d834ec9ddfe9fbd0caa2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables55875
Number of clauses177646
Sum of the clauses size434144
Maximum clause length2255
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2108197
Number of clauses of size 368250
Number of clauses of size 4252
Number of clauses of size 520
Number of clauses of size over 5926

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372678-1305942428/watcher-3372678-1305942428 -o /tmp/evaluation-result-3372678-1305942428/solver-3372678-1305942428 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372678-1305942428.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.61 31.55 31.90 1/413 10623
/proc/meminfo: memFree=255503924/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=33300 CPUtime=0.03 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 6248 1242 0 0 1 1 0 1 21 0 1 0 705729302 34099200 6179 268435456000 4194304 4417452 140735382608048 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 8325 6191 138 55 0 6211 0

[startup+0.0692479 s]
/proc/loadavg: 29.61 31.55 31.90 1/413 10623
/proc/meminfo: memFree=255503924/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=46448 CPUtime=0.06 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 9695 1242 0 0 3 2 0 1 21 0 1 0 705729302 47562752 9626 268435456000 4194304 4417452 140735382608048 18446744073709551615 4209658 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 11612 9626 141 55 0 9498 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 46448

[startup+0.101243 s]
/proc/loadavg: 29.61 31.55 31.90 1/413 10623
/proc/meminfo: memFree=255503924/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=51888 CPUtime=0.1 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 11033 1242 0 0 6 3 0 1 21 0 1 0 705729302 53133312 10964 268435456000 4194304 4417452 140735382608048 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 12972 10964 141 55 0 10858 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 51888

[startup+0.301248 s]
/proc/loadavg: 29.61 31.55 31.90 1/413 10623
/proc/meminfo: memFree=255503924/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=64888 CPUtime=0.3 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 14312 1242 0 0 25 4 0 1 22 0 1 0 705729302 66445312 14243 268435456000 4194304 4417452 140735382608048 18446744073709551615 4260021 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 16222 14243 146 55 0 14108 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 64888

[startup+0.700257 s]
/proc/loadavg: 29.61 31.55 31.90 1/413 10623
/proc/meminfo: memFree=255503924/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=92960 CPUtime=0.69 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 21314 1242 0 0 62 6 0 1 23 0 1 0 705729302 95191040 21245 268435456000 4194304 4417452 140735382608048 18446744073709551615 4259140 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 23240 21245 146 55 0 21126 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 92960

[startup+1.5003 s]
/proc/loadavg: 29.61 31.55 31.90 2/414 10629
/proc/meminfo: memFree=255401744/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=150156 CPUtime=1.5 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 35572 1242 0 0 140 9 0 1 25 0 1 0 705729302 153759744 35503 268435456000 4194304 4417452 140735382608048 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 37539 35519 146 55 0 35425 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 150156

[startup+3.10036 s]
/proc/loadavg: 29.61 31.55 31.90 2/414 10629
/proc/meminfo: memFree=255280644/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=295592 CPUtime=3.09 cores=0-31
/proc/10623/stat : 10623 (plingeling) R 10621 10623 10597 0 -1 4202496 71998 1242 0 0 292 16 0 1 25 0 1 0 705729302 302686208 71895 268435456000 4194304 4417452 140735382608048 18446744073709551615 4274358 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/10623/statm: 73898 71895 146 55 0 71784 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 295592

[startup+6.30235 s]
/proc/loadavg: 27.32 31.04 31.74 33/446 10661
/proc/meminfo: memFree=255102292/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=1030968 CPUtime=95.14 cores=0-31
/proc/10623/stat : 10623 (plingeling) S 10621 10623 10597 0 -1 4202496 207106 1242 0 0 9392 121 0 1 18 0 33 0 705729302 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 257742 92047 173 55 0 255628 0
[pid=10623/tid=10630] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10630/stat : 10630 (plingeling) R 10621 10623 10597 0 -1 4202560 5927 1242 0 0 286 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4278246 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=10623/tid=10631] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10631/stat : 10631 (plingeling) R 10621 10623 10597 0 -1 4202560 2522 1242 0 0 287 2 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=10623/tid=10632] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10632/stat : 10632 (plingeling) R 10621 10623 10597 0 -1 4202560 4204 1242 0 0 287 2 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10623/tid=10633] ppid=10621 vsize=1030968 CPUtime=2.89 cores=0-31
/proc/10623/task/10633/stat : 10633 (plingeling) R 10621 10623 10597 0 -1 4202560 961 1242 0 0 287 1 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=10623/tid=10634] ppid=10621 vsize=1030968 CPUtime=2.88 cores=0-31
/proc/10623/task/10634/stat : 10634 (plingeling) R 10621 10623 10597 0 -1 4202560 4098 1242 0 0 284 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10623/tid=10635] ppid=10621 vsize=1030968 CPUtime=2.88 cores=0-31
/proc/10623/task/10635/stat : 10635 (plingeling) R 10621 10623 10597 0 -1 4202560 4687 1242 0 0 284 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4326804 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=10623/tid=10636] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10636/stat : 10636 (plingeling) R 10621 10623 10597 0 -1 4202560 2426 1242 0 0 288 1 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10623/tid=10637] ppid=10621 vsize=1030968 CPUtime=2.81 cores=0-31
/proc/10623/task/10637/stat : 10637 (plingeling) R 10621 10623 10597 0 -1 4202560 7834 1242 0 0 277 3 0 1 19 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236564 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=10623/tid=10638] ppid=10621 vsize=1030968 CPUtime=2.88 cores=0-31
/proc/10623/task/10638/stat : 10638 (plingeling) R 10621 10623 10597 0 -1 4202560 2796 1242 0 0 284 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4271035 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=10623/tid=10639] ppid=10621 vsize=1030968 CPUtime=2.89 cores=0-31
/proc/10623/task/10639/stat : 10639 (plingeling) R 10621 10623 10597 0 -1 4202560 2816 1242 0 0 286 2 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4237136 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=10623/tid=10640] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10640/stat : 10640 (plingeling) R 10621 10623 10597 0 -1 4202560 3887 1242 0 0 286 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4275947 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10623/tid=10641] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10641/stat : 10641 (plingeling) R 10621 10623 10597 0 -1 4202560 2499 1242 0 0 286 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=10623/tid=10642] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10642/stat : 10642 (plingeling) R 10621 10623 10597 0 -1 4202560 7638 1242 0 0 284 5 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277543 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=10623/tid=10643] ppid=10621 vsize=1030968 CPUtime=2.9 cores=0-31
/proc/10623/task/10643/stat : 10643 (plingeling) R 10621 10623 10597 0 -1 4202560 5789 1242 0 0 284 5 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=10623/tid=10644] ppid=10621 vsize=1030968 CPUtime=2.89 cores=0-31
/proc/10623/task/10644/stat : 10644 (plingeling) R 10621 10623 10597 0 -1 4202560 3237 1242 0 0 285 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=10623/tid=10645] ppid=10621 vsize=1030968 CPUtime=2.89 cores=0-31
/proc/10623/task/10645/stat : 10645 (plingeling) R 10621 10623 10597 0 -1 4202560 4757 1242 0 0 286 2 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10623/tid=10646] ppid=10621 vsize=1030968 CPUtime=2.89 cores=0-31
/proc/10623/task/10646/stat : 10646 (plingeling) R 10621 10623 10597 0 -1 4202560 2740 1242 0 0 285 3 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4276538 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=10623/tid=10647] ppid=10621 vsize=1030968 CPUtime=2.75 cores=0-31
/proc/10623/task/10647/stat : 10647 (plingeling) R 10621 10623 10597 0 -1 4202560 7489 1242 0 0 272 2 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277671 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=10623/tid=10648] ppid=10621 vsize=1030968 CPUtime=2.87 cores=0-31
/proc/10623/task/10648/stat : 10648 (plingeling) R 10621 10623 10597 0 -1 4202560 2480 1242 0 0 284 2 0 1 23 0 33 0 705729640 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236598 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10623/tid=10649] ppid=10621 vsize=1030968 CPUtime=2.86 cores=0-31
/proc/10623/task/10649/stat : 10649 (plingeling) R 10621 10623 10597 0 -1 4202560 3091 1242 0 0 282 3 0 1 25 0 33 0 705729641 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=10623/tid=10650] ppid=10621 vsize=1030968 CPUtime=2.88 cores=0-31
/proc/10623/task/10650/stat : 10650 (plingeling) R 10621 10623 10597 0 -1 4202560 5294 1242 0 0 284 3 0 1 23 0 33 0 705729641 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277567 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=10623/tid=10651] ppid=10621 vsize=1030968 CPUtime=2.86 cores=0-31
/proc/10623/task/10651/stat : 10651 (plingeling) R 10621 10623 10597 0 -1 4202560 6292 1242 0 0 281 4 0 1 23 0 33 0 705729641 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=10623/tid=10652] ppid=10621 vsize=1030968 CPUtime=2.88 cores=0-31
/proc/10623/task/10652/stat : 10652 (plingeling) R 10621 10623 10597 0 -1 4202560 2531 1242 0 0 285 2 0 1 25 0 33 0 705729641 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=10623/tid=10653] ppid=10621 vsize=1030968 CPUtime=2.86 cores=0-31
/proc/10623/task/10653/stat : 10653 (plingeling) R 10621 10623 10597 0 -1 4202560 7610 1242 0 0 281 4 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236637 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=10623/tid=10654] ppid=10621 vsize=1030968 CPUtime=2.86 cores=0-31
/proc/10623/task/10654/stat : 10654 (plingeling) R 10621 10623 10597 0 -1 4202560 4752 1242 0 0 282 3 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=10623/tid=10655] ppid=10621 vsize=1030968 CPUtime=2.86 cores=0-31
/proc/10623/task/10655/stat : 10655 (plingeling) R 10621 10623 10597 0 -1 4202560 4656 1242 0 0 282 3 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=10623/tid=10656] ppid=10621 vsize=1030968 CPUtime=2.86 cores=0-31
/proc/10623/task/10656/stat : 10656 (plingeling) R 10621 10623 10597 0 -1 4202560 4251 1242 0 0 282 3 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=1030968 CPUtime=2.83 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4202560 2462 1242 0 0 280 2 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10623/tid=10658] ppid=10621 vsize=1030968 CPUtime=2.85 cores=0-31
/proc/10623/task/10658/stat : 10658 (plingeling) R 10621 10623 10597 0 -1 4202560 2901 1242 0 0 282 2 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=10623/tid=10659] ppid=10621 vsize=1030968 CPUtime=2.8 cores=0-31
/proc/10623/task/10659/stat : 10659 (plingeling) R 10621 10623 10597 0 -1 4202560 2927 1242 0 0 277 2 0 1 23 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10623/tid=10660] ppid=10621 vsize=1030968 CPUtime=2.85 cores=0-31
/proc/10623/task/10660/stat : 10660 (plingeling) R 10621 10623 10597 0 -1 4202560 2563 1242 0 0 282 2 0 1 25 0 33 0 705729642 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4327056 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=10623/tid=10661] ppid=10621 vsize=1030968 CPUtime=2.81 cores=0-31
/proc/10623/task/10661/stat : 10661 (plingeling) R 10621 10623 10597 0 -1 4202560 6566 1242 0 0 276 4 0 1 25 0 33 0 705729643 1055711232 92047 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 30 0 0 0
Current children cumulated CPU time (s) 95.14
Current children cumulated vsize (KiB) 1030968

[startup+12.7016 s]
/proc/loadavg: 27.69 31.06 31.74 33/446 10661
/proc/meminfo: memFree=255025644/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=1060252 CPUtime=299.65 cores=0-31
/proc/10623/stat : 10623 (plingeling) S 10621 10623 10597 0 -1 4202496 242404 1242 0 0 29835 129 0 1 18 0 33 0 705729302 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 265063 112659 175 55 0 262949 0
[pid=10623/tid=10630] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10630/stat : 10630 (plingeling) R 10621 10623 10597 0 -1 4202560 7039 1242 0 0 925 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4248888 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=10623/tid=10631] ppid=10621 vsize=1060252 CPUtime=9.3 cores=0-31
/proc/10623/task/10631/stat : 10631 (plingeling) R 10621 10623 10597 0 -1 4202560 3040 1242 0 0 927 2 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4250047 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=10623/tid=10632] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10632/stat : 10632 (plingeling) R 10621 10623 10597 0 -1 4202560 4344 1242 0 0 926 2 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10623/tid=10633] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10633/stat : 10633 (plingeling) R 10621 10623 10597 0 -1 4202560 961 1242 0 0 927 1 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=10623/tid=10634] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10634/stat : 10634 (plingeling) R 10621 10623 10597 0 -1 4202560 4104 1242 0 0 924 4 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10623/tid=10635] ppid=10621 vsize=1060252 CPUtime=9.28 cores=0-31
/proc/10623/task/10635/stat : 10635 (plingeling) R 10621 10623 10597 0 -1 4202560 5334 1242 0 0 924 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4248212 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=10623/tid=10636] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10636/stat : 10636 (plingeling) R 10621 10623 10597 0 -1 4202560 2426 1242 0 0 927 1 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4236559 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10623/tid=10637] ppid=10621 vsize=1060252 CPUtime=9.21 cores=0-31
/proc/10623/task/10637/stat : 10637 (plingeling) R 10621 10623 10597 0 -1 4202560 9420 1242 0 0 916 4 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4257702 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=10623/tid=10638] ppid=10621 vsize=1060252 CPUtime=9.28 cores=0-31
/proc/10623/task/10638/stat : 10638 (plingeling) R 10621 10623 10597 0 -1 4202560 3290 1242 0 0 924 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4248248 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=10623/tid=10639] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10639/stat : 10639 (plingeling) R 10621 10623 10597 0 -1 4202560 5090 1242 0 0 925 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4250072 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=10623/tid=10640] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10640/stat : 10640 (plingeling) R 10621 10623 10597 0 -1 4202560 4284 1242 0 0 925 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10623/tid=10641] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10641/stat : 10641 (plingeling) R 10621 10623 10597 0 -1 4202560 3017 1242 0 0 925 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=10623/tid=10642] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10642/stat : 10642 (plingeling) R 10621 10623 10597 0 -1 4202560 10802 1242 0 0 923 5 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4336693 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=10623/tid=10643] ppid=10621 vsize=1060252 CPUtime=9.29 cores=0-31
/proc/10623/task/10643/stat : 10643 (plingeling) R 10621 10623 10597 0 -1 4202560 8848 1242 0 0 923 5 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4235398 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=10623/tid=10644] ppid=10621 vsize=1060252 CPUtime=9.28 cores=0-31
/proc/10623/task/10644/stat : 10644 (plingeling) R 10621 10623 10597 0 -1 4202560 4443 1242 0 0 924 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=10623/tid=10645] ppid=10621 vsize=1060252 CPUtime=9.28 cores=0-31
/proc/10623/task/10645/stat : 10645 (plingeling) R 10621 10623 10597 0 -1 4202560 6421 1242 0 0 925 2 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4249519 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10623/tid=10646] ppid=10621 vsize=1060252 CPUtime=9.28 cores=0-31
/proc/10623/task/10646/stat : 10646 (plingeling) R 10621 10623 10597 0 -1 4202560 3386 1242 0 0 924 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4250080 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=10623/tid=10647] ppid=10621 vsize=1060252 CPUtime=8.97 cores=0-31
/proc/10623/task/10647/stat : 10647 (plingeling) R 10621 10623 10597 0 -1 4202560 9168 1242 0 0 893 3 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4336656 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=10623/tid=10648] ppid=10621 vsize=1060252 CPUtime=9.26 cores=0-31
/proc/10623/task/10648/stat : 10648 (plingeling) R 10621 10623 10597 0 -1 4202560 3184 1242 0 0 923 2 0 1 25 0 33 0 705729640 1085698048 112659 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10623/tid=10649] ppid=10621 vsize=1060252 CPUtime=9.25 cores=0-31

################
# More data... #
################

[pid=10623/tid=10641] ppid=10621 vsize=12251976 CPUtime=4951.6 cores=0-31
/proc/10623/task/10641/stat : 10641 (plingeling) R 10621 10623 10597 0 -1 4202560 560549 1242 0 0 494578 581 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=10623/tid=10642] ppid=10621 vsize=12251976 CPUtime=4952.63 cores=0-31
/proc/10623/task/10642/stat : 10642 (plingeling) R 10621 10623 10597 0 -1 4202560 500858 1242 0 0 494530 732 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=10623/tid=10643] ppid=10621 vsize=12251976 CPUtime=4957.19 cores=0-31
/proc/10623/task/10643/stat : 10643 (plingeling) R 10621 10623 10597 0 -1 4202560 566971 1242 0 0 495065 653 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=10623/tid=10644] ppid=10621 vsize=12251976 CPUtime=4954.53 cores=0-31
/proc/10623/task/10644/stat : 10644 (plingeling) R 10621 10623 10597 0 -1 4202560 578588 1242 0 0 494652 800 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10623/tid=10645] ppid=10621 vsize=12251976 CPUtime=4944.7 cores=0-31
/proc/10623/task/10645/stat : 10645 (plingeling) R 10621 10623 10597 0 -1 4202560 589142 1242 0 0 493663 806 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10623/tid=10646] ppid=10621 vsize=12251976 CPUtime=4951.07 cores=0-31
/proc/10623/task/10646/stat : 10646 (plingeling) R 10621 10623 10597 0 -1 4202560 477927 1242 0 0 494446 660 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=10623/tid=10647] ppid=10621 vsize=12251976 CPUtime=4954.24 cores=0-31
/proc/10623/task/10647/stat : 10647 (plingeling) R 10621 10623 10597 0 -1 4202560 653504 1242 0 0 494726 697 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=10623/tid=10648] ppid=10621 vsize=12251976 CPUtime=4956.38 cores=0-31
/proc/10623/task/10648/stat : 10648 (plingeling) R 10621 10623 10597 0 -1 4202560 544286 1242 0 0 495048 589 0 1 25 0 33 0 705729640 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=10623/tid=10649] ppid=10621 vsize=12251976 CPUtime=4954.53 cores=0-31
/proc/10623/task/10649/stat : 10649 (plingeling) R 10621 10623 10597 0 -1 4202560 656925 1242 0 0 494440 1012 0 1 25 0 33 0 705729641 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=10623/tid=10650] ppid=10621 vsize=12251976 CPUtime=4955.49 cores=0-31
/proc/10623/task/10650/stat : 10650 (plingeling) R 10621 10623 10597 0 -1 4202560 516251 1242 0 0 494727 821 0 1 25 0 33 0 705729641 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=10623/tid=10651] ppid=10621 vsize=12251976 CPUtime=4953.42 cores=0-31
/proc/10623/task/10651/stat : 10651 (plingeling) R 10621 10623 10597 0 -1 4202560 566784 1242 0 0 494573 768 0 1 25 0 33 0 705729641 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10623/tid=10652] ppid=10621 vsize=12251976 CPUtime=4950.04 cores=0-31
/proc/10623/task/10652/stat : 10652 (plingeling) R 10621 10623 10597 0 -1 4202560 484075 1242 0 0 494479 524 0 1 25 0 33 0 705729641 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=10623/tid=10653] ppid=10621 vsize=12251976 CPUtime=4940.04 cores=0-31
/proc/10623/task/10653/stat : 10653 (plingeling) R 10621 10623 10597 0 -1 4202560 583460 1242 0 0 493158 845 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=10623/tid=10654] ppid=10621 vsize=12251976 CPUtime=4952.91 cores=0-31
/proc/10623/task/10654/stat : 10654 (plingeling) R 10621 10623 10597 0 -1 4202560 542859 1242 0 0 494609 681 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10623/tid=10655] ppid=10621 vsize=12251976 CPUtime=4954.02 cores=0-31
/proc/10623/task/10655/stat : 10655 (plingeling) R 10621 10623 10597 0 -1 4202560 583652 1242 0 0 494662 739 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=10623/tid=10656] ppid=10621 vsize=12251976 CPUtime=4949.31 cores=0-31
/proc/10623/task/10656/stat : 10656 (plingeling) R 10621 10623 10597 0 -1 4202560 554824 1242 0 0 494172 758 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=12251976 CPUtime=4956.22 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4202560 562781 1242 0 0 494871 750 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10623/tid=10658] ppid=10621 vsize=12251976 CPUtime=4944.17 cores=0-31
/proc/10623/task/10658/stat : 10658 (plingeling) R 10621 10623 10597 0 -1 4202560 508744 1242 0 0 493815 601 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=10623/tid=10659] ppid=10621 vsize=12251976 CPUtime=4935.42 cores=0-31
/proc/10623/task/10659/stat : 10659 (plingeling) R 10621 10623 10597 0 -1 4202560 572091 1242 0 0 492798 743 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=10623/tid=10660] ppid=10621 vsize=12251976 CPUtime=4956.81 cores=0-31
/proc/10623/task/10660/stat : 10660 (plingeling) R 10621 10623 10597 0 -1 4202560 549664 1242 0 0 495095 585 0 1 25 0 33 0 705729642 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10623/tid=10661] ppid=10621 vsize=12251976 CPUtime=4952.39 cores=0-31
/proc/10623/task/10661/stat : 10661 (plingeling) R 10621 10623 10597 0 -1 4202560 548306 1242 0 0 494560 678 0 1 25 0 33 0 705729643 12546023424 2916785 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 158428
Current children cumulated vsize (KiB) 12251976



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.5 s]
/proc/loadavg: 32.08 32.04 32.06 34/446 11282
/proc/meminfo: memFree=244157812/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=11914952 CPUtime=160002 cores=0-31
/proc/10623/stat : 10623 (plingeling) S 10621 10623 10597 0 -1 4202496 17808345 1242 0 0 15978013 22231 0 1 18 0 33 0 705729302 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 2978738 2832536 175 55 0 2976624 0
[pid=10623/tid=10630] ppid=10621 vsize=11914952 CPUtime=5003.09 cores=0-31
/proc/10623/task/10630/stat : 10630 (plingeling) R 10621 10623 10597 0 -1 4202560 625147 1242 0 0 499597 711 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=10623/tid=10631] ppid=10621 vsize=11914952 CPUtime=4993.87 cores=0-31
/proc/10623/task/10631/stat : 10631 (plingeling) R 10621 10623 10597 0 -1 4202560 516424 1242 0 0 498829 557 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=10623/tid=10632] ppid=10621 vsize=11914952 CPUtime=5005.61 cores=0-31
/proc/10623/task/10632/stat : 10632 (plingeling) R 10621 10623 10597 0 -1 4202560 573373 1242 0 0 499824 736 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=10623/tid=10633] ppid=10621 vsize=11914952 CPUtime=4989.98 cores=0-31
/proc/10623/task/10633/stat : 10633 (plingeling) R 10621 10623 10597 0 -1 4202560 430820 1242 0 0 498688 309 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=10623/tid=10634] ppid=10621 vsize=11914952 CPUtime=5005.51 cores=0-31
/proc/10623/task/10634/stat : 10634 (plingeling) R 10621 10623 10597 0 -1 4202560 517540 1242 0 0 499909 641 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=10623/tid=10635] ppid=10621 vsize=11914952 CPUtime=4987.74 cores=0-31
/proc/10623/task/10635/stat : 10635 (plingeling) R 10621 10623 10597 0 -1 4202560 584306 1242 0 0 498053 720 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=10623/tid=10636] ppid=10621 vsize=11914952 CPUtime=5004.17 cores=0-31
/proc/10623/task/10636/stat : 10636 (plingeling) R 10621 10623 10597 0 -1 4202560 577787 1242 0 0 499707 709 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10623/tid=10637] ppid=10621 vsize=11914952 CPUtime=5002.13 cores=0-31
/proc/10623/task/10637/stat : 10637 (plingeling) R 10621 10623 10597 0 -1 4202560 592268 1242 0 0 499518 694 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=10623/tid=10638] ppid=10621 vsize=11914952 CPUtime=4990.93 cores=0-31
/proc/10623/task/10638/stat : 10638 (plingeling) R 10621 10623 10597 0 -1 4202560 466275 1242 0 0 498451 641 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=10623/tid=10639] ppid=10621 vsize=11914952 CPUtime=5005.25 cores=0-31
/proc/10623/task/10639/stat : 10639 (plingeling) R 10621 10623 10597 0 -1 4202560 594273 1242 0 0 499835 689 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=10623/tid=10640] ppid=10621 vsize=11914952 CPUtime=5001.28 cores=0-31
/proc/10623/task/10640/stat : 10640 (plingeling) R 10621 10623 10597 0 -1 4202560 439040 1242 0 0 499491 636 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=10623/tid=10641] ppid=10621 vsize=11914952 CPUtime=5000.83 cores=0-31
/proc/10623/task/10641/stat : 10641 (plingeling) R 10621 10623 10597 0 -1 4202560 560549 1242 0 0 499501 581 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=10623/tid=10642] ppid=10621 vsize=11914952 CPUtime=5001.86 cores=0-31
/proc/10623/task/10642/stat : 10642 (plingeling) R 10621 10623 10597 0 -1 4202560 517595 1242 0 0 499448 737 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=10623/tid=10643] ppid=10621 vsize=11914952 CPUtime=5006.42 cores=0-31
/proc/10623/task/10643/stat : 10643 (plingeling) R 10621 10623 10597 0 -1 4202560 603760 1242 0 0 499954 687 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=10623/tid=10644] ppid=10621 vsize=11914952 CPUtime=5003.76 cores=0-31
/proc/10623/task/10644/stat : 10644 (plingeling) R 10621 10623 10597 0 -1 4202560 578588 1242 0 0 499575 800 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10623/tid=10645] ppid=10621 vsize=11914952 CPUtime=4993.93 cores=0-31
/proc/10623/task/10645/stat : 10645 (plingeling) R 10621 10623 10597 0 -1 4202560 589142 1242 0 0 498586 806 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10623/tid=10646] ppid=10621 vsize=11914952 CPUtime=5000.3 cores=0-31
/proc/10623/task/10646/stat : 10646 (plingeling) R 10621 10623 10597 0 -1 4202560 477927 1242 0 0 499369 660 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=10623/tid=10647] ppid=10621 vsize=11914952 CPUtime=5003.47 cores=0-31
/proc/10623/task/10647/stat : 10647 (plingeling) R 10621 10623 10597 0 -1 4202560 653504 1242 0 0 499649 697 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=10623/tid=10648] ppid=10621 vsize=11914952 CPUtime=5005.61 cores=0-31
/proc/10623/task/10648/stat : 10648 (plingeling) R 10621 10623 10597 0 -1 4202560 591884 1242 0 0 499884 676 0 1 25 0 33 0 705729640 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364696 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=10623/tid=10649] ppid=10621 vsize=11914952 CPUtime=5003.75 cores=0-31
/proc/10623/task/10649/stat : 10649 (plingeling) R 10621 10623 10597 0 -1 4202560 656925 1242 0 0 499361 1013 0 1 25 0 33 0 705729641 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4353482 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=10623/tid=10650] ppid=10621 vsize=11914952 CPUtime=5004.72 cores=0-31
/proc/10623/task/10650/stat : 10650 (plingeling) R 10621 10623 10597 0 -1 4202560 531555 1242 0 0 499645 826 0 1 25 0 33 0 705729641 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=10623/tid=10651] ppid=10621 vsize=11914952 CPUtime=5002.65 cores=0-31
/proc/10623/task/10651/stat : 10651 (plingeling) R 10621 10623 10597 0 -1 4202560 566784 1242 0 0 499496 768 0 1 25 0 33 0 705729641 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10623/tid=10652] ppid=10621 vsize=11914952 CPUtime=4999.27 cores=0-31
/proc/10623/task/10652/stat : 10652 (plingeling) R 10621 10623 10597 0 -1 4202560 484075 1242 0 0 499402 524 0 1 25 0 33 0 705729641 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=10623/tid=10653] ppid=10621 vsize=11914952 CPUtime=4989.27 cores=0-31
/proc/10623/task/10653/stat : 10653 (plingeling) R 10621 10623 10597 0 -1 4202560 583460 1242 0 0 498081 845 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=10623/tid=10654] ppid=10621 vsize=11914952 CPUtime=5002.14 cores=0-31
/proc/10623/task/10654/stat : 10654 (plingeling) R 10621 10623 10597 0 -1 4202560 542859 1242 0 0 499532 681 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10623/tid=10655] ppid=10621 vsize=11914952 CPUtime=5003.25 cores=0-31
/proc/10623/task/10655/stat : 10655 (plingeling) R 10621 10623 10597 0 -1 4202560 583652 1242 0 0 499585 739 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=10623/tid=10656] ppid=10621 vsize=11914952 CPUtime=4998.55 cores=0-31
/proc/10623/task/10656/stat : 10656 (plingeling) R 10621 10623 10597 0 -1 4202560 554824 1242 0 0 499096 758 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=11914952 CPUtime=5005.45 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4202560 562781 1242 0 0 499794 750 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10623/tid=10658] ppid=10621 vsize=11914952 CPUtime=4993.4 cores=0-31
/proc/10623/task/10658/stat : 10658 (plingeling) R 10621 10623 10597 0 -1 4202560 508744 1242 0 0 498738 601 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=10623/tid=10659] ppid=10621 vsize=11914952 CPUtime=4983.24 cores=0-31
/proc/10623/task/10659/stat : 10659 (plingeling) R 10621 10623 10597 0 -1 4202560 572091 1242 0 0 497580 743 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=10623/tid=10660] ppid=10621 vsize=11914952 CPUtime=5006.04 cores=0-31
/proc/10623/task/10660/stat : 10660 (plingeling) R 10621 10623 10597 0 -1 4202560 549664 1242 0 0 500018 585 0 1 25 0 33 0 705729642 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4366117 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10623/tid=10661] ppid=10621 vsize=11914952 CPUtime=5001.62 cores=0-31
/proc/10623/task/10661/stat : 10661 (plingeling) R 10621 10623 10597 0 -1 4202560 548306 1242 0 0 499483 678 0 1 25 0 33 0 705729643 12200910848 2832536 268435456000 4194304 4417452 140735382608048 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 11914952

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.8 s]
/proc/loadavg: 32.08 32.04 32.06 34/446 11282
/proc/meminfo: memFree=244157812/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=0 CPUtime=160003 cores=0-31
/proc/10623/stat : 10623 (plingeling) Z 10621 10623 10597 0 -1 4203548 17808346 1242 0 0 15978035 22256 0 1 18 0 2 0 705729302 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 0 0 0 0 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=0 CPUtime=5005.71 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4203588 562781 1242 0 0 499795 775 0 1 25 0 2 0 705729642 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

[startup+5012.2 s]
/proc/loadavg: 32.08 32.04 32.06 34/446 11282
/proc/meminfo: memFree=244157812/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=0 CPUtime=160003 cores=0-31
/proc/10623/stat : 10623 (plingeling) Z 10621 10623 10597 0 -1 4203548 17808346 1242 0 0 15978035 22296 0 1 18 0 2 0 705729302 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 0 0 0 0 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=0 CPUtime=5006.11 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4203588 562781 1242 0 0 499795 815 0 1 25 0 2 0 705729642 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

[startup+5012.4 s]
/proc/loadavg: 32.08 32.04 32.06 34/446 11282
/proc/meminfo: memFree=244157812/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=0 CPUtime=160004 cores=0-31
/proc/10623/stat : 10623 (plingeling) Z 10621 10623 10597 0 -1 4203548 17808346 1242 0 0 15978035 22316 0 1 18 0 2 0 705729302 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 0 0 0 0 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=0 CPUtime=5006.31 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4203588 562781 1242 0 0 499795 835 0 1 25 0 2 0 705729642 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

[startup+5012.5 s]
/proc/loadavg: 32.08 32.04 32.06 34/446 11282
/proc/meminfo: memFree=244157812/264257624 swapFree=67111528/67111528
[pid=10623] ppid=10621 vsize=0 CPUtime=160004 cores=0-31
/proc/10623/stat : 10623 (plingeling) Z 10621 10623 10597 0 -1 4203548 17808346 1242 0 0 15978035 22326 0 1 18 0 2 0 705729302 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 8 0 0 0
/proc/10623/statm: 0 0 0 0 0 0 0
[pid=10623/tid=10657] ppid=10621 vsize=0 CPUtime=5006.41 cores=0-31
/proc/10623/task/10657/stat : 10657 (plingeling) R 10621 10623 10597 0 -1 4203588 562781 1242 0 0 499795 845 0 1 25 0 2 0 705729642 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.56
CPU time (s): 160004
CPU user time (s): 159780
CPU system time (s): 223.317
CPU usage (%): 3192.06
Max. virtual memory (cumulated for all children) (KiB): 12467288

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159780
system time used= 223.317
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17809588
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8606
involuntary context switches= 406070

runsolver used 27.1129 second user time and 114.66 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-21 03:47:09
IDJOB=3372678
IDBENCH=83113
IDSOLVER=1852
FILE ID=node200/3372678-1305942428
RUNJOBID= node200-1305942428-10611
PBS_JOBID= 13387783
Free space on /tmp= 62044 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top22.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372678-1305942428/watcher-3372678-1305942428 -o /tmp/evaluation-result-3372678-1305942428/solver-3372678-1305942428 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372678-1305942428.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= e822739302a2d834ec9ddfe9fbd0caa2
RANDOM SEED=1379052354

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255504072 kB
Buffers:        453352 kB
Cached:        7898544 kB
SwapCached:          0 kB
Active:        7411268 kB
Inactive:      1009752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255504072 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2912 kB
Writeback:           0 kB
AnonPages:       70140 kB
Mapped:          13484 kB
Slab:           252428 kB
PageTables:       3996 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   189764 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62044 MiB
End job on node200 at 2011-05-21 05:10:42