Trace number 3372249

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 160004 5019.11

General information on the benchmark

NameAPPLICATIONS/
bitverif/maxxor/maxxor128.cnf
MD5SUM065c126f0d55807310a398728b44423f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark148113
Satisfiable
(Un)Satisfiability was proved
Number of variables200440
Number of clauses599015
Sum of the clauses size1397699
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2399342
Number of clauses of size 3199671
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372249-1305523023/watcher-3372249-1305523023 -o /tmp/evaluation-result-3372249-1305523023/solver-3372249-1305523023 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372249-1305523023.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 27.14 31.02 31.72 1/413 16014
/proc/meminfo: memFree=255570760/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=16416 CPUtime=0.02 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 2179 1251 0 0 2 0 0 0 22 0 1 0 663788774 16809984 2109 268435456000 4194304 4417452 140734488338992 18446744073709551615 4274337 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 4104 2109 145 55 0 1990 0

[startup+0.0857491 s]
/proc/loadavg: 27.14 31.02 31.72 1/413 16014
/proc/meminfo: memFree=255570760/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=25164 CPUtime=0.07 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 4366 1251 0 0 7 0 0 0 22 0 1 0 663788774 25767936 4296 268435456000 4194304 4417452 140734488338992 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 6291 4296 145 55 0 4177 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 25164

[startup+0.100748 s]
/proc/loadavg: 27.14 31.02 31.72 1/413 16014
/proc/meminfo: memFree=255570760/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=29420 CPUtime=0.09 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 5431 1251 0 0 8 1 0 0 22 0 1 0 663788774 30126080 5361 268435456000 4194304 4417452 140734488338992 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 7355 5361 146 55 0 5241 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29420

[startup+0.300761 s]
/proc/loadavg: 27.14 31.02 31.72 1/413 16014
/proc/meminfo: memFree=255570760/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=47476 CPUtime=0.29 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 9945 1251 0 0 27 2 0 0 23 0 1 0 663788774 48615424 9875 268435456000 4194304 4417452 140734488338992 18446744073709551615 4227843 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 11869 9875 146 55 0 9755 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 47476

[startup+0.700757 s]
/proc/loadavg: 27.14 31.02 31.72 1/413 16014
/proc/meminfo: memFree=255570760/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=83732 CPUtime=0.68 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 19025 1251 0 0 64 4 0 0 25 0 1 0 663788774 85741568 18955 268435456000 4194304 4417452 140734488338992 18446744073709551615 4274387 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 20933 18955 146 55 0 18819 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 83732

[startup+1.50082 s]
/proc/loadavg: 27.14 31.02 31.72 2/414 16020
/proc/meminfo: memFree=255457152/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=153216 CPUtime=1.49 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 36403 1251 0 0 141 8 0 0 25 0 1 0 663788774 156893184 36326 268435456000 4194304 4417452 140734488338992 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 38304 36326 146 55 0 36190 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 153216

[startup+3.10086 s]
/proc/loadavg: 27.14 31.02 31.72 2/414 16020
/proc/meminfo: memFree=255348808/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=293568 CPUtime=3.09 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 71495 1251 0 0 294 15 0 0 25 0 1 0 663788774 300613632 71414 268435456000 4194304 4417452 140734488338992 18446744073709551615 4259147 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 73392 71414 146 55 0 71278 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 293568

[startup+6.30097 s]
/proc/loadavg: 25.05 30.53 31.56 2/414 16020
/proc/meminfo: memFree=255001004/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=575124 CPUtime=6.28 cores=0-31
/proc/16014/stat : 16014 (plingeling) R 16012 16014 15988 0 -1 4202496 142039 1251 0 0 600 28 0 0 25 0 1 0 663788774 588926976 141803 268435456000 4194304 4417452 140734488338992 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/16014/statm: 143781 141803 146 55 0 141667 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 575124

[startup+12.7031 s]
/proc/loadavg: 23.12 30.04 31.39 33/446 16052
/proc/meminfo: memFree=254507188/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=1892716 CPUtime=36.27 cores=0-31
/proc/16014/stat : 16014 (plingeling) S 16012 16014 15988 0 -1 4202496 455975 1251 0 0 3190 437 0 0 18 0 33 0 663788774 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 24 0 0 0
/proc/16014/statm: 473179 346276 168 55 0 471065 0
[pid=16014/tid=16021] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16021/stat : 16021 (plingeling) R 16012 16014 15988 0 -1 4202560 5485 1251 0 0 66 11 0 0 18 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=16014/tid=16022] ppid=16012 vsize=1892716 CPUtime=0.66 cores=0-31
/proc/16014/task/16022/stat : 16022 (plingeling) R 16012 16014 15988 0 -1 4202560 5482 1251 0 0 56 10 0 0 25 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284980 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16014/tid=16023] ppid=16012 vsize=1892716 CPUtime=0.79 cores=0-31
/proc/16014/task/16023/stat : 16023 (plingeling) R 16012 16014 15988 0 -1 4202560 5486 1251 0 0 71 8 0 0 18 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4288172 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16014/tid=16024] ppid=16012 vsize=1892716 CPUtime=0.79 cores=0-31
/proc/16014/task/16024/stat : 16024 (plingeling) R 16012 16014 15988 0 -1 4202560 4359 1251 0 0 75 4 0 0 18 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=16014/tid=16025] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16025/stat : 16025 (plingeling) R 16012 16014 15988 0 -1 4202560 5489 1251 0 0 67 10 0 0 18 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4290944 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16014/tid=16026] ppid=16012 vsize=1892716 CPUtime=0.78 cores=0-31
/proc/16014/task/16026/stat : 16026 (plingeling) R 16012 16014 15988 0 -1 4202560 5482 1251 0 0 66 12 0 0 22 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284160 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16014/tid=16027] ppid=16012 vsize=1892716 CPUtime=0.78 cores=0-31
/proc/16014/task/16027/stat : 16027 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 66 12 0 0 18 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284860 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16014/tid=16028] ppid=16012 vsize=1892716 CPUtime=0.78 cores=0-31
/proc/16014/task/16028/stat : 16028 (plingeling) R 16012 16014 15988 0 -1 4202560 5467 1251 0 0 68 10 0 0 18 0 33 0 663789962 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4291216 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=16014/tid=16029] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16029/stat : 16029 (plingeling) R 16012 16014 15988 0 -1 4202560 5479 1251 0 0 67 10 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=16014/tid=16030] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16030/stat : 16030 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 63 14 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4286255 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=16014/tid=16031] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16031/stat : 16031 (plingeling) R 16012 16014 15988 0 -1 4202560 5483 1251 0 0 67 10 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16014/tid=16032] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16032/stat : 16032 (plingeling) R 16012 16014 15988 0 -1 4202560 5483 1251 0 0 62 15 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4288920 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=16014/tid=16033] ppid=16012 vsize=1892716 CPUtime=0.78 cores=0-31
/proc/16014/task/16033/stat : 16033 (plingeling) R 16012 16014 15988 0 -1 4202560 5483 1251 0 0 67 11 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=16014/tid=16034] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16034/stat : 16034 (plingeling) R 16012 16014 15988 0 -1 4202560 5530 1251 0 0 63 14 0 0 20 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284484 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=16014/tid=16035] ppid=16012 vsize=1892716 CPUtime=0.75 cores=0-31
/proc/16014/task/16035/stat : 16035 (plingeling) R 16012 16014 15988 0 -1 4202560 5484 1251 0 0 65 10 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4291616 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=16014/tid=16036] ppid=16012 vsize=1892716 CPUtime=0.75 cores=0-31
/proc/16014/task/16036/stat : 16036 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 66 9 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4291876 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16014/tid=16037] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16037/stat : 16037 (plingeling) R 16012 16014 15988 0 -1 4202560 5533 1251 0 0 66 11 0 0 20 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=16014/tid=16038] ppid=16012 vsize=1892716 CPUtime=0.76 cores=0-31
/proc/16014/task/16038/stat : 16038 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 66 10 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4290456 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=16014/tid=16039] ppid=16012 vsize=1892716 CPUtime=0.76 cores=0-31
/proc/16014/task/16039/stat : 16039 (plingeling) R 16012 16014 15988 0 -1 4202560 5531 1251 0 0 65 11 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4290744 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=16014/tid=16040] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16040/stat : 16040 (plingeling) R 16012 16014 15988 0 -1 4202560 5529 1251 0 0 62 15 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284516 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=16014/tid=16041] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16041/stat : 16041 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 62 15 0 0 22 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4287201 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=16014/tid=16042] ppid=16012 vsize=1892716 CPUtime=0.77 cores=0-31
/proc/16014/task/16042/stat : 16042 (plingeling) R 16012 16014 15988 0 -1 4202560 5285 1251 0 0 63 14 0 0 22 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=16014/tid=16043] ppid=16012 vsize=1892716 CPUtime=0.72 cores=0-31
/proc/16014/task/16043/stat : 16043 (plingeling) R 16012 16014 15988 0 -1 4202560 5533 1251 0 0 61 11 0 0 18 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284484 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=16014/tid=16044] ppid=16012 vsize=1892716 CPUtime=0.75 cores=0-31
/proc/16014/task/16044/stat : 16044 (plingeling) R 16012 16014 15988 0 -1 4202560 5484 1251 0 0 61 14 0 0 22 0 33 0 663789963 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=16014/tid=16045] ppid=16012 vsize=1892716 CPUtime=0.74 cores=0-31
/proc/16014/task/16045/stat : 16045 (plingeling) R 16012 16014 15988 0 -1 4202560 5480 1251 0 0 61 13 0 0 18 0 33 0 663789964 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4287492 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=16014/tid=16046] ppid=16012 vsize=1892716 CPUtime=0.75 cores=0-31
/proc/16014/task/16046/stat : 16046 (plingeling) R 16012 16014 15988 0 -1 4202560 5335 1251 0 0 61 14 0 0 18 0 33 0 663789964 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=16014/tid=16047] ppid=16012 vsize=1892716 CPUtime=0.75 cores=0-31
/proc/16014/task/16047/stat : 16047 (plingeling) R 16012 16014 15988 0 -1 4202560 5482 1251 0 0 61 14 0 0 18 0 33 0 663789964 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=16014/tid=16048] ppid=16012 vsize=1892716 CPUtime=0.61 cores=0-31
/proc/16014/task/16048/stat : 16048 (plingeling) R 16012 16014 15988 0 -1 4202560 5090 1251 0 0 57 4 0 0 18 0 33 0 663789964 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4285006 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=16014/tid=16049] ppid=16012 vsize=1892716 CPUtime=0.69 cores=0-31
/proc/16014/task/16049/stat : 16049 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 61 8 0 0 18 0 33 0 663789964 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4286323 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16014/tid=16050] ppid=16012 vsize=1892716 CPUtime=0.74 cores=0-31
/proc/16014/task/16050/stat : 16050 (plingeling) R 16012 16014 15988 0 -1 4202560 5481 1251 0 0 63 11 0 0 20 0 33 0 663789965 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284167 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=16014/tid=16051] ppid=16012 vsize=1892716 CPUtime=0.75 cores=0-31
/proc/16014/task/16051/stat : 16051 (plingeling) R 16012 16014 15988 0 -1 4202560 5334 1251 0 0 62 13 0 0 20 0 33 0 663789965 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4284484 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=16014/tid=16052] ppid=16012 vsize=1892716 CPUtime=0.76 cores=0-31
/proc/16014/task/16052/stat : 16052 (plingeling) R 16012 16014 15988 0 -1 4202560 5287 1251 0 0 60 16 0 0 20 0 33 0 663789965 1938141184 346276 268435456000 4194304 4417452 140734488338992 18446744073709551615 4287492 0 0 4096 17442 0 0 0 -1 22 0 0 0
Current children cumulated CPU time (s) 36.27
Current children cumulated vsize (KiB) 1892716

[startup+25.5015 s]
/proc/loadavg: 25.09 30.13 31.40 33/446 16052
/proc/meminfo: memFree=253362336/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=2562552 CPUtime=435.47 cores=0-31
/proc/16014/stat : 16014 (plingeling) S 16012 16014 15988 0 -1 4202496 820922 1251 0 0 42803 744 0 0 18 0 33 0 663788774 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 24 0 0 0
/proc/16014/statm: 640638 546775 174 55 0 638524 0
[pid=16014/tid=16021] ppid=16012 vsize=2562552 CPUtime=13.29 cores=0-31
/proc/16014/task/16021/stat : 16021 (plingeling) R 16012 16014 15988 0 -1 4202560 25958 1251 0 0 1302 27 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=16014/tid=16022] ppid=16012 vsize=2562552 CPUtime=13.35 cores=0-31
/proc/16014/task/16022/stat : 16022 (plingeling) R 16012 16014 15988 0 -1 4202560 20411 1251 0 0 1310 25 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4253272 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16014/tid=16023] ppid=16012 vsize=2562552 CPUtime=13.48 cores=0-31
/proc/16014/task/16023/stat : 16023 (plingeling) R 16012 16014 15988 0 -1 4202560 14398 1251 0 0 1339 9 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=16014/tid=16024] ppid=16012 vsize=2562552 CPUtime=13.57 cores=0-31
/proc/16014/task/16024/stat : 16024 (plingeling) R 16012 16014 15988 0 -1 4202560 4360 1251 0 0 1353 4 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=16014/tid=16025] ppid=16012 vsize=2562552 CPUtime=13.47 cores=0-31
/proc/16014/task/16025/stat : 16025 (plingeling) R 16012 16014 15988 0 -1 4202560 27063 1251 0 0 1322 25 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=16014/tid=16026] ppid=16012 vsize=2562552 CPUtime=13.2 cores=0-31
/proc/16014/task/16026/stat : 16026 (plingeling) R 16012 16014 15988 0 -1 4202560 13882 1251 0 0 1296 24 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4235099 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16014/tid=16027] ppid=16012 vsize=2562552 CPUtime=13.46 cores=0-31
/proc/16014/task/16027/stat : 16027 (plingeling) R 16012 16014 15988 0 -1 4202560 13466 1251 0 0 1332 14 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=16014/tid=16028] ppid=16012 vsize=2562552 CPUtime=12.93 cores=0-31
/proc/16014/task/16028/stat : 16028 (plingeling) R 16012 16014 15988 0 -1 4202560 24447 1251 0 0 1266 27 0 0 25 0 33 0 663789962 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4253390 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=16014/tid=16029] ppid=16012 vsize=2562552 CPUtime=13.34 cores=0-31
/proc/16014/task/16029/stat : 16029 (plingeling) R 16012 16014 15988 0 -1 4202560 13284 1251 0 0 1311 23 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4274030 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=16014/tid=16030] ppid=16012 vsize=2562552 CPUtime=13.21 cores=0-31
/proc/16014/task/16030/stat : 16030 (plingeling) R 16012 16014 15988 0 -1 4202560 13885 1251 0 0 1305 16 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4320455 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=16014/tid=16031] ppid=16012 vsize=2562552 CPUtime=13.47 cores=0-31
/proc/16014/task/16031/stat : 16031 (plingeling) R 16012 16014 15988 0 -1 4202560 15685 1251 0 0 1335 12 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=16014/tid=16032] ppid=16012 vsize=2562552 CPUtime=13.05 cores=0-31
/proc/16014/task/16032/stat : 16032 (plingeling) R 16012 16014 15988 0 -1 4202560 20232 1251 0 0 1277 28 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4253214 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16014/tid=16033] ppid=16012 vsize=2562552 CPUtime=13.42 cores=0-31
/proc/16014/task/16033/stat : 16033 (plingeling) R 16012 16014 15988 0 -1 4202560 28266 1251 0 0 1315 27 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4273321 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=16014/tid=16034] ppid=16012 vsize=2562552 CPUtime=13.28 cores=0-31
/proc/16014/task/16034/stat : 16034 (plingeling) R 16012 16014 15988 0 -1 4202560 17183 1251 0 0 1305 23 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4252943 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=16014/tid=16035] ppid=16012 vsize=2562552 CPUtime=13.47 cores=0-31
/proc/16014/task/16035/stat : 16035 (plingeling) R 16012 16014 15988 0 -1 4202560 8676 1251 0 0 1336 11 0 0 25 0 33 0 663789963 2624053248 546775 268435456000 4194304 4417452 140734488338992 18446744073709551615 4236655 0 0 4096 17442 0 0 0 -1 20 0 0 0

################
# More data... #
################

/proc/16014/task/16026/stat : 16026 (plingeling) R 16012 16014 15988 0 -1 4202560 520284 1251 0 0 492536 539 0 0 25 0 33 0 663789962 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=16014/tid=16027] ppid=16012 vsize=6513720 CPUtime=4944.99 cores=0-31
/proc/16014/task/16027/stat : 16027 (plingeling) R 16012 16014 15988 0 -1 4202560 352795 1251 0 0 494313 186 0 0 25 0 33 0 663789962 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=16014/tid=16028] ppid=16012 vsize=6513720 CPUtime=4946.39 cores=0-31
/proc/16014/task/16028/stat : 16028 (plingeling) R 16012 16014 15988 0 -1 4202560 338383 1251 0 0 494240 399 0 0 25 0 33 0 663789962 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16014/tid=16029] ppid=16012 vsize=6513720 CPUtime=4945.53 cores=0-31
/proc/16014/task/16029/stat : 16029 (plingeling) R 16012 16014 15988 0 -1 4202560 286657 1251 0 0 494155 398 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=16014/tid=16030] ppid=16012 vsize=6513720 CPUtime=4947.55 cores=0-31
/proc/16014/task/16030/stat : 16030 (plingeling) R 16012 16014 15988 0 -1 4202560 114608 1251 0 0 494681 74 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=16014/tid=16031] ppid=16012 vsize=6513720 CPUtime=4926.36 cores=0-31
/proc/16014/task/16031/stat : 16031 (plingeling) R 16012 16014 15988 0 -1 4202560 141332 1251 0 0 492498 138 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4365181 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16014/tid=16032] ppid=16012 vsize=6513720 CPUtime=4946.85 cores=0-31
/proc/16014/task/16032/stat : 16032 (plingeling) R 16012 16014 15988 0 -1 4202560 116273 1251 0 0 494609 76 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=16014/tid=16033] ppid=16012 vsize=6513720 CPUtime=4941.5 cores=0-31
/proc/16014/task/16033/stat : 16033 (plingeling) R 16012 16014 15988 0 -1 4202560 118100 1251 0 0 494070 80 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16014/tid=16034] ppid=16012 vsize=6513720 CPUtime=4946.38 cores=0-31
/proc/16014/task/16034/stat : 16034 (plingeling) R 16012 16014 15988 0 -1 4202560 211149 1251 0 0 494451 187 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=16014/tid=16035] ppid=16012 vsize=6513720 CPUtime=4948.86 cores=0-31
/proc/16014/task/16035/stat : 16035 (plingeling) R 16012 16014 15988 0 -1 4202560 274833 1251 0 0 494604 282 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=16014/tid=16036] ppid=16012 vsize=6513720 CPUtime=4942.12 cores=0-31
/proc/16014/task/16036/stat : 16036 (plingeling) R 16012 16014 15988 0 -1 4202560 170079 1251 0 0 494058 154 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16014/tid=16037] ppid=16012 vsize=6513720 CPUtime=4945.43 cores=0-31
/proc/16014/task/16037/stat : 16037 (plingeling) R 16012 16014 15988 0 -1 4202560 231605 1251 0 0 494282 261 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4353536 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=16014/tid=16038] ppid=16012 vsize=6513720 CPUtime=4931.44 cores=0-31
/proc/16014/task/16038/stat : 16038 (plingeling) R 16012 16014 15988 0 -1 4202560 143942 1251 0 0 492968 176 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=16014/tid=16039] ppid=16012 vsize=6513720 CPUtime=4933.2 cores=0-31
/proc/16014/task/16039/stat : 16039 (plingeling) R 16012 16014 15988 0 -1 4202560 176731 1251 0 0 493200 120 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=16014/tid=16040] ppid=16012 vsize=6513720 CPUtime=4945.24 cores=0-31
/proc/16014/task/16040/stat : 16040 (plingeling) R 16012 16014 15988 0 -1 4202560 163888 1251 0 0 494399 125 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=16014/tid=16041] ppid=16012 vsize=6513720 CPUtime=4946.64 cores=0-31
/proc/16014/task/16041/stat : 16041 (plingeling) R 16012 16014 15988 0 -1 4202560 147302 1251 0 0 494508 156 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4265425 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16014/tid=16042] ppid=16012 vsize=6513720 CPUtime=4947.98 cores=0-31
/proc/16014/task/16042/stat : 16042 (plingeling) R 16012 16014 15988 0 -1 4202560 241971 1251 0 0 494630 168 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=16014/tid=16043] ppid=16012 vsize=6513720 CPUtime=4933.88 cores=0-31
/proc/16014/task/16043/stat : 16043 (plingeling) R 16012 16014 15988 0 -1 4202560 222095 1251 0 0 493298 90 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4357902 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=16014/tid=16044] ppid=16012 vsize=6513720 CPUtime=4948.17 cores=0-31
/proc/16014/task/16044/stat : 16044 (plingeling) R 16012 16014 15988 0 -1 4202560 182120 1251 0 0 494641 176 0 0 25 0 33 0 663789963 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=16014/tid=16045] ppid=16012 vsize=6513720 CPUtime=4947.38 cores=0-31
/proc/16014/task/16045/stat : 16045 (plingeling) R 16012 16014 15988 0 -1 4202560 197829 1251 0 0 494580 158 0 0 25 0 33 0 663789964 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4320859 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=16014/tid=16046] ppid=16012 vsize=6513720 CPUtime=4947.92 cores=0-31
/proc/16014/task/16046/stat : 16046 (plingeling) R 16012 16014 15988 0 -1 4202560 217924 1251 0 0 494600 192 0 0 25 0 33 0 663789964 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16014/tid=16047] ppid=16012 vsize=6513720 CPUtime=4947.61 cores=0-31
/proc/16014/task/16047/stat : 16047 (plingeling) R 16012 16014 15988 0 -1 4202560 478096 1251 0 0 494309 452 0 0 25 0 33 0 663789964 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4366014 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=16014/tid=16048] ppid=16012 vsize=6513720 CPUtime=4945.09 cores=0-31
/proc/16014/task/16048/stat : 16048 (plingeling) R 16012 16014 15988 0 -1 4202560 240549 1251 0 0 494278 231 0 0 25 0 33 0 663789964 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=16014/tid=16049] ppid=16012 vsize=6513720 CPUtime=4943.65 cores=0-31
/proc/16014/task/16049/stat : 16049 (plingeling) R 16012 16014 15988 0 -1 4202560 182355 1251 0 0 494109 256 0 0 25 0 33 0 663789964 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16014/tid=16050] ppid=16012 vsize=6513720 CPUtime=4937.66 cores=0-31
/proc/16014/task/16050/stat : 16050 (plingeling) R 16012 16014 15988 0 -1 4202560 164210 1251 0 0 493622 144 0 0 25 0 33 0 663789965 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4365181 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=16014/tid=16051] ppid=16012 vsize=6513720 CPUtime=4948.88 cores=0-31
/proc/16014/task/16051/stat : 16051 (plingeling) R 16012 16014 15988 0 -1 4202560 126217 1251 0 0 494812 76 0 0 25 0 33 0 663789965 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4232721 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=16014/tid=16052] ppid=16012 vsize=6513720 CPUtime=4948.05 cores=0-31
/proc/16014/task/16052/stat : 16052 (plingeling) R 16012 16014 15988 0 -1 4202560 165420 1251 0 0 494739 66 0 0 25 0 33 0 663789965 6670049280 1527079 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 158206
Current children cumulated vsize (KiB) 6513720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5018.5 s]
/proc/loadavg: 32.08 32.12 32.08 33/446 16201
/proc/meminfo: memFree=249197488/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=6807368 CPUtime=160003 cores=0-31
/proc/16014/stat : 16014 (plingeling) S 16012 16014 15988 0 -1 4202496 8912179 1251 0 0 15992231 8046 0 0 18 0 33 0 663788774 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 24 0 0 0
/proc/16014/statm: 1701842 1589680 175 55 0 1699728 0
[pid=16014/tid=16021] ppid=16012 vsize=6807368 CPUtime=4999.97 cores=0-31
/proc/16014/task/16021/stat : 16021 (plingeling) R 16012 16014 15988 0 -1 4202560 299577 1251 0 0 499648 349 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4253162 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=16014/tid=16022] ppid=16012 vsize=6807368 CPUtime=4996.15 cores=0-31
/proc/16014/task/16022/stat : 16022 (plingeling) R 16012 16014 15988 0 -1 4202560 100204 1251 0 0 499528 87 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=16014/tid=16023] ppid=16012 vsize=6807368 CPUtime=5003.6 cores=0-31
/proc/16014/task/16023/stat : 16023 (plingeling) R 16012 16014 15988 0 -1 4202560 247131 1251 0 0 500146 214 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16014/tid=16024] ppid=16012 vsize=6807368 CPUtime=5005 cores=0-31
/proc/16014/task/16024/stat : 16024 (plingeling) R 16012 16014 15988 0 -1 4202560 1662154 1251 0 0 498922 1578 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=16014/tid=16025] ppid=16012 vsize=6807368 CPUtime=5004.45 cores=0-31
/proc/16014/task/16025/stat : 16025 (plingeling) R 16012 16014 15988 0 -1 4202560 332709 1251 0 0 500100 345 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=16014/tid=16026] ppid=16012 vsize=6807368 CPUtime=4986.01 cores=0-31
/proc/16014/task/16026/stat : 16026 (plingeling) R 16012 16014 15988 0 -1 4202560 520315 1251 0 0 498062 539 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=16014/tid=16027] ppid=16012 vsize=6807368 CPUtime=5001.2 cores=0-31
/proc/16014/task/16027/stat : 16027 (plingeling) R 16012 16014 15988 0 -1 4202560 352795 1251 0 0 499934 186 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4346298 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=16014/tid=16028] ppid=16012 vsize=6807368 CPUtime=5002.61 cores=0-31
/proc/16014/task/16028/stat : 16028 (plingeling) R 16012 16014 15988 0 -1 4202560 338383 1251 0 0 499862 399 0 0 25 0 33 0 663789962 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16014/tid=16029] ppid=16012 vsize=6807368 CPUtime=5001.74 cores=0-31
/proc/16014/task/16029/stat : 16029 (plingeling) R 16012 16014 15988 0 -1 4202560 287961 1251 0 0 499776 398 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=16014/tid=16030] ppid=16012 vsize=6807368 CPUtime=5003.07 cores=0-31
/proc/16014/task/16030/stat : 16030 (plingeling) R 16012 16014 15988 0 -1 4202560 114608 1251 0 0 500233 74 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=16014/tid=16031] ppid=16012 vsize=6807368 CPUtime=4982.57 cores=0-31
/proc/16014/task/16031/stat : 16031 (plingeling) R 16012 16014 15988 0 -1 4202560 141372 1251 0 0 498119 138 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16014/tid=16032] ppid=16012 vsize=6807368 CPUtime=5003.04 cores=0-31
/proc/16014/task/16032/stat : 16032 (plingeling) R 16012 16014 15988 0 -1 4202560 116273 1251 0 0 500228 76 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=16014/tid=16033] ppid=16012 vsize=6807368 CPUtime=4997.72 cores=0-31
/proc/16014/task/16033/stat : 16033 (plingeling) R 16012 16014 15988 0 -1 4202560 125344 1251 0 0 499690 82 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16014/tid=16034] ppid=16012 vsize=6807368 CPUtime=5002.56 cores=0-31
/proc/16014/task/16034/stat : 16034 (plingeling) R 16012 16014 15988 0 -1 4202560 217054 1251 0 0 500067 189 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=16014/tid=16035] ppid=16012 vsize=6807368 CPUtime=5005.06 cores=0-31
/proc/16014/task/16035/stat : 16035 (plingeling) R 16012 16014 15988 0 -1 4202560 283591 1251 0 0 500222 284 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4346482 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=16014/tid=16036] ppid=16012 vsize=6807368 CPUtime=4998.32 cores=0-31
/proc/16014/task/16036/stat : 16036 (plingeling) R 16012 16014 15988 0 -1 4202560 170079 1251 0 0 499678 154 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16014/tid=16037] ppid=16012 vsize=6807368 CPUtime=5001.65 cores=0-31
/proc/16014/task/16037/stat : 16037 (plingeling) R 16012 16014 15988 0 -1 4202560 231605 1251 0 0 499904 261 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=16014/tid=16038] ppid=16012 vsize=6807368 CPUtime=4987.64 cores=0-31
/proc/16014/task/16038/stat : 16038 (plingeling) R 16012 16014 15988 0 -1 4202560 143942 1251 0 0 498588 176 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=16014/tid=16039] ppid=16012 vsize=6807368 CPUtime=4989.41 cores=0-31
/proc/16014/task/16039/stat : 16039 (plingeling) R 16012 16014 15988 0 -1 4202560 201313 1251 0 0 498817 124 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=16014/tid=16040] ppid=16012 vsize=6807368 CPUtime=5001.45 cores=0-31
/proc/16014/task/16040/stat : 16040 (plingeling) R 16012 16014 15988 0 -1 4202560 163888 1251 0 0 500020 125 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=16014/tid=16041] ppid=16012 vsize=6807368 CPUtime=5002.83 cores=0-31
/proc/16014/task/16041/stat : 16041 (plingeling) R 16012 16014 15988 0 -1 4202560 147302 1251 0 0 500127 156 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16014/tid=16042] ppid=16012 vsize=6807368 CPUtime=5004.2 cores=0-31
/proc/16014/task/16042/stat : 16042 (plingeling) R 16012 16014 15988 0 -1 4202560 243736 1251 0 0 500251 169 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=16014/tid=16043] ppid=16012 vsize=6807368 CPUtime=4990.09 cores=0-31
/proc/16014/task/16043/stat : 16043 (plingeling) R 16012 16014 15988 0 -1 4202560 232800 1251 0 0 498890 119 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4251238 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=16014/tid=16044] ppid=16012 vsize=6807368 CPUtime=5004.37 cores=0-31
/proc/16014/task/16044/stat : 16044 (plingeling) R 16012 16014 15988 0 -1 4202560 182120 1251 0 0 500261 176 0 0 25 0 33 0 663789963 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=16014/tid=16045] ppid=16012 vsize=6807368 CPUtime=5003.59 cores=0-31
/proc/16014/task/16045/stat : 16045 (plingeling) R 16012 16014 15988 0 -1 4202560 197829 1251 0 0 500201 158 0 0 25 0 33 0 663789964 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4346361 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=16014/tid=16046] ppid=16012 vsize=6807368 CPUtime=5004.12 cores=0-31
/proc/16014/task/16046/stat : 16046 (plingeling) R 16012 16014 15988 0 -1 4202560 217924 1251 0 0 500220 192 0 0 25 0 33 0 663789964 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16014/tid=16047] ppid=16012 vsize=6807368 CPUtime=5003.81 cores=0-31
/proc/16014/task/16047/stat : 16047 (plingeling) R 16012 16014 15988 0 -1 4202560 478875 1251 0 0 499929 452 0 0 25 0 33 0 663789964 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=16014/tid=16048] ppid=16012 vsize=6807368 CPUtime=5001.31 cores=0-31
/proc/16014/task/16048/stat : 16048 (plingeling) R 16012 16014 15988 0 -1 4202560 240549 1251 0 0 499900 231 0 0 25 0 33 0 663789964 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=16014/tid=16049] ppid=16012 vsize=6807368 CPUtime=4999.86 cores=0-31
/proc/16014/task/16049/stat : 16049 (plingeling) R 16012 16014 15988 0 -1 4202560 182386 1251 0 0 499730 256 0 0 25 0 33 0 663789964 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16014/tid=16050] ppid=16012 vsize=6807368 CPUtime=4993.86 cores=0-31
/proc/16014/task/16050/stat : 16050 (plingeling) R 16012 16014 15988 0 -1 4202560 164210 1251 0 0 499242 144 0 0 25 0 33 0 663789965 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4236750 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=16014/tid=16051] ppid=16012 vsize=6807368 CPUtime=5005.08 cores=0-31
/proc/16014/task/16051/stat : 16051 (plingeling) R 16012 16014 15988 0 -1 4202560 126217 1251 0 0 500432 76 0 0 25 0 33 0 663789965 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4232693 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=16014/tid=16052] ppid=16012 vsize=6807368 CPUtime=5004.25 cores=0-31
/proc/16014/task/16052/stat : 16052 (plingeling) R 16012 16014 15988 0 -1 4202560 165420 1251 0 0 500359 66 0 0 25 0 33 0 663789965 6970744832 1589680 268435456000 4194304 4417452 140734488338992 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 6807368

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5018.63 s]
/proc/loadavg: 32.08 32.12 32.08 33/446 16201
/proc/meminfo: memFree=249197488/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=0 CPUtime=160003 cores=0-31
/proc/16014/stat : 16014 (plingeling) Z 16012 16014 15988 0 -1 4203548 8912179 1251 0 0 15992253 8056 0 0 18 0 2 0 663788774 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 24 0 0 0
/proc/16014/statm: 0 0 0 0 0 0 0
[pid=16014/tid=16051] ppid=16012 vsize=0 CPUtime=5005.19 cores=0-31
/proc/16014/task/16051/stat : 16051 (plingeling) R 16012 16014 15988 0 -1 4203588 126217 1251 0 0 500433 86 0 0 25 0 2 0 663789965 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 13 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

[startup+5019 s]
/proc/loadavg: 32.08 32.12 32.08 33/446 16201
/proc/meminfo: memFree=249197488/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=0 CPUtime=160003 cores=0-31
/proc/16014/stat : 16014 (plingeling) Z 16012 16014 15988 0 -1 4203548 8912179 1251 0 0 15992253 8093 0 0 18 0 2 0 663788774 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 24 0 0 0
/proc/16014/statm: 0 0 0 0 0 0 0
[pid=16014/tid=16051] ppid=16012 vsize=0 CPUtime=5005.56 cores=0-31
/proc/16014/task/16051/stat : 16051 (plingeling) R 16012 16014 15988 0 -1 4203588 126217 1251 0 0 500433 123 0 0 25 0 2 0 663789965 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 13 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

[startup+5019.1 s]
/proc/loadavg: 32.08 32.12 32.08 33/446 16201
/proc/meminfo: memFree=249197488/264257624 swapFree=67111528/67111528
[pid=16014] ppid=16012 vsize=0 CPUtime=160004 cores=0-31
/proc/16014/stat : 16014 (plingeling) Z 16012 16014 15988 0 -1 4203548 8912179 1251 0 0 15992253 8103 0 0 18 0 2 0 663788774 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 24 0 0 0
/proc/16014/statm: 0 0 0 0 0 0 0
[pid=16014/tid=16051] ppid=16012 vsize=0 CPUtime=5005.66 cores=0-31
/proc/16014/task/16051/stat : 16051 (plingeling) R 16012 16014 15988 0 -1 4203588 126217 1251 0 0 500433 133 0 0 25 0 2 0 663789965 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 13 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5019.11
CPU time (s): 160004
CPU user time (s): 159923
CPU system time (s): 81.0577
CPU usage (%): 3187.89
Max. virtual memory (cumulated for all children) (KiB): 7060780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159923
system time used= 81.0577
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8913430
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14553
involuntary context switches= 405927

runsolver used 28.0417 second user time and 114.205 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-16 07:17:04
IDJOB=3372249
IDBENCH=70815
IDSOLVER=1852
FILE ID=node200/3372249-1305523023
RUNJOBID= node200-1305523023-16002
PBS_JOBID= 13285536
Free space on /tmp= 62040 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxxor/maxxor128.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372249-1305523023/watcher-3372249-1305523023 -o /tmp/evaluation-result-3372249-1305523023/solver-3372249-1305523023 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372249-1305523023.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 065c126f0d55807310a398728b44423f
RANDOM SEED=857686180

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255570792 kB
Buffers:        442720 kB
Cached:        7846972 kB
SwapCached:          0 kB
Active:        7395896 kB
Inactive:       962328 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255570792 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           11052 kB
Writeback:           0 kB
AnonPages:       68860 kB
Mapped:          14480 kB
Slab:           251072 kB
PageTables:       4432 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   182372 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62040 MiB
End job on node200 at 2011-05-16 08:40:44