Trace number 3372696

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 160004 5010.31

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom19.cnf
MD5SUMd725e0d6a363434dce7cb39ffdb1b83f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables40286
Number of clauses134663
Sum of the clauses size343327
Maximum clause length1301
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 269181
Number of clauses of size 364779
Number of clauses of size 4189
Number of clauses of size 517
Number of clauses of size over 5496

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372696-1305962649/watcher-3372696-1305962649 -o /tmp/evaluation-result-3372696-1305962649/solver-3372696-1305962649 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372696-1305962649.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 30.11 30.98 31.60 1/413 12174
/proc/meminfo: memFree=255489036/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=31064 CPUtime=0.03 cores=0-31
/proc/12174/stat : 12174 (plingeling) R 12172 12174 12014 0 -1 4202496 5717 1241 0 0 1 1 0 1 18 0 1 0 707751344 31809536 5649 268435456000 4194304 4417452 140735815948752 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/12174/statm: 7766 5661 138 55 0 5652 0

[startup+0.084963 s]
/proc/loadavg: 30.11 30.98 31.60 1/413 12174
/proc/meminfo: memFree=255489036/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=47732 CPUtime=0.08 cores=0-31
/proc/12174/stat : 12174 (plingeling) R 12172 12174 12014 0 -1 4202496 9989 1241 0 0 5 2 0 1 18 0 1 0 707751344 48877568 9921 268435456000 4194304 4417452 140735815948752 18446744073709551615 4264911 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/12174/statm: 11933 9921 145 55 0 9819 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 47732

[startup+0.100973 s]
/proc/loadavg: 30.11 30.98 31.60 1/413 12174
/proc/meminfo: memFree=255489036/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=48148 CPUtime=0.09 cores=0-31
/proc/12174/stat : 12174 (plingeling) R 12172 12174 12014 0 -1 4202496 10110 1241 0 0 6 2 0 1 18 0 1 0 707751344 49303552 10042 268435456000 4194304 4417452 140735815948752 18446744073709551615 4274358 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/12174/statm: 12037 10042 145 55 0 9923 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 48148

[startup+0.30098 s]
/proc/loadavg: 30.11 30.98 31.60 1/413 12174
/proc/meminfo: memFree=255489036/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=67664 CPUtime=0.29 cores=0-31
/proc/12174/stat : 12174 (plingeling) R 12172 12174 12014 0 -1 4202496 15005 1241 0 0 25 3 0 1 18 0 1 0 707751344 69287936 14937 268435456000 4194304 4417452 140735815948752 18446744073709551615 4259140 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/12174/statm: 16916 14937 146 55 0 14802 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 67664

[startup+0.700991 s]
/proc/loadavg: 30.11 30.98 31.60 1/413 12174
/proc/meminfo: memFree=255489036/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=90444 CPUtime=0.69 cores=0-31
/proc/12174/stat : 12174 (plingeling) R 12172 12174 12014 0 -1 4202496 20684 1241 0 0 63 5 0 1 18 0 1 0 707751344 92614656 20616 268435456000 4194304 4417452 140735815948752 18446744073709551615 4260023 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/12174/statm: 22611 20616 146 55 0 20497 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 90444

[startup+1.501 s]
/proc/loadavg: 30.11 30.98 31.60 2/414 12180
/proc/meminfo: memFree=255373692/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=169036 CPUtime=1.49 cores=0-31
/proc/12174/stat : 12174 (plingeling) R 12172 12174 12014 0 -1 4202496 40320 1241 0 0 139 9 0 1 20 0 1 0 707751344 173092864 40252 268435456000 4194304 4417452 140735815948752 18446744073709551615 4236008 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/12174/statm: 42259 40252 146 55 0 40145 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 169036

[startup+3.10095 s]
/proc/loadavg: 30.11 30.98 31.60 2/414 12180
/proc/meminfo: memFree=255261700/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=948932 CPUtime=15.78 cores=0-31
/proc/12174/stat : 12174 (plingeling) S 12172 12174 12014 0 -1 4202496 113270 1241 0 0 1460 117 0 1 18 0 33 0 707751344 971706368 73892 268435456000 4194304 4417452 140735815948752 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 237233 73892 169 55 0 235119 0
Current children cumulated CPU time (s) 15.78
Current children cumulated vsize (KiB) 948932

[startup+6.30205 s]
/proc/loadavg: 30.26 31.00 31.60 33/446 12212
/proc/meminfo: memFree=255128512/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=1002376 CPUtime=118.04 cores=0-31
/proc/12174/stat : 12174 (plingeling) S 12172 12174 12014 0 -1 4202496 210855 1241 0 0 11656 147 0 1 18 0 33 0 707751344 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 250594 91390 175 55 0 248480 0
[pid=12174/tid=12181] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12181/stat : 12181 (plingeling) R 12172 12174 12014 0 -1 4202560 7202 1241 0 0 358 3 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12174/tid=12182] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12182/stat : 12182 (plingeling) R 12172 12174 12014 0 -1 4202560 2059 1241 0 0 358 3 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12174/tid=12183] ppid=12172 vsize=1002376 CPUtime=3.63 cores=0-31
/proc/12174/task/12183/stat : 12183 (plingeling) R 12172 12174 12014 0 -1 4202560 2404 1241 0 0 358 4 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346501 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12174/tid=12184] ppid=12172 vsize=1002376 CPUtime=3.63 cores=0-31
/proc/12174/task/12184/stat : 12184 (plingeling) R 12172 12174 12014 0 -1 4202560 701 1241 0 0 360 2 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=12174/tid=12185] ppid=12172 vsize=1002376 CPUtime=3.63 cores=0-31
/proc/12174/task/12185/stat : 12185 (plingeling) R 12172 12174 12014 0 -1 4202560 6703 1241 0 0 358 4 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=12174/tid=12186] ppid=12172 vsize=1002376 CPUtime=3.57 cores=0-31
/proc/12174/task/12186/stat : 12186 (plingeling) R 12172 12174 12014 0 -1 4202560 5041 1241 0 0 354 2 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4270927 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=12174/tid=12187] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12187/stat : 12187 (plingeling) R 12172 12174 12014 0 -1 4202560 2706 1241 0 0 359 2 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4258241 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12174/tid=12188] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12188/stat : 12188 (plingeling) R 12172 12174 12014 0 -1 4202560 7655 1241 0 0 357 4 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346490 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12174/tid=12189] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12189/stat : 12189 (plingeling) R 12172 12174 12014 0 -1 4202560 6148 1241 0 0 356 5 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4259993 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12174/tid=12190] ppid=12172 vsize=1002376 CPUtime=3.61 cores=0-31
/proc/12174/task/12190/stat : 12190 (plingeling) R 12172 12174 12014 0 -1 4202560 5586 1241 0 0 357 3 0 1 25 0 33 0 707751608 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4259993 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=12174/tid=12191] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12191/stat : 12191 (plingeling) R 12172 12174 12014 0 -1 4202560 4955 1241 0 0 357 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12174/tid=12192] ppid=12172 vsize=1002376 CPUtime=3.63 cores=0-31
/proc/12174/task/12192/stat : 12192 (plingeling) R 12172 12174 12014 0 -1 4202560 2203 1241 0 0 358 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4255643 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=12174/tid=12193] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12193/stat : 12193 (plingeling) R 12172 12174 12014 0 -1 4202560 4586 1241 0 0 357 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4274358 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=12174/tid=12194] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12194/stat : 12194 (plingeling) R 12172 12174 12014 0 -1 4202560 6392 1241 0 0 358 3 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4234249 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=12174/tid=12195] ppid=12172 vsize=1002376 CPUtime=3.63 cores=0-31
/proc/12174/task/12195/stat : 12195 (plingeling) R 12172 12174 12014 0 -1 4202560 2224 1241 0 0 358 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346437 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=12174/tid=12196] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12196/stat : 12196 (plingeling) R 12172 12174 12014 0 -1 4202560 2559 1241 0 0 357 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4261096 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=12174/tid=12197] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12197/stat : 12197 (plingeling) R 12172 12174 12014 0 -1 4202560 4825 1241 0 0 357 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346390 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=12174/tid=12198] ppid=12172 vsize=1002376 CPUtime=3.63 cores=0-31
/proc/12174/task/12198/stat : 12198 (plingeling) R 12172 12174 12014 0 -1 4202560 6398 1241 0 0 356 6 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346390 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=12174/tid=12199] ppid=12172 vsize=1002376 CPUtime=3.6 cores=0-31
/proc/12174/task/12199/stat : 12199 (plingeling) R 12172 12174 12014 0 -1 4202560 2724 1241 0 0 356 3 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4247970 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=12174/tid=12200] ppid=12172 vsize=1002376 CPUtime=3.61 cores=0-31
/proc/12174/task/12200/stat : 12200 (plingeling) R 12172 12174 12014 0 -1 4202560 4374 1241 0 0 356 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12174/tid=12201] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12201/stat : 12201 (plingeling) R 12172 12174 12014 0 -1 4202560 6475 1241 0 0 356 5 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4317337 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=12174/tid=12202] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12202/stat : 12202 (plingeling) R 12172 12174 12014 0 -1 4202560 5938 1241 0 0 357 4 0 1 25 0 33 0 707751609 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346581 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=1002376 CPUtime=3.5 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4202560 3112 1241 0 0 346 3 0 1 25 0 33 0 707751610 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=12174/tid=12204] ppid=12172 vsize=1002376 CPUtime=3.6 cores=0-31
/proc/12174/task/12204/stat : 12204 (plingeling) R 12172 12174 12014 0 -1 4202560 7393 1241 0 0 356 3 0 1 25 0 33 0 707751610 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4259926 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=12174/tid=12205] ppid=12172 vsize=1002376 CPUtime=3.61 cores=0-31
/proc/12174/task/12205/stat : 12205 (plingeling) R 12172 12174 12014 0 -1 4202560 5241 1241 0 0 355 5 0 1 25 0 33 0 707751610 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346462 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=12174/tid=12206] ppid=12172 vsize=1002376 CPUtime=3.58 cores=0-31
/proc/12174/task/12206/stat : 12206 (plingeling) R 12172 12174 12014 0 -1 4202560 2479 1241 0 0 356 1 0 1 25 0 33 0 707751610 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346369 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=12174/tid=12207] ppid=12172 vsize=1002376 CPUtime=3.47 cores=0-31
/proc/12174/task/12207/stat : 12207 (plingeling) R 12172 12174 12014 0 -1 4202560 1775 1241 0 0 344 2 0 1 25 0 33 0 707751610 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=12174/tid=12208] ppid=12172 vsize=1002376 CPUtime=3.61 cores=0-31
/proc/12174/task/12208/stat : 12208 (plingeling) R 12172 12174 12014 0 -1 4202560 4057 1241 0 0 357 3 0 1 25 0 33 0 707751610 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346442 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=12174/tid=12209] ppid=12172 vsize=1002376 CPUtime=3.6 cores=0-31
/proc/12174/task/12209/stat : 12209 (plingeling) R 12172 12174 12014 0 -1 4202560 4558 1241 0 0 355 4 0 1 25 0 33 0 707751611 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=12174/tid=12210] ppid=12172 vsize=1002376 CPUtime=3.58 cores=0-31
/proc/12174/task/12210/stat : 12210 (plingeling) R 12172 12174 12014 0 -1 4202560 5480 1241 0 0 354 3 0 1 25 0 33 0 707751611 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=12174/tid=12211] ppid=12172 vsize=1002376 CPUtime=3.62 cores=0-31
/proc/12174/task/12211/stat : 12211 (plingeling) R 12172 12174 12014 0 -1 4202560 1681 1241 0 0 358 3 0 1 25 0 33 0 707751611 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346555 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=12174/tid=12212] ppid=12172 vsize=1002376 CPUtime=3.6 cores=0-31
/proc/12174/task/12212/stat : 12212 (plingeling) R 12172 12174 12014 0 -1 4202560 3339 1241 0 0 356 3 0 1 25 0 33 0 707751611 1026433024 91390 268435456000 4194304 4417452 140735815948752 18446744073709551615 4346361 0 0 4096 17442 0 0 0 -1 16 0 0 0
Current children cumulated CPU time (s) 118.04
Current children cumulated vsize (KiB) 1002376

[startup+12.7023 s]
/proc/loadavg: 30.40 31.02 31.61 33/446 12212
/proc/meminfo: memFree=255043920/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=1061588 CPUtime=322.59 cores=0-31
/proc/12174/stat : 12174 (plingeling) S 12172 12174 12014 0 -1 4202496 229849 1241 0 0 32104 154 0 1 18 0 33 0 707751344 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 265397 106723 175 55 0 263283 0
[pid=12174/tid=12181] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12181/stat : 12181 (plingeling) R 12172 12174 12014 0 -1 4202560 7345 1241 0 0 998 3 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12174/tid=12182] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12182/stat : 12182 (plingeling) R 12172 12174 12014 0 -1 4202560 2578 1241 0 0 998 3 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12174/tid=12183] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12183/stat : 12183 (plingeling) R 12172 12174 12014 0 -1 4202560 3313 1241 0 0 997 4 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4232674 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12174/tid=12184] ppid=12172 vsize=1061588 CPUtime=10.03 cores=0-31
/proc/12174/task/12184/stat : 12184 (plingeling) R 12172 12174 12014 0 -1 4202560 1335 1241 0 0 1000 2 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4236945 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=12174/tid=12185] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12185/stat : 12185 (plingeling) R 12172 12174 12014 0 -1 4202560 6855 1241 0 0 997 4 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=12174/tid=12186] ppid=12172 vsize=1061588 CPUtime=9.97 cores=0-31
/proc/12174/task/12186/stat : 12186 (plingeling) R 12172 12174 12014 0 -1 4202560 5056 1241 0 0 994 2 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=12174/tid=12187] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12187/stat : 12187 (plingeling) R 12172 12174 12014 0 -1 4202560 3907 1241 0 0 999 2 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4366184 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12174/tid=12188] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12188/stat : 12188 (plingeling) R 12172 12174 12014 0 -1 4202560 7902 1241 0 0 997 4 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12174/tid=12189] ppid=12172 vsize=1061588 CPUtime=10.03 cores=0-31
/proc/12174/task/12189/stat : 12189 (plingeling) R 12172 12174 12014 0 -1 4202560 7073 1241 0 0 996 6 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12174/tid=12190] ppid=12172 vsize=1061588 CPUtime=10 cores=0-31
/proc/12174/task/12190/stat : 12190 (plingeling) R 12172 12174 12014 0 -1 4202560 6182 1241 0 0 996 3 0 1 25 0 33 0 707751608 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=12174/tid=12191] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12191/stat : 12191 (plingeling) R 12172 12174 12014 0 -1 4202560 5299 1241 0 0 997 4 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4251010 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12174/tid=12192] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12192/stat : 12192 (plingeling) R 12172 12174 12014 0 -1 4202560 3001 1241 0 0 997 4 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=12174/tid=12193] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12193/stat : 12193 (plingeling) R 12172 12174 12014 0 -1 4202560 5450 1241 0 0 997 4 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=12174/tid=12194] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12194/stat : 12194 (plingeling) R 12172 12174 12014 0 -1 4202560 7191 1241 0 0 997 4 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=12174/tid=12195] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12195/stat : 12195 (plingeling) R 12172 12174 12014 0 -1 4202560 2681 1241 0 0 997 4 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=12174/tid=12196] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12196/stat : 12196 (plingeling) R 12172 12174 12014 0 -1 4202560 3293 1241 0 0 997 4 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=12174/tid=12197] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12197/stat : 12197 (plingeling) R 12172 12174 12014 0 -1 4202560 6215 1241 0 0 996 5 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=12174/tid=12198] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31
/proc/12174/task/12198/stat : 12198 (plingeling) R 12172 12174 12014 0 -1 4202560 7197 1241 0 0 995 6 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=12174/tid=12199] ppid=12172 vsize=1061588 CPUtime=9.99 cores=0-31
/proc/12174/task/12199/stat : 12199 (plingeling) R 12172 12174 12014 0 -1 4202560 3629 1241 0 0 995 3 0 1 25 0 33 0 707751609 1087066112 106723 268435456000 4194304 4417452 140735815948752 18446744073709551615 4366698 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=12174/tid=12200] ppid=12172 vsize=1061588 CPUtime=10.02 cores=0-31

################
# More data... #
################

[pid=12174/tid=12192] ppid=12172 vsize=12138640 CPUtime=4955.92 cores=0-31
/proc/12174/task/12192/stat : 12192 (plingeling) R 12172 12174 12014 0 -1 4202560 285755 1241 0 0 495276 315 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=12174/tid=12193] ppid=12172 vsize=12138640 CPUtime=4950.39 cores=0-31
/proc/12174/task/12193/stat : 12193 (plingeling) R 12172 12174 12014 0 -1 4202560 399638 1241 0 0 494570 468 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=12174/tid=12194] ppid=12172 vsize=12138640 CPUtime=4958.06 cores=0-31
/proc/12174/task/12194/stat : 12194 (plingeling) R 12172 12174 12014 0 -1 4202560 339242 1241 0 0 495420 385 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=12174/tid=12195] ppid=12172 vsize=12138640 CPUtime=4957.67 cores=0-31
/proc/12174/task/12195/stat : 12195 (plingeling) R 12172 12174 12014 0 -1 4202560 308375 1241 0 0 495305 461 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=12174/tid=12196] ppid=12172 vsize=12138640 CPUtime=4956.72 cores=0-31
/proc/12174/task/12196/stat : 12196 (plingeling) R 12172 12174 12014 0 -1 4202560 268770 1241 0 0 495393 278 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=12174/tid=12197] ppid=12172 vsize=12138640 CPUtime=4956.32 cores=0-31
/proc/12174/task/12197/stat : 12197 (plingeling) R 12172 12174 12014 0 -1 4202560 432781 1241 0 0 495096 535 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4265687 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=12174/tid=12198] ppid=12172 vsize=12138640 CPUtime=4956.84 cores=0-31
/proc/12174/task/12198/stat : 12198 (plingeling) R 12172 12174 12014 0 -1 4202560 470864 1241 0 0 495283 400 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=12174/tid=12199] ppid=12172 vsize=12138640 CPUtime=4958.44 cores=0-31
/proc/12174/task/12199/stat : 12199 (plingeling) R 12172 12174 12014 0 -1 4202560 520621 1241 0 0 495340 503 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12174/tid=12200] ppid=12172 vsize=12138640 CPUtime=4937.77 cores=0-31
/proc/12174/task/12200/stat : 12200 (plingeling) R 12172 12174 12014 0 -1 4202560 367580 1241 0 0 493317 459 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=12174/tid=12201] ppid=12172 vsize=12138640 CPUtime=4952.21 cores=0-31
/proc/12174/task/12201/stat : 12201 (plingeling) R 12172 12174 12014 0 -1 4202560 406426 1241 0 0 494931 289 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=12174/tid=12202] ppid=12172 vsize=12138640 CPUtime=4956.8 cores=0-31
/proc/12174/task/12202/stat : 12202 (plingeling) R 12172 12174 12014 0 -1 4202560 431846 1241 0 0 495273 406 0 1 25 0 33 0 707751609 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=12138640 CPUtime=4952.38 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4202560 355644 1241 0 0 494871 366 0 1 25 0 33 0 707751610 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=12174/tid=12204] ppid=12172 vsize=12138640 CPUtime=4951.5 cores=0-31
/proc/12174/task/12204/stat : 12204 (plingeling) R 12172 12174 12014 0 -1 4202560 429575 1241 0 0 494619 530 0 1 25 0 33 0 707751610 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=12174/tid=12205] ppid=12172 vsize=12138640 CPUtime=4955.66 cores=0-31
/proc/12174/task/12205/stat : 12205 (plingeling) R 12172 12174 12014 0 -1 4202560 375819 1241 0 0 495238 327 0 1 25 0 33 0 707751610 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=12174/tid=12206] ppid=12172 vsize=12138640 CPUtime=4957.23 cores=0-31
/proc/12174/task/12206/stat : 12206 (plingeling) R 12172 12174 12014 0 -1 4202560 385889 1241 0 0 495209 513 0 1 25 0 33 0 707751610 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=12174/tid=12207] ppid=12172 vsize=12138640 CPUtime=4953.29 cores=0-31
/proc/12174/task/12207/stat : 12207 (plingeling) R 12172 12174 12014 0 -1 4202560 458136 1241 0 0 494716 612 0 1 25 0 33 0 707751610 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=12174/tid=12208] ppid=12172 vsize=12138640 CPUtime=4957.49 cores=0-31
/proc/12174/task/12208/stat : 12208 (plingeling) R 12172 12174 12014 0 -1 4202560 345621 1241 0 0 495299 449 0 1 25 0 33 0 707751610 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12174/tid=12209] ppid=12172 vsize=12138640 CPUtime=4956.53 cores=0-31
/proc/12174/task/12209/stat : 12209 (plingeling) R 12172 12174 12014 0 -1 4202560 388689 1241 0 0 495205 447 0 1 25 0 33 0 707751611 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12174/tid=12210] ppid=12172 vsize=12138640 CPUtime=4953.45 cores=0-31
/proc/12174/task/12210/stat : 12210 (plingeling) R 12172 12174 12014 0 -1 4202560 337273 1241 0 0 495056 288 0 1 25 0 33 0 707751611 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=12174/tid=12211] ppid=12172 vsize=12138640 CPUtime=4945.84 cores=0-31
/proc/12174/task/12211/stat : 12211 (plingeling) R 12172 12174 12014 0 -1 4202560 361501 1241 0 0 494125 458 0 1 25 0 33 0 707751611 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=12174/tid=12212] ppid=12172 vsize=12138640 CPUtime=4955.38 cores=0-31
/proc/12174/task/12212/stat : 12212 (plingeling) R 12172 12174 12014 0 -1 4202560 456277 1241 0 0 494922 615 0 1 25 0 33 0 707751611 12429967360 2869072 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 12 0 0 0
Current children cumulated CPU time (s) 158499
Current children cumulated vsize (KiB) 12138640



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.3 s]
/proc/loadavg: 32.11 32.06 32.07 33/446 12359
/proc/meminfo: memFree=244010044/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=12140428 CPUtime=160003 cores=0-31
/proc/12174/stat : 12174 (plingeling) S 12172 12174 12014 0 -1 4202496 12215185 1241 0 0 15987091 13203 0 1 18 0 33 0 707751344 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 3035107 2869550 175 55 0 3032993 0
[pid=12174/tid=12181] ppid=12172 vsize=12140428 CPUtime=5002.45 cores=0-31
/proc/12174/task/12181/stat : 12181 (plingeling) R 12172 12174 12014 0 -1 4202560 447825 1241 0 0 499702 542 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12174/tid=12182] ppid=12172 vsize=12140428 CPUtime=4984.45 cores=0-31
/proc/12174/task/12182/stat : 12182 (plingeling) R 12172 12174 12014 0 -1 4202560 318829 1241 0 0 498088 356 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=12174/tid=12183] ppid=12172 vsize=12140428 CPUtime=5005.14 cores=0-31
/proc/12174/task/12183/stat : 12183 (plingeling) R 12172 12174 12014 0 -1 4202560 428501 1241 0 0 500054 459 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=12174/tid=12184] ppid=12172 vsize=12140428 CPUtime=5005.19 cores=0-31
/proc/12174/task/12184/stat : 12184 (plingeling) R 12172 12174 12014 0 -1 4202560 300145 1241 0 0 500280 238 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=12174/tid=12185] ppid=12172 vsize=12140428 CPUtime=5003.29 cores=0-31
/proc/12174/task/12185/stat : 12185 (plingeling) R 12172 12174 12014 0 -1 4202560 410214 1241 0 0 499778 550 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12174/tid=12186] ppid=12172 vsize=12140428 CPUtime=4998.06 cores=0-31
/proc/12174/task/12186/stat : 12186 (plingeling) R 12172 12174 12014 0 -1 4202560 337914 1241 0 0 499465 340 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=12174/tid=12187] ppid=12172 vsize=12140428 CPUtime=5001.49 cores=0-31
/proc/12174/task/12187/stat : 12187 (plingeling) R 12172 12174 12014 0 -1 4202560 393479 1241 0 0 499688 460 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12174/tid=12188] ppid=12172 vsize=12140428 CPUtime=5002.56 cores=0-31
/proc/12174/task/12188/stat : 12188 (plingeling) R 12172 12174 12014 0 -1 4202560 479913 1241 0 0 499752 503 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364854 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=12174/tid=12189] ppid=12172 vsize=12140428 CPUtime=4966.39 cores=0-31
/proc/12174/task/12189/stat : 12189 (plingeling) R 12172 12174 12014 0 -1 4202560 204765 1241 0 0 496449 189 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4366700 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12174/tid=12190] ppid=12172 vsize=12140428 CPUtime=5004.35 cores=0-31
/proc/12174/task/12190/stat : 12190 (plingeling) R 12172 12174 12014 0 -1 4202560 277054 1241 0 0 500327 107 0 1 25 0 33 0 707751608 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4357407 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=12174/tid=12191] ppid=12172 vsize=12140428 CPUtime=5004.74 cores=0-31
/proc/12174/task/12191/stat : 12191 (plingeling) R 12172 12174 12014 0 -1 4202560 356948 1241 0 0 500241 232 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12174/tid=12192] ppid=12172 vsize=12140428 CPUtime=5002.96 cores=0-31
/proc/12174/task/12192/stat : 12192 (plingeling) R 12172 12174 12014 0 -1 4202560 292593 1241 0 0 499961 334 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=12174/tid=12193] ppid=12172 vsize=12140428 CPUtime=4997.42 cores=0-31
/proc/12174/task/12193/stat : 12193 (plingeling) R 12172 12174 12014 0 -1 4202560 399638 1241 0 0 499273 468 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=12174/tid=12194] ppid=12172 vsize=12140428 CPUtime=5005.09 cores=0-31
/proc/12174/task/12194/stat : 12194 (plingeling) R 12172 12174 12014 0 -1 4202560 339242 1241 0 0 500123 385 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=12174/tid=12195] ppid=12172 vsize=12140428 CPUtime=5004.7 cores=0-31
/proc/12174/task/12195/stat : 12195 (plingeling) R 12172 12174 12014 0 -1 4202560 308375 1241 0 0 500008 461 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=12174/tid=12196] ppid=12172 vsize=12140428 CPUtime=5003.76 cores=0-31
/proc/12174/task/12196/stat : 12196 (plingeling) R 12172 12174 12014 0 -1 4202560 268770 1241 0 0 500097 278 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4262503 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=12174/tid=12197] ppid=12172 vsize=12140428 CPUtime=5003.35 cores=0-31
/proc/12174/task/12197/stat : 12197 (plingeling) R 12172 12174 12014 0 -1 4202560 449165 1241 0 0 499796 538 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=12174/tid=12198] ppid=12172 vsize=12140428 CPUtime=5003.87 cores=0-31
/proc/12174/task/12198/stat : 12198 (plingeling) R 12172 12174 12014 0 -1 4202560 470864 1241 0 0 499986 400 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=12174/tid=12199] ppid=12172 vsize=12140428 CPUtime=5005.48 cores=0-31
/proc/12174/task/12199/stat : 12199 (plingeling) R 12172 12174 12014 0 -1 4202560 520621 1241 0 0 500044 503 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364619 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12174/tid=12200] ppid=12172 vsize=12140428 CPUtime=4983.45 cores=0-31
/proc/12174/task/12200/stat : 12200 (plingeling) R 12172 12174 12014 0 -1 4202560 367580 1241 0 0 497885 459 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=12174/tid=12201] ppid=12172 vsize=12140428 CPUtime=4999.25 cores=0-31
/proc/12174/task/12201/stat : 12201 (plingeling) R 12172 12174 12014 0 -1 4202560 407843 1241 0 0 499632 292 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=12174/tid=12202] ppid=12172 vsize=12140428 CPUtime=5003.84 cores=0-31
/proc/12174/task/12202/stat : 12202 (plingeling) R 12172 12174 12014 0 -1 4202560 431846 1241 0 0 499977 406 0 1 25 0 33 0 707751609 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=12140428 CPUtime=4999.42 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4202560 366615 1241 0 0 499573 368 0 1 25 0 33 0 707751610 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=12174/tid=12204] ppid=12172 vsize=12140428 CPUtime=4998.54 cores=0-31
/proc/12174/task/12204/stat : 12204 (plingeling) R 12172 12174 12014 0 -1 4202560 443174 1241 0 0 499265 588 0 1 25 0 33 0 707751610 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 258651013786 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=12174/tid=12205] ppid=12172 vsize=12140428 CPUtime=5002.69 cores=0-31
/proc/12174/task/12205/stat : 12205 (plingeling) R 12172 12174 12014 0 -1 4202560 375819 1241 0 0 499941 327 0 1 25 0 33 0 707751610 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=12174/tid=12206] ppid=12172 vsize=12140428 CPUtime=5004.26 cores=0-31
/proc/12174/task/12206/stat : 12206 (plingeling) R 12172 12174 12014 0 -1 4202560 395782 1241 0 0 499910 515 0 1 25 0 33 0 707751610 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=12174/tid=12207] ppid=12172 vsize=12140428 CPUtime=5000.32 cores=0-31
/proc/12174/task/12207/stat : 12207 (plingeling) R 12172 12174 12014 0 -1 4202560 458136 1241 0 0 499419 612 0 1 25 0 33 0 707751610 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=12174/tid=12208] ppid=12172 vsize=12140428 CPUtime=5004.52 cores=0-31
/proc/12174/task/12208/stat : 12208 (plingeling) R 12172 12174 12014 0 -1 4202560 345621 1241 0 0 500002 449 0 1 25 0 33 0 707751610 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12174/tid=12209] ppid=12172 vsize=12140428 CPUtime=5003.56 cores=0-31
/proc/12174/task/12209/stat : 12209 (plingeling) R 12172 12174 12014 0 -1 4202560 389721 1241 0 0 499906 449 0 1 25 0 33 0 707751611 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12174/tid=12210] ppid=12172 vsize=12140428 CPUtime=5000.49 cores=0-31
/proc/12174/task/12210/stat : 12210 (plingeling) R 12172 12174 12014 0 -1 4202560 338533 1241 0 0 499756 292 0 1 25 0 33 0 707751611 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=12174/tid=12211] ppid=12172 vsize=12140428 CPUtime=4992.87 cores=0-31
/proc/12174/task/12211/stat : 12211 (plingeling) R 12172 12174 12014 0 -1 4202560 361501 1241 0 0 498828 458 0 1 25 0 33 0 707751611 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=12174/tid=12212] ppid=12172 vsize=12140428 CPUtime=5002.39 cores=0-31
/proc/12174/task/12212/stat : 12212 (plingeling) R 12172 12174 12014 0 -1 4202560 456277 1241 0 0 499622 616 0 1 25 0 33 0 707751611 12431798272 2869550 268435456000 4194304 4417452 140735815948752 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 12 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 12140428

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.45 s]
/proc/loadavg: 32.11 32.06 32.07 33/446 12359
/proc/meminfo: memFree=244010044/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=0 CPUtime=160003 cores=0-31
/proc/12174/stat : 12174 (plingeling) Z 12172 12174 12014 0 -1 4203548 12215185 1241 0 0 15987113 13215 0 1 18 0 2 0 707751344 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 0 0 0 0 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=0 CPUtime=4999.52 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4203588 366615 1241 0 0 499573 378 0 1 25 0 2 0 707751610 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

[startup+5009.8 s]
/proc/loadavg: 32.11 32.06 32.07 33/446 12359
/proc/meminfo: memFree=244010044/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=0 CPUtime=160004 cores=0-31
/proc/12174/stat : 12174 (plingeling) Z 12172 12174 12014 0 -1 4203548 12215185 1241 0 0 15987113 13250 0 1 18 0 2 0 707751344 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 0 0 0 0 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=0 CPUtime=4999.87 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4203588 366615 1241 0 0 499573 413 0 1 25 0 2 0 707751610 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

[startup+5010.2 s]
/proc/loadavg: 32.11 32.06 32.07 33/446 12359
/proc/meminfo: memFree=244010044/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=0 CPUtime=160004 cores=0-31
/proc/12174/stat : 12174 (plingeling) Z 12172 12174 12014 0 -1 4203548 12215185 1241 0 0 15987113 13290 0 1 18 0 2 0 707751344 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 0 0 0 0 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=0 CPUtime=5000.27 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4203588 366615 1241 0 0 499573 453 0 1 25 0 2 0 707751610 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

[startup+5010.3 s]
/proc/loadavg: 32.11 32.06 32.07 33/446 12359
/proc/meminfo: memFree=244010044/264257624 swapFree=67111528/67111528
[pid=12174] ppid=12172 vsize=0 CPUtime=160004 cores=0-31
/proc/12174/stat : 12174 (plingeling) Z 12172 12174 12014 0 -1 4203548 12215185 1241 0 0 15987113 13300 0 1 18 0 2 0 707751344 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 20 0 0 0
/proc/12174/statm: 0 0 0 0 0 0 0
[pid=12174/tid=12203] ppid=12172 vsize=0 CPUtime=5000.37 cores=0-31
/proc/12174/task/12203/stat : 12203 (plingeling) R 12172 12174 12014 0 -1 4203588 366615 1241 0 0 499573 463 0 1 25 0 2 0 707751610 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 20 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.31
CPU time (s): 160004
CPU user time (s): 159871
CPU system time (s): 133.022
CPU usage (%): 3193.5
Max. virtual memory (cumulated for all children) (KiB): 12551836

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159871
system time used= 133.022
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 12216426
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11849
involuntary context switches= 413837

runsolver used 24.7142 second user time and 116.701 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-21 09:24:09
IDJOB=3372696
IDBENCH=83119
IDSOLVER=1852
FILE ID=node200/3372696-1305962649
RUNJOBID= node200-1305962511-12028
PBS_JOBID= 13387787
Free space on /tmp= 62044 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom19.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372696-1305962649/watcher-3372696-1305962649 -o /tmp/evaluation-result-3372696-1305962649/solver-3372696-1305962649 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372696-1305962649.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= d725e0d6a363434dce7cb39ffdb1b83f
RANDOM SEED=132003531

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255489068 kB
Buffers:        453560 kB
Cached:        7898732 kB
SwapCached:          0 kB
Active:        7414400 kB
Inactive:      1006680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255489068 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2348 kB
Writeback:           0 kB
AnonPages:       70264 kB
Mapped:          14480 kB
Slab:           252280 kB
PageTables:       4516 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   186568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62044 MiB
End job on node200 at 2011-05-21 10:47:41