Trace number 3372807

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 160003 5063.48

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00X23.cnf
MD5SUM9cec6483d4ca03e8555377ba059b61ae
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2133873
Sum of the clauses size18060684
Maximum clause length91
Minimum clause length1
Number of clauses of size 116
Number of clauses of size 240913
Number of clauses of size 337518
Number of clauses of size 422333
Number of clauses of size 5147683
Number of clauses of size over 51885410

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372807-1306049160/watcher-3372807-1306049160 -o /tmp/evaluation-result-3372807-1306049160/solver-3372807-1306049160 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372807-1306049160.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.11 31.27 31.18 1/413 24800
/proc/meminfo: memFree=255376824/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=18508 CPUtime=0.02 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 2717 1242 0 0 2 0 0 0 23 0 1 0 716402774 18952192 2647 268435456000 4194304 4417452 140734708446224 18446744073709551615 4231277 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 4627 2647 145 55 0 2513 0

[startup+0.0925279 s]
/proc/loadavg: 29.11 31.27 31.18 1/413 24800
/proc/meminfo: memFree=255376824/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=28284 CPUtime=0.07 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 5096 1242 0 0 7 0 0 0 23 0 1 0 716402774 28962816 5026 268435456000 4194304 4417452 140734708446224 18446744073709551615 258650653381 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 7071 5046 146 55 0 4957 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 28284

[startup+0.100531 s]
/proc/loadavg: 29.11 31.27 31.18 1/413 24800
/proc/meminfo: memFree=255376824/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=31364 CPUtime=0.09 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 6060 1242 0 0 8 1 0 0 23 0 1 0 716402774 32116736 5862 268435456000 4194304 4417452 140734708446224 18446744073709551615 4274340 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 7841 5862 146 55 0 5727 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31364

[startup+0.300533 s]
/proc/loadavg: 29.11 31.27 31.18 1/413 24800
/proc/meminfo: memFree=255376824/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=35080 CPUtime=0.28 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 6989 1242 0 0 27 1 0 0 25 0 1 0 716402774 35921920 6791 268435456000 4194304 4417452 140734708446224 18446744073709551615 4235981 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 8770 6791 146 55 0 6656 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 35080

[startup+0.700554 s]
/proc/loadavg: 29.11 31.27 31.18 1/413 24800
/proc/meminfo: memFree=255376824/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=81164 CPUtime=0.68 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 19006 1242 0 0 65 3 0 0 25 0 1 0 716402774 83111936 18312 268435456000 4194304 4417452 140734708446224 18446744073709551615 4323168 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 20291 18312 146 55 0 18177 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 81164

[startup+1.50058 s]
/proc/loadavg: 29.11 31.27 31.18 2/414 24806
/proc/meminfo: memFree=255273124/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=165132 CPUtime=1.48 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 39540 1242 0 0 141 7 0 0 25 0 1 0 716402774 169095168 38846 268435456000 4194304 4417452 140734708446224 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 41283 38863 146 55 0 39169 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 165132

[startup+3.10064 s]
/proc/loadavg: 26.86 30.77 31.02 2/414 24806
/proc/meminfo: memFree=255208408/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=343308 CPUtime=3.08 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 84542 1242 0 0 292 16 0 0 25 0 1 0 716402774 351547392 83848 268435456000 4194304 4417452 140734708446224 18446744073709551615 4231277 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 85827 83848 146 55 0 83713 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 343308

[startup+6.30075 s]
/proc/loadavg: 26.86 30.77 31.02 2/414 24806
/proc/meminfo: memFree=254783324/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=703096 CPUtime=6.28 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 174457 1242 0 0 595 33 0 0 25 0 1 0 716402774 719970304 173763 268435456000 4194304 4417452 140734708446224 18446744073709551615 4259612 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 175774 173763 146 55 0 173660 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 703096

[startup+12.701 s]
/proc/loadavg: 22.89 29.79 30.70 2/414 24806
/proc/meminfo: memFree=253771048/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=1620600 CPUtime=12.68 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 403833 1242 0 0 1190 78 0 0 25 0 1 0 716402774 1659494400 403139 268435456000 4194304 4417452 140734708446224 18446744073709551615 4323212 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 405150 403139 146 55 0 403036 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1620600

[startup+25.5005 s]
/proc/loadavg: 19.52 28.84 30.38 2/414 24806
/proc/meminfo: memFree=252205012/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=3193464 CPUtime=25.48 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 797049 1242 0 0 2393 155 0 0 25 0 1 0 716402774 3270107136 796355 268435456000 4194304 4417452 140734708446224 18446744073709551615 258650574428 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 798366 796355 146 55 0 796252 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 3193464

[startup+51.1006 s]
/proc/loadavg: 13.20 26.60 29.60 2/414 24806
/proc/meminfo: memFree=249061076/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=6339192 CPUtime=51.08 cores=0-31
/proc/24800/stat : 24800 (plingeling) R 24798 24800 24644 0 -1 4202496 1583481 1242 0 0 4801 307 0 0 25 0 1 0 716402774 6491332608 1582787 268435456000 4194304 4417452 140734708446224 18446744073709551615 4231537 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/24800/statm: 1584798 1582787 146 55 0 1582684 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 6339192

[startup+102.323 s]
/proc/loadavg: 23.61 27.13 29.60 34/447 24841
/proc/meminfo: memFree=248410996/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=7433908 CPUtime=1482.53 cores=0-31
/proc/24800/stat : 24800 (plingeling) S 24798 24800 24644 0 -1 4202496 3256609 1242 0 0 140742 7511 0 0 19 0 33 0 716402774 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 31 0 0 0
/proc/24800/statm: 1858477 1743653 175 55 0 1856363 0
[pid=24800/tid=24807] ppid=24798 vsize=7433908 CPUtime=44.26 cores=0-31
/proc/24800/task/24807/stat : 24807 (plingeling) R 24798 24800 24644 0 -1 4202560 52359 1242 0 0 4221 205 0 0 25 0 33 0 716408161 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=24800/tid=24808] ppid=24798 vsize=7433908 CPUtime=45.49 cores=0-31
/proc/24800/task/24808/stat : 24808 (plingeling) R 24798 24800 24644 0 -1 4202560 53035 1242 0 0 4311 238 0 0 21 0 33 0 716408161 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=24800/tid=24809] ppid=24798 vsize=7433908 CPUtime=45.56 cores=0-31
/proc/24800/task/24809/stat : 24809 (plingeling) R 24798 24800 24644 0 -1 4202560 83703 1242 0 0 4352 204 0 0 25 0 33 0 716408161 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=24800/tid=24810] ppid=24798 vsize=7433908 CPUtime=41.77 cores=0-31
/proc/24800/task/24810/stat : 24810 (plingeling) R 24798 24800 24644 0 -1 4202560 26728 1242 0 0 4128 49 0 0 25 0 33 0 716408162 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=24800/tid=24811] ppid=24798 vsize=7433908 CPUtime=45.28 cores=0-31
/proc/24800/task/24811/stat : 24811 (plingeling) R 24798 24800 24644 0 -1 4202560 52063 1242 0 0 4291 237 0 0 25 0 33 0 716408162 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=24800/tid=24812] ppid=24798 vsize=7433908 CPUtime=44.91 cores=0-31
/proc/24800/task/24812/stat : 24812 (plingeling) R 24798 24800 24644 0 -1 4202560 52279 1242 0 0 4265 226 0 0 25 0 33 0 716408162 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24800/tid=24813] ppid=24798 vsize=7433908 CPUtime=43.6 cores=0-31
/proc/24800/task/24813/stat : 24813 (plingeling) R 24798 24800 24644 0 -1 4202560 51163 1242 0 0 4037 323 0 0 25 0 33 0 716408162 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=24800/tid=24814] ppid=24798 vsize=7433908 CPUtime=44.54 cores=0-31
/proc/24800/task/24814/stat : 24814 (plingeling) R 24798 24800 24644 0 -1 4202560 52381 1242 0 0 4233 221 0 0 25 0 33 0 716408162 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=24800/tid=24815] ppid=24798 vsize=7433908 CPUtime=45.09 cores=0-31
/proc/24800/task/24815/stat : 24815 (plingeling) R 24798 24800 24644 0 -1 4202560 52849 1242 0 0 4306 203 0 0 25 0 33 0 716408163 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24800/tid=24816] ppid=24798 vsize=7433908 CPUtime=45.37 cores=0-31
/proc/24800/task/24816/stat : 24816 (plingeling) R 24798 24800 24644 0 -1 4202560 51739 1242 0 0 4334 203 0 0 25 0 33 0 716408165 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24800/tid=24817] ppid=24798 vsize=7433908 CPUtime=43.12 cores=0-31
/proc/24800/task/24817/stat : 24817 (plingeling) R 24798 24800 24644 0 -1 4202560 50292 1242 0 0 4028 284 0 0 25 0 33 0 716408165 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=24800/tid=24818] ppid=24798 vsize=7433908 CPUtime=45.43 cores=0-31
/proc/24800/task/24818/stat : 24818 (plingeling) R 24798 24800 24644 0 -1 4202560 52726 1242 0 0 4321 222 0 0 21 0 33 0 716408165 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=24800/tid=24819] ppid=24798 vsize=7433908 CPUtime=46.09 cores=0-31
/proc/24800/task/24819/stat : 24819 (plingeling) R 24798 24800 24644 0 -1 4202560 52524 1242 0 0 4434 175 0 0 25 0 33 0 716408166 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364842 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24800/tid=24820] ppid=24798 vsize=7433908 CPUtime=46.08 cores=0-31
/proc/24800/task/24820/stat : 24820 (plingeling) R 24798 24800 24644 0 -1 4202560 53542 1242 0 0 4371 237 0 0 25 0 33 0 716408166 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=24800/tid=24821] ppid=24798 vsize=7433908 CPUtime=43.19 cores=0-31
/proc/24800/task/24821/stat : 24821 (plingeling) R 24798 24800 24644 0 -1 4202560 50499 1242 0 0 4040 279 0 0 25 0 33 0 716408167 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4356864 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=24800/tid=24822] ppid=24798 vsize=7433908 CPUtime=45.76 cores=0-31
/proc/24800/task/24822/stat : 24822 (plingeling) R 24798 24800 24644 0 -1 4202560 52440 1242 0 0 4329 247 0 0 25 0 33 0 716408167 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=24800/tid=24823] ppid=24798 vsize=7433908 CPUtime=44.06 cores=0-31
/proc/24800/task/24823/stat : 24823 (plingeling) R 24798 24800 24644 0 -1 4202560 53061 1242 0 0 4187 219 0 0 25 0 33 0 716408168 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=24800/tid=24824] ppid=24798 vsize=7433908 CPUtime=45.13 cores=0-31
/proc/24800/task/24824/stat : 24824 (plingeling) R 24798 24800 24644 0 -1 4202560 53134 1242 0 0 4287 226 0 0 25 0 33 0 716408168 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4278138 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=24800/tid=24825] ppid=24798 vsize=7433908 CPUtime=42.57 cores=0-31
/proc/24800/task/24825/stat : 24825 (plingeling) R 24798 24800 24644 0 -1 4202560 50371 1242 0 0 3992 265 0 0 25 0 33 0 716408169 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4260714 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24800/tid=24826] ppid=24798 vsize=7433908 CPUtime=45.44 cores=0-31
/proc/24800/task/24826/stat : 24826 (plingeling) R 24798 24800 24644 0 -1 4202560 52308 1242 0 0 4305 239 0 0 25 0 33 0 716408169 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4235713 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=24800/tid=24827] ppid=24798 vsize=7433908 CPUtime=45.54 cores=0-31
/proc/24800/task/24827/stat : 24827 (plingeling) R 24798 24800 24644 0 -1 4202560 52611 1242 0 0 4333 221 0 0 25 0 33 0 716408170 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24800/tid=24828] ppid=24798 vsize=7433908 CPUtime=45.5 cores=0-31
/proc/24800/task/24828/stat : 24828 (plingeling) R 24798 24800 24644 0 -1 4202560 52469 1242 0 0 4325 225 0 0 25 0 33 0 716408170 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4255631 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=24800/tid=24829] ppid=24798 vsize=7433908 CPUtime=43.28 cores=0-31
/proc/24800/task/24829/stat : 24829 (plingeling) R 24798 24800 24644 0 -1 4202560 50853 1242 0 0 4068 260 0 0 25 0 33 0 716408171 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=24800/tid=24830] ppid=24798 vsize=7433908 CPUtime=44.85 cores=0-31
/proc/24800/task/24830/stat : 24830 (plingeling) R 24798 24800 24644 0 -1 4202560 52246 1242 0 0 4271 214 0 0 25 0 33 0 716408171 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4236598 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=24800/tid=24831] ppid=24798 vsize=7433908 CPUtime=44.74 cores=0-31
/proc/24800/task/24831/stat : 24831 (plingeling) R 24798 24800 24644 0 -1 4202560 52706 1242 0 0 4250 224 0 0 25 0 33 0 716408172 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=24800/tid=24832] ppid=24798 vsize=7433908 CPUtime=44.76 cores=0-31
/proc/24800/task/24832/stat : 24832 (plingeling) R 24798 24800 24644 0 -1 4202560 53609 1242 0 0 4253 223 0 0 25 0 33 0 716408173 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4265462 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=24800/tid=24833] ppid=24798 vsize=7433908 CPUtime=43.04 cores=0-31
/proc/24800/task/24833/stat : 24833 (plingeling) R 24798 24800 24644 0 -1 4202560 51006 1242 0 0 4053 251 0 0 25 0 33 0 716408173 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4320304 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=24800/tid=24834] ppid=24798 vsize=7433908 CPUtime=45.2 cores=0-31
/proc/24800/task/24834/stat : 24834 (plingeling) R 24798 24800 24644 0 -1 4202560 52450 1242 0 0 4349 171 0 0 25 0 33 0 716408173 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24800/tid=24835] ppid=24798 vsize=7433908 CPUtime=46.03 cores=0-31
/proc/24800/task/24835/stat : 24835 (plingeling) R 24798 24800 24644 0 -1 4202560 52225 1242 0 0 4394 209 0 0 25 0 33 0 716408173 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=24800/tid=24836] ppid=24798 vsize=7433908 CPUtime=45.43 cores=0-31
/proc/24800/task/24836/stat : 24836 (plingeling) R 24798 24800 24644 0 -1 4202560 52126 1242 0 0 4334 209 0 0 25 0 33 0 716408173 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4260714 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=24800/tid=24837] ppid=24798 vsize=7433908 CPUtime=42.3 cores=0-31
/proc/24800/task/24837/stat : 24837 (plingeling) R 24798 24800 24644 0 -1 4202560 49449 1242 0 0 3991 239 0 0 25 0 33 0 716408181 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24800/tid=24838] ppid=24798 vsize=7433908 CPUtime=45.04 cores=0-31
/proc/24800/task/24838/stat : 24838 (plingeling) R 24798 24800 24644 0 -1 4202560 52141 1242 0 0 4262 242 0 0 25 0 33 0 716408181 7612321792 1743653 268435456000 4194304 4417452 140734708446224 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 15 0 0 0
Current children cumulated CPU time (s) 1482.53
Current children cumulated vsize (KiB) 7433908

[startup+162.302 s]
/proc/loadavg: 28.92 28.05 29.77 33/446 24843
/proc/meminfo: memFree=248574324/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=7245628 CPUtime=3398.58 cores=0-31
/proc/24800/stat : 24800 (plingeling) S 24798 24800 24644 0 -1 4202496 4263055 1242 0 0 332094 7764 0 0 19 0 33 0 716402774 7419523072 1698913 268435456000 4194304 4417452 140734708446224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 31 0 0 0
/proc/24800/statm: 1811407 1698913 175 55 0 1809293 0
[pid=24800/tid=24807] ppid=24798 vsize=7245628 CPUtime=104.22 cores=0-31
/proc/24800/task/24807/stat : 24807 (plingeling) R 24798 24800 24644 0 -1 4202560 87410 1242 0 0 10210 212 0 0 25 0 33 0 716408161 7419523072 1698913 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=24800/tid=24808] ppid=24798 vsize=7245628 CPUtime=105.46 cores=0-31

################
# More data... #
################

[pid=24800/tid=24838] ppid=24798 vsize=5922876 CPUtime=4899.88 cores=0-31
/proc/24800/task/24838/stat : 24838 (plingeling) R 24798 24800 24644 0 -1 4202560 812044 1242 0 0 489065 923 0 0 25 0 33 0 716408181 6065025024 1379633 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 30 0 0 0
Current children cumulated CPU time (s) 156783
Current children cumulated vsize (KiB) 5922876

[startup+5022.3 s]
/proc/loadavg: 32.00 32.01 32.00 33/446 24985
/proc/meminfo: memFree=249665720/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=6125860 CPUtime=158701 cores=0-31
/proc/24800/stat : 24800 (plingeling) S 24798 24800 24644 0 -1 4202496 26899405 1242 0 0 15839428 30680 0 0 19 0 33 0 716402774 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 31 0 0 0
/proc/24800/statm: 1531465 1430389 175 55 0 1529351 0
[pid=24800/tid=24807] ppid=24798 vsize=6125860 CPUtime=4959.36 cores=0-31
/proc/24800/task/24807/stat : 24807 (plingeling) R 24798 24800 24644 0 -1 4202560 826450 1242 0 0 494987 949 0 0 25 0 33 0 716408161 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=24800/tid=24808] ppid=24798 vsize=6125860 CPUtime=4963.67 cores=0-31
/proc/24800/task/24808/stat : 24808 (plingeling) R 24798 24800 24644 0 -1 4202560 549255 1242 0 0 495625 742 0 0 25 0 33 0 716408161 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24800/tid=24809] ppid=24798 vsize=6125860 CPUtime=4963.56 cores=0-31
/proc/24800/task/24809/stat : 24809 (plingeling) R 24798 24800 24644 0 -1 4202560 791354 1242 0 0 495339 1017 0 0 25 0 33 0 716408161 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=24800/tid=24810] ppid=24798 vsize=6125860 CPUtime=4951.1 cores=0-31
/proc/24800/task/24810/stat : 24810 (plingeling) R 24798 24800 24644 0 -1 4202560 683404 1242 0 0 494266 844 0 0 25 0 33 0 716408162 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=24800/tid=24811] ppid=24798 vsize=6125860 CPUtime=4942.58 cores=0-31
/proc/24800/task/24811/stat : 24811 (plingeling) R 24798 24800 24644 0 -1 4202560 832622 1242 0 0 493204 1054 0 0 25 0 33 0 716408162 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=24800/tid=24812] ppid=24798 vsize=6125860 CPUtime=4958.88 cores=0-31
/proc/24800/task/24812/stat : 24812 (plingeling) R 24798 24800 24644 0 -1 4202560 863479 1242 0 0 494875 1013 0 0 25 0 33 0 716408162 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24800/tid=24813] ppid=24798 vsize=6125860 CPUtime=4954.34 cores=0-31
/proc/24800/task/24813/stat : 24813 (plingeling) R 24798 24800 24644 0 -1 4202560 939791 1242 0 0 494205 1229 0 0 25 0 33 0 716408162 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=24800/tid=24814] ppid=24798 vsize=6125860 CPUtime=4962.37 cores=0-31
/proc/24800/task/24814/stat : 24814 (plingeling) R 24798 24800 24644 0 -1 4202560 861783 1242 0 0 495432 805 0 0 25 0 33 0 716408162 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24800/tid=24815] ppid=24798 vsize=6125860 CPUtime=4962.73 cores=0-31
/proc/24800/task/24815/stat : 24815 (plingeling) R 24798 24800 24644 0 -1 4202560 817441 1242 0 0 495105 1168 0 0 25 0 33 0 716408163 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24800/tid=24816] ppid=24798 vsize=6125860 CPUtime=4951.58 cores=0-31
/proc/24800/task/24816/stat : 24816 (plingeling) R 24798 24800 24644 0 -1 4202560 731123 1242 0 0 494197 961 0 0 25 0 33 0 716408165 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=24800/tid=24817] ppid=24798 vsize=6125860 CPUtime=4945.16 cores=0-31
/proc/24800/task/24817/stat : 24817 (plingeling) R 24798 24800 24644 0 -1 4202560 727159 1242 0 0 493630 886 0 0 25 0 33 0 716408165 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=24800/tid=24818] ppid=24798 vsize=6125860 CPUtime=4961.79 cores=0-31
/proc/24800/task/24818/stat : 24818 (plingeling) R 24798 24800 24644 0 -1 4202560 819565 1242 0 0 495001 1178 0 0 25 0 33 0 716408165 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=24800/tid=24819] ppid=24798 vsize=6125860 CPUtime=4960.28 cores=0-31
/proc/24800/task/24819/stat : 24819 (plingeling) R 24798 24800 24644 0 -1 4202560 816490 1242 0 0 495229 799 0 0 25 0 33 0 716408166 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=24800/tid=24820] ppid=24798 vsize=6125860 CPUtime=4964.32 cores=0-31
/proc/24800/task/24820/stat : 24820 (plingeling) R 24798 24800 24644 0 -1 4202560 599793 1242 0 0 495775 657 0 0 25 0 33 0 716408166 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24800/tid=24821] ppid=24798 vsize=6125860 CPUtime=4960.71 cores=0-31
/proc/24800/task/24821/stat : 24821 (plingeling) R 24798 24800 24644 0 -1 4202560 875674 1242 0 0 495121 950 0 0 25 0 33 0 716408167 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=24800/tid=24822] ppid=24798 vsize=6125860 CPUtime=4959.59 cores=0-31
/proc/24800/task/24822/stat : 24822 (plingeling) R 24798 24800 24644 0 -1 4202560 735780 1242 0 0 495123 836 0 0 25 0 33 0 716408167 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24800/tid=24823] ppid=24798 vsize=6125860 CPUtime=4953.16 cores=0-31
/proc/24800/task/24823/stat : 24823 (plingeling) R 24798 24800 24644 0 -1 4202560 911464 1242 0 0 494396 920 0 0 25 0 33 0 716408168 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=24800/tid=24824] ppid=24798 vsize=6125860 CPUtime=4960.37 cores=0-31
/proc/24800/task/24824/stat : 24824 (plingeling) R 24798 24800 24644 0 -1 4202560 907369 1242 0 0 495045 992 0 0 25 0 33 0 716408168 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=24800/tid=24825] ppid=24798 vsize=6125860 CPUtime=4960.16 cores=0-31
/proc/24800/task/24825/stat : 24825 (plingeling) R 24798 24800 24644 0 -1 4202560 816382 1242 0 0 494712 1304 0 0 25 0 33 0 716408169 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=24800/tid=24826] ppid=24798 vsize=6125860 CPUtime=4963.03 cores=0-31
/proc/24800/task/24826/stat : 24826 (plingeling) R 24798 24800 24644 0 -1 4202560 789248 1242 0 0 495367 936 0 0 25 0 33 0 716408169 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24800/tid=24827] ppid=24798 vsize=6125860 CPUtime=4960.12 cores=0-31
/proc/24800/task/24827/stat : 24827 (plingeling) R 24798 24800 24644 0 -1 4202560 823831 1242 0 0 495028 984 0 0 25 0 33 0 716408170 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=24800/tid=24828] ppid=24798 vsize=6125860 CPUtime=4963.75 cores=0-31
/proc/24800/task/24828/stat : 24828 (plingeling) R 24798 24800 24644 0 -1 4202560 557346 1242 0 0 495683 692 0 0 25 0 33 0 716408170 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=24800/tid=24829] ppid=24798 vsize=6125860 CPUtime=4953.97 cores=0-31
/proc/24800/task/24829/stat : 24829 (plingeling) R 24798 24800 24644 0 -1 4202560 890473 1242 0 0 494320 1077 0 0 25 0 33 0 716408171 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=24800/tid=24830] ppid=24798 vsize=6125860 CPUtime=4942.96 cores=0-31
/proc/24800/task/24830/stat : 24830 (plingeling) R 24798 24800 24644 0 -1 4202560 843603 1242 0 0 493280 1016 0 0 25 0 33 0 716408171 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=24800/tid=24831] ppid=24798 vsize=6125860 CPUtime=4957.86 cores=0-31
/proc/24800/task/24831/stat : 24831 (plingeling) R 24798 24800 24644 0 -1 4202560 945220 1242 0 0 494571 1215 0 0 25 0 33 0 716408172 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24800/tid=24832] ppid=24798 vsize=6125860 CPUtime=4961.6 cores=0-31
/proc/24800/task/24832/stat : 24832 (plingeling) R 24798 24800 24644 0 -1 4202560 547247 1242 0 0 495521 639 0 0 25 0 33 0 716408173 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=24800/tid=24833] ppid=24798 vsize=6125860 CPUtime=4955.09 cores=0-31
/proc/24800/task/24833/stat : 24833 (plingeling) R 24798 24800 24644 0 -1 4202560 804238 1242 0 0 494510 999 0 0 25 0 33 0 716408173 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=24800/tid=24834] ppid=24798 vsize=6125860 CPUtime=4962.09 cores=0-31
/proc/24800/task/24834/stat : 24834 (plingeling) R 24798 24800 24644 0 -1 4202560 833329 1242 0 0 495473 736 0 0 25 0 33 0 716408173 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=24800/tid=24835] ppid=24798 vsize=6125860 CPUtime=4959.85 cores=0-31
/proc/24800/task/24835/stat : 24835 (plingeling) R 24798 24800 24644 0 -1 4202560 811239 1242 0 0 495058 927 0 0 25 0 33 0 716408173 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=24800/tid=24836] ppid=24798 vsize=6125860 CPUtime=4958.64 cores=0-31
/proc/24800/task/24836/stat : 24836 (plingeling) R 24798 24800 24644 0 -1 4202560 676137 1242 0 0 495140 724 0 0 25 0 33 0 716408173 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=24800/tid=24837] ppid=24798 vsize=6125860 CPUtime=4952.36 cores=0-31
/proc/24800/task/24837/stat : 24837 (plingeling) R 24798 24800 24644 0 -1 4202560 873104 1242 0 0 494055 1181 0 0 25 0 33 0 716408181 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=24800/tid=24838] ppid=24798 vsize=6125860 CPUtime=4959.86 cores=0-31
/proc/24800/task/24838/stat : 24838 (plingeling) R 24798 24800 24644 0 -1 4202560 814490 1242 0 0 495063 923 0 0 25 0 33 0 716408181 6272880640 1430389 268435456000 4194304 4417452 140734708446224 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 30 0 0 0
Current children cumulated CPU time (s) 158701
Current children cumulated vsize (KiB) 6125860



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5063 s]
/proc/loadavg: 32.00 32.00 32.00 33/446 24985
/proc/meminfo: memFree=249612584/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=6189124 CPUtime=160003 cores=0-31
/proc/24800/stat : 24800 (plingeling) S 24798 24800 24644 0 -1 4202496 27026336 1242 0 0 15969427 30827 0 0 19 0 33 0 716402774 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 31 0 0 0
/proc/24800/statm: 1547281 1446208 175 55 0 1545167 0
[pid=24800/tid=24807] ppid=24798 vsize=6189124 CPUtime=5000.07 cores=0-31
/proc/24800/task/24807/stat : 24807 (plingeling) R 24798 24800 24644 0 -1 4202560 828512 1242 0 0 499052 955 0 0 25 0 33 0 716408161 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=24800/tid=24808] ppid=24798 vsize=6189124 CPUtime=5004.39 cores=0-31
/proc/24800/task/24808/stat : 24808 (plingeling) R 24798 24800 24644 0 -1 4202560 552666 1242 0 0 499692 747 0 0 25 0 33 0 716408161 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24800/tid=24809] ppid=24798 vsize=6189124 CPUtime=5004.27 cores=0-31
/proc/24800/task/24809/stat : 24809 (plingeling) R 24798 24800 24644 0 -1 4202560 793346 1242 0 0 499409 1018 0 0 25 0 33 0 716408161 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=24800/tid=24810] ppid=24798 vsize=6189124 CPUtime=4990.63 cores=0-31
/proc/24800/task/24810/stat : 24810 (plingeling) R 24798 24800 24644 0 -1 4202560 691597 1242 0 0 498218 845 0 0 25 0 33 0 716408162 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=24800/tid=24811] ppid=24798 vsize=6189124 CPUtime=4983.3 cores=0-31
/proc/24800/task/24811/stat : 24811 (plingeling) R 24798 24800 24644 0 -1 4202560 845318 1242 0 0 497245 1085 0 0 25 0 33 0 716408162 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4236601 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=24800/tid=24812] ppid=24798 vsize=6189124 CPUtime=4999.6 cores=0-31
/proc/24800/task/24812/stat : 24812 (plingeling) R 24798 24800 24644 0 -1 4202560 869713 1242 0 0 498935 1025 0 0 25 0 33 0 716408162 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24800/tid=24813] ppid=24798 vsize=6189124 CPUtime=4995.06 cores=0-31
/proc/24800/task/24813/stat : 24813 (plingeling) R 24798 24800 24644 0 -1 4202560 962335 1242 0 0 498267 1239 0 0 25 0 33 0 716408162 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=24800/tid=24814] ppid=24798 vsize=6189124 CPUtime=5003.08 cores=0-31
/proc/24800/task/24814/stat : 24814 (plingeling) R 24798 24800 24644 0 -1 4202560 861783 1242 0 0 499503 805 0 0 25 0 33 0 716408162 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24800/tid=24815] ppid=24798 vsize=6189124 CPUtime=5003.44 cores=0-31
/proc/24800/task/24815/stat : 24815 (plingeling) R 24798 24800 24644 0 -1 4202560 817441 1242 0 0 499176 1168 0 0 25 0 33 0 716408163 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4270130 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24800/tid=24816] ppid=24798 vsize=6189124 CPUtime=4992.3 cores=0-31
/proc/24800/task/24816/stat : 24816 (plingeling) R 24798 24800 24644 0 -1 4202560 731123 1242 0 0 498269 961 0 0 25 0 33 0 716408165 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=24800/tid=24817] ppid=24798 vsize=6189124 CPUtime=4985.88 cores=0-31
/proc/24800/task/24817/stat : 24817 (plingeling) R 24798 24800 24644 0 -1 4202560 729113 1242 0 0 497696 892 0 0 25 0 33 0 716408165 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=24800/tid=24818] ppid=24798 vsize=6189124 CPUtime=5002.51 cores=0-31
/proc/24800/task/24818/stat : 24818 (plingeling) R 24798 24800 24644 0 -1 4202560 821945 1242 0 0 499066 1185 0 0 25 0 33 0 716408165 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366092 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=24800/tid=24819] ppid=24798 vsize=6189124 CPUtime=5001 cores=0-31
/proc/24800/task/24819/stat : 24819 (plingeling) R 24798 24800 24644 0 -1 4202560 818089 1242 0 0 499300 800 0 0 25 0 33 0 716408166 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=24800/tid=24820] ppid=24798 vsize=6189124 CPUtime=5005.04 cores=0-31
/proc/24800/task/24820/stat : 24820 (plingeling) R 24798 24800 24644 0 -1 4202560 600961 1242 0 0 499846 658 0 0 25 0 33 0 716408166 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24800/tid=24821] ppid=24798 vsize=6189124 CPUtime=5001.42 cores=0-31
/proc/24800/task/24821/stat : 24821 (plingeling) R 24798 24800 24644 0 -1 4202560 879743 1242 0 0 499188 954 0 0 25 0 33 0 716408167 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=24800/tid=24822] ppid=24798 vsize=6189124 CPUtime=5000.31 cores=0-31
/proc/24800/task/24822/stat : 24822 (plingeling) R 24798 24800 24644 0 -1 4202560 748892 1242 0 0 499180 851 0 0 25 0 33 0 716408167 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24800/tid=24823] ppid=24798 vsize=6189124 CPUtime=4993.88 cores=0-31
/proc/24800/task/24823/stat : 24823 (plingeling) R 24798 24800 24644 0 -1 4202560 914078 1242 0 0 498460 928 0 0 25 0 33 0 716408168 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=24800/tid=24824] ppid=24798 vsize=6189124 CPUtime=5001.06 cores=0-31
/proc/24800/task/24824/stat : 24824 (plingeling) R 24798 24800 24644 0 -1 4202560 919203 1242 0 0 499101 1005 0 0 25 0 33 0 716408168 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=24800/tid=24825] ppid=24798 vsize=6189124 CPUtime=5000.86 cores=0-31
/proc/24800/task/24825/stat : 24825 (plingeling) R 24798 24800 24644 0 -1 4202560 818522 1242 0 0 498777 1309 0 0 25 0 33 0 716408169 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4353973 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=24800/tid=24826] ppid=24798 vsize=6189124 CPUtime=5003.74 cores=0-31
/proc/24800/task/24826/stat : 24826 (plingeling) R 24798 24800 24644 0 -1 4202560 791825 1242 0 0 499438 936 0 0 25 0 33 0 716408169 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24800/tid=24827] ppid=24798 vsize=6189124 CPUtime=5000.83 cores=0-31
/proc/24800/task/24827/stat : 24827 (plingeling) R 24798 24800 24644 0 -1 4202560 823831 1242 0 0 499099 984 0 0 25 0 33 0 716408170 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=24800/tid=24828] ppid=24798 vsize=6189124 CPUtime=5004.35 cores=0-31
/proc/24800/task/24828/stat : 24828 (plingeling) R 24798 24800 24644 0 -1 4202560 559757 1242 0 0 499741 694 0 0 25 0 33 0 716408170 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=24800/tid=24829] ppid=24798 vsize=6189124 CPUtime=4994.68 cores=0-31
/proc/24800/task/24829/stat : 24829 (plingeling) R 24798 24800 24644 0 -1 4202560 890473 1242 0 0 498391 1077 0 0 25 0 33 0 716408171 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=24800/tid=24830] ppid=24798 vsize=6189124 CPUtime=4983.67 cores=0-31
/proc/24800/task/24830/stat : 24830 (plingeling) R 24798 24800 24644 0 -1 4202560 844719 1242 0 0 497351 1016 0 0 25 0 33 0 716408171 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=24800/tid=24831] ppid=24798 vsize=6189124 CPUtime=4998.56 cores=0-31
/proc/24800/task/24831/stat : 24831 (plingeling) R 24798 24800 24644 0 -1 4202560 948580 1242 0 0 498638 1218 0 0 25 0 33 0 716408172 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24800/tid=24832] ppid=24798 vsize=6189124 CPUtime=5002.31 cores=0-31
/proc/24800/task/24832/stat : 24832 (plingeling) R 24798 24800 24644 0 -1 4202560 554164 1242 0 0 499590 641 0 0 25 0 33 0 716408173 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=24800/tid=24833] ppid=24798 vsize=6189124 CPUtime=4995.81 cores=0-31
/proc/24800/task/24833/stat : 24833 (plingeling) R 24798 24800 24644 0 -1 4202560 805218 1242 0 0 498581 1000 0 0 25 0 33 0 716408173 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=24800/tid=24834] ppid=24798 vsize=6189124 CPUtime=5002.79 cores=0-31
/proc/24800/task/24834/stat : 24834 (plingeling) R 24798 24800 24644 0 -1 4202560 835497 1242 0 0 499542 737 0 0 25 0 33 0 716408173 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=24800/tid=24835] ppid=24798 vsize=6189124 CPUtime=5000.57 cores=0-31
/proc/24800/task/24835/stat : 24835 (plingeling) R 24798 24800 24644 0 -1 4202560 812175 1242 0 0 499129 928 0 0 25 0 33 0 716408173 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=24800/tid=24836] ppid=24798 vsize=6189124 CPUtime=4999.35 cores=0-31
/proc/24800/task/24836/stat : 24836 (plingeling) R 24798 24800 24644 0 -1 4202560 676137 1242 0 0 499211 724 0 0 25 0 33 0 716408173 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=24800/tid=24837] ppid=24798 vsize=6189124 CPUtime=4993.08 cores=0-31
/proc/24800/task/24837/stat : 24837 (plingeling) R 24798 24800 24644 0 -1 4202560 877775 1242 0 0 498119 1189 0 0 25 0 33 0 716408181 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=24800/tid=24838] ppid=24798 vsize=6189124 CPUtime=5000.58 cores=0-31
/proc/24800/task/24838/stat : 24838 (plingeling) R 24798 24800 24644 0 -1 4202560 818283 1242 0 0 499128 930 0 0 25 0 33 0 716408181 6337662976 1446208 268435456000 4194304 4417452 140734708446224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 6189124

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5063.4 s]
/proc/loadavg: 32.00 32.00 32.00 2/416 24986
/proc/meminfo: memFree=251693296/264257624 swapFree=67111528/67111528
[pid=24800] ppid=24798 vsize=0 CPUtime=160003 cores=0-31
/proc/24800/stat : 24800 (plingeling) Z 24798 24800 24644 0 -1 4203548 27026336 1242 0 0 15969450 30864 0 0 18 0 2 0 716402774 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 31 0 0 0
/proc/24800/statm: 0 0 0 0 0 0 0
[pid=24800/tid=24810] ppid=24798 vsize=0 CPUtime=4991.01 cores=0-31
/proc/24800/task/24810/stat : 24810 (plingeling) R 24798 24800 24644 0 -1 4203588 691597 1242 0 0 498219 882 0 0 25 0 2 0 716408162 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 15 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5063.48
CPU time (s): 160003
CPU user time (s): 159694
CPU system time (s): 308.727
CPU usage (%): 3159.95
Max. virtual memory (cumulated for all children) (KiB): 11283512

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159695
system time used= 308.727
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27027578
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5553
involuntary context switches= 400313

runsolver used 27.9218 second user time and 116.44 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-22 09:26:04
IDJOB=3372807
IDBENCH=83463
IDSOLVER=1852
FILE ID=node200/3372807-1306049160
RUNJOBID= node200-1306049148-24658
PBS_JOBID= 13387808
Free space on /tmp= 61948 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00X23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372807-1306049160/watcher-3372807-1306049160 -o /tmp/evaluation-result-3372807-1306049160/solver-3372807-1306049160 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372807-1306049160.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 9cec6483d4ca03e8555377ba059b61ae
RANDOM SEED=161563625

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255376980 kB
Buffers:        454924 kB
Cached:        7999476 kB
SwapCached:          0 kB
Active:        7539132 kB
Inactive:       984352 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255376980 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          101444 kB
Writeback:           0 kB
AnonPages:       69288 kB
Mapped:          14532 kB
Slab:           255224 kB
PageTables:       4432 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   196956 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61948 MiB
End job on node200 at 2011-05-22 10:50:29