Trace number 3372630

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 160002 5018.69

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
MD5SUM7886cd26d6e0801ea382a1ffd6224023
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark18047.5
Satisfiable
(Un)Satisfiability was proved
Number of variables192503
Number of clauses564953
Sum of the clauses size1318221
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2376634
Number of clauses of size 3188317
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372630-1305692963/watcher-3372630-1305692963 -o /tmp/evaluation-result-3372630-1305692963/solver-3372630-1305692963 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372630-1305692963.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 17.72 23.38 26.98 1/413 31280
/proc/meminfo: memFree=255503788/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=19540 CPUtime=0.02 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 2940 1240 0 0 2 0 0 0 21 0 1 0 680782808 20008960 2870 268435456000 4194304 4417452 140733198923312 18446744073709551615 4235981 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 4885 2870 145 55 0 2771 0

[startup+0.128684 s]
/proc/loadavg: 17.72 23.38 26.98 1/413 31280
/proc/meminfo: memFree=255503788/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=31468 CPUtime=0.12 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 5923 1240 0 0 11 1 0 0 21 0 1 0 680782808 32223232 5853 268435456000 4194304 4417452 140733198923312 18446744073709551615 4264990 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 7867 5853 146 55 0 5753 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 31468

[startup+0.200693 s]
/proc/loadavg: 17.72 23.38 26.98 1/413 31280
/proc/meminfo: memFree=255503788/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=51216 CPUtime=0.19 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 10892 1240 0 0 17 2 0 0 21 0 1 0 680782808 52445184 10822 268435456000 4194304 4417452 140733198923312 18446744073709551615 4262041 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 12804 10822 146 55 0 10690 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 51216

[startup+0.300674 s]
/proc/loadavg: 17.72 23.38 26.98 1/413 31280
/proc/meminfo: memFree=255503788/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=51216 CPUtime=0.29 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 10892 1240 0 0 27 2 0 0 22 0 1 0 680782808 52445184 10822 268435456000 4194304 4417452 140733198923312 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 12804 10822 146 55 0 10690 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 51216

[startup+0.700709 s]
/proc/loadavg: 17.72 23.38 26.98 1/413 31280
/proc/meminfo: memFree=255503788/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=82700 CPUtime=0.69 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 18763 1240 0 0 65 4 0 0 23 0 1 0 680782808 84684800 18693 268435456000 4194304 4417452 140733198923312 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 20675 18693 146 55 0 18561 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 82700

[startup+1.50073 s]
/proc/loadavg: 17.72 23.38 26.98 2/414 31286
/proc/meminfo: memFree=255391056/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=153740 CPUtime=1.49 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 36523 1240 0 0 141 8 0 0 25 0 1 0 680782808 157429760 36453 268435456000 4194304 4417452 140733198923312 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 38435 36453 146 55 0 36321 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 153740

[startup+3.10079 s]
/proc/loadavg: 17.72 23.38 26.98 2/414 31286
/proc/meminfo: memFree=255235660/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=293260 CPUtime=3.08 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 71422 1240 0 0 293 15 0 0 25 0 1 0 680782808 300298240 71333 268435456000 4194304 4417452 140733198923312 18446744073709551615 4259697 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 73315 71333 146 55 0 71201 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 293260

[startup+6.3009 s]
/proc/loadavg: 16.38 23.01 26.84 2/414 31286
/proc/meminfo: memFree=254937272/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=574672 CPUtime=6.29 cores=0-31
/proc/31280/stat : 31280 (plingeling) R 31278 31280 31124 0 -1 4202496 141775 1240 0 0 599 30 0 0 25 0 1 0 680782808 588464128 141686 268435456000 4194304 4417452 140733198923312 18446744073709551615 4228002 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/31280/statm: 143668 141686 146 55 0 141554 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 574672

[startup+12.702 s]
/proc/loadavg: 15.15 22.64 26.70 33/446 31318
/proc/meminfo: memFree=254069932/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=1989460 CPUtime=82.22 cores=0-31
/proc/31280/stat : 31280 (plingeling) S 31278 31280 31124 0 -1 4202496 540786 1240 0 0 7853 369 0 0 18 0 33 0 680782808 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 23 0 0 0
/proc/31280/statm: 497365 360330 169 55 0 495251 0
[pid=31280/tid=31287] ppid=31278 vsize=1989460 CPUtime=2.27 cores=0-31
/proc/31280/task/31287/stat : 31287 (plingeling) R 31278 31280 31124 0 -1 4202560 10111 1240 0 0 219 8 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4289052 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31280/tid=31288] ppid=31278 vsize=1989460 CPUtime=2.27 cores=0-31
/proc/31280/task/31288/stat : 31288 (plingeling) R 31278 31280 31124 0 -1 4202560 6754 1240 0 0 218 9 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287492 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31280/tid=31289] ppid=31278 vsize=1989460 CPUtime=2.27 cores=0-31
/proc/31280/task/31289/stat : 31289 (plingeling) R 31278 31280 31124 0 -1 4202560 8664 1240 0 0 217 10 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31280/tid=31290] ppid=31278 vsize=1989460 CPUtime=2.24 cores=0-31
/proc/31280/task/31290/stat : 31290 (plingeling) R 31278 31280 31124 0 -1 4202560 4273 1240 0 0 222 2 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4264959 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=31280/tid=31291] ppid=31278 vsize=1989460 CPUtime=2.26 cores=0-31
/proc/31280/task/31291/stat : 31291 (plingeling) R 31278 31280 31124 0 -1 4202560 8616 1240 0 0 217 9 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31280/tid=31292] ppid=31278 vsize=1989460 CPUtime=2.26 cores=0-31
/proc/31280/task/31292/stat : 31292 (plingeling) R 31278 31280 31124 0 -1 4202560 6382 1240 0 0 217 9 0 0 25 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=31280/tid=31293] ppid=31278 vsize=1989460 CPUtime=2.27 cores=0-31
/proc/31280/task/31293/stat : 31293 (plingeling) R 31278 31280 31124 0 -1 4202560 10107 1240 0 0 215 12 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31280/tid=31294] ppid=31278 vsize=1989460 CPUtime=2.26 cores=0-31
/proc/31280/task/31294/stat : 31294 (plingeling) R 31278 31280 31124 0 -1 4202560 7468 1240 0 0 217 9 0 0 21 0 33 0 680783847 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31280/tid=31295] ppid=31278 vsize=1989460 CPUtime=2.21 cores=0-31
/proc/31280/task/31295/stat : 31295 (plingeling) R 31278 31280 31124 0 -1 4202560 7872 1240 0 0 212 9 0 0 21 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4290595 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=31280/tid=31296] ppid=31278 vsize=1989460 CPUtime=2.23 cores=0-31
/proc/31280/task/31296/stat : 31296 (plingeling) R 31278 31280 31124 0 -1 4202560 5314 1240 0 0 214 9 0 0 21 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31280/tid=31297] ppid=31278 vsize=1989460 CPUtime=2.23 cores=0-31
/proc/31280/task/31297/stat : 31297 (plingeling) R 31278 31280 31124 0 -1 4202560 5315 1240 0 0 215 8 0 0 21 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4290618 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=31280/tid=31298] ppid=31278 vsize=1989460 CPUtime=2.25 cores=0-31
/proc/31280/task/31298/stat : 31298 (plingeling) R 31278 31280 31124 0 -1 4202560 11693 1240 0 0 212 13 0 0 25 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4286475 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=31280/tid=31299] ppid=31278 vsize=1989460 CPUtime=2.25 cores=0-31
/proc/31280/task/31299/stat : 31299 (plingeling) R 31278 31280 31124 0 -1 4202560 7920 1240 0 0 214 11 0 0 21 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=31280/tid=31300] ppid=31278 vsize=1989460 CPUtime=2.24 cores=0-31
/proc/31280/task/31300/stat : 31300 (plingeling) R 31278 31280 31124 0 -1 4202560 10105 1240 0 0 213 11 0 0 21 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=31280/tid=31301] ppid=31278 vsize=1989460 CPUtime=2.19 cores=0-31
/proc/31280/task/31301/stat : 31301 (plingeling) R 31278 31280 31124 0 -1 4202560 8245 1240 0 0 206 13 0 0 25 0 33 0 680783848 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=31280/tid=31302] ppid=31278 vsize=1989460 CPUtime=2.25 cores=0-31
/proc/31280/task/31302/stat : 31302 (plingeling) R 31278 31280 31124 0 -1 4202560 6755 1240 0 0 215 10 0 0 25 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=31280/tid=31303] ppid=31278 vsize=1989460 CPUtime=2.23 cores=0-31
/proc/31280/task/31303/stat : 31303 (plingeling) R 31278 31280 31124 0 -1 4202560 5272 1240 0 0 215 8 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4277708 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=31280/tid=31304] ppid=31278 vsize=1989460 CPUtime=2.25 cores=0-31
/proc/31280/task/31304/stat : 31304 (plingeling) R 31278 31280 31124 0 -1 4202560 8989 1240 0 0 212 13 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287111 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=31280/tid=31305] ppid=31278 vsize=1989460 CPUtime=2.24 cores=0-31
/proc/31280/task/31305/stat : 31305 (plingeling) R 31278 31280 31124 0 -1 4202560 9410 1240 0 0 214 10 0 0 25 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4286223 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=31280/tid=31306] ppid=31278 vsize=1989460 CPUtime=2.18 cores=0-31
/proc/31280/task/31306/stat : 31306 (plingeling) R 31278 31280 31124 0 -1 4202560 10155 1240 0 0 206 12 0 0 25 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4282443 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=31280/tid=31307] ppid=31278 vsize=1989460 CPUtime=2.25 cores=0-31
/proc/31280/task/31307/stat : 31307 (plingeling) R 31278 31280 31124 0 -1 4202560 9410 1240 0 0 212 13 0 0 25 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4286467 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=31280/tid=31308] ppid=31278 vsize=1989460 CPUtime=2.24 cores=0-31
/proc/31280/task/31308/stat : 31308 (plingeling) R 31278 31280 31124 0 -1 4202560 10528 1240 0 0 219 5 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287304 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=31280/tid=31309] ppid=31278 vsize=1989460 CPUtime=2.26 cores=0-31
/proc/31280/task/31309/stat : 31309 (plingeling) R 31278 31280 31124 0 -1 4202560 4107 1240 0 0 223 3 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284784 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=31280/tid=31310] ppid=31278 vsize=1989460 CPUtime=2.24 cores=0-31
/proc/31280/task/31310/stat : 31310 (plingeling) R 31278 31280 31124 0 -1 4202560 6754 1240 0 0 215 9 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284626 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=31280/tid=31311] ppid=31278 vsize=1989460 CPUtime=2.25 cores=0-31
/proc/31280/task/31311/stat : 31311 (plingeling) R 31278 31280 31124 0 -1 4202560 7684 1240 0 0 215 10 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=31280/tid=31312] ppid=31278 vsize=1989460 CPUtime=2.24 cores=0-31
/proc/31280/task/31312/stat : 31312 (plingeling) R 31278 31280 31124 0 -1 4202560 11084 1240 0 0 211 13 0 0 21 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284289 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=31280/tid=31313] ppid=31278 vsize=1989460 CPUtime=2.2 cores=0-31
/proc/31280/task/31313/stat : 31313 (plingeling) R 31278 31280 31124 0 -1 4202560 9174 1240 0 0 211 9 0 0 25 0 33 0 680783849 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=31280/tid=31314] ppid=31278 vsize=1989460 CPUtime=2.2 cores=0-31
/proc/31280/task/31314/stat : 31314 (plingeling) R 31278 31280 31124 0 -1 4202560 9174 1240 0 0 211 9 0 0 25 0 33 0 680783850 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4285073 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=31280/tid=31315] ppid=31278 vsize=1989460 CPUtime=2.2 cores=0-31
/proc/31280/task/31315/stat : 31315 (plingeling) R 31278 31280 31124 0 -1 4202560 7498 1240 0 0 212 8 0 0 25 0 33 0 680783855 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=31280/tid=31316] ppid=31278 vsize=1989460 CPUtime=2.2 cores=0-31
/proc/31280/task/31316/stat : 31316 (plingeling) R 31278 31280 31124 0 -1 4202560 7872 1240 0 0 215 5 0 0 25 0 33 0 680783855 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4290744 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31280/tid=31317] ppid=31278 vsize=1989460 CPUtime=2.2 cores=0-31
/proc/31280/task/31317/stat : 31317 (plingeling) R 31278 31280 31124 0 -1 4202560 7919 1240 0 0 212 8 0 0 21 0 33 0 680783855 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4293750 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=31280/tid=31318] ppid=31278 vsize=1989460 CPUtime=2.19 cores=0-31
/proc/31280/task/31318/stat : 31318 (plingeling) R 31278 31280 31124 0 -1 4202560 7918 1240 0 0 211 8 0 0 19 0 33 0 680783855 2037207040 360330 268435456000 4194304 4417452 140733198923312 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 26 0 0 0
Current children cumulated CPU time (s) 82.22
Current children cumulated vsize (KiB) 1989460

[startup+25.5014 s]
/proc/loadavg: 18.88 23.10 26.79 33/446 31320
/proc/meminfo: memFree=253365136/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=2591668 CPUtime=482.96 cores=0-31
/proc/31280/stat : 31280 (plingeling) S 31278 31280 31124 0 -1 4202496 801862 1240 0 0 47683 613 0 0 18 0 33 0 680782808 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 23 0 0 0
/proc/31280/statm: 647917 530446 174 55 0 645803 0
[pid=31280/tid=31287] ppid=31278 vsize=2591668 CPUtime=14.48 cores=0-31
/proc/31280/task/31287/stat : 31287 (plingeling) R 31278 31280 31124 0 -1 4202560 21369 1240 0 0 1435 13 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4248238 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31280/tid=31288] ppid=31278 vsize=2591668 CPUtime=15.06 cores=0-31
/proc/31280/task/31288/stat : 31288 (plingeling) R 31278 31280 31124 0 -1 4202560 10857 1240 0 0 1487 19 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4252188 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=31280/tid=31289] ppid=31278 vsize=2591668 CPUtime=14.95 cores=0-31
/proc/31280/task/31289/stat : 31289 (plingeling) R 31278 31280 31124 0 -1 4202560 11186 1240 0 0 1485 10 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4336704 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=31280/tid=31290] ppid=31278 vsize=2591668 CPUtime=15.03 cores=0-31
/proc/31280/task/31290/stat : 31290 (plingeling) R 31278 31280 31124 0 -1 4202560 4274 1240 0 0 1501 2 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4251121 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=31280/tid=31291] ppid=31278 vsize=2591668 CPUtime=14.64 cores=0-31
/proc/31280/task/31291/stat : 31291 (plingeling) R 31278 31280 31124 0 -1 4202560 12718 1240 0 0 1443 21 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31280/tid=31292] ppid=31278 vsize=2591668 CPUtime=14.34 cores=0-31
/proc/31280/task/31292/stat : 31292 (plingeling) R 31278 31280 31124 0 -1 4202560 14532 1240 0 0 1421 13 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4258267 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=31280/tid=31293] ppid=31278 vsize=2591668 CPUtime=15.03 cores=0-31
/proc/31280/task/31293/stat : 31293 (plingeling) R 31278 31280 31124 0 -1 4202560 21771 1240 0 0 1488 15 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4378090 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=31280/tid=31294] ppid=31278 vsize=2591668 CPUtime=14.59 cores=0-31
/proc/31280/task/31294/stat : 31294 (plingeling) R 31278 31280 31124 0 -1 4202560 11570 1240 0 0 1447 12 0 0 25 0 33 0 680783847 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4235997 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31280/tid=31295] ppid=31278 vsize=2591668 CPUtime=14.79 cores=0-31
/proc/31280/task/31295/stat : 31295 (plingeling) R 31278 31280 31124 0 -1 4202560 18454 1240 0 0 1456 23 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4252276 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31280/tid=31296] ppid=31278 vsize=2591668 CPUtime=14.32 cores=0-31
/proc/31280/task/31296/stat : 31296 (plingeling) R 31278 31280 31124 0 -1 4202560 14836 1240 0 0 1410 22 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4335976 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=31280/tid=31297] ppid=31278 vsize=2591668 CPUtime=15.03 cores=0-31
/proc/31280/task/31297/stat : 31297 (plingeling) R 31278 31280 31124 0 -1 4202560 10053 1240 0 0 1493 10 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4377275 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=31280/tid=31298] ppid=31278 vsize=2591668 CPUtime=14.75 cores=0-31
/proc/31280/task/31298/stat : 31298 (plingeling) R 31278 31280 31124 0 -1 4202560 17811 1240 0 0 1448 27 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4235398 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=31280/tid=31299] ppid=31278 vsize=2591668 CPUtime=14.74 cores=0-31
/proc/31280/task/31299/stat : 31299 (plingeling) R 31278 31280 31124 0 -1 4202560 19118 1240 0 0 1450 24 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4233269 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=31280/tid=31300] ppid=31278 vsize=2591668 CPUtime=14.83 cores=0-31
/proc/31280/task/31300/stat : 31300 (plingeling) R 31278 31280 31124 0 -1 4202560 21863 1240 0 0 1460 23 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4336675 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=31280/tid=31301] ppid=31278 vsize=2591668 CPUtime=14.97 cores=0-31
/proc/31280/task/31301/stat : 31301 (plingeling) R 31278 31280 31124 0 -1 4202560 10737 1240 0 0 1484 13 0 0 25 0 33 0 680783848 2653868032 530446 268435456000 4194304 4417452 140733198923312 18446744073709551615 4376679 0 0 4096 17442 0 0 0 -1 1 0 0 0

################
# More data... #
################

/proc/31280/task/31292/stat : 31292 (plingeling) R 31278 31280 31124 0 -1 4202560 1023109 1240 0 0 493226 879 0 0 25 0 33 0 680783847 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=31280/tid=31293] ppid=31278 vsize=6754748 CPUtime=4938.69 cores=0-31
/proc/31280/task/31293/stat : 31293 (plingeling) R 31278 31280 31124 0 -1 4202560 740244 1240 0 0 493291 578 0 0 25 0 33 0 680783847 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 18446744073699065980 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=31280/tid=31294] ppid=31278 vsize=6754748 CPUtime=4949.47 cores=0-31
/proc/31280/task/31294/stat : 31294 (plingeling) R 31278 31280 31124 0 -1 4202560 354051 1240 0 0 494634 313 0 0 25 0 33 0 680783847 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4232832 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31280/tid=31295] ppid=31278 vsize=6754748 CPUtime=4940.51 cores=0-31
/proc/31280/task/31295/stat : 31295 (plingeling) R 31278 31280 31124 0 -1 4202560 404800 1240 0 0 493737 314 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=31280/tid=31296] ppid=31278 vsize=6754748 CPUtime=4944.78 cores=0-31
/proc/31280/task/31296/stat : 31296 (plingeling) R 31278 31280 31124 0 -1 4202560 579043 1240 0 0 494017 461 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=31280/tid=31297] ppid=31278 vsize=6754748 CPUtime=4942.92 cores=0-31
/proc/31280/task/31297/stat : 31297 (plingeling) R 31278 31280 31124 0 -1 4202560 1186473 1240 0 0 493161 1131 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=31280/tid=31298] ppid=31278 vsize=6754748 CPUtime=4946.84 cores=0-31
/proc/31280/task/31298/stat : 31298 (plingeling) R 31278 31280 31124 0 -1 4202560 898806 1240 0 0 493891 793 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=31280/tid=31299] ppid=31278 vsize=6754748 CPUtime=4945.28 cores=0-31
/proc/31280/task/31299/stat : 31299 (plingeling) R 31278 31280 31124 0 -1 4202560 528426 1240 0 0 493888 640 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31280/tid=31300] ppid=31278 vsize=6754748 CPUtime=4950.02 cores=0-31
/proc/31280/task/31300/stat : 31300 (plingeling) R 31278 31280 31124 0 -1 4202560 317196 1240 0 0 494803 199 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31280/tid=31301] ppid=31278 vsize=6754748 CPUtime=4947.35 cores=0-31
/proc/31280/task/31301/stat : 31301 (plingeling) R 31278 31280 31124 0 -1 4202560 724658 1240 0 0 494145 590 0 0 25 0 33 0 680783848 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4236935 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=31280/tid=31302] ppid=31278 vsize=6754748 CPUtime=4949.45 cores=0-31
/proc/31280/task/31302/stat : 31302 (plingeling) R 31278 31280 31124 0 -1 4202560 319540 1240 0 0 494833 112 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4236982 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=31280/tid=31303] ppid=31278 vsize=6754748 CPUtime=4948.47 cores=0-31
/proc/31280/task/31303/stat : 31303 (plingeling) R 31278 31280 31124 0 -1 4202560 457530 1240 0 0 494410 437 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=31280/tid=31304] ppid=31278 vsize=6754748 CPUtime=4939.94 cores=0-31
/proc/31280/task/31304/stat : 31304 (plingeling) R 31278 31280 31124 0 -1 4202560 707558 1240 0 0 493504 490 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=31280/tid=31305] ppid=31278 vsize=6754748 CPUtime=4942.66 cores=0-31
/proc/31280/task/31305/stat : 31305 (plingeling) R 31278 31280 31124 0 -1 4202560 697610 1240 0 0 493686 580 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=31280/tid=31306] ppid=31278 vsize=6754748 CPUtime=4942.39 cores=0-31
/proc/31280/task/31306/stat : 31306 (plingeling) R 31278 31280 31124 0 -1 4202560 412426 1240 0 0 493853 386 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4257124 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=31280/tid=31307] ppid=31278 vsize=6754748 CPUtime=4948.31 cores=0-31
/proc/31280/task/31307/stat : 31307 (plingeling) R 31278 31280 31124 0 -1 4202560 260589 1240 0 0 494610 221 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=31280/tid=31308] ppid=31278 vsize=6754748 CPUtime=4931.81 cores=0-31
/proc/31280/task/31308/stat : 31308 (plingeling) R 31278 31280 31124 0 -1 4202560 537611 1240 0 0 492830 351 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4357981 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=31280/tid=31309] ppid=31278 vsize=6754748 CPUtime=4941.66 cores=0-31
/proc/31280/task/31309/stat : 31309 (plingeling) R 31278 31280 31124 0 -1 4202560 486395 1240 0 0 493924 242 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4357241 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=31280/tid=31310] ppid=31278 vsize=6754748 CPUtime=4936.77 cores=0-31
/proc/31280/task/31310/stat : 31310 (plingeling) R 31278 31280 31124 0 -1 4202560 421013 1240 0 0 493274 403 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=31280/tid=31311] ppid=31278 vsize=6754748 CPUtime=4948.84 cores=0-31
/proc/31280/task/31311/stat : 31311 (plingeling) R 31278 31280 31124 0 -1 4202560 829755 1240 0 0 494185 699 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=31280/tid=31312] ppid=31278 vsize=6754748 CPUtime=4947.56 cores=0-31
/proc/31280/task/31312/stat : 31312 (plingeling) R 31278 31280 31124 0 -1 4202560 1137267 1240 0 0 493846 910 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31280/tid=31313] ppid=31278 vsize=6754748 CPUtime=4939.61 cores=0-31
/proc/31280/task/31313/stat : 31313 (plingeling) R 31278 31280 31124 0 -1 4202560 641549 1240 0 0 493367 594 0 0 25 0 33 0 680783849 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4366094 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31280/tid=31314] ppid=31278 vsize=6754748 CPUtime=4945.25 cores=0-31
/proc/31280/task/31314/stat : 31314 (plingeling) R 31278 31280 31124 0 -1 4202560 421516 1240 0 0 494157 368 0 0 25 0 33 0 680783850 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31280/tid=31315] ppid=31278 vsize=6754748 CPUtime=4949.46 cores=0-31
/proc/31280/task/31315/stat : 31315 (plingeling) R 31278 31280 31124 0 -1 4202560 249515 1240 0 0 494701 245 0 0 25 0 33 0 680783855 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=31280/tid=31316] ppid=31278 vsize=6754748 CPUtime=4942.66 cores=0-31
/proc/31280/task/31316/stat : 31316 (plingeling) R 31278 31280 31124 0 -1 4202560 368738 1240 0 0 493917 349 0 0 25 0 33 0 680783855 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31280/tid=31317] ppid=31278 vsize=6754748 CPUtime=4944.7 cores=0-31
/proc/31280/task/31317/stat : 31317 (plingeling) R 31278 31280 31124 0 -1 4202560 425995 1240 0 0 494236 234 0 0 25 0 33 0 680783855 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=31280/tid=31318] ppid=31278 vsize=6754748 CPUtime=4948.09 cores=0-31
/proc/31280/task/31318/stat : 31318 (plingeling) R 31278 31280 31124 0 -1 4202560 507086 1240 0 0 494329 480 0 0 25 0 33 0 680783855 6916861952 1577826 268435456000 4194304 4417452 140733198923312 18446744073709551615 4353528 0 0 4096 17442 0 0 0 -1 11 0 0 0
Current children cumulated CPU time (s) 158218
Current children cumulated vsize (KiB) 6754748



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5018.1 s]
/proc/loadavg: 32.09 32.10 32.05 33/446 31464
/proc/meminfo: memFree=249125580/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=6817668 CPUtime=160001 cores=0-31
/proc/31280/stat : 31280 (plingeling) S 31278 31280 31124 0 -1 4202496 19050664 1240 0 0 15984334 15772 0 0 18 0 33 0 680782808 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 23 0 0 0
/proc/31280/statm: 1704417 1593644 175 55 0 1702303 0
[pid=31280/tid=31287] ppid=31278 vsize=6817668 CPUtime=5003.57 cores=0-31
/proc/31280/task/31287/stat : 31287 (plingeling) R 31278 31280 31124 0 -1 4202560 732169 1240 0 0 500000 357 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=31280/tid=31288] ppid=31278 vsize=6817668 CPUtime=5000.72 cores=0-31
/proc/31280/task/31288/stat : 31288 (plingeling) R 31278 31280 31124 0 -1 4202560 667304 1240 0 0 499518 554 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=31280/tid=31289] ppid=31278 vsize=6817668 CPUtime=4996.07 cores=0-31
/proc/31280/task/31289/stat : 31289 (plingeling) R 31278 31280 31124 0 -1 4202560 744304 1240 0 0 498946 661 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=31280/tid=31290] ppid=31278 vsize=6817668 CPUtime=5004.71 cores=0-31
/proc/31280/task/31290/stat : 31290 (plingeling) R 31278 31280 31124 0 -1 4202560 441589 1240 0 0 499955 516 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31280/tid=31291] ppid=31278 vsize=6817668 CPUtime=4986.79 cores=0-31
/proc/31280/task/31291/stat : 31291 (plingeling) R 31278 31280 31124 0 -1 4202560 359567 1240 0 0 498294 385 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=31280/tid=31292] ppid=31278 vsize=6817668 CPUtime=4996.86 cores=0-31
/proc/31280/task/31292/stat : 31292 (plingeling) R 31278 31280 31124 0 -1 4202560 1029637 1240 0 0 498805 881 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=31280/tid=31293] ppid=31278 vsize=6817668 CPUtime=4994.47 cores=0-31
/proc/31280/task/31293/stat : 31293 (plingeling) R 31278 31280 31124 0 -1 4202560 753171 1240 0 0 498843 604 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=31280/tid=31294] ppid=31278 vsize=6817668 CPUtime=5005.28 cores=0-31
/proc/31280/task/31294/stat : 31294 (plingeling) R 31278 31280 31124 0 -1 4202560 354531 1240 0 0 500215 313 0 0 25 0 33 0 680783847 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31280/tid=31295] ppid=31278 vsize=6817668 CPUtime=4996.31 cores=0-31
/proc/31280/task/31295/stat : 31295 (plingeling) R 31278 31280 31124 0 -1 4202560 406772 1240 0 0 499312 319 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=31280/tid=31296] ppid=31278 vsize=6817668 CPUtime=5000.58 cores=0-31
/proc/31280/task/31296/stat : 31296 (plingeling) R 31278 31280 31124 0 -1 4202560 581079 1240 0 0 499597 461 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=31280/tid=31297] ppid=31278 vsize=6817668 CPUtime=4998.67 cores=0-31
/proc/31280/task/31297/stat : 31297 (plingeling) R 31278 31280 31124 0 -1 4202560 1195260 1240 0 0 498728 1139 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=31280/tid=31298] ppid=31278 vsize=6817668 CPUtime=5002.65 cores=0-31
/proc/31280/task/31298/stat : 31298 (plingeling) R 31278 31280 31124 0 -1 4202560 904153 1240 0 0 499471 794 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=31280/tid=31299] ppid=31278 vsize=6817668 CPUtime=5000.22 cores=0-31
/proc/31280/task/31299/stat : 31299 (plingeling) R 31278 31280 31124 0 -1 4202560 532991 1240 0 0 499377 645 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=31280/tid=31300] ppid=31278 vsize=6817668 CPUtime=5005.83 cores=0-31
/proc/31280/task/31300/stat : 31300 (plingeling) R 31278 31280 31124 0 -1 4202560 318681 1240 0 0 500384 199 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31280/tid=31301] ppid=31278 vsize=6817668 CPUtime=5003.16 cores=0-31
/proc/31280/task/31301/stat : 31301 (plingeling) R 31278 31280 31124 0 -1 4202560 728990 1240 0 0 499717 599 0 0 25 0 33 0 680783848 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=31280/tid=31302] ppid=31278 vsize=6817668 CPUtime=5004.6 cores=0-31
/proc/31280/task/31302/stat : 31302 (plingeling) R 31278 31280 31124 0 -1 4202560 335924 1240 0 0 500345 115 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=31280/tid=31303] ppid=31278 vsize=6817668 CPUtime=5004.19 cores=0-31
/proc/31280/task/31303/stat : 31303 (plingeling) R 31278 31280 31124 0 -1 4202560 465850 1240 0 0 499980 439 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=31280/tid=31304] ppid=31278 vsize=6817668 CPUtime=4995.75 cores=0-31
/proc/31280/task/31304/stat : 31304 (plingeling) R 31278 31280 31124 0 -1 4202560 707558 1240 0 0 499085 490 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=31280/tid=31305] ppid=31278 vsize=6817668 CPUtime=4998.27 cores=0-31
/proc/31280/task/31305/stat : 31305 (plingeling) R 31278 31280 31124 0 -1 4202560 721536 1240 0 0 499193 634 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=31280/tid=31306] ppid=31278 vsize=6817668 CPUtime=4998.2 cores=0-31
/proc/31280/task/31306/stat : 31306 (plingeling) R 31278 31280 31124 0 -1 4202560 417237 1240 0 0 499432 388 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=31280/tid=31307] ppid=31278 vsize=6817668 CPUtime=5004.11 cores=0-31
/proc/31280/task/31307/stat : 31307 (plingeling) R 31278 31280 31124 0 -1 4202560 263122 1240 0 0 500189 222 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=31280/tid=31308] ppid=31278 vsize=6817668 CPUtime=4987.2 cores=0-31
/proc/31280/task/31308/stat : 31308 (plingeling) R 31278 31280 31124 0 -1 4202560 548801 1240 0 0 498346 374 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=31280/tid=31309] ppid=31278 vsize=6817668 CPUtime=4997.47 cores=0-31
/proc/31280/task/31309/stat : 31309 (plingeling) R 31278 31280 31124 0 -1 4202560 490138 1240 0 0 499504 243 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=31280/tid=31310] ppid=31278 vsize=6817668 CPUtime=4992.42 cores=0-31
/proc/31280/task/31310/stat : 31310 (plingeling) R 31278 31280 31124 0 -1 4202560 437661 1240 0 0 498809 433 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=31280/tid=31311] ppid=31278 vsize=6817668 CPUtime=5004.59 cores=0-31
/proc/31280/task/31311/stat : 31311 (plingeling) R 31278 31280 31124 0 -1 4202560 837352 1240 0 0 499750 709 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=31280/tid=31312] ppid=31278 vsize=6817668 CPUtime=5003.38 cores=0-31
/proc/31280/task/31312/stat : 31312 (plingeling) R 31278 31280 31124 0 -1 4202560 1138295 1240 0 0 499425 913 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31280/tid=31313] ppid=31278 vsize=6817668 CPUtime=4995.42 cores=0-31
/proc/31280/task/31313/stat : 31313 (plingeling) R 31278 31280 31124 0 -1 4202560 657046 1240 0 0 498934 608 0 0 25 0 33 0 680783849 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31280/tid=31314] ppid=31278 vsize=6817668 CPUtime=5001.06 cores=0-31
/proc/31280/task/31314/stat : 31314 (plingeling) R 31278 31280 31124 0 -1 4202560 421516 1240 0 0 499738 368 0 0 25 0 33 0 680783850 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31280/tid=31315] ppid=31278 vsize=6817668 CPUtime=5005.27 cores=0-31
/proc/31280/task/31315/stat : 31315 (plingeling) R 31278 31280 31124 0 -1 4202560 253288 1240 0 0 500273 254 0 0 25 0 33 0 680783855 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=31280/tid=31316] ppid=31278 vsize=6817668 CPUtime=4998.47 cores=0-31
/proc/31280/task/31316/stat : 31316 (plingeling) R 31278 31280 31124 0 -1 4202560 374127 1240 0 0 499489 358 0 0 25 0 33 0 680783855 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31280/tid=31317] ppid=31278 vsize=6817668 CPUtime=5000.28 cores=0-31
/proc/31280/task/31317/stat : 31317 (plingeling) R 31278 31280 31124 0 -1 4202560 438337 1240 0 0 499790 238 0 0 25 0 33 0 680783855 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=31280/tid=31318] ppid=31278 vsize=6817668 CPUtime=5003.79 cores=0-31
/proc/31280/task/31318/stat : 31318 (plingeling) R 31278 31280 31124 0 -1 4202560 510434 1240 0 0 499893 486 0 0 25 0 33 0 680783855 6981292032 1593644 268435456000 4194304 4417452 140733198923312 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 160001
Current children cumulated vsize (KiB) 6817668

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5018.32 s]
/proc/loadavg: 32.09 32.10 32.05 2/416 31465
/proc/meminfo: memFree=250221988/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=0 CPUtime=160001 cores=0-31
/proc/31280/stat : 31280 (plingeling) Z 31278 31280 31124 0 -1 4203548 19050664 1240 0 0 15984357 15791 0 0 18 0 2 0 680782808 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 23 0 0 0
/proc/31280/statm: 0 0 0 0 0 0 0
[pid=31280/tid=31287] ppid=31278 vsize=0 CPUtime=5003.76 cores=0-31
/proc/31280/task/31287/stat : 31287 (plingeling) R 31278 31280 31124 0 -1 4203588 732169 1240 0 0 500000 376 0 0 25 0 2 0 680783847 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 28 0 0 0
Current children cumulated CPU time (s) 160001
Current children cumulated vsize (KiB) 0

[startup+5018.5 s]
/proc/loadavg: 32.09 32.10 32.05 2/416 31465
/proc/meminfo: memFree=250221988/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=0 CPUtime=160002 cores=0-31
/proc/31280/stat : 31280 (plingeling) Z 31278 31280 31124 0 -1 4203548 19050664 1240 0 0 15984357 15809 0 0 18 0 2 0 680782808 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 23 0 0 0
/proc/31280/statm: 0 0 0 0 0 0 0
[pid=31280/tid=31287] ppid=31278 vsize=0 CPUtime=5003.94 cores=0-31
/proc/31280/task/31287/stat : 31287 (plingeling) R 31278 31280 31124 0 -1 4203588 732169 1240 0 0 500000 394 0 0 25 0 2 0 680783847 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 28 0 0 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 0

[startup+5018.6 s]
/proc/loadavg: 32.09 32.10 32.05 2/416 31465
/proc/meminfo: memFree=250221988/264257624 swapFree=67111528/67111528
[pid=31280] ppid=31278 vsize=0 CPUtime=160002 cores=0-31
/proc/31280/stat : 31280 (plingeling) Z 31278 31280 31124 0 -1 4203548 19050664 1240 0 0 15984357 15819 0 0 18 0 2 0 680782808 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 23 0 0 0
/proc/31280/statm: 0 0 0 0 0 0 0
[pid=31280/tid=31287] ppid=31278 vsize=0 CPUtime=5004.04 cores=0-31
/proc/31280/task/31287/stat : 31287 (plingeling) R 31278 31280 31124 0 -1 4203588 732169 1240 0 0 500000 404 0 0 25 0 2 0 680783847 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 28 0 0 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5018.69
CPU time (s): 160002
CPU user time (s): 159844
CPU system time (s): 158.284
CPU usage (%): 3188.12
Max. virtual memory (cumulated for all children) (KiB): 6904576

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159844
system time used= 158.284
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19051904
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9774
involuntary context switches= 398035

runsolver used 26.103 second user time and 115.549 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-18 06:29:24
IDJOB=3372630
IDBENCH=82493
IDSOLVER=1852
FILE ID=node200/3372630-1305692963
RUNJOBID= node200-1305692877-31138
PBS_JOBID= 13357384
Free space on /tmp= 62040 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372630-1305692963/watcher-3372630-1305692963 -o /tmp/evaluation-result-3372630-1305692963/solver-3372630-1305692963 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372630-1305692963.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 7886cd26d6e0801ea382a1ffd6224023
RANDOM SEED=2139696707

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255503944 kB
Buffers:        452276 kB
Cached:        7897892 kB
SwapCached:          0 kB
Active:        7410960 kB
Inactive:      1008148 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255503944 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10260 kB
Writeback:           0 kB
AnonPages:       69032 kB
Mapped:          14532 kB
Slab:           251892 kB
PageTables:       4432 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   193096 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62040 MiB
End job on node200 at 2011-05-18 07:53:04