Trace number 3472517

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 117275 5102.76

General information on the benchmark

NameSAT04/industrial/velev/vliw_unsat_2.0/
9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf
MD5SUM9a43349587a435e7109b46b3aceb156e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark84323.6
Satisfiable
(Un)Satisfiability was proved
Number of variables482093
Number of clauses9676386
Sum of the clauses size28195028
Maximum clause length226
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 29152157
Number of clauses of size 3120945
Number of clauses of size 410067
Number of clauses of size 528986
Number of clauses of size over 5364230

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...819266/instance-3472517-1307819266.cnf
3.79/3.83	c Solving...
117272.47/5100.03	
117272.47/5100.03	*** INTERRUPTED! ***
117272.47/5100.03	*** Shutting down threads...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3472517-1307819266/watcher-3472517-1307819266 -o /tmp/evaluation-result-3472517-1307819266/solver-3472517-1307819266 -C 160000 -W 5100 -M 256000 HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472517-1307819266.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 262144000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 262195200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 25.17 29.10 27.61 1/413 11764
/proc/meminfo: memFree=261761436/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=82084 CPUtime=0.02 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 4630 0 0 0 2 0 0 0 23 0 1 0 47314273 84054016 4560 270582939648 4194304 4964800 140734443975536 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 20521 4568 373 189 0 15395 0

[startup+0.101355 s]
/proc/loadavg: 25.17 29.10 27.61 1/413 11764
/proc/meminfo: memFree=261761436/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=82084 CPUtime=0.09 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 15473 0 0 0 7 2 0 0 23 0 1 0 47314273 84054016 15403 270582939648 4194304 4964800 140734443975536 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 20521 15413 373 189 0 15395 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 82084

[startup+0.201328 s]
/proc/loadavg: 25.17 29.10 27.61 1/413 11764
/proc/meminfo: memFree=261761436/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=119752 CPUtime=0.19 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 28551 0 0 0 15 4 0 0 23 0 1 0 47314273 122626048 24715 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 29938 24716 385 189 0 24812 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 119752

[startup+0.301322 s]
/proc/loadavg: 25.17 29.10 27.61 1/413 11764
/proc/meminfo: memFree=261761436/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=126036 CPUtime=0.29 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 30171 0 0 0 24 5 0 0 24 0 1 0 47314273 129060864 26252 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 31509 26252 385 189 0 26383 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 126036

[startup+0.700358 s]
/proc/loadavg: 25.17 29.10 27.61 1/413 11764
/proc/meminfo: memFree=261761436/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=149544 CPUtime=0.69 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 36178 0 0 0 61 8 0 0 25 0 1 0 47314273 153133056 32072 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 37386 32073 385 189 0 32260 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 149544

[startup+1.50036 s]
/proc/loadavg: 25.17 29.10 27.61 2/414 11765
/proc/meminfo: memFree=261612244/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=192420 CPUtime=1.49 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 47311 0 0 0 134 15 0 0 25 0 1 0 47314273 197038080 42787 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 48105 42787 385 189 0 42979 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 192420

[startup+3.10047 s]
/proc/loadavg: 25.17 29.10 27.61 2/414 11765
/proc/meminfo: memFree=261553964/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=276944 CPUtime=3.09 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 69019 0 0 0 281 28 0 0 25 0 1 0 47314273 283590656 63555 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/11764/statm: 69236 63555 385 189 0 64110 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 276944

[startup+6.30246 s]
/proc/loadavg: 25.63 29.13 27.63 17/445 11796
/proc/meminfo: memFree=260583924/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=3049024 CPUtime=49.35 cores=0-31
/proc/11764/stat : 11764 (claspmt) S 11762 11764 11734 0 -1 4202496 488612 0 0 0 593 4342 0 0 18 0 32 0 47314273 3122200576 359504 270582939648 4194304 4964800 140734443975536 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 29 0 0 0
/proc/11764/statm: 762256 359512 432 189 0 756605 0
[pid=11764/tid=11766] ppid=11762 vsize=3049024 CPUtime=1.46 cores=0-31
/proc/11764/task/11766/stat : 11766 (claspmt) D 11762 11764 11734 0 -1 4202560 13206 0 0 0 6 140 0 0 17 0 32 0 47314656 3122200576 359515 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=11764/tid=11767] ppid=11762 vsize=3049024 CPUtime=1.45 cores=0-31
/proc/11764/task/11767/stat : 11767 (claspmt) D 11762 11764 11734 0 -1 4202560 9438 0 0 0 4 141 0 0 18 0 32 0 47314656 3122200576 359526 270582939648 4194304 4964800 140734443975536 18446744073709551615 4679106 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11764/tid=11768] ppid=11762 vsize=3049024 CPUtime=1.5 cores=0-31
/proc/11764/task/11768/stat : 11768 (claspmt) D 11762 11764 11734 0 -1 4202560 9865 0 0 0 4 146 0 0 18 0 32 0 47314656 3122200576 359528 270582939648 4194304 4964800 140734443975536 18446744073709551615 4679094 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11764/tid=11769] ppid=11762 vsize=3049024 CPUtime=1.47 cores=0-31
/proc/11764/task/11769/stat : 11769 (claspmt) D 11762 11764 11734 0 -1 4202560 12648 0 0 0 8 139 0 0 17 0 32 0 47314656 3122200576 359530 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=11764/tid=11770] ppid=11762 vsize=3049024 CPUtime=1.5 cores=0-31
/proc/11764/task/11770/stat : 11770 (claspmt) D 11762 11764 11734 0 -1 4202560 12628 0 0 0 8 142 0 0 17 0 32 0 47314656 3122200576 359532 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=11764/tid=11771] ppid=11762 vsize=3049024 CPUtime=1.43 cores=0-31
/proc/11764/task/11771/stat : 11771 (claspmt) D 11762 11764 11734 0 -1 4202560 11911 0 0 0 6 137 0 0 18 0 32 0 47314656 3122200576 359537 270582939648 4194304 4964800 140734443975536 18446744073709551615 4378056 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11764/tid=11772] ppid=11762 vsize=3049024 CPUtime=1.4 cores=0-31
/proc/11764/task/11772/stat : 11772 (claspmt) R 11762 11764 11734 0 -1 4202560 14286 0 0 0 7 133 0 0 18 0 32 0 47314656 3122200576 359538 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=11764/tid=11773] ppid=11762 vsize=3049024 CPUtime=1.53 cores=0-31
/proc/11764/task/11773/stat : 11773 (claspmt) D 11762 11764 11734 0 -1 4202560 12985 0 0 0 7 146 0 0 17 0 32 0 47314656 3122200576 359539 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=11764/tid=11774] ppid=11762 vsize=3049024 CPUtime=1.46 cores=0-31
/proc/11764/task/11774/stat : 11774 (claspmt) R 11762 11764 11734 0 -1 4202560 13625 0 0 0 13 133 0 0 17 0 32 0 47314656 3122200576 359548 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11764/tid=11775] ppid=11762 vsize=3049024 CPUtime=1.49 cores=0-31
/proc/11764/task/11775/stat : 11775 (claspmt) D 11762 11764 11734 0 -1 4202560 13265 0 0 0 6 143 0 0 18 0 32 0 47314656 3122200576 359551 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=11764/tid=11776] ppid=11762 vsize=3049024 CPUtime=1.47 cores=0-31
/proc/11764/task/11776/stat : 11776 (claspmt) D 11762 11764 11734 0 -1 4202560 13185 0 0 0 5 142 0 0 18 0 32 0 47314656 3122200576 359552 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11764/tid=11777] ppid=11762 vsize=3049024 CPUtime=1.42 cores=0-31
/proc/11764/task/11777/stat : 11777 (claspmt) D 11762 11764 11734 0 -1 4202560 8628 0 0 0 4 138 0 0 18 0 32 0 47314656 3122200576 359553 270582939648 4194304 4964800 140734443975536 18446744073709551615 4679091 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=11764/tid=11778] ppid=11762 vsize=3049024 CPUtime=1.48 cores=0-31
/proc/11764/task/11778/stat : 11778 (claspmt) R 11762 11764 11734 0 -1 4202560 12494 0 0 0 6 142 0 0 18 0 32 0 47314656 3122200576 359565 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=11764/tid=11779] ppid=11762 vsize=3049024 CPUtime=1.44 cores=0-31
/proc/11764/task/11779/stat : 11779 (claspmt) D 11762 11764 11734 0 -1 4202560 13920 0 0 0 7 137 0 0 17 0 32 0 47314657 3122200576 359565 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=11764/tid=11780] ppid=11762 vsize=3049024 CPUtime=1.36 cores=0-31
/proc/11764/task/11780/stat : 11780 (claspmt) S 11762 11764 11734 0 -1 4202560 18813 0 0 0 18 118 0 0 17 0 32 0 47314657 3122200576 359572 270582939648 4194304 4964800 140734443975536 18446744073709551615 258651060958 0 0 4096 18946 18446604568752659936 0 0 -1 10 0 0 0
[pid=11764/tid=11781] ppid=11762 vsize=3049024 CPUtime=1.47 cores=0-31
/proc/11764/task/11781/stat : 11781 (claspmt) S 11762 11764 11734 0 -1 4202560 13498 0 0 0 8 139 0 0 17 0 32 0 47314657 3122200576 359576 270582939648 4194304 4964800 140734443975536 18446744073709551615 258651060958 0 0 4096 18946 18446604563801259488 0 0 -1 25 0 0 0
[pid=11764/tid=11782] ppid=11762 vsize=3049024 CPUtime=1.46 cores=0-31
/proc/11764/task/11782/stat : 11782 (claspmt) D 11762 11764 11734 0 -1 4202560 13247 0 0 0 6 140 0 0 17 0 32 0 47314657 3122200576 359577 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=11764/tid=11783] ppid=11762 vsize=3049024 CPUtime=1.45 cores=0-31
/proc/11764/task/11783/stat : 11783 (claspmt) D 11762 11764 11734 0 -1 4202560 14113 0 0 0 7 138 0 0 17 0 32 0 47314657 3122200576 359577 270582939648 4194304 4964800 140734443975536 18446744073709551615 4697753 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=11764/tid=11784] ppid=11762 vsize=3049024 CPUtime=1.46 cores=0-31
/proc/11764/task/11784/stat : 11784 (claspmt) D 11762 11764 11734 0 -1 4202560 8807 0 0 0 4 142 0 0 18 0 32 0 47314657 3122200576 359584 270582939648 4194304 4964800 140734443975536 18446744073709551615 4679091 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11764/tid=11785] ppid=11762 vsize=3049024 CPUtime=1.48 cores=0-31
/proc/11764/task/11785/stat : 11785 (claspmt) D 11762 11764 11734 0 -1 4202560 12399 0 0 0 6 142 0 0 18 0 32 0 47314657 3122200576 359587 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=11764/tid=11786] ppid=11762 vsize=3049024 CPUtime=1.53 cores=0-31
/proc/11764/task/11786/stat : 11786 (claspmt) D 11762 11764 11734 0 -1 4202560 12529 0 0 0 8 145 0 0 17 0 32 0 47314657 3122200576 359590 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11764/tid=11787] ppid=11762 vsize=3049024 CPUtime=1.48 cores=0-31
/proc/11764/task/11787/stat : 11787 (claspmt) D 11762 11764 11734 0 -1 4202560 12527 0 0 0 7 141 0 0 18 0 32 0 47314657 3122200576 359601 270582939648 4194304 4964800 140734443975536 18446744073709551615 4377943 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=11764/tid=11788] ppid=11762 vsize=3049024 CPUtime=1.46 cores=0-31
/proc/11764/task/11788/stat : 11788 (claspmt) D 11762 11764 11734 0 -1 4202560 14184 0 0 0 6 140 0 0 18 0 32 0 47314657 3122200576 359602 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=11764/tid=11789] ppid=11762 vsize=3049024 CPUtime=1.5 cores=0-31
/proc/11764/task/11789/stat : 11789 (claspmt) D 11762 11764 11734 0 -1 4202560 13237 0 0 0 7 143 0 0 17 0 32 0 47314657 3122200576 359603 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=11764/tid=11790] ppid=11762 vsize=3049024 CPUtime=1.47 cores=0-31
/proc/11764/task/11790/stat : 11790 (claspmt) D 11762 11764 11734 0 -1 4202560 13120 0 0 0 6 141 0 0 17 0 32 0 47314657 3122200576 359611 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=11764/tid=11791] ppid=11762 vsize=3049024 CPUtime=1.44 cores=0-31
/proc/11764/task/11791/stat : 11791 (claspmt) D 11762 11764 11734 0 -1 4202560 13139 0 0 0 5 139 0 0 18 0 32 0 47314657 3122200576 359611 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=11764/tid=11792] ppid=11762 vsize=3049024 CPUtime=1.43 cores=0-31
/proc/11764/task/11792/stat : 11792 (claspmt) D 11762 11764 11734 0 -1 4202560 14383 0 0 0 10 133 0 0 17 0 32 0 47314657 3122200576 359611 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=11764/tid=11793] ppid=11762 vsize=3049024 CPUtime=1.51 cores=0-31
/proc/11764/task/11793/stat : 11793 (claspmt) S 11762 11764 11734 0 -1 4202560 13243 0 0 0 10 141 0 0 17 0 32 0 47314657 3122200576 359614 270582939648 4194304 4964800 140734443975536 18446744073709551615 258651060958 0 0 4096 18946 18446744071566924264 0 0 -1 27 0 0 0
[pid=11764/tid=11794] ppid=11762 vsize=3049024 CPUtime=1.44 cores=0-31
/proc/11764/task/11794/stat : 11794 (claspmt) S 11762 11764 11734 0 -1 4202560 12757 0 0 0 9 135 0 0 17 0 32 0 47314657 3122200576 359617 270582939648 4194304 4964800 140734443975536 18446744073709551615 258651060958 0 0 4096 18946 18446744071566932504 0 0 -1 13 0 0 0
[pid=11764/tid=11795] ppid=11762 vsize=3049024 CPUtime=1.34 cores=0-31
/proc/11764/task/11795/stat : 11795 (claspmt) D 11762 11764 11734 0 -1 4202560 16137 0 0 0 13 121 0 0 17 0 32 0 47314657 3122200576 359622 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=11764/tid=11796] ppid=11762 vsize=3049024 CPUtime=1.43 cores=0-31
/proc/11764/task/11796/stat : 11796 (claspmt) D 11762 11764 11734 0 -1 4202560 14447 0 0 0 7 136 0 0 17 0 32 0 47314657 3122200576 359623 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 19 0 0 0
Current children cumulated CPU time (s) 49.35
Current children cumulated vsize (KiB) 3049024

[startup+12.7027 s]
/proc/loadavg: 26.06 29.16 27.65 5/445 11796
/proc/meminfo: memFree=258968800/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=3652728 CPUtime=73.21 cores=0-31
/proc/11764/stat : 11764 (claspmt) S 11762 11764 11734 0 -1 4202496 864307 0 0 0 1595 5726 0 0 18 0 32 0 47314273 3740393472 732564 270582939648 4194304 4964800 140734443975536 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 29 0 0 0
/proc/11764/statm: 913182 732568 430 189 0 907531 0
[pid=11764/tid=11766] ppid=11762 vsize=3652728 CPUtime=2.19 cores=0-31
/proc/11764/task/11766/stat : 11766 (claspmt) S 11762 11764 11734 0 -1 4202560 25048 0 0 0 36 183 0 0 16 0 32 0 47314656 3740393472 732569 270582939648 4194304 4964800 140734443975536 18446744073709551615 258651060958 0 0 4096 18946 18446744071566927584 0 0 -1 24 0 0 0
[pid=11764/tid=11767] ppid=11762 vsize=3652728 CPUtime=2.21 cores=0-31
/proc/11764/task/11767/stat : 11767 (claspmt) D 11762 11764 11734 0 -1 4202560 23148 0 0 0 34 187 0 0 16 0 32 0 47314656 3740393472 732570 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11764/tid=11768] ppid=11762 vsize=3652728 CPUtime=2.21 cores=0-31
/proc/11764/task/11768/stat : 11768 (claspmt) D 11762 11764 11734 0 -1 4202560 23356 0 0 0 34 187 0 0 16 0 32 0 47314656 3740393472 732577 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11764/tid=11769] ppid=11762 vsize=3652728 CPUtime=2.18 cores=0-31
/proc/11764/task/11769/stat : 11769 (claspmt) D 11762 11764 11734 0 -1 4202560 24562 0 0 0 34 184 0 0 16 0 32 0 47314656 3740393472 732578 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=11764/tid=11770] ppid=11762 vsize=3652728 CPUtime=2.29 cores=0-31
/proc/11764/task/11770/stat : 11770 (claspmt) R 11762 11764 11734 0 -1 4202560 24505 0 0 0 36 193 0 0 16 0 32 0 47314656 3740393472 732582 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 18446604575313731712 0 0 -1 29 0 0 0
[pid=11764/tid=11771] ppid=11762 vsize=3652728 CPUtime=2.17 cores=0-31
/proc/11764/task/11771/stat : 11771 (claspmt) D 11762 11764 11734 0 -1 4202560 24287 0 0 0 38 179 0 0 16 0 32 0 47314656 3740393472 732584 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11764/tid=11772] ppid=11762 vsize=3652728 CPUtime=2.13 cores=0-31
/proc/11764/task/11772/stat : 11772 (claspmt) D 11762 11764 11734 0 -1 4202560 26327 0 0 0 35 178 0 0 16 0 32 0 47314656 3740393472 732590 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=11764/tid=11773] ppid=11762 vsize=3652728 CPUtime=2.27 cores=0-31
/proc/11764/task/11773/stat : 11773 (claspmt) D 11762 11764 11734 0 -1 4202560 24829 0 0 0 34 193 0 0 15 0 32 0 47314656 3740393472 732590 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=11764/tid=11774] ppid=11762 vsize=3652728 CPUtime=2.23 cores=0-31
/proc/11764/task/11774/stat : 11774 (claspmt) D 11762 11764 11734 0 -1 4202560 25353 0 0 0 44 179 0 0 16 0 32 0 47314656 3740393472 732593 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11764/tid=11775] ppid=11762 vsize=3652728 CPUtime=2.2 cores=0-31
/proc/11764/task/11775/stat : 11775 (claspmt) D 11762 11764 11734 0 -1 4202560 25235 0 0 0 33 187 0 0 16 0 32 0 47314656 3740393472 732595 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=11764/tid=11776] ppid=11762 vsize=3652728 CPUtime=2.17 cores=0-31
/proc/11764/task/11776/stat : 11776 (claspmt) R 11762 11764 11734 0 -1 4202560 25113 0 0 0 30 187 0 0 16 0 32 0 47314656 3740393472 732598 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=11764/tid=11777] ppid=11762 vsize=3652728 CPUtime=2.18 cores=0-31
/proc/11764/task/11777/stat : 11777 (claspmt) D 11762 11764 11734 0 -1 4202560 22331 0 0 0 31 187 0 0 15 0 32 0 47314656 3740393472 732604 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650999207 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=11764/tid=11778] ppid=11762 vsize=3652728 CPUtime=2.2 cores=0-31
/proc/11764/task/11778/stat : 11778 (claspmt) D 11762 11764 11734 0 -1 4202560 24376 0 0 0 34 186 0 0 16 0 32 0 47314656 3740393472 732606 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11764/tid=11779] ppid=11762 vsize=3652728 CPUtime=2.17 cores=0-31
/proc/11764/task/11779/stat : 11779 (claspmt) D 11762 11764 11734 0 -1 4202560 25863 0 0 0 34 183 0 0 16 0 32 0 47314657 3740393472 732608 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=11764/tid=11780] ppid=11762 vsize=3652728 CPUtime=2.98 cores=0-31
/proc/11764/task/11780/stat : 11780 (claspmt) R 11762 11764 11734 0 -1 4202560 29398 0 0 0 143 155 0 0 17 0 32 0 47314657 3740393472 732609 270582939648 4194304 4964800 140734443975536 18446744073709551615 4388554 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=11764/tid=11781] ppid=11762 vsize=3652728 CPUtime=2.2 cores=0-31
/proc/11764/task/11781/stat : 11781 (claspmt) S 11762 11764 11734 0 -1 4202560 24973 0 0 0 35 185 0 0 16 0 32 0 47314657 3740393472 732611 270582939648 4194304 4964800 140734443975536 18446744073709551615 258662772457 0 0 4096 18946 18446604558942019040 0 0 -1 25 0 0 0
[pid=11764/tid=11782] ppid=11762 vsize=3652728 CPUtime=2.15 cores=0-31
/proc/11764/task/11782/stat : 11782 (claspmt) S 11762 11764 11734 0 -1 4202560 25028 0 0 0 34 181 0 0 16 0 32 0 47314657 3740393472 732619 270582939648 4194304 4964800 140734443975536 18446744073709551615 258662772457 0 0 4096 18946 18446604566620446176 0 0 -1 8 0 0 0
[pid=11764/tid=11783] ppid=11762 vsize=3652728 CPUtime=2.2 cores=0-31
/proc/11764/task/11783/stat : 11783 (claspmt) S 11762 11764 11734 0 -1 4202560 25964 0 0 0 36 184 0 0 15 0 32 0 47314657 3740393472 732623 270582939648 4194304 4964800 140734443975536 18446744073709551615 258651060958 0 0 4096 18946 18446744071566929864 0 0 -1 17 0 0 0
[pid=11764/tid=11784] ppid=11762 vsize=3652728 CPUtime=2.17 cores=0-31
/proc/11764/task/11784/stat : 11784 (claspmt) D 11762 11764 11734 0 -1 4202560 22859 0 0 0 32 185 0 0 16 0 32 0 47314657 3740393472 732626 270582939648 4194304 4964800 140734443975536 18446744073709551615 4685574 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11764/tid=11785] ppid=11762 vsize=3652728 CPUtime=2.18 cores=0-31
/proc/11764/task/11785/stat : 11785 (claspmt) D 11762 11764 11734 0 -1 4202560 24351 0 0 0 33 185 0 0 16 0 32 0 47314657 3740393472 732631 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650616986 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=11764/tid=11786] ppid=11762 vsize=3652728 CPUtime=2.27 cores=0-31

################
# More data... #
################

[pid=11764/tid=11773] ppid=11762 vsize=14521488 CPUtime=3471.34 cores=0-31
/proc/11764/task/11773/stat : 11773 (claspmt) R 11762 11764 11734 0 -1 4202560 34306 0 0 0 346904 230 0 0 25 0 32 0 47314656 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=11764/tid=11774] ppid=11762 vsize=14521488 CPUtime=3469.76 cores=0-31
/proc/11764/task/11774/stat : 11774 (claspmt) R 11762 11764 11734 0 -1 4202560 34224 0 0 0 346768 208 0 0 25 0 32 0 47314656 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11764/tid=11775] ppid=11762 vsize=14521488 CPUtime=3457.11 cores=0-31
/proc/11764/task/11775/stat : 11775 (claspmt) R 11762 11764 11734 0 -1 4202560 438283 0 0 0 344580 1131 0 0 25 0 32 0 47314656 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4313761 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=11764/tid=11776] ppid=11762 vsize=14521488 CPUtime=3471.92 cores=0-31
/proc/11764/task/11776/stat : 11776 (claspmt) R 11762 11764 11734 0 -1 4202560 76331 0 0 0 346844 348 0 0 25 0 32 0 47314656 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=11764/tid=11777] ppid=11762 vsize=14521488 CPUtime=3471.31 cores=0-31
/proc/11764/task/11777/stat : 11777 (claspmt) R 11762 11764 11734 0 -1 4202560 58034 0 0 0 346834 297 0 0 25 0 32 0 47314656 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=11764/tid=11778] ppid=11762 vsize=14521488 CPUtime=4791.09 cores=0-31
/proc/11764/task/11778/stat : 11778 (claspmt) R 11762 11764 11734 0 -1 4202560 31316 0 0 0 478905 204 0 0 25 0 32 0 47314656 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11764/tid=11779] ppid=11762 vsize=14521488 CPUtime=3471.78 cores=0-31
/proc/11764/task/11779/stat : 11779 (claspmt) R 11762 11764 11734 0 -1 4202560 108972 0 0 0 346706 472 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=11764/tid=11780] ppid=11762 vsize=14521488 CPUtime=3472.5 cores=0-31
/proc/11764/task/11780/stat : 11780 (claspmt) R 11762 11764 11734 0 -1 4202560 72661 0 0 0 346921 329 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4678032 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11764/tid=11781] ppid=11762 vsize=14521488 CPUtime=3471.16 cores=0-31
/proc/11764/task/11781/stat : 11781 (claspmt) R 11762 11764 11734 0 -1 4202560 35265 0 0 0 346894 222 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11764/tid=11782] ppid=11762 vsize=14521488 CPUtime=3469.74 cores=0-31
/proc/11764/task/11782/stat : 11782 (claspmt) R 11762 11764 11734 0 -1 4202560 33703 0 0 0 346738 236 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4652110 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=11764/tid=11783] ppid=11762 vsize=14521488 CPUtime=3471.67 cores=0-31
/proc/11764/task/11783/stat : 11783 (claspmt) R 11762 11764 11734 0 -1 4202560 409973 0 0 0 345962 1205 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=11764/tid=11784] ppid=11762 vsize=14521488 CPUtime=3472.02 cores=0-31
/proc/11764/task/11784/stat : 11784 (claspmt) R 11762 11764 11734 0 -1 4202560 97070 0 0 0 346785 417 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4653507 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=11764/tid=11785] ppid=11762 vsize=14521488 CPUtime=3470.54 cores=0-31
/proc/11764/task/11785/stat : 11785 (claspmt) R 11762 11764 11734 0 -1 4202560 89651 0 0 0 346686 368 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=11764/tid=11786] ppid=11762 vsize=14521488 CPUtime=4869.92 cores=0-31
/proc/11764/task/11786/stat : 11786 (claspmt) R 11762 11764 11734 0 -1 4202560 32880 0 0 0 486778 214 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4669131 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11764/tid=11787] ppid=11762 vsize=14521488 CPUtime=3471.89 cores=0-31
/proc/11764/task/11787/stat : 11787 (claspmt) R 11762 11764 11734 0 -1 4202560 91141 0 0 0 346796 393 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668715 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=11764/tid=11788] ppid=11762 vsize=14521488 CPUtime=3472.32 cores=0-31
/proc/11764/task/11788/stat : 11788 (claspmt) R 11762 11764 11734 0 -1 4202560 87758 0 0 0 346805 427 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=11764/tid=11789] ppid=11762 vsize=14521488 CPUtime=3471.2 cores=0-31
/proc/11764/task/11789/stat : 11789 (claspmt) R 11762 11764 11734 0 -1 4202560 34582 0 0 0 346901 219 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4652110 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=11764/tid=11790] ppid=11762 vsize=14521488 CPUtime=3448.96 cores=0-31
/proc/11764/task/11790/stat : 11790 (claspmt) R 11762 11764 11734 0 -1 4202560 32995 0 0 0 344684 212 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 31 0 0 0
[pid=11764/tid=11791] ppid=11762 vsize=14521488 CPUtime=3471.5 cores=0-31
/proc/11764/task/11791/stat : 11791 (claspmt) R 11762 11764 11734 0 -1 4202560 352372 0 0 0 346053 1097 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=11764/tid=11792] ppid=11762 vsize=14521488 CPUtime=3461.28 cores=0-31
/proc/11764/task/11792/stat : 11792 (claspmt) R 11762 11764 11734 0 -1 4202560 84405 0 0 0 345784 344 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4684009 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=11764/tid=11793] ppid=11762 vsize=14521488 CPUtime=3437.76 cores=0-31
/proc/11764/task/11793/stat : 11793 (claspmt) R 11762 11764 11734 0 -1 4202560 65038 0 0 0 343483 293 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668984 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=11764/tid=11794] ppid=11762 vsize=14521488 CPUtime=5058.1 cores=0-31
/proc/11764/task/11794/stat : 11794 (claspmt) R 11762 11764 11734 0 -1 4202560 32497 0 0 0 505615 195 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11764/tid=11795] ppid=11762 vsize=14521488 CPUtime=3471.77 cores=0-31
/proc/11764/task/11795/stat : 11795 (claspmt) R 11762 11764 11734 0 -1 4202560 102783 0 0 0 346759 418 0 0 25 0 32 0 47314657 14870003712 3258884 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=11764/tid=11796] ppid=11762 vsize=14521488 CPUtime=3471.11 cores=0-31
/proc/11764/task/11796/stat : 11796 (claspmt) R 11762 11764 11734 0 -1 4202560 69072 0 0 0 346758 353 0 0 25 0 32 0 47314657 14870003712 3258885 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 8 0 0 0
Current children cumulated CPU time (s) 116706
Current children cumulated vsize (KiB) 14521488



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 32.18 32.19 31.54 33/445 11944
/proc/meminfo: memFree=248645328/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=14587024 CPUtime=117272 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 3411788 0 0 0 11714105 13142 0 0 25 0 32 0 47314273 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 9 0 0 0
/proc/11764/statm: 3646756 3275002 457 189 0 3641105 0
[pid=11764/tid=11766] ppid=11762 vsize=14587024 CPUtime=3488.93 cores=0-31
/proc/11764/task/11766/stat : 11766 (claspmt) R 11762 11764 11734 0 -1 4202560 33936 0 0 0 348680 213 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=11764/tid=11767] ppid=11762 vsize=14587024 CPUtime=3485.52 cores=0-31
/proc/11764/task/11767/stat : 11767 (claspmt) R 11762 11764 11734 0 -1 4202560 371051 0 0 0 347413 1139 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4379614 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=11764/tid=11768] ppid=11762 vsize=14587024 CPUtime=3489.71 cores=0-31
/proc/11764/task/11768/stat : 11768 (claspmt) R 11762 11764 11734 0 -1 4202560 107420 0 0 0 348511 460 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11764/tid=11769] ppid=11762 vsize=14587024 CPUtime=3488.91 cores=0-31
/proc/11764/task/11769/stat : 11769 (claspmt) R 11762 11764 11734 0 -1 4202560 87079 0 0 0 348506 385 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4370485 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=11764/tid=11770] ppid=11762 vsize=14587024 CPUtime=4887.64 cores=0-31
/proc/11764/task/11770/stat : 11770 (claspmt) R 11762 11764 11734 0 -1 4202560 31843 0 0 0 488548 216 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=11764/tid=11771] ppid=11762 vsize=14587024 CPUtime=3489.64 cores=0-31
/proc/11764/task/11771/stat : 11771 (claspmt) R 11762 11764 11734 0 -1 4202560 89151 0 0 0 348560 404 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4653482 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=11764/tid=11772] ppid=11762 vsize=14587024 CPUtime=3488.85 cores=0-31
/proc/11764/task/11772/stat : 11772 (claspmt) R 11762 11764 11734 0 -1 4202560 76445 0 0 0 348521 364 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=11764/tid=11773] ppid=11762 vsize=14587024 CPUtime=3489.05 cores=0-31
/proc/11764/task/11773/stat : 11773 (claspmt) R 11762 11764 11734 0 -1 4202560 34868 0 0 0 348672 233 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4370288 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=11764/tid=11774] ppid=11762 vsize=14587024 CPUtime=3487.48 cores=0-31
/proc/11764/task/11774/stat : 11774 (claspmt) R 11762 11764 11734 0 -1 4202560 34224 0 0 0 348540 208 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4372165 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11764/tid=11775] ppid=11762 vsize=14587024 CPUtime=3474.83 cores=0-31
/proc/11764/task/11775/stat : 11775 (claspmt) R 11762 11764 11734 0 -1 4202560 438285 0 0 0 346352 1131 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4313751 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=11764/tid=11776] ppid=11762 vsize=14587024 CPUtime=3489.63 cores=0-31
/proc/11764/task/11776/stat : 11776 (claspmt) R 11762 11764 11734 0 -1 4202560 76345 0 0 0 348615 348 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=11764/tid=11777] ppid=11762 vsize=14587024 CPUtime=3489.03 cores=0-31
/proc/11764/task/11777/stat : 11777 (claspmt) R 11762 11764 11734 0 -1 4202560 58034 0 0 0 348606 297 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=11764/tid=11778] ppid=11762 vsize=14587024 CPUtime=4808.81 cores=0-31
/proc/11764/task/11778/stat : 11778 (claspmt) R 11762 11764 11734 0 -1 4202560 31316 0 0 0 480677 204 0 0 25 0 32 0 47314656 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11764/tid=11779] ppid=11762 vsize=14587024 CPUtime=3489.5 cores=0-31
/proc/11764/task/11779/stat : 11779 (claspmt) R 11762 11764 11734 0 -1 4202560 108990 0 0 0 348478 472 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4321025 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=11764/tid=11780] ppid=11762 vsize=14587024 CPUtime=3490.22 cores=0-31
/proc/11764/task/11780/stat : 11780 (claspmt) R 11762 11764 11734 0 -1 4202560 72661 0 0 0 348693 329 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11764/tid=11781] ppid=11762 vsize=14587024 CPUtime=3488.87 cores=0-31
/proc/11764/task/11781/stat : 11781 (claspmt) R 11762 11764 11734 0 -1 4202560 35265 0 0 0 348665 222 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4684732 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11764/tid=11782] ppid=11762 vsize=14587024 CPUtime=3487.46 cores=0-31
/proc/11764/task/11782/stat : 11782 (claspmt) R 11762 11764 11734 0 -1 4202560 33993 0 0 0 348509 237 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=11764/tid=11783] ppid=11762 vsize=14587024 CPUtime=3489.39 cores=0-31
/proc/11764/task/11783/stat : 11783 (claspmt) R 11762 11764 11734 0 -1 4202560 419270 0 0 0 347704 1235 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=11764/tid=11784] ppid=11762 vsize=14587024 CPUtime=3489.73 cores=0-31
/proc/11764/task/11784/stat : 11784 (claspmt) R 11762 11764 11734 0 -1 4202560 98141 0 0 0 348552 421 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=11764/tid=11785] ppid=11762 vsize=14587024 CPUtime=3488.25 cores=0-31
/proc/11764/task/11785/stat : 11785 (claspmt) R 11762 11764 11734 0 -1 4202560 89651 0 0 0 348457 368 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=11764/tid=11786] ppid=11762 vsize=14587024 CPUtime=4887.64 cores=0-31
/proc/11764/task/11786/stat : 11786 (claspmt) R 11762 11764 11734 0 -1 4202560 32880 0 0 0 488550 214 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4678045 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11764/tid=11787] ppid=11762 vsize=14587024 CPUtime=3489.6 cores=0-31
/proc/11764/task/11787/stat : 11787 (claspmt) R 11762 11764 11734 0 -1 4202560 93379 0 0 0 348561 399 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=11764/tid=11788] ppid=11762 vsize=14587024 CPUtime=3490.04 cores=0-31
/proc/11764/task/11788/stat : 11788 (claspmt) R 11762 11764 11734 0 -1 4202560 87758 0 0 0 348577 427 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=11764/tid=11789] ppid=11762 vsize=14587024 CPUtime=3488.92 cores=0-31
/proc/11764/task/11789/stat : 11789 (claspmt) R 11762 11764 11734 0 -1 4202560 34582 0 0 0 348673 219 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=11764/tid=11790] ppid=11762 vsize=14587024 CPUtime=3466.15 cores=0-31
/proc/11764/task/11790/stat : 11790 (claspmt) R 11762 11764 11734 0 -1 4202560 32995 0 0 0 346403 212 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4370259 0 0 4096 18946 0 0 0 -1 31 0 0 0
[pid=11764/tid=11791] ppid=11762 vsize=14587024 CPUtime=3489.22 cores=0-31
/proc/11764/task/11791/stat : 11791 (claspmt) R 11762 11764 11734 0 -1 4202560 353464 0 0 0 347822 1100 0 0 25 0 32 0 47314657 14937112576 3275002 270582939648 4194304 4964800 140734443975536 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=11764/tid=11792] ppid=11762 vsize=14587024 CPUtime=3478.99 cores=0-31
/proc/11764/task/11792/stat : 11792 (claspmt) R 11762 11764 11734 0 -1 4202560 84419 0 0 0 347555 344 0 0 25 0 32 0 47314657 14937112576 3275003 270582939648 4194304 4964800 140734443975536 18446744073709551615 4669131 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=11764/tid=11793] ppid=11762 vsize=14587024 CPUtime=3455.48 cores=0-31
/proc/11764/task/11793/stat : 11793 (claspmt) R 11762 11764 11734 0 -1 4202560 65040 0 0 0 345255 293 0 0 25 0 32 0 47314657 14937112576 3275005 270582939648 4194304 4964800 140734443975536 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=11764/tid=11794] ppid=11762 vsize=14587024 CPUtime=5075.82 cores=0-31
/proc/11764/task/11794/stat : 11794 (claspmt) R 11762 11764 11734 0 -1 4202560 32497 0 0 0 507387 195 0 0 25 0 32 0 47314657 14937112576 3275005 270582939648 4194304 4964800 140734443975536 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11764/tid=11795] ppid=11762 vsize=14587024 CPUtime=3489.49 cores=0-31
/proc/11764/task/11795/stat : 11795 (claspmt) R 11762 11764 11734 0 -1 4202560 103457 0 0 0 348529 420 0 0 25 0 32 0 47314657 14937112576 3275005 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=11764/tid=11796] ppid=11762 vsize=14587024 CPUtime=3488.8 cores=0-31
/proc/11764/task/11796/stat : 11796 (claspmt) R 11762 11764 11734 0 -1 4202560 69883 0 0 0 348524 356 0 0 25 0 32 0 47314657 14937112576 3275005 270582939648 4194304 4964800 140734443975536 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 8 0 0 0
Current children cumulated CPU time (s) 117272
Current children cumulated vsize (KiB) 14587024

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -11764

Solver just ended. Dumping a history of the last processes samples

[startup+5100.7 s]
/proc/loadavg: 32.18 32.19 31.54 2/415 11945
/proc/meminfo: memFree=248645580/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=14496824 CPUtime=117273 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 3411811 0 0 0 11714203 13142 0 0 25 0 1 0 47314273 14844747776 3274980 270582939648 4194304 4964800 140734443975536 18446744073709551615 4627081 0 0 4096 18946 0 0 0 17 9 0 0 0
/proc/11764/statm: 3624206 3274980 468 189 0 3618555 0
Current children cumulated CPU time (s) 117273
Current children cumulated vsize (KiB) 14496824

[startup+5101.5 s]
/proc/loadavg: 32.18 32.19 31.54 2/415 11945
/proc/meminfo: memFree=248645580/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=14413488 CPUtime=117274 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4202496 3411811 0 0 0 11714279 13143 0 0 25 0 1 0 47314273 14759411712 3253861 270582939648 4194304 4964800 140734443975536 18446744073709551615 258650611056 0 0 4096 18946 0 0 0 17 9 0 0 0
/proc/11764/statm: 3603372 3253861 468 189 0 3597721 0
Current children cumulated CPU time (s) 117274
Current children cumulated vsize (KiB) 14413488

[startup+5102.3 s]
/proc/loadavg: 32.18 32.19 31.54 2/415 11945
/proc/meminfo: memFree=248753584/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=0 CPUtime=117275 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4203524 3411811 0 0 0 11714331 13171 0 0 25 0 1 0 47314273 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 9 0 0 0
/proc/11764/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 117275
Current children cumulated vsize (KiB) 0

[startup+5102.7 s]
/proc/loadavg: 32.18 32.19 31.54 2/415 11945
/proc/meminfo: memFree=248753584/264257624 swapFree=67111528/67111528
[pid=11764] ppid=11762 vsize=0 CPUtime=117275 cores=0-31
/proc/11764/stat : 11764 (claspmt) R 11762 11764 11734 0 -1 4203524 3411811 0 0 0 11714331 13211 0 0 25 0 1 0 47314273 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 9 0 0 0
/proc/11764/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 117275
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 5102.76
CPU time (s): 117275
CPU user time (s): 117143
CPU system time (s): 132.169
CPU usage (%): 2298.28
Max. virtual memory (cumulated for all children) (KiB): 14587024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 117143
system time used= 132.169
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3411811
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1129215
involuntary context switches= 275486

runsolver used 26.399 second user time and 117.027 second system time

The end

Launcher Data 

Begin job on node200 at 2011-06-11 21:07:54
IDJOB=3472517
IDBENCH=85008
IDSOLVER=1961
FILE ID=node200/3472517-1307819266
RUNJOBID= node200-1307819266-11748
PBS_JOBID= 13551020
Free space on /tmp= 61536 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT04/industrial/velev/vliw_unsat_2.0/9dlx_vliw_at_b_iq9.used-as.sat04-719.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3472517-1307819266/watcher-3472517-1307819266 -o /tmp/evaluation-result-3472517-1307819266/solver-3472517-1307819266 -C 160000 -W 5100 -M 256000  HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472517-1307819266.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 256000 MiB
NBCORE= 32

MD5SUM BENCH= 9a43349587a435e7109b46b3aceb156e
RANDOM SEED=651659468

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      261759072 kB
Buffers:        295448 kB
Cached:        1871156 kB
SwapCached:          0 kB
Active:         536204 kB
Inactive:      1693656 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      261759072 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          214548 kB
Writeback:           0 kB
AnonPages:       63320 kB
Mapped:          14368 kB
Slab:           190548 kB
PageTables:       4428 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   158400 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61528 MiB
End job on node200 at 2011-06-11 22:32:57