Trace number 3472450

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 160004 5009.72

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom20.cnf
MD5SUM9851f8e63efc4505343bf50c1cf30646
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables44362
Number of clauses148436
Sum of the clauses size378642
Maximum clause length1419
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 276003
Number of clauses of size 371663
Number of clauses of size 4209
Number of clauses of size 518
Number of clauses of size over 5542

Solver Data 

0.00/0.01	c clasp version 2.0.0-RC2
0.00/0.01	c Reading from ...668236/instance-3472450-1307668236.cnf
0.78/0.85	c Solving...
160001.47/5007.42	
160001.47/5007.42	*** INTERRUPTED! ***
160001.47/5007.42	*** Shutting down threads...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3472450-1307668236/watcher-3472450-1307668236 -o /tmp/evaluation-result-3472450-1307668236/solver-3472450-1307668236 -C 160000 -W 5100 -M 256000 HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472450-1307668236.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 262144000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 262195200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.62 31.59 31.91 1/412 397
/proc/meminfo: memFree=262195012/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=26556 CPUtime=0 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 537 0 0 0 0 0 0 0 22 0 1 0 32210493 27193344 467 270582939648 4194304 4964800 140734948202656 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/397/statm: 6639 471 373 189 0 1513 0

[startup+0.096591 s]
/proc/loadavg: 29.62 31.59 31.91 1/412 397
/proc/meminfo: memFree=262195012/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=33448 CPUtime=0.09 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 4231 0 0 0 8 1 0 0 22 0 1 0 32210493 34250752 3523 270582939648 4194304 4964800 140734948202656 18446744073709551615 258650616632 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/397/statm: 8362 3524 386 189 0 3236 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 33448

[startup+0.100616 s]
/proc/loadavg: 29.62 31.59 31.91 1/412 397
/proc/meminfo: memFree=262195012/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=33712 CPUtime=0.09 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 4295 0 0 0 8 1 0 0 22 0 1 0 32210493 34521088 3587 270582939648 4194304 4964800 140734948202656 18446744073709551615 258650955760 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/397/statm: 8428 3589 386 189 0 3302 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 33712

[startup+0.300603 s]
/proc/loadavg: 29.62 31.59 31.91 1/412 397
/proc/meminfo: memFree=262195012/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=44340 CPUtime=0.28 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 7616 0 0 0 27 1 0 0 23 0 1 0 32210493 45404160 6023 270582939648 4194304 4964800 140734948202656 18446744073709551615 4615858 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/397/statm: 11085 6023 401 189 0 5959 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 44340

[startup+0.700618 s]
/proc/loadavg: 29.62 31.59 31.91 1/412 397
/proc/meminfo: memFree=262195012/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=49092 CPUtime=0.68 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 8830 0 0 0 66 2 0 0 25 0 1 0 32210493 50270208 7237 270582939648 4194304 4964800 140734948202656 18446744073709551615 4622881 0 0 4096 18946 0 0 0 17 16 0 0 0
/proc/397/statm: 12273 7237 401 189 0 7147 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 49092

[startup+1.50268 s]
/proc/loadavg: 29.62 31.59 31.91 32/444 429
/proc/meminfo: memFree=262098540/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=2094212 CPUtime=6.62 cores=0-31
/proc/397/stat : 397 (claspmt) S 395 397 367 0 -1 4202496 66259 0 0 0 221 441 0 0 18 0 32 0 32210493 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/397/statm: 523553 53232 440 189 0 517902 0
[pid=397/tid=399] ppid=395 vsize=2094212 CPUtime=0.16 cores=0-31
/proc/397/task/399/stat : 399 (claspmt) S 395 397 367 0 -1 4202560 1464 0 0 0 1 15 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604497844952544 0 0 -1 1 0 0 0
[pid=397/tid=400] ppid=395 vsize=2094212 CPUtime=0.16 cores=0-31
/proc/397/task/400/stat : 400 (claspmt) S 395 397 367 0 -1 4202560 1906 0 0 0 1 15 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604704194911712 0 0 -1 2 0 0 0
[pid=397/tid=401] ppid=395 vsize=2094212 CPUtime=0.15 cores=0-31
/proc/397/task/401/stat : 401 (claspmt) S 395 397 367 0 -1 4202560 2081 0 0 0 2 13 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712224513504 0 0 -1 28 0 0 0
[pid=397/tid=402] ppid=395 vsize=2094212 CPUtime=0.15 cores=0-31
/proc/397/task/402/stat : 402 (claspmt) S 395 397 367 0 -1 4202560 1525 0 0 0 1 14 0 0 17 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604708678778336 0 0 -1 16 0 0 0
[pid=397/tid=403] ppid=395 vsize=2094212 CPUtime=0.35 cores=0-31
/proc/397/task/403/stat : 403 (claspmt) R 395 397 367 0 -1 4202560 1908 0 0 0 23 12 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668766 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=397/tid=404] ppid=395 vsize=2094212 CPUtime=0.15 cores=0-31
/proc/397/task/404/stat : 404 (claspmt) S 395 397 367 0 -1 4202560 2108 0 0 0 1 14 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604709323029984 0 0 -1 24 0 0 0
[pid=397/tid=405] ppid=395 vsize=2094212 CPUtime=0.12 cores=0-31
/proc/397/task/405/stat : 405 (claspmt) S 395 397 367 0 -1 4202560 1930 0 0 0 2 10 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604709394415072 0 0 -1 19 0 0 0
[pid=397/tid=406] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/406/stat : 406 (claspmt) S 395 397 367 0 -1 4202560 1657 0 0 0 2 15 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604709465554400 0 0 -1 14 0 0 0
[pid=397/tid=407] ppid=395 vsize=2094212 CPUtime=0.13 cores=0-31
/proc/397/task/407/stat : 407 (claspmt) S 395 397 367 0 -1 4202560 1652 0 0 0 1 12 0 0 17 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712200994272 0 0 -1 18 0 0 0
[pid=397/tid=408] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/408/stat : 408 (claspmt) S 395 397 367 0 -1 4202560 2039 0 0 0 2 15 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712380685792 0 0 -1 8 0 0 0
[pid=397/tid=409] ppid=395 vsize=2094212 CPUtime=0.19 cores=0-31
/proc/397/task/409/stat : 409 (claspmt) S 395 397 367 0 -1 4202560 2015 0 0 0 3 16 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712285003232 0 0 -1 5 0 0 0
[pid=397/tid=410] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/410/stat : 410 (claspmt) S 395 397 367 0 -1 4202560 1626 0 0 0 2 15 0 0 18 0 32 0 32210578 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604711375519200 0 0 -1 6 0 0 0
[pid=397/tid=411] ppid=395 vsize=2094212 CPUtime=0.35 cores=0-31
/proc/397/task/411/stat : 411 (claspmt) R 395 397 367 0 -1 4202560 1809 0 0 0 21 14 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=397/tid=412] ppid=395 vsize=2094212 CPUtime=0.16 cores=0-31
/proc/397/task/412/stat : 412 (claspmt) S 395 397 367 0 -1 4202560 1885 0 0 0 1 15 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604703725542880 0 0 -1 0 0 0 0
[pid=397/tid=413] ppid=395 vsize=2094212 CPUtime=0.16 cores=0-31
/proc/397/task/413/stat : 413 (claspmt) S 395 397 367 0 -1 4202560 1993 0 0 0 2 14 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712284986848 0 0 -1 30 0 0 0
[pid=397/tid=414] ppid=395 vsize=2094212 CPUtime=0.14 cores=0-31
/proc/397/task/414/stat : 414 (claspmt) S 395 397 367 0 -1 4202560 1671 0 0 0 1 13 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604711819853280 0 0 -1 22 0 0 0
[pid=397/tid=415] ppid=395 vsize=2094212 CPUtime=0.15 cores=0-31
/proc/397/task/415/stat : 415 (claspmt) S 395 397 367 0 -1 4202560 1672 0 0 0 1 14 0 0 17 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604710933216736 0 0 -1 25 0 0 0
[pid=397/tid=416] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/416/stat : 416 (claspmt) S 395 397 367 0 -1 4202560 1983 0 0 0 2 15 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604697391767008 0 0 -1 21 0 0 0
[pid=397/tid=417] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/417/stat : 417 (claspmt) S 395 397 367 0 -1 4202560 2052 0 0 0 1 16 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604705305181664 0 0 -1 13 0 0 0
[pid=397/tid=418] ppid=395 vsize=2094212 CPUtime=0.12 cores=0-31
/proc/397/task/418/stat : 418 (claspmt) S 395 397 367 0 -1 4202560 1591 0 0 0 1 11 0 0 17 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604493234757088 0 0 -1 16 0 0 0
[pid=397/tid=419] ppid=395 vsize=2094212 CPUtime=0.33 cores=0-31
/proc/397/task/419/stat : 419 (claspmt) R 395 397 367 0 -1 4202560 1779 0 0 0 19 14 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 4399150 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=397/tid=420] ppid=395 vsize=2094212 CPUtime=0.14 cores=0-31
/proc/397/task/420/stat : 420 (claspmt) S 395 397 367 0 -1 4202560 1892 0 0 0 2 12 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604501141552608 0 0 -1 11 0 0 0
[pid=397/tid=421] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/421/stat : 421 (claspmt) S 395 397 367 0 -1 4202560 1948 0 0 0 2 15 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604707916807648 0 0 -1 3 0 0 0
[pid=397/tid=422] ppid=395 vsize=2094212 CPUtime=0.16 cores=0-31
/proc/397/task/422/stat : 422 (claspmt) S 395 397 367 0 -1 4202560 1625 0 0 0 2 14 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604707592912352 0 0 -1 7 0 0 0
[pid=397/tid=423] ppid=395 vsize=2094212 CPUtime=0.14 cores=0-31
/proc/397/task/423/stat : 423 (claspmt) S 395 397 367 0 -1 4202560 1629 0 0 0 1 13 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712459337184 0 0 -1 29 0 0 0
[pid=397/tid=424] ppid=395 vsize=2094212 CPUtime=0.14 cores=0-31
/proc/397/task/424/stat : 424 (claspmt) S 395 397 367 0 -1 4202560 1973 0 0 0 2 12 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604488150195680 0 0 -1 26 0 0 0
[pid=397/tid=425] ppid=395 vsize=2094212 CPUtime=0.16 cores=0-31
/proc/397/task/425/stat : 425 (claspmt) S 395 397 367 0 -1 4202560 2085 0 0 0 2 14 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604712302525920 0 0 -1 27 0 0 0
[pid=397/tid=426] ppid=395 vsize=2094212 CPUtime=0.13 cores=0-31
/proc/397/task/426/stat : 426 (claspmt) S 395 397 367 0 -1 4202560 1545 0 0 0 1 12 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604562990243296 0 0 -1 20 0 0 0
[pid=397/tid=427] ppid=395 vsize=2094212 CPUtime=0.25 cores=0-31
/proc/397/task/427/stat : 427 (claspmt) R 395 397 367 0 -1 4202560 1921 0 0 0 15 10 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=397/tid=428] ppid=395 vsize=2094212 CPUtime=0.17 cores=0-31
/proc/397/task/428/stat : 428 (claspmt) S 395 397 367 0 -1 4202560 2047 0 0 0 3 14 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604499506437600 0 0 -1 17 0 0 0
[pid=397/tid=429] ppid=395 vsize=2094212 CPUtime=0.15 cores=0-31
/proc/397/task/429/stat : 429 (claspmt) S 395 397 367 0 -1 4202560 1931 0 0 0 3 12 0 0 18 0 32 0 32210579 2144473088 53232 270582939648 4194304 4964800 140734948202656 18446744073709551615 258662772457 0 0 4096 18946 18446604709793463776 0 0 -1 23 0 0 0
Current children cumulated CPU time (s) 6.62
Current children cumulated vsize (KiB) 2094212

[startup+3.10159 s]
/proc/loadavg: 27.72 31.17 31.77 33/444 429
/proc/meminfo: memFree=261972060/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=2095984 CPUtime=55.26 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 78678 0 0 0 5046 480 0 0 17 0 32 0 32210493 2146287616 65651 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670259 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/397/statm: 523996 65651 461 189 0 518345 0
[pid=397/tid=399] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/399/stat : 399 (claspmt) R 395 397 367 0 -1 4202560 1798 0 0 0 152 16 0 0 17 0 32 0 32210578 2146287616 65651 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=397/tid=400] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/400/stat : 400 (claspmt) R 395 397 367 0 -1 4202560 2525 0 0 0 150 18 0 0 17 0 32 0 32210578 2146287616 65652 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670674 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=397/tid=401] ppid=395 vsize=2095984 CPUtime=1.66 cores=0-31
/proc/397/task/401/stat : 401 (claspmt) R 395 397 367 0 -1 4202560 2554 0 0 0 152 14 0 0 17 0 32 0 32210578 2146287616 65653 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=397/tid=402] ppid=395 vsize=2095984 CPUtime=1.67 cores=0-31
/proc/397/task/402/stat : 402 (claspmt) R 395 397 367 0 -1 4202560 1901 0 0 0 152 15 0 0 17 0 32 0 32210578 2146287616 65654 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668920 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=397/tid=403] ppid=395 vsize=2095984 CPUtime=1.9 cores=0-31
/proc/397/task/403/stat : 403 (claspmt) R 395 397 367 0 -1 4202560 1937 0 0 0 178 12 0 0 20 0 32 0 32210578 2146287616 65654 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=397/tid=404] ppid=395 vsize=2095984 CPUtime=1.66 cores=0-31
/proc/397/task/404/stat : 404 (claspmt) R 395 397 367 0 -1 4202560 2443 0 0 0 151 15 0 0 17 0 32 0 32210578 2146287616 65655 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670286 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=397/tid=405] ppid=395 vsize=2095984 CPUtime=1.65 cores=0-31
/proc/397/task/405/stat : 405 (claspmt) R 395 397 367 0 -1 4202560 2475 0 0 0 152 13 0 0 17 0 32 0 32210578 2146287616 65655 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=397/tid=406] ppid=395 vsize=2095984 CPUtime=1.69 cores=0-31
/proc/397/task/406/stat : 406 (claspmt) R 395 397 367 0 -1 4202560 2064 0 0 0 153 16 0 0 17 0 32 0 32210578 2146287616 65655 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670097 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=397/tid=407] ppid=395 vsize=2095984 CPUtime=1.65 cores=0-31
/proc/397/task/407/stat : 407 (claspmt) R 395 397 367 0 -1 4202560 1987 0 0 0 152 13 0 0 17 0 32 0 32210578 2146287616 65655 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=397/tid=408] ppid=395 vsize=2095984 CPUtime=1.67 cores=0-31
/proc/397/task/408/stat : 408 (claspmt) R 395 397 367 0 -1 4202560 2606 0 0 0 150 17 0 0 17 0 32 0 32210578 2146287616 65655 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=397/tid=409] ppid=395 vsize=2095984 CPUtime=1.71 cores=0-31
/proc/397/task/409/stat : 409 (claspmt) R 395 397 367 0 -1 4202560 2522 0 0 0 154 17 0 0 17 0 32 0 32210578 2146287616 65656 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=397/tid=410] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/410/stat : 410 (claspmt) R 395 397 367 0 -1 4202560 2084 0 0 0 152 16 0 0 17 0 32 0 32210578 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4669936 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=397/tid=411] ppid=395 vsize=2095984 CPUtime=1.91 cores=0-31
/proc/397/task/411/stat : 411 (claspmt) R 395 397 367 0 -1 4202560 1842 0 0 0 177 14 0 0 20 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=397/tid=412] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/412/stat : 412 (claspmt) R 395 397 367 0 -1 4202560 2242 0 0 0 152 16 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=397/tid=413] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/413/stat : 413 (claspmt) R 395 397 367 0 -1 4202560 2453 0 0 0 153 15 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668920 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=397/tid=414] ppid=395 vsize=2095984 CPUtime=1.66 cores=0-31
/proc/397/task/414/stat : 414 (claspmt) R 395 397 367 0 -1 4202560 2050 0 0 0 151 15 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670194 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=397/tid=415] ppid=395 vsize=2095984 CPUtime=1.66 cores=0-31
/proc/397/task/415/stat : 415 (claspmt) R 395 397 367 0 -1 4202560 1985 0 0 0 151 15 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=397/tid=416] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/416/stat : 416 (claspmt) R 395 397 367 0 -1 4202560 2757 0 0 0 150 18 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 258651061007 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=397/tid=417] ppid=395 vsize=2095984 CPUtime=1.69 cores=0-31
/proc/397/task/417/stat : 417 (claspmt) R 395 397 367 0 -1 4202560 2502 0 0 0 152 17 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=397/tid=418] ppid=395 vsize=2095984 CPUtime=1.63 cores=0-31
/proc/397/task/418/stat : 418 (claspmt) R 395 397 367 0 -1 4202560 1963 0 0 0 151 12 0 0 17 0 32 0 32210579 2146287616 65657 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=397/tid=419] ppid=395 vsize=2095984 CPUtime=1.9 cores=0-31
/proc/397/task/419/stat : 419 (claspmt) R 395 397 367 0 -1 4202560 1813 0 0 0 176 14 0 0 20 0 32 0 32210579 2146287616 65659 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 10 0 0 0
[pid=397/tid=420] ppid=395 vsize=2095984 CPUtime=1.66 cores=0-31
/proc/397/task/420/stat : 420 (claspmt) R 395 397 367 0 -1 4202560 2254 0 0 0 153 13 0 0 17 0 32 0 32210579 2146287616 65660 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=397/tid=421] ppid=395 vsize=2095984 CPUtime=1.63 cores=0-31
/proc/397/task/421/stat : 421 (claspmt) R 395 397 367 0 -1 4202560 2420 0 0 0 146 17 0 0 17 0 32 0 32210579 2146287616 65660 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670212 0 0 4096 18946 0 0 0 -1 31 0 0 0
[pid=397/tid=422] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31
/proc/397/task/422/stat : 422 (claspmt) R 395 397 367 0 -1 4202560 2024 0 0 0 152 16 0 0 17 0 32 0 32210579 2146287616 65662 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=397/tid=423] ppid=395 vsize=2095984 CPUtime=1.66 cores=0-31
/proc/397/task/423/stat : 423 (claspmt) R 395 397 367 0 -1 4202560 1980 0 0 0 152 14 0 0 17 0 32 0 32210579 2146287616 65662 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=397/tid=424] ppid=395 vsize=2095984 CPUtime=1.65 cores=0-31
/proc/397/task/424/stat : 424 (claspmt) R 395 397 367 0 -1 4202560 2574 0 0 0 152 13 0 0 17 0 32 0 32210579 2146287616 65662 270582939648 4194304 4964800 140734948202656 18446744073709551615 4362964 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=397/tid=425] ppid=395 vsize=2095984 CPUtime=1.67 cores=0-31
/proc/397/task/425/stat : 425 (claspmt) R 395 397 367 0 -1 4202560 2504 0 0 0 151 16 0 0 17 0 32 0 32210579 2146287616 65662 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668544 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=397/tid=426] ppid=395 vsize=2095984 CPUtime=1.64 cores=0-31
/proc/397/task/426/stat : 426 (claspmt) R 395 397 367 0 -1 4202560 1956 0 0 0 151 13 0 0 17 0 32 0 32210579 2146287616 65662 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=397/tid=427] ppid=395 vsize=2095984 CPUtime=1.85 cores=0-31
/proc/397/task/427/stat : 427 (claspmt) R 395 397 367 0 -1 4202560 1979 0 0 0 175 10 0 0 20 0 32 0 32210579 2146287616 65662 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668930 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=397/tid=428] ppid=395 vsize=2095984 CPUtime=1.68 cores=0-31

################
# More data... #
################

/proc/397/task/410/stat : 410 (claspmt) R 395 397 367 0 -1 4202560 36740 0 0 0 495799 151 0 0 25 0 32 0 32210578 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=397/tid=411] ppid=395 vsize=5955160 CPUtime=4959.77 cores=0-31
/proc/397/task/411/stat : 411 (claspmt) R 395 397 367 0 -1 4202560 25710 0 0 0 495872 105 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=397/tid=412] ppid=395 vsize=5955160 CPUtime=4956.19 cores=0-31
/proc/397/task/412/stat : 412 (claspmt) R 395 397 367 0 -1 4202560 24387 0 0 0 495511 108 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=397/tid=413] ppid=395 vsize=5955160 CPUtime=4956.19 cores=0-31
/proc/397/task/413/stat : 413 (claspmt) R 395 397 367 0 -1 4202560 112927 0 0 0 495154 465 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=397/tid=414] ppid=395 vsize=5955160 CPUtime=4943.93 cores=0-31
/proc/397/task/414/stat : 414 (claspmt) R 395 397 367 0 -1 4202560 20796 0 0 0 494295 98 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=397/tid=415] ppid=395 vsize=5955160 CPUtime=4959.4 cores=0-31
/proc/397/task/415/stat : 415 (claspmt) R 395 397 367 0 -1 4202560 19022 0 0 0 495866 74 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=397/tid=416] ppid=395 vsize=5955160 CPUtime=4948.7 cores=0-31
/proc/397/task/416/stat : 416 (claspmt) R 395 397 367 0 -1 4202560 35409 0 0 0 494733 137 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=397/tid=417] ppid=395 vsize=5955160 CPUtime=4959.6 cores=0-31
/proc/397/task/417/stat : 417 (claspmt) R 395 397 367 0 -1 4202560 21886 0 0 0 495865 95 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=397/tid=418] ppid=395 vsize=5955160 CPUtime=4959.58 cores=0-31
/proc/397/task/418/stat : 418 (claspmt) R 395 397 367 0 -1 4202560 33506 0 0 0 495820 138 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=397/tid=419] ppid=395 vsize=5955160 CPUtime=4955.61 cores=0-31
/proc/397/task/419/stat : 419 (claspmt) R 395 397 367 0 -1 4202560 30058 0 0 0 495430 131 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=397/tid=420] ppid=395 vsize=5955160 CPUtime=4959.24 cores=0-31
/proc/397/task/420/stat : 420 (claspmt) R 395 397 367 0 -1 4202560 22518 0 0 0 495830 94 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=397/tid=421] ppid=395 vsize=5955160 CPUtime=4956.76 cores=0-31
/proc/397/task/421/stat : 421 (claspmt) R 395 397 367 0 -1 4202560 114757 0 0 0 495181 495 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=397/tid=422] ppid=395 vsize=5955160 CPUtime=4937.33 cores=0-31
/proc/397/task/422/stat : 422 (claspmt) R 395 397 367 0 -1 4202560 24219 0 0 0 493620 113 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=397/tid=423] ppid=395 vsize=5955160 CPUtime=4959.37 cores=0-31
/proc/397/task/423/stat : 423 (claspmt) R 395 397 367 0 -1 4202560 18788 0 0 0 495856 81 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4332248 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=397/tid=424] ppid=395 vsize=5955160 CPUtime=4959.62 cores=0-31
/proc/397/task/424/stat : 424 (claspmt) R 395 397 367 0 -1 4202560 43274 0 0 0 495808 154 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=397/tid=425] ppid=395 vsize=5955160 CPUtime=4953.15 cores=0-31
/proc/397/task/425/stat : 425 (claspmt) R 395 397 367 0 -1 4202560 29230 0 0 0 495194 121 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4320953 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=397/tid=426] ppid=395 vsize=5955160 CPUtime=4959.57 cores=0-31
/proc/397/task/426/stat : 426 (claspmt) R 395 397 367 0 -1 4202560 31489 0 0 0 495826 131 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=397/tid=427] ppid=395 vsize=5955160 CPUtime=4953.13 cores=0-31
/proc/397/task/427/stat : 427 (claspmt) R 395 397 367 0 -1 4202560 22660 0 0 0 495226 87 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=397/tid=428] ppid=395 vsize=5955160 CPUtime=4959.55 cores=0-31
/proc/397/task/428/stat : 428 (claspmt) R 395 397 367 0 -1 4202560 24558 0 0 0 495855 100 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4378480 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=397/tid=429] ppid=395 vsize=5955160 CPUtime=4943.33 cores=0-31
/proc/397/task/429/stat : 429 (claspmt) R 395 397 367 0 -1 4202560 101025 0 0 0 493934 399 0 0 25 0 32 0 32210579 6098083840 1187843 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 31 0 0 0
Current children cumulated CPU time (s) 158560
Current children cumulated vsize (KiB) 5955160



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.4 s]
/proc/loadavg: 32.06 32.08 32.09 33/444 1065
/proc/meminfo: memFree=257440092/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=5955160 CPUtime=160001 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 1214524 0 0 0 15995165 4981 0 0 25 0 32 0 32210493 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 10 0 0 0
/proc/397/statm: 1488790 1188470 463 189 0 1483139 0
[pid=397/tid=399] ppid=395 vsize=5955160 CPUtime=5004.42 cores=0-31
/proc/397/task/399/stat : 399 (claspmt) R 395 397 367 0 -1 4202560 19502 0 0 0 500363 79 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 9 0 0 0
[pid=397/tid=400] ppid=395 vsize=5955160 CPUtime=5004.26 cores=0-31
/proc/397/task/400/stat : 400 (claspmt) R 395 397 367 0 -1 4202560 46928 0 0 0 500251 175 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=397/tid=401] ppid=395 vsize=5955160 CPUtime=4985.95 cores=0-31
/proc/397/task/401/stat : 401 (claspmt) R 395 397 367 0 -1 4202560 25481 0 0 0 498490 105 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 27 0 0 0
[pid=397/tid=402] ppid=395 vsize=5955160 CPUtime=5004.32 cores=0-31
/proc/397/task/402/stat : 402 (claspmt) R 395 397 367 0 -1 4202560 34593 0 0 0 500296 136 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 16 0 0 0
[pid=397/tid=403] ppid=395 vsize=5955160 CPUtime=5004.5 cores=0-31
/proc/397/task/403/stat : 403 (claspmt) R 395 397 367 0 -1 4202560 28449 0 0 0 500343 107 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 8 0 0 0
[pid=397/tid=404] ppid=395 vsize=5955160 CPUtime=5003.71 cores=0-31
/proc/397/task/404/stat : 404 (claspmt) R 395 397 367 0 -1 4202560 22360 0 0 0 500255 116 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 12 0 0 0
[pid=397/tid=405] ppid=395 vsize=5955160 CPUtime=4990.94 cores=0-31
/proc/397/task/405/stat : 405 (claspmt) R 395 397 367 0 -1 4202560 105886 0 0 0 498691 403 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 15 0 0 0
[pid=397/tid=406] ppid=395 vsize=5955160 CPUtime=4996.93 cores=0-31
/proc/397/task/406/stat : 406 (claspmt) R 395 397 367 0 -1 4202560 26168 0 0 0 499572 121 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 258650653504 0 0 4096 18946 0 0 0 -1 19 0 0 0
[pid=397/tid=407] ppid=395 vsize=5955160 CPUtime=4999.87 cores=0-31
/proc/397/task/407/stat : 407 (claspmt) R 395 397 367 0 -1 4202560 19408 0 0 0 499891 96 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=397/tid=408] ppid=395 vsize=5955160 CPUtime=5004.34 cores=0-31
/proc/397/task/408/stat : 408 (claspmt) R 395 397 367 0 -1 4202560 40243 0 0 0 500279 155 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=397/tid=409] ppid=395 vsize=5955160 CPUtime=5004.72 cores=0-31
/proc/397/task/409/stat : 409 (claspmt) R 395 397 367 0 -1 4202560 23259 0 0 0 500367 105 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 25 0 0 0
[pid=397/tid=410] ppid=395 vsize=5955160 CPUtime=5004.61 cores=0-31
/proc/397/task/410/stat : 410 (claspmt) R 395 397 367 0 -1 4202560 36740 0 0 0 500309 152 0 0 25 0 32 0 32210578 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=397/tid=411] ppid=395 vsize=5955160 CPUtime=5004.88 cores=0-31
/proc/397/task/411/stat : 411 (claspmt) R 395 397 367 0 -1 4202560 25710 0 0 0 500383 105 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=397/tid=412] ppid=395 vsize=5955160 CPUtime=5001.29 cores=0-31
/proc/397/task/412/stat : 412 (claspmt) R 395 397 367 0 -1 4202560 24387 0 0 0 500021 108 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=397/tid=413] ppid=395 vsize=5955160 CPUtime=5001.29 cores=0-31
/proc/397/task/413/stat : 413 (claspmt) R 395 397 367 0 -1 4202560 112928 0 0 0 499664 465 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 11 0 0 0
[pid=397/tid=414] ppid=395 vsize=5955160 CPUtime=4989.04 cores=0-31
/proc/397/task/414/stat : 414 (claspmt) R 395 397 367 0 -1 4202560 20796 0 0 0 498806 98 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4332355 0 0 4096 18946 0 0 0 -1 23 0 0 0
[pid=397/tid=415] ppid=395 vsize=5955160 CPUtime=5004.51 cores=0-31
/proc/397/task/415/stat : 415 (claspmt) R 395 397 367 0 -1 4202560 19022 0 0 0 500377 74 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 30 0 0 0
[pid=397/tid=416] ppid=395 vsize=5955160 CPUtime=4993.8 cores=0-31
/proc/397/task/416/stat : 416 (claspmt) R 395 397 367 0 -1 4202560 35512 0 0 0 499243 137 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=397/tid=417] ppid=395 vsize=5955160 CPUtime=5004.7 cores=0-31
/proc/397/task/417/stat : 417 (claspmt) R 395 397 367 0 -1 4202560 21886 0 0 0 500375 95 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 13 0 0 0
[pid=397/tid=418] ppid=395 vsize=5955160 CPUtime=5004.66 cores=0-31
/proc/397/task/418/stat : 418 (claspmt) R 395 397 367 0 -1 4202560 33506 0 0 0 500328 138 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 28 0 0 0
[pid=397/tid=419] ppid=395 vsize=5955160 CPUtime=5000.72 cores=0-31
/proc/397/task/419/stat : 419 (claspmt) R 395 397 367 0 -1 4202560 30058 0 0 0 499941 131 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 14 0 0 0
[pid=397/tid=420] ppid=395 vsize=5955160 CPUtime=5004.34 cores=0-31
/proc/397/task/420/stat : 420 (claspmt) R 395 397 367 0 -1 4202560 22541 0 0 0 500340 94 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 21 0 0 0
[pid=397/tid=421] ppid=395 vsize=5955160 CPUtime=5001.87 cores=0-31
/proc/397/task/421/stat : 421 (claspmt) R 395 397 367 0 -1 4202560 114757 0 0 0 499692 495 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=397/tid=422] ppid=395 vsize=5955160 CPUtime=4982.43 cores=0-31
/proc/397/task/422/stat : 422 (claspmt) R 395 397 367 0 -1 4202560 24243 0 0 0 498130 113 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 22 0 0 0
[pid=397/tid=423] ppid=395 vsize=5955160 CPUtime=5004.47 cores=0-31
/proc/397/task/423/stat : 423 (claspmt) R 395 397 367 0 -1 4202560 18788 0 0 0 500365 82 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 29 0 0 0
[pid=397/tid=424] ppid=395 vsize=5955160 CPUtime=5004.73 cores=0-31
/proc/397/task/424/stat : 424 (claspmt) R 395 397 367 0 -1 4202560 43414 0 0 0 500318 155 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 26 0 0 0
[pid=397/tid=425] ppid=395 vsize=5955160 CPUtime=4998.25 cores=0-31
/proc/397/task/425/stat : 425 (claspmt) R 395 397 367 0 -1 4202560 29232 0 0 0 499704 121 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 18 0 0 0
[pid=397/tid=426] ppid=395 vsize=5955160 CPUtime=5004.68 cores=0-31
/proc/397/task/426/stat : 426 (claspmt) R 395 397 367 0 -1 4202560 31490 0 0 0 500337 131 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 20 0 0 0
[pid=397/tid=427] ppid=395 vsize=5955160 CPUtime=4998.24 cores=0-31
/proc/397/task/427/stat : 427 (claspmt) R 395 397 367 0 -1 4202560 22661 0 0 0 499737 87 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 24 0 0 0
[pid=397/tid=428] ppid=395 vsize=5955160 CPUtime=5004.66 cores=0-31
/proc/397/task/428/stat : 428 (claspmt) R 395 397 367 0 -1 4202560 24558 0 0 0 500366 100 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 17 0 0 0
[pid=397/tid=429] ppid=395 vsize=5955160 CPUtime=4987.14 cores=0-31
/proc/397/task/429/stat : 429 (claspmt) R 395 397 367 0 -1 4202560 101263 0 0 0 498314 400 0 0 25 0 32 0 32210579 6098083840 1188470 270582939648 4194304 4964800 140734948202656 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 31 0 0 0
Current children cumulated CPU time (s) 160001
Current children cumulated vsize (KiB) 5955160

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -397

Solver just ended. Dumping a history of the last processes samples

[startup+5007.8 s]
/proc/loadavg: 32.06 32.08 32.09 33/444 1065
/proc/meminfo: memFree=257440092/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=5850740 CPUtime=160003 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 1214537 0 0 0 15995270 4982 0 0 25 0 1 0 32210493 5991157760 1184743 270582939648 4194304 4964800 140734948202656 18446744073709551615 258650611056 0 0 4096 18946 0 0 0 17 10 0 0 0
/proc/397/statm: 1462685 1184743 474 189 0 1457034 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 5850740

[startup+5008.6 s]
/proc/loadavg: 32.06 32.08 32.09 2/414 1066
/proc/meminfo: memFree=257471828/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=5817780 CPUtime=160003 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4202496 1214537 0 0 0 15995350 4982 0 0 25 0 1 0 32210493 5957406720 1176966 270582939648 4194304 4964800 140734948202656 18446744073709551615 258650611056 0 0 4096 18946 0 0 0 17 10 0 0 0
/proc/397/statm: 1454445 1176966 474 189 0 1448794 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 5817780

[startup+5009.44 s]
/proc/loadavg: 32.06 32.08 32.09 2/414 1066
/proc/meminfo: memFree=257510656/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=0 CPUtime=160004 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4203524 1214537 0 0 0 15995433 4983 0 0 25 0 1 0 32210493 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 10 0 0 0
/proc/397/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

[startup+5009.6 s]
/proc/loadavg: 32.06 32.08 32.09 2/414 1066
/proc/meminfo: memFree=257510656/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=0 CPUtime=160004 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4203524 1214537 0 0 0 15995433 4999 0 0 25 0 1 0 32210493 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 10 0 0 0
/proc/397/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

[startup+5009.7 s]
/proc/loadavg: 32.06 32.08 32.09 2/414 1066
/proc/meminfo: memFree=257510656/264257624 swapFree=67111528/67111528
[pid=397] ppid=395 vsize=0 CPUtime=160004 cores=0-31
/proc/397/stat : 397 (claspmt) R 395 397 367 0 -1 4203524 1214537 0 0 0 15995433 5009 0 0 25 0 1 0 32210493 0 0 270582939648 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 10 0 0 0
/proc/397/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 160004
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 5009.72
CPU time (s): 160004
CPU user time (s): 159954
CPU system time (s): 50.1164
CPU usage (%): 3193.88
Max. virtual memory (cumulated for all children) (KiB): 5955160

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159954
system time used= 50.1164
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1214537
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 369073
involuntary context switches= 410912

runsolver used 26.559 second user time and 114.753 second system time

The end

Launcher Data 

Begin job on node200 at 2011-06-10 03:10:36
IDJOB=3472450
IDBENCH=83110
IDSOLVER=1961
FILE ID=node200/3472450-1307668236
RUNJOBID= node200-1307668236-381
PBS_JOBID= 13549492
Free space on /tmp= 61740 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom20.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3472450-1307668236/watcher-3472450-1307668236 -o /tmp/evaluation-result-3472450-1307668236/solver-3472450-1307668236 -C 160000 -W 5100 -M 256000  HOME/claspmt -t32 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3472450-1307668236.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 256000 MiB
NBCORE= 32

MD5SUM BENCH= 9851f8e63efc4505343bf50c1cf30646
RANDOM SEED=458982432

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.10
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.045
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      262196680 kB
Buffers:        257684 kB
Cached:        1488392 kB
SwapCached:          0 kB
Active:         276132 kB
Inactive:      1532780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      262196680 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            3696 kB
Writeback:           0 kB
AnonPages:       65016 kB
Mapped:          14472 kB
Slab:           172424 kB
PageTables:       5480 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   155604 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61740 MiB
End job on node200 at 2011-06-10 04:34:06