Trace number 3372519

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 1950.78 127.562

General information on the benchmark

Nameapplication/jarvisalo/AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-27-step13.cnf
MD5SUM52e16341bcff805ef2d6abe4e95359a0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark450.455
Satisfiable
(Un)Satisfiability was proved
Number of variables224228
Number of clauses5314673
Sum of the clauses size11732345
Maximum clause length3193
Minimum clause length1
Number of clauses of size 1556
Number of clauses of size 25229536
Number of clauses of size 36084
Number of clauses of size 49856
Number of clauses of size 58159
Number of clauses of size over 560482

Solver Data 

1950.70/127.56	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372519-1305674357/watcher-3372519-1305674357 -o /tmp/evaluation-result-3372519-1305674357/solver-3372519-1305674357 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372519-1305674357.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.23 14.79 20.29 1/413 27664
/proc/meminfo: memFree=255416428/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=42472 CPUtime=0.02 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 8647 1248 0 0 1 1 0 0 21 0 1 0 678922628 43491328 8578 268435456000 4194304 4417452 140735899762384 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 10618 8593 144 55 0 8504 0

[startup+0.125805 s]
/proc/loadavg: 8.23 14.79 20.29 1/413 27664
/proc/meminfo: memFree=255416428/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=143628 CPUtime=0.11 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 33971 1248 0 0 5 6 0 0 21 0 1 0 678922628 147075072 33902 268435456000 4194304 4417452 140735899762384 18446744073709551615 4259247 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 35907 33902 145 55 0 33793 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 143628

[startup+0.200803 s]
/proc/loadavg: 8.23 14.79 20.29 1/413 27664
/proc/meminfo: memFree=255416428/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=154536 CPUtime=0.18 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 36696 1248 0 0 12 6 0 0 21 0 1 0 678922628 158244864 36627 268435456000 4194304 4417452 140735899762384 18446744073709551615 4262008 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 38634 36627 145 55 0 36520 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 154536

[startup+0.300816 s]
/proc/loadavg: 8.23 14.79 20.29 1/413 27664
/proc/meminfo: memFree=255416428/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=166120 CPUtime=0.29 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 39596 1248 0 0 22 7 0 0 22 0 1 0 678922628 170106880 39527 268435456000 4194304 4417452 140735899762384 18446744073709551615 4320705 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 41530 39527 145 55 0 39416 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 166120

[startup+0.700819 s]
/proc/loadavg: 8.23 14.79 20.29 1/413 27664
/proc/meminfo: memFree=255416428/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=206488 CPUtime=0.69 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 49696 1248 0 0 60 9 0 0 23 0 1 0 678922628 211443712 49627 268435456000 4194304 4417452 140735899762384 18446744073709551615 4259501 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 51622 49627 145 55 0 49508 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 206488

[startup+1.50085 s]
/proc/loadavg: 7.73 14.57 20.19 2/414 27670
/proc/meminfo: memFree=255206880/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=267652 CPUtime=1.48 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 65003 1248 0 0 137 11 0 0 25 0 1 0 678922628 274075648 64934 268435456000 4194304 4417452 140735899762384 18446744073709551615 4231569 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 66913 64934 145 55 0 64799 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 267652

[startup+3.1009 s]
/proc/loadavg: 7.73 14.57 20.19 2/414 27670
/proc/meminfo: memFree=255090816/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=408784 CPUtime=3.08 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 100379 1248 0 0 290 18 0 0 25 0 1 0 678922628 418594816 100218 268435456000 4194304 4417452 140735899762384 18446744073709551615 4323298 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 102196 100218 146 55 0 100082 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 408784

[startup+6.30102 s]
/proc/loadavg: 7.19 14.35 20.09 2/414 27670
/proc/meminfo: memFree=254771836/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=772120 CPUtime=6.28 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 191533 1248 0 0 592 36 0 0 25 0 1 0 678922628 790650880 191052 268435456000 4194304 4417452 140735899762384 18446744073709551615 4264934 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 193030 191052 146 55 0 190916 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 772120

[startup+12.7012 s]
/proc/loadavg: 6.69 14.13 19.99 2/414 27670
/proc/meminfo: memFree=254289508/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=1138204 CPUtime=12.68 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 283071 1248 0 0 1213 55 0 0 25 0 1 0 678922628 1165520896 282573 268435456000 4194304 4417452 140735899762384 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 284551 282573 146 55 0 282437 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1138204

[startup+25.5007 s]
/proc/loadavg: 5.43 13.48 19.68 2/414 27672
/proc/meminfo: memFree=253508112/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=1924636 CPUtime=25.48 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 479679 1248 0 0 2453 95 0 0 25 0 1 0 678922628 1970827264 479181 268435456000 4194304 4417452 140735899762384 18446744073709551615 4231490 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 481159 479181 146 55 0 479045 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1924636

[startup+51.1006 s]
/proc/loadavg: 3.92 12.48 19.18 2/414 27672
/proc/meminfo: memFree=252458988/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=2973212 CPUtime=51.07 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 741823 1248 0 0 4959 148 0 0 25 0 1 0 678922628 3044569088 741325 268435456000 4194304 4417452 140735899762384 18446744073709551615 4235991 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/27664/statm: 743303 741325 146 55 0 741189 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 2973212

[startup+102.302 s]
/proc/loadavg: 17.30 14.58 19.53 33/446 27706
/proc/meminfo: memFree=252188352/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=3814456 CPUtime=1152.34 cores=0-31
/proc/27664/stat : 27664 (plingeling) S 27662 27664 27306 0 -1 4202496 2070478 1248 0 0 112534 2700 0 0 18 0 33 0 678922628 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 30 0 0 0
/proc/27664/statm: 953614 803108 175 55 0 951500 0
[pid=27664/tid=27673] ppid=27662 vsize=3814456 CPUtime=33.21 cores=0-31
/proc/27664/task/27673/stat : 27673 (plingeling) R 27662 27664 27306 0 -1 4202560 42451 1248 0 0 3222 99 0 0 25 0 33 0 678929103 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=27664/tid=27674] ppid=27662 vsize=3814456 CPUtime=33.31 cores=0-31
/proc/27664/task/27674/stat : 27674 (plingeling) R 27662 27664 27306 0 -1 4202560 44143 1248 0 0 3228 103 0 0 25 0 33 0 678929103 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4235398 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=27664/tid=27675] ppid=27662 vsize=3814456 CPUtime=33.85 cores=0-31
/proc/27664/task/27675/stat : 27675 (plingeling) R 27662 27664 27306 0 -1 4202560 46537 1248 0 0 3296 89 0 0 25 0 33 0 678929103 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236355 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=27664/tid=27676] ppid=27662 vsize=3814456 CPUtime=34.52 cores=0-31
/proc/27664/task/27676/stat : 27676 (plingeling) R 27662 27664 27306 0 -1 4202560 4740 1248 0 0 3447 5 0 0 25 0 33 0 678929103 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=27664/tid=27677] ppid=27662 vsize=3814456 CPUtime=34.47 cores=0-31
/proc/27664/task/27677/stat : 27677 (plingeling) R 27662 27664 27306 0 -1 4202560 46322 1248 0 0 3354 93 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258176 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27664/tid=27678] ppid=27662 vsize=3814456 CPUtime=34.18 cores=0-31
/proc/27664/task/27678/stat : 27678 (plingeling) R 27662 27664 27306 0 -1 4202560 40483 1248 0 0 3354 64 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27664/tid=27679] ppid=27662 vsize=3814456 CPUtime=34.19 cores=0-31
/proc/27664/task/27679/stat : 27679 (plingeling) R 27662 27664 27306 0 -1 4202560 41919 1248 0 0 3367 52 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258625 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=27664/tid=27680] ppid=27662 vsize=3814456 CPUtime=34.13 cores=0-31
/proc/27664/task/27680/stat : 27680 (plingeling) R 27662 27664 27306 0 -1 4202560 43687 1248 0 0 3345 68 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258410 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=27664/tid=27681] ppid=27662 vsize=3814456 CPUtime=32.94 cores=0-31
/proc/27664/task/27681/stat : 27681 (plingeling) R 27662 27664 27306 0 -1 4202560 42618 1248 0 0 3207 87 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4248229 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27664/tid=27682] ppid=27662 vsize=3814456 CPUtime=33.39 cores=0-31
/proc/27664/task/27682/stat : 27682 (plingeling) R 27662 27664 27306 0 -1 4202560 39973 1248 0 0 3268 71 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4249870 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=27664/tid=27683] ppid=27662 vsize=3814456 CPUtime=34.84 cores=0-31
/proc/27664/task/27683/stat : 27683 (plingeling) R 27662 27664 27306 0 -1 4202560 39661 1248 0 0 3420 64 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4249675 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=27664/tid=27684] ppid=27662 vsize=3814456 CPUtime=34.47 cores=0-31
/proc/27664/task/27684/stat : 27684 (plingeling) R 27662 27664 27306 0 -1 4202560 42038 1248 0 0 3365 82 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236302 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27664/tid=27685] ppid=27662 vsize=3814456 CPUtime=33.55 cores=0-31
/proc/27664/task/27685/stat : 27685 (plingeling) R 27662 27664 27306 0 -1 4202560 45018 1248 0 0 3246 109 0 0 25 0 33 0 678929104 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4233460 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27664/tid=27686] ppid=27662 vsize=3814456 CPUtime=34.18 cores=0-31
/proc/27664/task/27686/stat : 27686 (plingeling) R 27662 27664 27306 0 -1 4202560 44428 1248 0 0 3324 94 0 0 25 0 33 0 678929105 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4249924 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=27664/tid=27687] ppid=27662 vsize=3814456 CPUtime=34.78 cores=0-31
/proc/27664/task/27687/stat : 27687 (plingeling) R 27662 27664 27306 0 -1 4202560 48995 1248 0 0 3391 87 0 0 25 0 33 0 678929105 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4248939 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27664/tid=27688] ppid=27662 vsize=3814456 CPUtime=33.07 cores=0-31
/proc/27664/task/27688/stat : 27688 (plingeling) R 27662 27664 27306 0 -1 4202560 43892 1248 0 0 3204 103 0 0 25 0 33 0 678929105 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258258 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=27664/tid=27689] ppid=27662 vsize=3814456 CPUtime=34.27 cores=0-31
/proc/27664/task/27689/stat : 27689 (plingeling) R 27662 27664 27306 0 -1 4202560 42608 1248 0 0 3324 103 0 0 25 0 33 0 678929105 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258499 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=27664/tid=27690] ppid=27662 vsize=3814456 CPUtime=34.56 cores=0-31
/proc/27664/task/27690/stat : 27690 (plingeling) R 27662 27664 27306 0 -1 4202560 38894 1248 0 0 3397 59 0 0 25 0 33 0 678929105 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4211465 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=27664/tid=27691] ppid=27662 vsize=3814456 CPUtime=34.97 cores=0-31
/proc/27664/task/27691/stat : 27691 (plingeling) R 27662 27664 27306 0 -1 4202560 45286 1248 0 0 3421 76 0 0 25 0 33 0 678929105 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236319 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=27664/tid=27692] ppid=27662 vsize=3814456 CPUtime=33.09 cores=0-31
/proc/27664/task/27692/stat : 27692 (plingeling) R 27662 27664 27306 0 -1 4202560 39144 1248 0 0 3217 92 0 0 25 0 33 0 678929106 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236290 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=27664/tid=27693] ppid=27662 vsize=3814456 CPUtime=34.88 cores=0-31
/proc/27664/task/27693/stat : 27693 (plingeling) R 27662 27664 27306 0 -1 4202560 38674 1248 0 0 3430 58 0 0 25 0 33 0 678929106 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=27664/tid=27694] ppid=27662 vsize=3814456 CPUtime=34.24 cores=0-31
/proc/27664/task/27694/stat : 27694 (plingeling) R 27662 27664 27306 0 -1 4202560 46537 1248 0 0 3341 83 0 0 25 0 33 0 678929107 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258472 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=27664/tid=27695] ppid=27662 vsize=3814456 CPUtime=32.91 cores=0-31
/proc/27664/task/27695/stat : 27695 (plingeling) R 27662 27664 27306 0 -1 4202560 48278 1248 0 0 3220 71 0 0 25 0 33 0 678929107 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258194 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=27664/tid=27696] ppid=27662 vsize=3814456 CPUtime=33.75 cores=0-31
/proc/27664/task/27696/stat : 27696 (plingeling) R 27662 27664 27306 0 -1 4202560 40671 1248 0 0 3311 64 0 0 25 0 33 0 678929107 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4248923 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=27664/tid=27697] ppid=27662 vsize=3814456 CPUtime=34.55 cores=0-31
/proc/27664/task/27697/stat : 27697 (plingeling) R 27662 27664 27306 0 -1 4202560 38892 1248 0 0 3391 64 0 0 25 0 33 0 678929107 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27664/tid=27698] ppid=27662 vsize=3814456 CPUtime=33.77 cores=0-31
/proc/27664/task/27698/stat : 27698 (plingeling) R 27662 27664 27306 0 -1 4202560 44236 1248 0 0 3273 104 0 0 25 0 33 0 678929107 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258491 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27664/tid=27699] ppid=27662 vsize=3814456 CPUtime=34.27 cores=0-31
/proc/27664/task/27699/stat : 27699 (plingeling) R 27662 27664 27306 0 -1 4202560 26570 1248 0 0 3384 43 0 0 25 0 33 0 678929107 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4248238 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=27664/tid=27700] ppid=27662 vsize=3814456 CPUtime=33.68 cores=0-31
/proc/27664/task/27700/stat : 27700 (plingeling) R 27662 27664 27306 0 -1 4202560 42309 1248 0 0 3266 102 0 0 25 0 33 0 678929108 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236267 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=27664/tid=27701] ppid=27662 vsize=3814456 CPUtime=34.69 cores=0-31
/proc/27664/task/27701/stat : 27701 (plingeling) R 27662 27664 27306 0 -1 4202560 46865 1248 0 0 3411 58 0 0 25 0 33 0 678929108 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4319768 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=27664/tid=27702] ppid=27662 vsize=3814456 CPUtime=33.56 cores=0-31
/proc/27664/task/27702/stat : 27702 (plingeling) R 27662 27664 27306 0 -1 4202560 42043 1248 0 0 3263 93 0 0 25 0 33 0 678929112 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=27664/tid=27703] ppid=27662 vsize=3814456 CPUtime=34.03 cores=0-31
/proc/27664/task/27703/stat : 27703 (plingeling) R 27662 27664 27306 0 -1 4202560 45594 1248 0 0 3306 97 0 0 25 0 33 0 678929113 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258224 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=27664/tid=27704] ppid=27662 vsize=3814456 CPUtime=32.96 cores=0-31
/proc/27664/task/27704/stat : 27704 (plingeling) R 27662 27664 27306 0 -1 4202560 45111 1248 0 0 3203 93 0 0 25 0 33 0 678929113 3906002944 803108 268435456000 4194304 4417452 140735899762384 18446744073709551615 4258359 0 0 4096 17442 0 0 0 -1 27 0 0 0
Current children cumulated CPU time (s) 1152.34
Current children cumulated vsize (KiB) 3814456

Solver just ended. Dumping a history of the last processes samples

[startup+102.422 s]
/proc/loadavg: 17.30 14.58 19.53 33/446 27706
/proc/meminfo: memFree=252188352/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=3814456 CPUtime=1155.55 cores=0-31
/proc/27664/stat : 27664 (plingeling) S 27662 27664 27306 0 -1 4202496 2070990 1248 0 0 112854 2701 0 0 18 0 33 0 678922628 3906002944 803620 268435456000 4194304 4417452 140735899762384 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 30 0 0 0
/proc/27664/statm: 953614 803620 175 55 0 951500 0
[pid=27664/tid=27673] ppid=27662 vsize=3814456 CPUtime=33.31 cores=0-31

################
# More data... #
################

[pid=27664/tid=27703] ppid=27662 vsize=3812112 CPUtime=56.51 cores=0-31
/proc/27664/task/27703/stat : 27703 (plingeling) R 27662 27664 27306 0 -1 4202560 45594 1248 0 0 5554 97 0 0 25 0 33 0 678929113 3903602688 799441 268435456000 4194304 4417452 140735899762384 18446744073709551615 4358103 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=27664/tid=27704] ppid=27662 vsize=3812112 CPUtime=55.44 cores=0-31
/proc/27664/task/27704/stat : 27704 (plingeling) R 27662 27664 27306 0 -1 4202560 45111 1248 0 0 5451 93 0 0 25 0 33 0 678929113 3903602688 799441 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 27 0 0 0
Current children cumulated CPU time (s) 1870.92
Current children cumulated vsize (KiB) 3812112

[startup+126.402 s]
/proc/loadavg: 22.38 15.99 19.87 33/446 27706
/proc/meminfo: memFree=252219856/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=3812112 CPUtime=1922.07 cores=0-31
/proc/27664/stat : 27664 (plingeling) S 27662 27664 27306 0 -1 4202496 2077867 1248 0 0 189504 2703 0 0 18 0 33 0 678922628 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 30 0 0 0
/proc/27664/statm: 953028 799612 175 55 0 950914 0
[pid=27664/tid=27673] ppid=27662 vsize=3812112 CPUtime=57.29 cores=0-31
/proc/27664/task/27673/stat : 27673 (plingeling) R 27662 27664 27306 0 -1 4202560 42451 1248 0 0 5630 99 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=27664/tid=27674] ppid=27662 vsize=3812112 CPUtime=57.39 cores=0-31
/proc/27664/task/27674/stat : 27674 (plingeling) R 27662 27664 27306 0 -1 4202560 44143 1248 0 0 5636 103 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=27664/tid=27675] ppid=27662 vsize=3812112 CPUtime=57.93 cores=0-31
/proc/27664/task/27675/stat : 27675 (plingeling) R 27662 27664 27306 0 -1 4202560 46537 1248 0 0 5704 89 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=27664/tid=27676] ppid=27662 vsize=3812112 CPUtime=58.59 cores=0-31
/proc/27664/task/27676/stat : 27676 (plingeling) R 27662 27664 27306 0 -1 4202560 4740 1248 0 0 5854 5 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=27664/tid=27677] ppid=27662 vsize=3812112 CPUtime=58.54 cores=0-31
/proc/27664/task/27677/stat : 27677 (plingeling) R 27662 27664 27306 0 -1 4202560 46322 1248 0 0 5761 93 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27664/tid=27678] ppid=27662 vsize=3812112 CPUtime=58.26 cores=0-31
/proc/27664/task/27678/stat : 27678 (plingeling) R 27662 27664 27306 0 -1 4202560 40483 1248 0 0 5762 64 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27664/tid=27679] ppid=27662 vsize=3812112 CPUtime=58.27 cores=0-31
/proc/27664/task/27679/stat : 27679 (plingeling) R 27662 27664 27306 0 -1 4202560 44683 1248 0 0 5774 53 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=27664/tid=27680] ppid=27662 vsize=3812112 CPUtime=58.21 cores=0-31
/proc/27664/task/27680/stat : 27680 (plingeling) R 27662 27664 27306 0 -1 4202560 43687 1248 0 0 5753 68 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=27664/tid=27681] ppid=27662 vsize=3812112 CPUtime=57.02 cores=0-31
/proc/27664/task/27681/stat : 27681 (plingeling) R 27662 27664 27306 0 -1 4202560 42618 1248 0 0 5615 87 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27664/tid=27682] ppid=27662 vsize=3812112 CPUtime=57.46 cores=0-31
/proc/27664/task/27682/stat : 27682 (plingeling) R 27662 27664 27306 0 -1 4202560 39973 1248 0 0 5675 71 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=27664/tid=27683] ppid=27662 vsize=3812112 CPUtime=58.92 cores=0-31
/proc/27664/task/27683/stat : 27683 (plingeling) R 27662 27664 27306 0 -1 4202560 39661 1248 0 0 5828 64 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=27664/tid=27684] ppid=27662 vsize=3812112 CPUtime=58.55 cores=0-31
/proc/27664/task/27684/stat : 27684 (plingeling) R 27662 27664 27306 0 -1 4202560 42038 1248 0 0 5773 82 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27664/tid=27685] ppid=27662 vsize=3812112 CPUtime=57.63 cores=0-31
/proc/27664/task/27685/stat : 27685 (plingeling) R 27662 27664 27306 0 -1 4202560 45018 1248 0 0 5654 109 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27664/tid=27686] ppid=27662 vsize=3812112 CPUtime=58.25 cores=0-31
/proc/27664/task/27686/stat : 27686 (plingeling) R 27662 27664 27306 0 -1 4202560 45731 1248 0 0 5731 94 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=27664/tid=27687] ppid=27662 vsize=3812112 CPUtime=58.86 cores=0-31
/proc/27664/task/27687/stat : 27687 (plingeling) R 27662 27664 27306 0 -1 4202560 48995 1248 0 0 5799 87 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4232705 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27664/tid=27688] ppid=27662 vsize=3812112 CPUtime=57.14 cores=0-31
/proc/27664/task/27688/stat : 27688 (plingeling) R 27662 27664 27306 0 -1 4202560 44404 1248 0 0 5611 103 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=27664/tid=27689] ppid=27662 vsize=3812112 CPUtime=58.35 cores=0-31
/proc/27664/task/27689/stat : 27689 (plingeling) R 27662 27664 27306 0 -1 4202560 43120 1248 0 0 5732 103 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=27664/tid=27690] ppid=27662 vsize=3812112 CPUtime=58.64 cores=0-31
/proc/27664/task/27690/stat : 27690 (plingeling) R 27662 27664 27306 0 -1 4202560 38894 1248 0 0 5805 59 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=27664/tid=27691] ppid=27662 vsize=3812112 CPUtime=59.04 cores=0-31
/proc/27664/task/27691/stat : 27691 (plingeling) R 27662 27664 27306 0 -1 4202560 45286 1248 0 0 5828 76 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236603 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=27664/tid=27692] ppid=27662 vsize=3812112 CPUtime=57.17 cores=0-31
/proc/27664/task/27692/stat : 27692 (plingeling) R 27662 27664 27306 0 -1 4202560 39144 1248 0 0 5625 92 0 0 25 0 33 0 678929106 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353598 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=27664/tid=27693] ppid=27662 vsize=3812112 CPUtime=58.96 cores=0-31
/proc/27664/task/27693/stat : 27693 (plingeling) R 27662 27664 27306 0 -1 4202560 38674 1248 0 0 5838 58 0 0 25 0 33 0 678929106 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=27664/tid=27694] ppid=27662 vsize=3812112 CPUtime=58.32 cores=0-31
/proc/27664/task/27694/stat : 27694 (plingeling) R 27662 27664 27306 0 -1 4202560 47049 1248 0 0 5749 83 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=27664/tid=27695] ppid=27662 vsize=3812112 CPUtime=56.31 cores=0-31
/proc/27664/task/27695/stat : 27695 (plingeling) R 27662 27664 27306 0 -1 4202560 48278 1248 0 0 5560 71 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=27664/tid=27696] ppid=27662 vsize=3812112 CPUtime=57.81 cores=0-31
/proc/27664/task/27696/stat : 27696 (plingeling) R 27662 27664 27306 0 -1 4202560 40671 1248 0 0 5717 64 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=27664/tid=27697] ppid=27662 vsize=3812112 CPUtime=58.63 cores=0-31
/proc/27664/task/27697/stat : 27697 (plingeling) R 27662 27664 27306 0 -1 4202560 38892 1248 0 0 5799 64 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27664/tid=27698] ppid=27662 vsize=3812112 CPUtime=57.84 cores=0-31
/proc/27664/task/27698/stat : 27698 (plingeling) R 27662 27664 27306 0 -1 4202560 44236 1248 0 0 5680 104 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27664/tid=27699] ppid=27662 vsize=3812112 CPUtime=58.35 cores=0-31
/proc/27664/task/27699/stat : 27699 (plingeling) R 27662 27664 27306 0 -1 4202560 27876 1248 0 0 5791 44 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=27664/tid=27700] ppid=27662 vsize=3812112 CPUtime=57.75 cores=0-31
/proc/27664/task/27700/stat : 27700 (plingeling) R 27662 27664 27306 0 -1 4202560 42789 1248 0 0 5673 102 0 0 25 0 33 0 678929108 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=27664/tid=27701] ppid=27662 vsize=3812112 CPUtime=58.77 cores=0-31
/proc/27664/task/27701/stat : 27701 (plingeling) R 27662 27664 27306 0 -1 4202560 46865 1248 0 0 5819 58 0 0 25 0 33 0 678929108 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=27664/tid=27702] ppid=27662 vsize=3812112 CPUtime=57.63 cores=0-31
/proc/27664/task/27702/stat : 27702 (plingeling) R 27662 27664 27306 0 -1 4202560 42043 1248 0 0 5670 93 0 0 25 0 33 0 678929112 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=27664/tid=27703] ppid=27662 vsize=3812112 CPUtime=58.11 cores=0-31
/proc/27664/task/27703/stat : 27703 (plingeling) R 27662 27664 27306 0 -1 4202560 45594 1248 0 0 5714 97 0 0 25 0 33 0 678929113 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=27664/tid=27704] ppid=27662 vsize=3812112 CPUtime=57.04 cores=0-31
/proc/27664/task/27704/stat : 27704 (plingeling) R 27662 27664 27306 0 -1 4202560 45111 1248 0 0 5611 93 0 0 25 0 33 0 678929113 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 27 0 0 0
Current children cumulated CPU time (s) 1922.07
Current children cumulated vsize (KiB) 3812112

[startup+127.202 s]
/proc/loadavg: 22.38 15.99 19.87 33/446 27706
/proc/meminfo: memFree=252220276/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=3812112 CPUtime=1947.64 cores=0-31
/proc/27664/stat : 27664 (plingeling) S 27662 27664 27306 0 -1 4202496 2077867 1248 0 0 192061 2703 0 0 18 0 33 0 678922628 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 30 0 0 0
/proc/27664/statm: 953028 799612 175 55 0 950914 0
[pid=27664/tid=27673] ppid=27662 vsize=3812112 CPUtime=58.09 cores=0-31
/proc/27664/task/27673/stat : 27673 (plingeling) R 27662 27664 27306 0 -1 4202560 42451 1248 0 0 5710 99 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=27664/tid=27674] ppid=27662 vsize=3812112 CPUtime=58.19 cores=0-31
/proc/27664/task/27674/stat : 27674 (plingeling) R 27662 27664 27306 0 -1 4202560 44143 1248 0 0 5716 103 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=27664/tid=27675] ppid=27662 vsize=3812112 CPUtime=58.73 cores=0-31
/proc/27664/task/27675/stat : 27675 (plingeling) R 27662 27664 27306 0 -1 4202560 46537 1248 0 0 5784 89 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=27664/tid=27676] ppid=27662 vsize=3812112 CPUtime=59.39 cores=0-31
/proc/27664/task/27676/stat : 27676 (plingeling) R 27662 27664 27306 0 -1 4202560 4740 1248 0 0 5934 5 0 0 25 0 33 0 678929103 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281907 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=27664/tid=27677] ppid=27662 vsize=3812112 CPUtime=59.34 cores=0-31
/proc/27664/task/27677/stat : 27677 (plingeling) R 27662 27664 27306 0 -1 4202560 46322 1248 0 0 5841 93 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27664/tid=27678] ppid=27662 vsize=3812112 CPUtime=59.06 cores=0-31
/proc/27664/task/27678/stat : 27678 (plingeling) R 27662 27664 27306 0 -1 4202560 40483 1248 0 0 5842 64 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27664/tid=27679] ppid=27662 vsize=3812112 CPUtime=59.07 cores=0-31
/proc/27664/task/27679/stat : 27679 (plingeling) R 27662 27664 27306 0 -1 4202560 44683 1248 0 0 5854 53 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353585 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=27664/tid=27680] ppid=27662 vsize=3812112 CPUtime=59.01 cores=0-31
/proc/27664/task/27680/stat : 27680 (plingeling) R 27662 27664 27306 0 -1 4202560 43687 1248 0 0 5833 68 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=27664/tid=27681] ppid=27662 vsize=3812112 CPUtime=57.82 cores=0-31
/proc/27664/task/27681/stat : 27681 (plingeling) R 27662 27664 27306 0 -1 4202560 42618 1248 0 0 5695 87 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27664/tid=27682] ppid=27662 vsize=3812112 CPUtime=58.26 cores=0-31
/proc/27664/task/27682/stat : 27682 (plingeling) R 27662 27664 27306 0 -1 4202560 39973 1248 0 0 5755 71 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=27664/tid=27683] ppid=27662 vsize=3812112 CPUtime=59.72 cores=0-31
/proc/27664/task/27683/stat : 27683 (plingeling) R 27662 27664 27306 0 -1 4202560 39661 1248 0 0 5908 64 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=27664/tid=27684] ppid=27662 vsize=3812112 CPUtime=59.35 cores=0-31
/proc/27664/task/27684/stat : 27684 (plingeling) R 27662 27664 27306 0 -1 4202560 42038 1248 0 0 5853 82 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27664/tid=27685] ppid=27662 vsize=3812112 CPUtime=58.43 cores=0-31
/proc/27664/task/27685/stat : 27685 (plingeling) R 27662 27664 27306 0 -1 4202560 45018 1248 0 0 5734 109 0 0 25 0 33 0 678929104 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27664/tid=27686] ppid=27662 vsize=3812112 CPUtime=59.05 cores=0-31
/proc/27664/task/27686/stat : 27686 (plingeling) R 27662 27664 27306 0 -1 4202560 45731 1248 0 0 5811 94 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=27664/tid=27687] ppid=27662 vsize=3812112 CPUtime=59.66 cores=0-31
/proc/27664/task/27687/stat : 27687 (plingeling) R 27662 27664 27306 0 -1 4202560 48995 1248 0 0 5879 87 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27664/tid=27688] ppid=27662 vsize=3812112 CPUtime=57.94 cores=0-31
/proc/27664/task/27688/stat : 27688 (plingeling) R 27662 27664 27306 0 -1 4202560 44404 1248 0 0 5691 103 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=27664/tid=27689] ppid=27662 vsize=3812112 CPUtime=59.15 cores=0-31
/proc/27664/task/27689/stat : 27689 (plingeling) R 27662 27664 27306 0 -1 4202560 43120 1248 0 0 5812 103 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 18446744073699065913 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=27664/tid=27690] ppid=27662 vsize=3812112 CPUtime=59.44 cores=0-31
/proc/27664/task/27690/stat : 27690 (plingeling) R 27662 27664 27306 0 -1 4202560 38894 1248 0 0 5885 59 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=27664/tid=27691] ppid=27662 vsize=3812112 CPUtime=59.84 cores=0-31
/proc/27664/task/27691/stat : 27691 (plingeling) R 27662 27664 27306 0 -1 4202560 45286 1248 0 0 5908 76 0 0 25 0 33 0 678929105 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=27664/tid=27692] ppid=27662 vsize=3812112 CPUtime=57.97 cores=0-31
/proc/27664/task/27692/stat : 27692 (plingeling) R 27662 27664 27306 0 -1 4202560 39144 1248 0 0 5705 92 0 0 25 0 33 0 678929106 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=27664/tid=27693] ppid=27662 vsize=3812112 CPUtime=59.76 cores=0-31
/proc/27664/task/27693/stat : 27693 (plingeling) R 27662 27664 27306 0 -1 4202560 38674 1248 0 0 5918 58 0 0 25 0 33 0 678929106 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4322039 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=27664/tid=27694] ppid=27662 vsize=3812112 CPUtime=59.12 cores=0-31
/proc/27664/task/27694/stat : 27694 (plingeling) R 27662 27664 27306 0 -1 4202560 47049 1248 0 0 5829 83 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281907 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=27664/tid=27695] ppid=27662 vsize=3812112 CPUtime=57.08 cores=0-31
/proc/27664/task/27695/stat : 27695 (plingeling) R 27662 27664 27306 0 -1 4202560 48278 1248 0 0 5637 71 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=27664/tid=27696] ppid=27662 vsize=3812112 CPUtime=58.61 cores=0-31
/proc/27664/task/27696/stat : 27696 (plingeling) R 27662 27664 27306 0 -1 4202560 40671 1248 0 0 5797 64 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281996 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=27664/tid=27697] ppid=27662 vsize=3812112 CPUtime=59.43 cores=0-31
/proc/27664/task/27697/stat : 27697 (plingeling) R 27662 27664 27306 0 -1 4202560 38892 1248 0 0 5879 64 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27664/tid=27698] ppid=27662 vsize=3812112 CPUtime=58.64 cores=0-31
/proc/27664/task/27698/stat : 27698 (plingeling) R 27662 27664 27306 0 -1 4202560 44236 1248 0 0 5760 104 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27664/tid=27699] ppid=27662 vsize=3812112 CPUtime=59.15 cores=0-31
/proc/27664/task/27699/stat : 27699 (plingeling) R 27662 27664 27306 0 -1 4202560 27876 1248 0 0 5871 44 0 0 25 0 33 0 678929107 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=27664/tid=27700] ppid=27662 vsize=3812112 CPUtime=58.55 cores=0-31
/proc/27664/task/27700/stat : 27700 (plingeling) R 27662 27664 27306 0 -1 4202560 42789 1248 0 0 5753 102 0 0 25 0 33 0 678929108 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=27664/tid=27701] ppid=27662 vsize=3812112 CPUtime=59.57 cores=0-31
/proc/27664/task/27701/stat : 27701 (plingeling) R 27662 27664 27306 0 -1 4202560 46865 1248 0 0 5899 58 0 0 25 0 33 0 678929108 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=27664/tid=27702] ppid=27662 vsize=3812112 CPUtime=58.43 cores=0-31
/proc/27664/task/27702/stat : 27702 (plingeling) R 27662 27664 27306 0 -1 4202560 42043 1248 0 0 5750 93 0 0 25 0 33 0 678929112 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=27664/tid=27703] ppid=27662 vsize=3812112 CPUtime=58.91 cores=0-31
/proc/27664/task/27703/stat : 27703 (plingeling) R 27662 27664 27306 0 -1 4202560 45594 1248 0 0 5794 97 0 0 25 0 33 0 678929113 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4358748 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=27664/tid=27704] ppid=27662 vsize=3812112 CPUtime=57.84 cores=0-31
/proc/27664/task/27704/stat : 27704 (plingeling) R 27662 27664 27306 0 -1 4202560 45111 1248 0 0 5691 93 0 0 25 0 33 0 678929113 3903602688 799612 268435456000 4194304 4417452 140735899762384 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 27 0 0 0
Current children cumulated CPU time (s) 1947.64
Current children cumulated vsize (KiB) 3812112

[startup+127.401 s]
/proc/loadavg: 22.38 15.99 19.87 33/446 27706
/proc/meminfo: memFree=252220276/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=2298908 CPUtime=1950.6 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 2077967 1248 0 0 192348 2712 0 0 17 0 1 0 678922628 2354081792 488475 268435456000 4194304 4417452 140735899762384 18446744073709551615 258650999159 0 0 4096 0 0 0 0 17 30 0 0 0
/proc/27664/statm: 574727 487963 176 55 0 572613 0
Current children cumulated CPU time (s) 1950.6
Current children cumulated vsize (KiB) 2298908

[startup+127.501 s]
/proc/loadavg: 22.38 15.99 19.87 33/446 27706
/proc/meminfo: memFree=252220276/264257624 swapFree=67111528/67111528
[pid=27664] ppid=27662 vsize=1111488 CPUtime=1950.7 cores=0-31
/proc/27664/stat : 27664 (plingeling) R 27662 27664 27306 0 -1 4202496 2077967 1248 0 0 192348 2722 0 0 17 0 1 0 678922628 1138163712 154793 268435456000 4194304 4417452 140735899762384 18446744073709551615 258650999159 0 0 4096 0 0 0 0 17 30 0 0 0
/proc/27664/statm: 277872 154441 176 55 0 275758 0
Current children cumulated CPU time (s) 1950.7
Current children cumulated vsize (KiB) 1111488

Child status: 20
Real time (s): 127.562
CPU time (s): 1950.78
CPU user time (s): 1923.49
CPU system time (s): 27.2919
CPU usage (%): 1529.27
Max. virtual memory (cumulated for all children) (KiB): 5216032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1923.49
system time used= 27.2919
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2079219
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6709
involuntary context switches= 4684

runsolver used 0.904862 second user time and 2.93255 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-18 01:19:22
IDJOB=3372519
IDBENCH=82430
IDSOLVER=1852
FILE ID=node200/3372519-1305674357
RUNJOBID= node200-1305673932-27320
PBS_JOBID= 13357374
Free space on /tmp= 61960 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/jarvisalo/AAAI2010-SATPlanning/aaai10-planning-ipc5-pipesworld-27-step13.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372519-1305674357/watcher-3372519-1305674357 -o /tmp/evaluation-result-3372519-1305674357/solver-3372519-1305674357 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372519-1305674357.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 52e16341bcff805ef2d6abe4e95359a0
RANDOM SEED=369028707

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255416840 kB
Buffers:        450992 kB
Cached:        7976948 kB
SwapCached:          0 kB
Active:        7492456 kB
Inactive:      1004740 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255416840 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           93804 kB
Writeback:           0 kB
AnonPages:       69604 kB
Mapped:          14536 kB
Slab:           253428 kB
PageTables:       4444 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   163468 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61960 MiB
End job on node200 at 2011-05-18 01:21:30