Trace number 3347383

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 160003 5009.84

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf
MD5SUM732b9c9b0d44d6a9e75489b2f5004165
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark50676.1
Satisfiable
(Un)Satisfiability was proved
Number of variables95456
Number of clauses477186
Sum of the clauses size1137161
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2470925
Number of clauses of size 31500
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54550

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347383-1305115211/watcher-3347383-1305115211 -o /tmp/evaluation-result-3347383-1305115211/solver-3347383-1305115211 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347383-1305115211.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.45 31.49 31.85 1/413 8796
/proc/meminfo: memFree=256037280/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 23 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0

[startup+0.0476299 s]
/proc/loadavg: 29.45 31.49 31.85 1/413 8796
/proc/meminfo: memFree=256037280/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 23 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100616 s]
/proc/loadavg: 29.45 31.49 31.85 1/413 8796
/proc/meminfo: memFree=256037280/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 23 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300616 s]
/proc/loadavg: 29.45 31.49 31.85 1/413 8796
/proc/meminfo: memFree=256037280/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 22 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700634 s]
/proc/loadavg: 29.45 31.49 31.85 1/413 8796
/proc/meminfo: memFree=256037280/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 22 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50065 s]
/proc/loadavg: 27.49 31.05 31.70 6/419 8807
/proc/meminfo: memFree=255819084/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 16 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
[pid=8797] ppid=8796 vsize=70852 CPUtime=1.48 cores=0
/proc/8797/stat : 8797 (cryptominisat) R 8796 8796 8770 0 -1 4202496 11608 0 0 0 146 2 0 0 25 0 1 0 623007580 72552448 11392 268435456000 4194304 4587354 140736918010192 18446744073709551615 4421058 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8797/statm: 17713 11392 310 96 0 14275 0
[pid=8798] ppid=8796 vsize=44892 CPUtime=1.48 cores=1
/proc/8798/stat : 8798 (clasp) R 8796 8796 8770 0 -1 4202496 12019 0 0 0 144 4 0 0 20 0 1 0 623007580 45969408 8410 268435456000 4194304 4785740 140733939421552 18446744073709551615 4287092 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8798/statm: 11223 8410 338 145 0 8268 0
[pid=8799] ppid=8796 vsize=478664 CPUtime=1.48 cores=2
/proc/8799/stat : 8799 (TNM) R 8796 8796 8770 0 -1 4202496 10010 0 0 0 145 3 0 0 20 0 1 0 623007580 490151936 9907 268435456000 134512640 134534564 4289121824 18446744073709551615 134527201 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8799/statm: 119666 9914 92 6 0 118331 0
[pid=8800] ppid=8796 vsize=67452 CPUtime=1.49 cores=3
/proc/8800/stat : 8800 (march_hi) R 8796 8796 8770 0 -1 4194304 25559 0 0 0 142 7 0 0 20 0 1 0 623007580 69070848 10764 268435456000 4194304 4331988 140735827932096 18446744073709551615 258650611706 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8800/statm: 16863 10764 127 34 0 15305 0
[pid=8801] ppid=8796 vsize=99788 CPUtime=1.48 cores=4-31
/proc/8801/stat : 8801 (plingeling) R 8796 8796 8770 0 -1 4202496 23707 1240 0 0 141 7 0 0 21 0 1 0 623007580 102182912 23590 268435456000 4194304 4356188 140735240914224 18446744073709551615 4210587 0 0 4096 17442 0 0 0 17 9 0 0 0
/proc/8801/statm: 24947 23590 129 40 0 23491 0
Current children cumulated CPU time (s) 7.41
Current children cumulated vsize (KiB) 779972

[startup+3.10072 s]
/proc/loadavg: 27.49 31.05 31.70 6/419 8807
/proc/meminfo: memFree=255694532/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 16 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
[pid=8797] ppid=8796 vsize=70852 CPUtime=3.08 cores=0
/proc/8797/stat : 8797 (cryptominisat) R 8796 8796 8770 0 -1 4202496 11614 0 0 0 306 2 0 0 25 0 1 0 623007580 72552448 11398 268435456000 4194304 4587354 140736918010192 18446744073709551615 4367364 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8797/statm: 17713 11398 310 96 0 14275 0
[pid=8798] ppid=8796 vsize=62540 CPUtime=3.08 cores=1
/proc/8798/stat : 8798 (clasp) R 8796 8796 8770 0 -1 4202496 16428 0 0 0 303 5 0 0 25 0 1 0 623007580 64040960 12819 268435456000 4194304 4785740 140733939421552 18446744073709551615 4279309 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8798/statm: 15635 12819 338 145 0 12680 0
[pid=8799] ppid=8796 vsize=488696 CPUtime=3.08 cores=2
/proc/8799/stat : 8799 (TNM) R 8796 8796 8770 0 -1 4202496 15173 0 0 0 304 4 0 0 25 0 1 0 623007580 500424704 15070 268435456000 134512640 134534564 4289121824 18446744073709551615 134528288 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8799/statm: 122174 15070 95 6 0 120839 0
[pid=8800] ppid=8796 vsize=72520 CPUtime=3.08 cores=3
/proc/8800/stat : 8800 (march_hi) R 8796 8796 8770 0 -1 4194304 53365 0 0 0 295 13 0 0 25 0 1 0 623007580 74260480 12010 268435456000 4194304 4331988 140735827932096 18446744073709551615 258650613552 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8800/statm: 18130 12010 127 34 0 16572 0
[pid=8801] ppid=8796 vsize=296860 CPUtime=3.07 cores=4-31
/proc/8801/stat : 8801 (plingeling) R 8796 8796 8770 0 -1 4202496 73039 1240 0 0 291 16 0 0 25 0 1 0 623007580 303984640 72874 268435456000 4194304 4356188 140735240914224 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 9 0 0 0
/proc/8801/statm: 74215 72874 129 40 0 72759 0
Current children cumulated CPU time (s) 15.39
Current children cumulated vsize (KiB) 1009792

[startup+6.30177 s]
/proc/loadavg: 27.49 31.05 31.70 34/447 8835
/proc/meminfo: memFree=255486296/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 16 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
[pid=8797] ppid=8796 vsize=81756 CPUtime=6.28 cores=0
/proc/8797/stat : 8797 (cryptominisat) R 8796 8796 8770 0 -1 4202496 19882 0 0 0 624 4 0 0 25 0 1 0 623007580 83718144 14653 268435456000 4194304 4587354 140736918010192 18446744073709551615 258650652667 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8797/statm: 20439 14653 328 96 0 17001 0
[pid=8798] ppid=8796 vsize=97924 CPUtime=6.29 cores=1
/proc/8798/stat : 8798 (clasp) R 8796 8796 8770 0 -1 4202496 25237 0 0 0 621 8 0 0 25 0 1 0 623007580 100274176 21628 268435456000 4194304 4785740 140733939421552 18446744073709551615 4287129 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8798/statm: 24481 21628 338 145 0 21526 0
[pid=8799] ppid=8796 vsize=488696 CPUtime=6.28 cores=2
/proc/8799/stat : 8799 (TNM) R 8796 8796 8770 0 -1 4202496 15173 0 0 0 624 4 0 0 25 0 1 0 623007580 500424704 15070 268435456000 134512640 134534564 4289121824 18446744073709551615 134528600 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8799/statm: 122174 15070 95 6 0 120839 0
[pid=8800] ppid=8796 vsize=67208 CPUtime=6.28 cores=3
/proc/8800/stat : 8800 (march_hi) R 8796 8796 8770 0 -1 4194304 90476 0 0 0 606 22 0 0 25 0 1 0 623007580 68820992 10703 268435456000 4194304 4331988 140735827932096 18446744073709551615 258650614482 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8800/statm: 16802 10703 127 34 0 15244 0
[pid=8801] ppid=8796 vsize=884596 CPUtime=52.76 cores=4-31
/proc/8801/stat : 8801 (plingeling) S 8796 8796 8770 0 -1 4202496 160736 1240 0 0 5234 42 0 0 18 0 29 0 623007580 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0
/proc/8801/statm: 221149 80457 155 40 0 219693 0
[pid=8801/tid=8808] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8808/stat : 8808 (plingeling) R 8796 8796 8770 0 -1 4202560 1156 1240 0 0 173 0 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322024 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8801/tid=8809] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8809/stat : 8809 (plingeling) R 8796 8796 8770 0 -1 4202560 1169 1240 0 0 173 0 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4321927 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=8801/tid=8810] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8810/stat : 8810 (plingeling) R 8796 8796 8770 0 -1 4202560 1985 1240 0 0 173 0 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322106 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8801/tid=8811] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8811/stat : 8811 (plingeling) R 8796 8796 8770 0 -1 4202560 3233 1240 0 0 172 1 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=8801/tid=8812] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8812/stat : 8812 (plingeling) R 8796 8796 8770 0 -1 4202560 2857 1240 0 0 172 1 0 0 18 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4321839 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=8801/tid=8813] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8813/stat : 8813 (plingeling) R 8796 8796 8770 0 -1 4202560 3358 1240 0 0 171 0 0 0 24 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4286893 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=8801/tid=8814] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8814/stat : 8814 (plingeling) R 8796 8796 8770 0 -1 4202560 1879 1240 0 0 170 1 0 0 23 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322169 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=8801/tid=8815] ppid=8796 vsize=884596 CPUtime=1.72 cores=4-31
/proc/8801/task/8815/stat : 8815 (plingeling) R 8796 8796 8770 0 -1 4202560 1677 1240 0 0 172 0 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322106 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=8801/tid=8816] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8816/stat : 8816 (plingeling) R 8796 8796 8770 0 -1 4202560 2482 1240 0 0 173 0 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8801/tid=8817] ppid=8796 vsize=884596 CPUtime=1.72 cores=4-31
/proc/8801/task/8817/stat : 8817 (plingeling) R 8796 8796 8770 0 -1 4202560 4198 1240 0 0 171 1 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4286898 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=8801/tid=8818] ppid=8796 vsize=884596 CPUtime=1.73 cores=4-31
/proc/8801/task/8818/stat : 8818 (plingeling) R 8796 8796 8770 0 -1 4202560 4258 1240 0 0 172 1 0 0 20 0 29 0 623008034 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322106 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=8801/tid=8819] ppid=8796 vsize=884596 CPUtime=1.72 cores=4-31
/proc/8801/task/8819/stat : 8819 (plingeling) R 8796 8796 8770 0 -1 4202560 946 1240 0 0 172 0 0 0 20 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=8801/tid=8820] ppid=8796 vsize=884596 CPUtime=1.72 cores=4-31
/proc/8801/task/8820/stat : 8820 (plingeling) R 8796 8796 8770 0 -1 4202560 3971 1240 0 0 171 1 0 0 20 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4248450 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=8801/tid=8821] ppid=8796 vsize=884596 CPUtime=1.72 cores=4-31
/proc/8801/task/8821/stat : 8821 (plingeling) R 8796 8796 8770 0 -1 4202560 4429 1240 0 0 171 1 0 0 20 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4286843 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=8801/tid=8822] ppid=8796 vsize=884596 CPUtime=1.72 cores=4-31
/proc/8801/task/8822/stat : 8822 (plingeling) R 8796 8796 8770 0 -1 4202560 4331 1240 0 0 171 1 0 0 18 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4286843 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8801/tid=8823] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8823/stat : 8823 (plingeling) R 8796 8796 8770 0 -1 4202560 3996 1240 0 0 171 0 0 0 18 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4286843 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=8801/tid=8824] ppid=8796 vsize=884596 CPUtime=1.7 cores=4-31
/proc/8801/task/8824/stat : 8824 (plingeling) R 8796 8796 8770 0 -1 4202560 3575 1240 0 0 170 0 0 0 20 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322079 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=8801/tid=8825] ppid=8796 vsize=884596 CPUtime=1.7 cores=4-31
/proc/8801/task/8825/stat : 8825 (plingeling) R 8796 8796 8770 0 -1 4202560 131 1240 0 0 170 0 0 0 25 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4321560 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=8801/tid=8826] ppid=8796 vsize=884596 CPUtime=1.7 cores=4-31
/proc/8801/task/8826/stat : 8826 (plingeling) R 8796 8796 8770 0 -1 4202560 2227 1240 0 0 170 0 0 0 25 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4321571 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=8801/tid=8827] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8827/stat : 8827 (plingeling) R 8796 8796 8770 0 -1 4202560 1769 1240 0 0 171 0 0 0 20 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=8801/tid=8828] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8828/stat : 8828 (plingeling) R 8796 8796 8770 0 -1 4202560 2972 1240 0 0 170 1 0 0 25 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4321585 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=8801/tid=8829] ppid=8796 vsize=884596 CPUtime=1.65 cores=4-31
/proc/8801/task/8829/stat : 8829 (plingeling) R 8796 8796 8770 0 -1 4202560 66 1240 0 0 165 0 0 0 25 0 29 0 623008035 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=8801/tid=8830] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8830/stat : 8830 (plingeling) R 8796 8796 8770 0 -1 4202560 2124 1240 0 0 171 0 0 0 25 0 29 0 623008036 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322121 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=8801/tid=8831] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8831/stat : 8831 (plingeling) R 8796 8796 8770 0 -1 4202560 2922 1240 0 0 171 0 0 0 20 0 29 0 623008036 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322032 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=8801/tid=8832] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8832/stat : 8832 (plingeling) R 8796 8796 8770 0 -1 4202560 2049 1240 0 0 171 0 0 0 20 0 29 0 623008036 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322079 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=8801/tid=8833] ppid=8796 vsize=884596 CPUtime=1.7 cores=4-31
/proc/8801/task/8833/stat : 8833 (plingeling) R 8796 8796 8770 0 -1 4202560 3388 1240 0 0 170 0 0 0 25 0 29 0 623008036 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322071 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=8801/tid=8834] ppid=8796 vsize=884596 CPUtime=1.71 cores=4-31
/proc/8801/task/8834/stat : 8834 (plingeling) R 8796 8796 8770 0 -1 4202560 2625 1240 0 0 171 0 0 0 20 0 29 0 623008036 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4322208 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=8801/tid=8835] ppid=8796 vsize=884596 CPUtime=1.7 cores=4-31
/proc/8801/task/8835/stat : 8835 (plingeling) R 8796 8796 8770 0 -1 4202560 1691 1240 0 0 170 0 0 0 24 0 29 0 623008036 905826304 80457 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281771 0 0 4096 17442 0 0 0 -1 10 0 0 0
Current children cumulated CPU time (s) 77.89
Current children cumulated vsize (KiB) 1638504

[startup+12.702 s]
/proc/loadavg: 28.19 31.08 31.70 33/447 8837
/proc/meminfo: memFree=255076324/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 0 0 0 0 15 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 20 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
[pid=8797] ppid=8796 vsize=119260 CPUtime=12.68 cores=0
/proc/8797/stat : 8797 (cryptominisat) R 8796 8796 8770 0 -1 4202496 21814 0 0 0 1263 5 0 0 25 0 1 0 623007580 122122240 16584 268435456000 4194304 4587354 140736918010192 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=8799] ppid=8796 vsize=488696 CPUtime=4961.35 cores=2
/proc/8799/stat : 8799 (TNM) R 8796 8796 8770 0 -1 4202496 15173 0 0 0 496131 4 0 0 25 0 1 0 623007580 500424704 15070 268435456000 134512640 134534564 4289121824 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8799/statm: 122174 15070 95 6 0 120839 0
[pid=8800] ppid=8796 vsize=324296 CPUtime=4961.31 cores=3
/proc/8800/stat : 8800 (march_hi) R 8796 8796 8770 0 -1 4202496 160489 0 0 0 496075 56 0 0 25 0 1 0 623007580 332079104 41599 268435456000 4194304 4331988 140735827932096 18446744073709551615 4263156 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8800/statm: 81074 41599 174 34 0 79516 0
[pid=8801] ppid=8796 vsize=5509280 CPUtime=138639 cores=4-31
/proc/8801/stat : 8801 (plingeling) S 8796 8796 8770 0 -1 4202496 24286415 1240 0 0 13852566 11337 0 0 18 0 29 0 623007580 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0
/proc/8801/statm: 1377320 1227612 159 40 0 1375864 0
[pid=8801/tid=8808] ppid=8796 vsize=5509280 CPUtime=4956.34 cores=4-31
/proc/8801/task/8808/stat : 8808 (plingeling) R 8796 8796 8770 0 -1 4202560 788017 1240 0 0 495312 322 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=8801/tid=8809] ppid=8796 vsize=5509280 CPUtime=4939.65 cores=4-31
/proc/8801/task/8809/stat : 8809 (plingeling) R 8796 8796 8770 0 -1 4202560 883730 1240 0 0 493590 375 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4284253 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=8801/tid=8810] ppid=8796 vsize=5509280 CPUtime=4956.44 cores=4-31
/proc/8801/task/8810/stat : 8810 (plingeling) R 8796 8796 8770 0 -1 4202560 881427 1240 0 0 495219 425 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8801/tid=8811] ppid=8796 vsize=5509280 CPUtime=4956.19 cores=4-31
/proc/8801/task/8811/stat : 8811 (plingeling) R 8796 8796 8770 0 -1 4202560 1162650 1240 0 0 495114 505 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4233996 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=8801/tid=8812] ppid=8796 vsize=5509280 CPUtime=4955.56 cores=4-31
/proc/8801/task/8812/stat : 8812 (plingeling) R 8796 8796 8770 0 -1 4202560 825828 1240 0 0 495187 369 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4273866 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=8801/tid=8813] ppid=8796 vsize=5509280 CPUtime=4956.66 cores=4-31
/proc/8801/task/8813/stat : 8813 (plingeling) R 8796 8796 8770 0 -1 4202560 712074 1240 0 0 495358 308 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=8801/tid=8814] ppid=8796 vsize=5509280 CPUtime=4956.33 cores=4-31
/proc/8801/task/8814/stat : 8814 (plingeling) R 8796 8796 8770 0 -1 4202560 799226 1240 0 0 495231 402 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4298515 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=8801/tid=8815] ppid=8796 vsize=5509280 CPUtime=4948.62 cores=4-31
/proc/8801/task/8815/stat : 8815 (plingeling) R 8796 8796 8770 0 -1 4202560 561603 1240 0 0 494264 598 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=8801/tid=8816] ppid=8796 vsize=5509280 CPUtime=4920.33 cores=4-31
/proc/8801/task/8816/stat : 8816 (plingeling) R 8796 8796 8770 0 -1 4202560 1025372 1240 0 0 491541 492 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4210567 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8801/tid=8817] ppid=8796 vsize=5509280 CPUtime=4956.09 cores=4-31
/proc/8801/task/8817/stat : 8817 (plingeling) R 8796 8796 8770 0 -1 4202560 873527 1240 0 0 495253 356 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4279765 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=8801/tid=8818] ppid=8796 vsize=5509280 CPUtime=4937.02 cores=4-31
/proc/8801/task/8818/stat : 8818 (plingeling) R 8796 8796 8770 0 -1 4202560 935935 1240 0 0 493365 337 0 0 25 0 29 0 623008034 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=8801/tid=8819] ppid=8796 vsize=5509280 CPUtime=4956.45 cores=4-31
/proc/8801/task/8819/stat : 8819 (plingeling) R 8796 8796 8770 0 -1 4202560 915997 1240 0 0 495252 393 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331079 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=8801/tid=8820] ppid=8796 vsize=5509280 CPUtime=4956.56 cores=4-31
/proc/8801/task/8820/stat : 8820 (plingeling) R 8796 8796 8770 0 -1 4202560 964905 1240 0 0 495253 403 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281690 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=8801/tid=8821] ppid=8796 vsize=5509280 CPUtime=4956.5 cores=4-31
/proc/8801/task/8821/stat : 8821 (plingeling) R 8796 8796 8770 0 -1 4202560 1019739 1240 0 0 495253 397 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=8801/tid=8822] ppid=8796 vsize=5509280 CPUtime=4956.28 cores=4-31
/proc/8801/task/8822/stat : 8822 (plingeling) R 8796 8796 8770 0 -1 4202560 1153599 1240 0 0 495165 463 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8801/tid=8823] ppid=8796 vsize=5509280 CPUtime=4956.54 cores=4-31
/proc/8801/task/8823/stat : 8823 (plingeling) R 8796 8796 8770 0 -1 4202560 524434 1240 0 0 495197 457 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=8801/tid=8824] ppid=8796 vsize=5509280 CPUtime=4956.02 cores=4-31
/proc/8801/task/8824/stat : 8824 (plingeling) R 8796 8796 8770 0 -1 4202560 799797 1240 0 0 495272 330 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=8801/tid=8825] ppid=8796 vsize=5509280 CPUtime=4950.34 cores=4-31
/proc/8801/task/8825/stat : 8825 (plingeling) R 8796 8796 8770 0 -1 4202560 733650 1240 0 0 494751 283 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281681 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=8801/tid=8826] ppid=8796 vsize=5509280 CPUtime=4956.35 cores=4-31
/proc/8801/task/8826/stat : 8826 (plingeling) R 8796 8796 8770 0 -1 4202560 1061790 1240 0 0 495158 477 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=8801/tid=8827] ppid=8796 vsize=5509280 CPUtime=4951.62 cores=4-31
/proc/8801/task/8827/stat : 8827 (plingeling) R 8796 8796 8770 0 -1 4202560 921773 1240 0 0 494808 354 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4284205 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=8801/tid=8828] ppid=8796 vsize=5509280 CPUtime=4956.66 cores=4-31
/proc/8801/task/8828/stat : 8828 (plingeling) R 8796 8796 8770 0 -1 4202560 592960 1240 0 0 495403 263 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=8801/tid=8829] ppid=8796 vsize=5509280 CPUtime=4952.31 cores=4-31
/proc/8801/task/8829/stat : 8829 (plingeling) R 8796 8796 8770 0 -1 4202560 950135 1240 0 0 494794 437 0 0 25 0 29 0 623008035 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8801/tid=8830] ppid=8796 vsize=5509280 CPUtime=4956.5 cores=4-31
/proc/8801/task/8830/stat : 8830 (plingeling) R 8796 8796 8770 0 -1 4202560 927949 1240 0 0 495325 325 0 0 25 0 29 0 623008036 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=8801/tid=8831] ppid=8796 vsize=5509280 CPUtime=4955.98 cores=4-31
/proc/8801/task/8831/stat : 8831 (plingeling) R 8796 8796 8770 0 -1 4202560 569879 1240 0 0 494989 609 0 0 25 0 29 0 623008036 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=8801/tid=8832] ppid=8796 vsize=5509280 CPUtime=4954.53 cores=4-31
/proc/8801/task/8832/stat : 8832 (plingeling) R 8796 8796 8770 0 -1 4202560 763044 1240 0 0 495080 373 0 0 25 0 29 0 623008036 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4332309 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=8801/tid=8833] ppid=8796 vsize=5509280 CPUtime=4945.36 cores=4-31
/proc/8801/task/8833/stat : 8833 (plingeling) R 8796 8796 8770 0 -1 4202560 797356 1240 0 0 494170 366 0 0 25 0 29 0 623008036 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331259 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=8801/tid=8834] ppid=8796 vsize=5509280 CPUtime=4956.2 cores=4-31
/proc/8801/task/8834/stat : 8834 (plingeling) R 8796 8796 8770 0 -1 4202560 1064474 1240 0 0 495137 483 0 0 25 0 29 0 623008036 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331245 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=8801/tid=8835] ppid=8796 vsize=5509280 CPUtime=4920.82 cores=4-31
/proc/8801/task/8835/stat : 8835 (plingeling) R 8796 8796 8770 0 -1 4202560 986273 1240 0 0 491681 401 0 0 25 0 29 0 623008036 5641502720 1227612 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 31 0 0 0
Current children cumulated CPU time (s) 158484
Current children cumulated vsize (KiB) 8817364



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.8 s]
/proc/loadavg: 32.09 32.06 32.03 33/447 8992
/proc/meminfo: memFree=248946964/264257624 swapFree=67111528/67111528
[pid=8796] ppid=8794 vsize=18324 CPUtime=0.06 cores=0-31
/proc/8796/stat : 8796 (ppfolio) S 8794 8796 8770 0 -1 4202496 515 0 0 0 1 5 0 0 15 0 1 0 623007580 18763776 386 268435456000 4194304 4287625 140737206097440 18446744073709551615 258650975999 0 0 4096 65536 9207012132762157055 0 0 17 0 0 0 0
/proc/8796/statm: 4581 386 337 23 0 91 0
[pid=8797] ppid=8796 vsize=901140 CPUtime=5008.81 cores=0
/proc/8797/stat : 8797 (cryptominisat) R 8796 8796 8770 0 -1 4202496 1326492 0 0 0 500281 600 0 0 25 0 1 0 623007580 922767360 83180 268435456000 4194304 4587354 140736918010192 18446744073709551615 4239208 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8797/statm: 225285 83180 338 96 0 221847 0
[pid=8798] ppid=8796 vsize=1575628 CPUtime=5008.83 cores=1
/proc/8798/stat : 8798 (clasp) R 8796 8796 8770 0 -1 4202496 393603 0 0 0 500754 129 0 0 25 0 1 0 623007580 1613443072 389994 268435456000 4194304 4785740 140733939421552 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8798/statm: 393907 389994 338 145 0 390952 0
[pid=8799] ppid=8796 vsize=488696 CPUtime=5008.86 cores=2
/proc/8799/stat : 8799 (TNM) R 8796 8796 8770 0 -1 4202496 15173 0 0 0 500882 4 0 0 25 0 1 0 623007580 500424704 15070 268435456000 134512640 134534564 4289121824 18446744073709551615 134525994 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8799/statm: 122174 15070 95 6 0 120839 0
[pid=8800] ppid=8796 vsize=324296 CPUtime=5008.82 cores=3
/proc/8800/stat : 8800 (march_hi) R 8796 8796 8770 0 -1 4202496 160597 0 0 0 500826 56 0 0 25 0 1 0 623007580 332079104 41707 268435456000 4194304 4331988 140735827932096 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8800/statm: 81074 41707 174 34 0 79516 0
[pid=8801] ppid=8796 vsize=5558424 CPUtime=139968 cores=4-31
/proc/8801/stat : 8801 (plingeling) S 8796 8796 8770 0 -1 4202496 24497428 1240 0 0 13985344 11438 0 0 18 0 29 0 623007580 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0
/proc/8801/statm: 1389606 1239898 159 40 0 1388150 0
[pid=8801/tid=8808] ppid=8796 vsize=5558424 CPUtime=5003.85 cores=4-31
/proc/8801/task/8808/stat : 8808 (plingeling) R 8796 8796 8770 0 -1 4202560 792113 1240 0 0 500063 322 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4210567 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=8801/tid=8809] ppid=8796 vsize=5558424 CPUtime=4987.17 cores=4-31
/proc/8801/task/8809/stat : 8809 (plingeling) R 8796 8796 8770 0 -1 4202560 889874 1240 0 0 498336 381 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=8801/tid=8810] ppid=8796 vsize=5558424 CPUtime=5003.95 cores=4-31
/proc/8801/task/8810/stat : 8810 (plingeling) R 8796 8796 8770 0 -1 4202560 890643 1240 0 0 499968 427 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4332067 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8801/tid=8811] ppid=8796 vsize=5558424 CPUtime=5003.7 cores=4-31
/proc/8801/task/8811/stat : 8811 (plingeling) R 8796 8796 8770 0 -1 4202560 1162650 1240 0 0 499865 505 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=8801/tid=8812] ppid=8796 vsize=5558424 CPUtime=5003.07 cores=4-31
/proc/8801/task/8812/stat : 8812 (plingeling) R 8796 8796 8770 0 -1 4202560 841188 1240 0 0 499926 381 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=8801/tid=8813] ppid=8796 vsize=5558424 CPUtime=5004.17 cores=4-31
/proc/8801/task/8813/stat : 8813 (plingeling) R 8796 8796 8770 0 -1 4202560 720266 1240 0 0 500107 310 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4237079 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=8801/tid=8814] ppid=8796 vsize=5558424 CPUtime=5003.85 cores=4-31
/proc/8801/task/8814/stat : 8814 (plingeling) R 8796 8796 8770 0 -1 4202560 804346 1240 0 0 499981 404 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4242660 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=8801/tid=8815] ppid=8796 vsize=5558424 CPUtime=4996.13 cores=4-31
/proc/8801/task/8815/stat : 8815 (plingeling) R 8796 8796 8770 0 -1 4202560 565699 1240 0 0 499014 599 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4238339 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=8801/tid=8816] ppid=8796 vsize=5558424 CPUtime=4967.84 cores=4-31
/proc/8801/task/8816/stat : 8816 (plingeling) R 8796 8796 8770 0 -1 4202560 1031516 1240 0 0 496282 502 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8801/tid=8817] ppid=8796 vsize=5558424 CPUtime=5003.61 cores=4-31
/proc/8801/task/8817/stat : 8817 (plingeling) R 8796 8796 8770 0 -1 4202560 881719 1240 0 0 500002 359 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4284182 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=8801/tid=8818] ppid=8796 vsize=5558424 CPUtime=4984.52 cores=4-31
/proc/8801/task/8818/stat : 8818 (plingeling) R 8796 8796 8770 0 -1 4202560 947199 1240 0 0 498113 339 0 0 25 0 29 0 623008034 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=8801/tid=8819] ppid=8796 vsize=5558424 CPUtime=5003.96 cores=4-31
/proc/8801/task/8819/stat : 8819 (plingeling) R 8796 8796 8770 0 -1 4202560 915997 1240 0 0 500002 394 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=8801/tid=8820] ppid=8796 vsize=5558424 CPUtime=5004.07 cores=4-31
/proc/8801/task/8820/stat : 8820 (plingeling) R 8796 8796 8770 0 -1 4202560 977193 1240 0 0 499992 415 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=8801/tid=8821] ppid=8796 vsize=5558424 CPUtime=5004 cores=4-31
/proc/8801/task/8821/stat : 8821 (plingeling) R 8796 8796 8770 0 -1 4202560 1035099 1240 0 0 500000 400 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4279717 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=8801/tid=8822] ppid=8796 vsize=5558424 CPUtime=5003.79 cores=4-31
/proc/8801/task/8822/stat : 8822 (plingeling) R 8796 8796 8770 0 -1 4202560 1166911 1240 0 0 499914 465 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4233948 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8801/tid=8823] ppid=8796 vsize=5558424 CPUtime=5004.05 cores=4-31
/proc/8801/task/8823/stat : 8823 (plingeling) R 8796 8796 8770 0 -1 4202560 524434 1240 0 0 499948 457 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=8801/tid=8824] ppid=8796 vsize=5558424 CPUtime=5003.52 cores=4-31
/proc/8801/task/8824/stat : 8824 (plingeling) R 8796 8796 8770 0 -1 4202560 803893 1240 0 0 500012 340 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=8801/tid=8825] ppid=8796 vsize=5558424 CPUtime=4997.85 cores=4-31
/proc/8801/task/8825/stat : 8825 (plingeling) R 8796 8796 8770 0 -1 4202560 739829 1240 0 0 499501 284 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=8801/tid=8826] ppid=8796 vsize=5558424 CPUtime=5003.76 cores=4-31
/proc/8801/task/8826/stat : 8826 (plingeling) R 8796 8796 8770 0 -1 4202560 1063838 1240 0 0 499899 477 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=8801/tid=8827] ppid=8796 vsize=5558424 CPUtime=4999.14 cores=4-31
/proc/8801/task/8827/stat : 8827 (plingeling) R 8796 8796 8770 0 -1 4202560 925869 1240 0 0 499558 356 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=8801/tid=8828] ppid=8796 vsize=5558424 CPUtime=5004.18 cores=4-31
/proc/8801/task/8828/stat : 8828 (plingeling) R 8796 8796 8770 0 -1 4202560 604224 1240 0 0 500148 270 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331126 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=8801/tid=8829] ppid=8796 vsize=5558424 CPUtime=4999.82 cores=4-31
/proc/8801/task/8829/stat : 8829 (plingeling) R 8796 8796 8770 0 -1 4202560 960375 1240 0 0 499543 439 0 0 25 0 29 0 623008035 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4284190 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8801/tid=8830] ppid=8796 vsize=5558424 CPUtime=5003.97 cores=4-31
/proc/8801/task/8830/stat : 8830 (plingeling) R 8796 8796 8770 0 -1 4202560 940237 1240 0 0 500069 328 0 0 25 0 29 0 623008036 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=8801/tid=8831] ppid=8796 vsize=5558424 CPUtime=5003.49 cores=4-31
/proc/8801/task/8831/stat : 8831 (plingeling) R 8796 8796 8770 0 -1 4202560 590359 1240 0 0 499727 622 0 0 25 0 29 0 623008036 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=8801/tid=8832] ppid=8796 vsize=5558424 CPUtime=5002.02 cores=4-31
/proc/8801/task/8832/stat : 8832 (plingeling) R 8796 8796 8770 0 -1 4202560 765092 1240 0 0 499829 373 0 0 25 0 29 0 623008036 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=8801/tid=8833] ppid=8796 vsize=5558424 CPUtime=4992.87 cores=4-31
/proc/8801/task/8833/stat : 8833 (plingeling) R 8796 8796 8770 0 -1 4202560 798414 1240 0 0 498921 366 0 0 25 0 29 0 623008036 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331352 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=8801/tid=8834] ppid=8796 vsize=5558424 CPUtime=5003.71 cores=4-31
/proc/8801/task/8834/stat : 8834 (plingeling) R 8796 8796 8770 0 -1 4202560 1075738 1240 0 0 499886 485 0 0 25 0 29 0 623008036 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=8801/tid=8835] ppid=8796 vsize=5558424 CPUtime=4966.98 cores=4-31
/proc/8801/task/8835/stat : 8835 (plingeling) R 8796 8796 8770 0 -1 4202560 993441 1240 0 0 496295 403 0 0 25 0 29 0 623008036 5691826176 1239898 268435456000 4194304 4356188 140735240914224 18446744073709551615 4330817 0 0 4096 17442 0 0 0 -1 31 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 8866508

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8796 and gives
#  childrusage.ru_utime.tv_sec=5008
#  childrusage.ru_utime.tv_usec=845539
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=109983
# CPU time returned by wait4() is 5008.96
# while last known CPU time is 160003
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5009.84
CPU time (s): 160003
CPU user time (s): 159881
CPU system time (s): 122.32
CPU usage (%): 3193.78
Max. virtual memory (cumulated for all children) (KiB): 9532116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5008.85
system time used= 0.109983
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15689
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11879
involuntary context switches= 12528

runsolver used 30.8083 second user time and 110.955 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-11 14:00:12
IDJOB=3347383
IDBENCH=82390
IDSOLVER=1808
FILE ID=node200/3347383-1305115211
RUNJOBID= node200-1305115211-8784
PBS_JOBID= 13282059
Free space on /tmp= 62044 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.025-NOTKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347383-1305115211/watcher-3347383-1305115211 -o /tmp/evaluation-result-3347383-1305115211/solver-3347383-1305115211 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347383-1305115211.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 732b9c9b0d44d6a9e75489b2f5004165
RANDOM SEED=765987976

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      256037684 kB
Buffers:        412520 kB
Cached:        7414392 kB
SwapCached:          0 kB
Active:        6955716 kB
Inactive:       939816 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      256037684 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           18228 kB
Writeback:           0 kB
AnonPages:       70052 kB
Mapped:          13732 kB
Slab:           244152 kB
PageTables:       4120 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   188984 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62032 MiB
End job on node200 at 2011-05-11 15:23:44