Trace number 3347619

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 160002 5047.86

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00N23.cnf
MD5SUM1a1f0dddf727883e0973677dd00e9269
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2210893
Sum of the clauses size20370578
Maximum clause length105
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 241189
Number of clauses of size 336730
Number of clauses of size 432798
Number of clauses of size 5188784
Number of clauses of size over 51911364

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347619-1305395727/watcher-3347619-1305395727 -o /tmp/evaluation-result-3347619-1305395727/solver-3347619-1305395727 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347619-1305395727.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.56 31.53 31.84 1/413 31950
/proc/meminfo: memFree=255468468/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0

[startup+0.0619469 s]
/proc/loadavg: 29.56 31.53 31.84 1/413 31950
/proc/meminfo: memFree=255468468/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100993 s]
/proc/loadavg: 29.56 31.53 31.84 1/413 31950
/proc/meminfo: memFree=255468468/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300989 s]
/proc/loadavg: 29.56 31.53 31.84 1/413 31950
/proc/meminfo: memFree=255468468/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700993 s]
/proc/loadavg: 29.56 31.53 31.84 1/413 31950
/proc/meminfo: memFree=255468468/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50097 s]
/proc/loadavg: 27.59 31.09 31.70 6/419 31961
/proc/meminfo: memFree=255162932/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=286292 CPUtime=1.49 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 44752 0 0 0 134 15 0 0 20 0 1 0 651059591 293163008 42873 268435456000 4194304 4587354 140734638323168 18446744073709551615 4420280 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 71573 42874 287 96 0 68135 0
[pid=31952] ppid=31950 vsize=127188 CPUtime=1.49 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 35220 0 0 0 134 15 0 0 20 0 1 0 651059591 130240512 29014 268435456000 4194304 4785740 140733571824784 18446744073709551615 258650616632 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 31797 29014 306 145 0 28842 0
[pid=31953] ppid=31950 vsize=466788 CPUtime=1.48 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 4502 0 0 0 146 2 0 0 20 0 1 0 651059591 477990912 4401 268435456000 134512640 134534564 4287528448 18446744073709551615 4155047 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 116697 4401 90 6 0 115362 0
[pid=31954] ppid=31950 vsize=67568 CPUtime=1.48 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4194304 14018 0 0 0 141 7 0 0 20 0 1 0 651059591 69189632 13914 268435456000 4194304 4331988 140736182014288 18446744073709551615 258650955760 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 16892 13915 112 34 0 15334 0
[pid=31955] ppid=31950 vsize=154640 CPUtime=1.49 cores=4-31
/proc/31955/stat : 31955 (plingeling) R 31950 31950 31580 0 -1 4202496 37851 1240 0 0 140 8 0 1 21 0 1 0 651059592 158351360 37320 268435456000 4194304 4356188 140734883135760 18446744073709551615 4273850 0 0 4096 17442 0 0 0 17 20 0 0 0
/proc/31955/statm: 38660 37320 129 40 0 37204 0
Current children cumulated CPU time (s) 7.43
Current children cumulated vsize (KiB) 1120800

[startup+3.10104 s]
/proc/loadavg: 27.59 31.09 31.70 6/419 31961
/proc/meminfo: memFree=254707976/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=311488 CPUtime=3.08 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 53208 0 0 0 291 17 0 0 25 0 1 0 651059591 318963712 51143 268435456000 4194304 4587354 140734638323168 18446744073709551615 4237684 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 77872 51143 304 96 0 74434 0
[pid=31952] ppid=31950 vsize=296432 CPUtime=3.09 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 79196 0 0 0 284 25 0 0 25 0 1 0 651059591 303546368 69765 268435456000 4194304 4785740 140733571824784 18446744073709551615 4495520 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 74108 69765 315 145 0 71153 0
[pid=31953] ppid=31950 vsize=500052 CPUtime=3.09 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 15196 0 0 0 301 8 0 0 25 0 1 0 651059591 512053248 15095 268435456000 134512640 134534564 4287528448 18446744073709551615 4155047 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 125013 15095 90 6 0 123678 0
[pid=31954] ppid=31950 vsize=117464 CPUtime=3.08 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4194304 27418 0 0 0 291 17 0 0 25 0 1 0 651059591 120283136 27314 268435456000 4194304 4331988 140736182014288 18446744073709551615 258650955760 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 29366 27314 112 34 0 27808 0
[pid=31955] ppid=31950 vsize=298000 CPUtime=3.09 cores=4-31
/proc/31955/stat : 31955 (plingeling) R 31950 31950 31580 0 -1 4202496 73691 1240 0 0 293 15 0 1 25 0 1 0 651059592 305152000 73160 268435456000 4194304 4356188 140734883135760 18446744073709551615 4277592 0 0 4096 17442 0 0 0 17 20 0 0 0
/proc/31955/statm: 74500 73160 129 40 0 73044 0
Current children cumulated CPU time (s) 15.43
Current children cumulated vsize (KiB) 1541760

[startup+6.30115 s]
/proc/loadavg: 27.59 31.09 31.70 6/419 31961
/proc/meminfo: memFree=253731940/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=753528 CPUtime=6.28 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 150678 0 0 0 590 38 0 0 25 0 1 0 651059591 771612672 148211 268435456000 4194304 4587354 140734638323168 18446744073709551615 4357668 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 188382 148211 309 96 0 184944 0
[pid=31952] ppid=31950 vsize=296432 CPUtime=6.29 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 79196 0 0 0 604 25 0 0 25 0 1 0 651059591 303546368 69765 268435456000 4194304 4785740 140733571824784 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 74108 69765 315 145 0 71153 0
[pid=31953] ppid=31950 vsize=809932 CPUtime=6.28 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 98452 0 0 0 600 28 0 0 25 0 1 0 651059591 829370368 98350 268435456000 134512640 134534564 4287528448 18446744073709551615 134524469 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 202483 98350 91 6 0 201148 0
[pid=31954] ppid=31950 vsize=266112 CPUtime=6.29 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4194304 64687 0 0 0 598 31 0 0 25 0 1 0 651059591 272498688 42107 268435456000 4194304 4331988 140736182014288 18446744073709551615 258650351057 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 66528 42108 124 34 0 64970 0
[pid=31955] ppid=31950 vsize=722668 CPUtime=6.29 cores=4-31
/proc/31955/stat : 31955 (plingeling) R 31950 31950 31580 0 -1 4202496 179826 1240 0 0 594 34 0 1 25 0 1 0 651059592 740012032 179295 268435456000 4194304 4356188 140734883135760 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 20 0 0 0
/proc/31955/statm: 180667 179295 129 40 0 179211 0
Current children cumulated CPU time (s) 31.43
Current children cumulated vsize (KiB) 2866996

[startup+12.7014 s]
/proc/loadavg: 24.12 30.23 31.41 6/419 31961
/proc/meminfo: memFree=252616488/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=753528 CPUtime=12.68 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 150678 0 0 0 1230 38 0 0 25 0 1 0 651059591 771612672 148211 268435456000 4194304 4587354 140734638323168 18446744073709551615 4357632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 188382 148211 309 96 0 184944 0
[pid=31952] ppid=31950 vsize=296432 CPUtime=12.69 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 79197 0 0 0 1244 25 0 0 25 0 1 0 651059591 303546368 69766 268435456000 4194304 4785740 140733571824784 18446744073709551615 4495610 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 74108 69766 316 145 0 71153 0
[pid=31953] ppid=31950 vsize=809932 CPUtime=12.68 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 98452 0 0 0 1240 28 0 0 25 0 1 0 651059591 829370368 98350 268435456000 134512640 134534564 4287528448 18446744073709551615 134524573 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 202483 98350 91 6 0 201148 0
[pid=31954] ppid=31950 vsize=425820 CPUtime=12.68 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4194304 198281 0 0 0 1211 57 0 0 25 0 1 0 651059591 436039680 77455 268435456000 4194304 4331988 140736182014288 18446744073709551615 4252200 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 106455 77456 127 34 0 104897 0
[pid=31955] ppid=31950 vsize=1410796 CPUtime=12.69 cores=4-31
/proc/31955/stat : 31955 (plingeling) R 31950 31950 31580 0 -1 4202496 351858 1240 0 0 1198 70 0 1 25 0 1 0 651059592 1444655104 351327 268435456000 4194304 4356188 140734883135760 18446744073709551615 4274613 0 0 4096 17442 0 0 0 17 20 0 0 0
/proc/31955/statm: 352699 351327 129 40 0 351243 0
Current children cumulated CPU time (s) 63.42
Current children cumulated vsize (KiB) 3714832

[startup+25.5008 s]
/proc/loadavg: 21.18 29.40 31.13 6/419 31961
/proc/meminfo: memFree=250633236/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=796312 CPUtime=25.48 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 224664 0 0 0 2495 53 0 0 25 0 1 0 651059591 815423488 166503 268435456000 4194304 4587354 140734638323168 18446744073709551615 4388264 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 199078 166503 314 96 0 195640 0
[pid=31952] ppid=31950 vsize=296432 CPUtime=25.48 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 79197 0 0 0 2523 25 0 0 25 0 1 0 651059591 303546368 69766 268435456000 4194304 4785740 140733571824784 18446744073709551615 4495669 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 74108 69766 316 145 0 71153 0
[pid=31953] ppid=31950 vsize=809932 CPUtime=25.48 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 98452 0 0 0 2520 28 0 0 25 0 1 0 651059591 829370368 98350 268435456000 134512640 134534564 4287528448 18446744073709551615 134524577 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 202483 98350 91 6 0 201148 0
[pid=31954] ppid=31950 vsize=474256 CPUtime=25.48 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4202496 609026 0 0 0 2399 149 0 0 25 0 1 0 651059591 485638144 95506 268435456000 4194304 4331988 140736182014288 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 118564 95506 149 34 0 117006 0
[pid=31955] ppid=31950 vsize=3475180 CPUtime=25.48 cores=4-31
/proc/31955/stat : 31955 (plingeling) R 31950 31950 31580 0 -1 4202496 867954 1240 0 0 2376 171 0 1 23 0 1 0 651059592 3558584320 867423 268435456000 4194304 4356188 140734883135760 18446744073709551615 258651013786 0 0 4096 17442 0 0 0 17 20 0 0 0
/proc/31955/statm: 868795 867423 129 40 0 867339 0
Current children cumulated CPU time (s) 127.4
Current children cumulated vsize (KiB) 5870436

[startup+51.1027 s]
/proc/loadavg: 15.73 27.46 30.44 33/447 31991
/proc/meminfo: memFree=247594620/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=796312 CPUtime=51.08 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 224664 0 0 0 5055 53 0 0 25 0 1 0 651059591 815423488 166503 268435456000 4194304 4587354 140734638323168 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 199078 166503 314 96 0 195640 0
[pid=31952] ppid=31950 vsize=296432 CPUtime=51.08 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 79197 0 0 0 5083 25 0 0 25 0 1 0 651059591 303546368 69766 268435456000 4194304 4785740 140733571824784 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 74108 69766 316 145 0 71153 0
[pid=31953] ppid=31950 vsize=809932 CPUtime=51.07 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 98452 0 0 0 5079 28 0 0 25 0 1 0 651059591 829370368 98350 268435456000 134512640 134534564 4287528448 18446744073709551615 134524736 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 202483 98350 91 6 0 201148 0
[pid=31954] ppid=31950 vsize=490512 CPUtime=51.07 cores=3

################
# More data... #
################

[pid=31953] ppid=31950 vsize=809932 CPUtime=5021.33 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 98452 0 0 0 502105 28 0 0 25 0 1 0 651059591 829370368 98350 268435456000 134512640 134534564 4287528448 18446744073709551615 134524536 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 202483 98350 91 6 0 201148 0
[pid=31954] ppid=31950 vsize=15367952 CPUtime=5021.29 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4202496 4246351 0 0 0 500025 2104 0 0 25 0 1 0 651059591 15736782848 3732831 268435456000 4194304 4331988 140736182014288 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 3841988 3732831 149 34 0 3840430 0
[pid=31955] ppid=31950 vsize=7423928 CPUtime=139100 cores=4-31
/proc/31955/stat : 31955 (plingeling) S 31950 31950 31580 0 -1 4202496 6254397 1240 0 0 13903131 6855 0 1 18 0 29 0 651059592 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/31955/statm: 1855982 1743162 159 40 0 1854526 0
[pid=31955/tid=31964] ppid=31950 vsize=7423928 CPUtime=4971.74 cores=4-31
/proc/31955/task/31964/stat : 31964 (plingeling) R 31950 31950 31580 0 -1 4202560 164863 1240 0 0 496936 237 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4210704 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31955/tid=31965] ppid=31950 vsize=7423928 CPUtime=4970.65 cores=4-31
/proc/31955/task/31965/stat : 31965 (plingeling) R 31950 31950 31580 0 -1 4202560 177606 1240 0 0 496866 198 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31955/tid=31966] ppid=31950 vsize=7423928 CPUtime=4971.57 cores=4-31
/proc/31955/task/31966/stat : 31966 (plingeling) R 31950 31950 31580 0 -1 4202560 180353 1240 0 0 496835 321 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=31955/tid=31967] ppid=31950 vsize=7423928 CPUtime=4971.51 cores=4-31
/proc/31955/task/31967/stat : 31967 (plingeling) R 31950 31950 31580 0 -1 4202560 37550 1240 0 0 497119 31 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=31955/tid=31968] ppid=31950 vsize=7423928 CPUtime=4970.76 cores=4-31
/proc/31955/task/31968/stat : 31968 (plingeling) R 31950 31950 31580 0 -1 4202560 184182 1240 0 0 496782 293 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=31955/tid=31969] ppid=31950 vsize=7423928 CPUtime=4970.17 cores=4-31
/proc/31955/task/31969/stat : 31969 (plingeling) R 31950 31950 31580 0 -1 4202560 169097 1240 0 0 496722 294 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=31955/tid=31970] ppid=31950 vsize=7423928 CPUtime=4968.18 cores=4-31
/proc/31955/task/31970/stat : 31970 (plingeling) R 31950 31950 31580 0 -1 4202560 184579 1240 0 0 496424 393 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=31955/tid=31971] ppid=31950 vsize=7423928 CPUtime=4971.85 cores=4-31
/proc/31955/task/31971/stat : 31971 (plingeling) R 31950 31950 31580 0 -1 4202560 207768 1240 0 0 496860 324 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=31955/tid=31972] ppid=31950 vsize=7423928 CPUtime=4971.73 cores=4-31
/proc/31955/task/31972/stat : 31972 (plingeling) R 31950 31950 31580 0 -1 4202560 221382 1240 0 0 496827 345 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331528 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31955/tid=31973] ppid=31950 vsize=7423928 CPUtime=4971.79 cores=4-31
/proc/31955/task/31973/stat : 31973 (plingeling) R 31950 31950 31580 0 -1 4202560 257593 1240 0 0 496970 208 0 1 25 0 29 0 651064429 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=31955/tid=31974] ppid=31950 vsize=7423928 CPUtime=4971.87 cores=4-31
/proc/31955/task/31974/stat : 31974 (plingeling) R 31950 31950 31580 0 -1 4202560 166062 1240 0 0 496918 268 0 1 25 0 29 0 651064430 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=31955/tid=31975] ppid=31950 vsize=7423928 CPUtime=4969.52 cores=4-31
/proc/31955/task/31975/stat : 31975 (plingeling) R 31950 31950 31580 0 -1 4202560 70230 1240 0 0 496877 74 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=31955/tid=31976] ppid=31950 vsize=7423928 CPUtime=4969.41 cores=4-31
/proc/31955/task/31976/stat : 31976 (plingeling) R 31950 31950 31580 0 -1 4202560 185159 1240 0 0 496615 325 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=31955/tid=31977] ppid=31950 vsize=7423928 CPUtime=4971.67 cores=4-31
/proc/31955/task/31977/stat : 31977 (plingeling) R 31950 31950 31580 0 -1 4202560 147910 1240 0 0 496969 197 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=31955/tid=31978] ppid=31950 vsize=7423928 CPUtime=4971.63 cores=4-31
/proc/31955/task/31978/stat : 31978 (plingeling) R 31950 31950 31580 0 -1 4202560 233700 1240 0 0 496959 203 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=31955/tid=31979] ppid=31950 vsize=7423928 CPUtime=4971.2 cores=4-31
/proc/31955/task/31979/stat : 31979 (plingeling) R 31950 31950 31580 0 -1 4202560 250967 1240 0 0 496849 270 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=31955/tid=31980] ppid=31950 vsize=7423928 CPUtime=4971.62 cores=4-31
/proc/31955/task/31980/stat : 31980 (plingeling) R 31950 31950 31580 0 -1 4202560 182029 1240 0 0 496919 242 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=31955/tid=31981] ppid=31950 vsize=7423928 CPUtime=4971.79 cores=4-31
/proc/31955/task/31981/stat : 31981 (plingeling) R 31950 31950 31580 0 -1 4202560 211137 1240 0 0 496963 215 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=31955/tid=31982] ppid=31950 vsize=7423928 CPUtime=4971.7 cores=4-31
/proc/31955/task/31982/stat : 31982 (plingeling) R 31950 31950 31580 0 -1 4202560 152636 1240 0 0 496927 242 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4279749 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=31955/tid=31983] ppid=31950 vsize=7423928 CPUtime=4971.04 cores=4-31
/proc/31955/task/31983/stat : 31983 (plingeling) R 31950 31950 31580 0 -1 4202560 111610 1240 0 0 497012 91 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=31955/tid=31984] ppid=31950 vsize=7423928 CPUtime=4971.56 cores=4-31
/proc/31955/task/31984/stat : 31984 (plingeling) R 31950 31950 31580 0 -1 4202560 202186 1240 0 0 496860 295 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=31955/tid=31985] ppid=31950 vsize=7423928 CPUtime=4970.74 cores=4-31
/proc/31955/task/31985/stat : 31985 (plingeling) R 31950 31950 31580 0 -1 4202560 125929 1240 0 0 496885 188 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=31955/tid=31986] ppid=31950 vsize=7423928 CPUtime=4971.66 cores=4-31
/proc/31955/task/31986/stat : 31986 (plingeling) R 31950 31950 31580 0 -1 4202560 172326 1240 0 0 496963 202 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=31955/tid=31987] ppid=31950 vsize=7423928 CPUtime=4970.95 cores=4-31
/proc/31955/task/31987/stat : 31987 (plingeling) R 31950 31950 31580 0 -1 4202560 252441 1240 0 0 496816 278 0 1 25 0 29 0 651064434 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=31955/tid=31988] ppid=31950 vsize=7423928 CPUtime=4830.21 cores=4-31
/proc/31955/task/31988/stat : 31988 (plingeling) R 31950 31950 31580 0 -1 4202560 177537 1240 0 0 482766 254 0 1 25 0 29 0 651064441 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=31955/tid=31989] ppid=31950 vsize=7423928 CPUtime=4971.75 cores=4-31
/proc/31955/task/31989/stat : 31989 (plingeling) R 31950 31950 31580 0 -1 4202560 177493 1240 0 0 496976 198 0 1 25 0 29 0 651064447 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=31955/tid=31990] ppid=31950 vsize=7423928 CPUtime=4971.47 cores=4-31
/proc/31955/task/31990/stat : 31990 (plingeling) R 31950 31950 31580 0 -1 4202560 199528 1240 0 0 496833 313 0 1 25 0 29 0 651064449 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=31955/tid=31991] ppid=31950 vsize=7423928 CPUtime=4971.81 cores=4-31
/proc/31955/task/31991/stat : 31991 (plingeling) R 31950 31950 31580 0 -1 4202560 66456 1240 0 0 497110 70 0 1 25 0 29 0 651064449 7602102272 1743162 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 159185
Current children cumulated vsize (KiB) 25817756



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5047.8 s]
/proc/loadavg: 32.04 32.04 32.00 34/447 32144
/proc/meminfo: memFree=231006788/264257624 swapFree=67111528/67111528
[pid=31950] ppid=31948 vsize=18324 CPUtime=0 cores=0-31
/proc/31950/stat : 31950 (ppfolio) S 31948 31950 31580 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 651059591 18763776 386 268435456000 4194304 4287625 140733456707040 18446744073709551615 258650975999 0 0 4096 65536 9206941489140072447 0 0 17 16 0 0 0
/proc/31950/statm: 4581 386 337 23 0 91 0
[pid=31951] ppid=31950 vsize=960840 CPUtime=5046.88 cores=0
/proc/31951/stat : 31951 (cryptominisat) R 31950 31950 31580 0 -1 4202496 785264 0 0 0 504492 196 0 0 25 0 1 0 651059591 983900160 204754 268435456000 4194304 4587354 140734638323168 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31951/statm: 240210 204754 336 96 0 236772 0
[pid=31952] ppid=31950 vsize=1244356 CPUtime=5046.87 cores=1
/proc/31952/stat : 31952 (clasp) R 31950 31950 31580 0 -1 4202496 315076 0 0 0 504498 189 0 0 25 0 1 0 651059591 1274220544 301328 268435456000 4194304 4785740 140733571824784 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/31952/statm: 311089 301328 338 145 0 308134 0
[pid=31953] ppid=31950 vsize=809932 CPUtime=5046.87 cores=2
/proc/31953/stat : 31953 (TNM) R 31950 31950 31580 0 -1 4202496 98452 0 0 0 504659 28 0 0 25 0 1 0 651059591 829370368 98350 268435456000 134512640 134534564 4287528448 18446744073709551615 134524686 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/31953/statm: 202483 98350 91 6 0 201148 0
[pid=31954] ppid=31950 vsize=15450980 CPUtime=5046.83 cores=3
/proc/31954/stat : 31954 (march_hi) R 31950 31950 31580 0 -1 4202496 4272228 0 0 0 502567 2116 0 0 25 0 1 0 651059591 15821803520 3758708 268435456000 4194304 4331988 140736182014288 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31954/statm: 3862745 3758708 149 34 0 3861187 0
[pid=31955] ppid=31950 vsize=7422684 CPUtime=139814 cores=4-31
/proc/31955/stat : 31955 (plingeling) S 31950 31950 31580 0 -1 4202496 6254397 1240 0 0 13974555 6856 0 1 18 0 29 0 651059592 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/31955/statm: 1855671 1742851 159 40 0 1854215 0
[pid=31955/tid=31964] ppid=31950 vsize=7422684 CPUtime=4997.27 cores=4-31
/proc/31955/task/31964/stat : 31964 (plingeling) R 31950 31950 31580 0 -1 4202560 164863 1240 0 0 499489 237 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31955/tid=31965] ppid=31950 vsize=7422684 CPUtime=4996.19 cores=4-31
/proc/31955/task/31965/stat : 31965 (plingeling) R 31950 31950 31580 0 -1 4202560 177606 1240 0 0 499420 198 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4234244 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31955/tid=31966] ppid=31950 vsize=7422684 CPUtime=4997.1 cores=4-31
/proc/31955/task/31966/stat : 31966 (plingeling) R 31950 31950 31580 0 -1 4202560 180353 1240 0 0 499388 321 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4238574 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=31955/tid=31967] ppid=31950 vsize=7422684 CPUtime=4997.05 cores=4-31
/proc/31955/task/31967/stat : 31967 (plingeling) R 31950 31950 31580 0 -1 4202560 37550 1240 0 0 499673 31 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=31955/tid=31968] ppid=31950 vsize=7422684 CPUtime=4996.29 cores=4-31
/proc/31955/task/31968/stat : 31968 (plingeling) R 31950 31950 31580 0 -1 4202560 184182 1240 0 0 499335 293 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=31955/tid=31969] ppid=31950 vsize=7422684 CPUtime=4995.71 cores=4-31
/proc/31955/task/31969/stat : 31969 (plingeling) R 31950 31950 31580 0 -1 4202560 169097 1240 0 0 499276 294 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=31955/tid=31970] ppid=31950 vsize=7422684 CPUtime=4993.71 cores=4-31
/proc/31955/task/31970/stat : 31970 (plingeling) R 31950 31950 31580 0 -1 4202560 184579 1240 0 0 498976 394 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=31955/tid=31971] ppid=31950 vsize=7422684 CPUtime=4997.38 cores=4-31
/proc/31955/task/31971/stat : 31971 (plingeling) R 31950 31950 31580 0 -1 4202560 207768 1240 0 0 499413 324 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=31955/tid=31972] ppid=31950 vsize=7422684 CPUtime=4997.27 cores=4-31
/proc/31955/task/31972/stat : 31972 (plingeling) R 31950 31950 31580 0 -1 4202560 221382 1240 0 0 499381 345 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31955/tid=31973] ppid=31950 vsize=7422684 CPUtime=4997.32 cores=4-31
/proc/31955/task/31973/stat : 31973 (plingeling) R 31950 31950 31580 0 -1 4202560 257593 1240 0 0 499523 208 0 1 25 0 29 0 651064429 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4210581 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=31955/tid=31974] ppid=31950 vsize=7422684 CPUtime=4997.41 cores=4-31
/proc/31955/task/31974/stat : 31974 (plingeling) R 31950 31950 31580 0 -1 4202560 166062 1240 0 0 499472 268 0 1 25 0 29 0 651064430 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=31955/tid=31975] ppid=31950 vsize=7422684 CPUtime=4995.06 cores=4-31
/proc/31955/task/31975/stat : 31975 (plingeling) R 31950 31950 31580 0 -1 4202560 70230 1240 0 0 499431 74 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=31955/tid=31976] ppid=31950 vsize=7422684 CPUtime=4994.94 cores=4-31
/proc/31955/task/31976/stat : 31976 (plingeling) R 31950 31950 31580 0 -1 4202560 185159 1240 0 0 499168 325 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=31955/tid=31977] ppid=31950 vsize=7422684 CPUtime=4997.2 cores=4-31
/proc/31955/task/31977/stat : 31977 (plingeling) R 31950 31950 31580 0 -1 4202560 147910 1240 0 0 499522 197 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=31955/tid=31978] ppid=31950 vsize=7422684 CPUtime=4997.17 cores=4-31
/proc/31955/task/31978/stat : 31978 (plingeling) R 31950 31950 31580 0 -1 4202560 233700 1240 0 0 499513 203 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=31955/tid=31979] ppid=31950 vsize=7422684 CPUtime=4996.73 cores=4-31
/proc/31955/task/31979/stat : 31979 (plingeling) R 31950 31950 31580 0 -1 4202560 250967 1240 0 0 499402 270 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=31955/tid=31980] ppid=31950 vsize=7422684 CPUtime=4997.16 cores=4-31
/proc/31955/task/31980/stat : 31980 (plingeling) R 31950 31950 31580 0 -1 4202560 182029 1240 0 0 499473 242 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=31955/tid=31981] ppid=31950 vsize=7422684 CPUtime=4997.32 cores=4-31
/proc/31955/task/31981/stat : 31981 (plingeling) R 31950 31950 31580 0 -1 4202560 211137 1240 0 0 499516 215 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=31955/tid=31982] ppid=31950 vsize=7422684 CPUtime=4997.24 cores=4-31
/proc/31955/task/31982/stat : 31982 (plingeling) R 31950 31950 31580 0 -1 4202560 152636 1240 0 0 499481 242 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=31955/tid=31983] ppid=31950 vsize=7422684 CPUtime=4996.58 cores=4-31
/proc/31955/task/31983/stat : 31983 (plingeling) R 31950 31950 31580 0 -1 4202560 111610 1240 0 0 499566 91 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=31955/tid=31984] ppid=31950 vsize=7422684 CPUtime=4997.1 cores=4-31
/proc/31955/task/31984/stat : 31984 (plingeling) R 31950 31950 31580 0 -1 4202560 202186 1240 0 0 499414 295 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=31955/tid=31985] ppid=31950 vsize=7422684 CPUtime=4996.27 cores=4-31
/proc/31955/task/31985/stat : 31985 (plingeling) R 31950 31950 31580 0 -1 4202560 125929 1240 0 0 499438 188 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=31955/tid=31986] ppid=31950 vsize=7422684 CPUtime=4997.2 cores=4-31
/proc/31955/task/31986/stat : 31986 (plingeling) R 31950 31950 31580 0 -1 4202560 172326 1240 0 0 499517 202 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=31955/tid=31987] ppid=31950 vsize=7422684 CPUtime=4996.49 cores=4-31
/proc/31955/task/31987/stat : 31987 (plingeling) R 31950 31950 31580 0 -1 4202560 252441 1240 0 0 499370 278 0 1 25 0 29 0 651064434 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=31955/tid=31988] ppid=31950 vsize=7422684 CPUtime=4854.98 cores=4-31
/proc/31955/task/31988/stat : 31988 (plingeling) R 31950 31950 31580 0 -1 4202560 177537 1240 0 0 485243 254 0 1 25 0 29 0 651064441 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=31955/tid=31989] ppid=31950 vsize=7422684 CPUtime=4997.29 cores=4-31
/proc/31955/task/31989/stat : 31989 (plingeling) R 31950 31950 31580 0 -1 4202560 177493 1240 0 0 499530 198 0 1 25 0 29 0 651064447 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331176 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=31955/tid=31990] ppid=31950 vsize=7422684 CPUtime=4997.01 cores=4-31
/proc/31955/task/31990/stat : 31990 (plingeling) R 31950 31950 31580 0 -1 4202560 199528 1240 0 0 499387 313 0 1 25 0 29 0 651064449 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=31955/tid=31991] ppid=31950 vsize=7422684 CPUtime=4997.35 cores=4-31
/proc/31955/task/31991/stat : 31991 (plingeling) R 31950 31950 31580 0 -1 4202560 66456 1240 0 0 499664 70 0 1 25 0 29 0 651064449 7600828416 1742851 268435456000 4194304 4356188 140734883135760 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 25907116

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31950 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.005998
# while last known CPU time is 160002
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5047.86
CPU time (s): 160002
CPU user time (s): 159908
CPU system time (s): 93.86
CPU usage (%): 3169.69
Max. virtual memory (cumulated for all children) (KiB): 25907116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 513
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 80
involuntary context switches= 2

runsolver used 26.167 second user time and 118.66 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-14 19:55:32
IDJOB=3347619
IDBENCH=83466
IDSOLVER=1808
FILE ID=node200/3347619-1305395727
RUNJOBID= node200-1305390664-31594
PBS_JOBID= 13285492
Free space on /tmp= 61940 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00N23.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347619-1305395727/watcher-3347619-1305395727 -o /tmp/evaluation-result-3347619-1305395727/solver-3347619-1305395727 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347619-1305395727.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 1a1f0dddf727883e0973677dd00e9269
RANDOM SEED=1698358921

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255468872 kB
Buffers:        437592 kB
Cached:        7943432 kB
SwapCached:          0 kB
Active:        7498076 kB
Inactive:       951752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255468872 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          124000 kB
Writeback:           0 kB
AnonPages:       68788 kB
Mapped:          14532 kB
Slab:           252808 kB
PageTables:       4288 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   189820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61928 MiB
End job on node200 at 2011-05-14 21:19:42