Trace number 3347521

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 156417 5100.04

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom24.cnf
MD5SUM16e1f2a4ab0c9df60ac0d098f9f252bb
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables62686
Number of clauses210488
Sum of the clauses size537842
Maximum clause length1941
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2106681
Number of clauses of size 3102739
Number of clauses of size 4299
Number of clauses of size 522
Number of clauses of size over 5746

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347521-1305227894/watcher-3347521-1305227894 -o /tmp/evaluation-result-3347521-1305227894/solver-3347521-1305227894 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347521-1305227894.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 27.23 31.03 31.70 1/413 21952
/proc/meminfo: memFree=255633560/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 514 0 0 0 0 0 0 0 21 0 1 0 634275840 18763776 386 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 8847910673057841151 0 0 17 4 0 0 0
/proc/21952/statm: 4581 386 337 23 0 91 0

[startup+0.05232 s]
/proc/loadavg: 27.23 31.03 31.70 1/413 21952
/proc/meminfo: memFree=255633560/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 514 0 0 0 0 0 0 0 21 0 1 0 634275840 18763776 386 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 8847910673057841151 0 0 17 4 0 0 0
/proc/21952/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100341 s]
/proc/loadavg: 27.23 31.03 31.70 1/413 21952
/proc/meminfo: memFree=255633560/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 21 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18324

[startup+0.300334 s]
/proc/loadavg: 27.23 31.03 31.70 1/413 21952
/proc/meminfo: memFree=255633560/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 19 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197971950698496 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18324

[startup+0.700355 s]
/proc/loadavg: 27.23 31.03 31.70 1/413 21952
/proc/meminfo: memFree=255633560/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 19 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197971950698496 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18324

[startup+1.50136 s]
/proc/loadavg: 27.23 31.03 31.70 5/418 21965
/proc/meminfo: memFree=255441600/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 17 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633294 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
[pid=21953] ppid=21952 vsize=54032 CPUtime=1.48 cores=0
/proc/21953/stat : 21953 (cryptominisat) R 21952 21952 21926 0 -1 4202496 7915 0 0 0 145 3 0 0 25 0 1 0 634275841 55328768 7688 268435456000 4194304 4587354 140736994357024 18446744073709551615 258650616632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21953/statm: 13508 7690 308 96 0 10070 0
[pid=21954] ppid=21952 vsize=48972 CPUtime=1.48 cores=1
/proc/21954/stat : 21954 (clasp) R 21952 21952 21926 0 -1 4202496 11877 0 0 0 145 3 0 0 20 0 1 0 634275841 50147328 9426 268435456000 4194304 4785740 140734430712624 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21954/statm: 12243 9426 338 145 0 9288 0
[pid=21956] ppid=21952 vsize=39928 CPUtime=1.48 cores=3
/proc/21956/stat : 21956 (march_hi) R 21952 21952 21926 0 -1 4202496 49304 0 0 0 135 13 0 0 20 0 1 0 634275841 40886272 6554 268435456000 4194304 4331988 140736440634288 18446744073709551615 4251979 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21956/statm: 9982 6554 148 34 0 8424 0
[pid=21957] ppid=21952 vsize=123972 CPUtime=1.49 cores=4-31
/proc/21957/stat : 21957 (plingeling) R 21952 21952 21926 0 -1 4202496 29768 1241 0 0 140 8 0 1 21 0 1 0 634275841 126947328 29652 268435456000 4194304 4356188 140735836311168 18446744073709551615 4277592 0 0 4096 17442 0 0 0 17 10 0 0 0
/proc/21957/statm: 30993 29652 129 40 0 29537 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 285228

[startup+3.10145 s]
/proc/loadavg: 27.23 31.03 31.70 5/418 21965
/proc/meminfo: memFree=255256720/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 15 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197971950698496 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
[pid=21953] ppid=21952 vsize=82420 CPUtime=3.08 cores=0
/proc/21953/stat : 21953 (cryptominisat) R 21952 21952 21926 0 -1 4202496 20003 0 0 0 303 5 0 0 25 0 1 0 634275841 84398080 15626 268435456000 4194304 4587354 140736994357024 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21953/statm: 20605 15626 328 96 0 17167 0
[pid=21954] ppid=21952 vsize=48972 CPUtime=3.08 cores=1
/proc/21954/stat : 21954 (clasp) R 21952 21952 21926 0 -1 4202496 11877 0 0 0 305 3 0 0 25 0 1 0 634275841 50147328 9426 268435456000 4194304 4785740 140734430712624 18446744073709551615 4562683 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21954/statm: 12243 9426 338 145 0 9288 0
[pid=21956] ppid=21952 vsize=142660 CPUtime=3.08 cores=3
/proc/21956/stat : 21956 (march_hi) R 21952 21952 21926 0 -1 4202496 76827 0 0 0 292 16 0 0 25 0 1 0 634275841 146083840 18132 268435456000 4194304 4331988 140736440634288 18446744073709551615 4228453 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21956/statm: 35665 18132 176 34 0 34107 0
[pid=21957] ppid=21952 vsize=234188 CPUtime=3.08 cores=4-31
/proc/21957/stat : 21957 (plingeling) R 21952 21952 21926 0 -1 4202496 57306 1241 0 0 293 14 0 1 25 0 1 0 634275841 239808512 57190 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210579 0 0 4096 17442 0 0 0 17 10 0 0 0
/proc/21957/statm: 58547 57190 129 40 0 57091 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 526564

[startup+6.30156 s]
/proc/loadavg: 25.37 30.58 31.55 32/446 21993
/proc/meminfo: memFree=255011572/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 15 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633294 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
[pid=21953] ppid=21952 vsize=119924 CPUtime=6.29 cores=0
/proc/21953/stat : 21953 (cryptominisat) R 21952 21952 21926 0 -1 4202496 20732 0 0 0 623 6 0 0 25 0 1 0 634275841 122802176 16334 268435456000 4194304 4587354 140736994357024 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21953/statm: 29981 16334 328 96 0 26543 0
[pid=21954] ppid=21952 vsize=51804 CPUtime=6.28 cores=1
/proc/21954/stat : 21954 (clasp) R 21952 21952 21926 0 -1 4202496 12595 0 0 0 625 3 0 0 25 0 1 0 634275841 53047296 10144 268435456000 4194304 4785740 140734430712624 18446744073709551615 4553024 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21954/statm: 12951 10144 338 145 0 9996 0
[pid=21956] ppid=21952 vsize=148140 CPUtime=6.28 cores=3
/proc/21956/stat : 21956 (march_hi) R 21952 21952 21926 0 -1 4202496 78443 0 0 0 611 17 0 0 25 0 1 0 634275841 151695360 19746 268435456000 4194304 4331988 140736440634288 18446744073709551615 258650652667 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21956/statm: 37035 19746 174 34 0 35477 0
[pid=21957] ppid=21952 vsize=972012 CPUtime=84.23 cores=4-31
/proc/21957/stat : 21957 (plingeling) S 21952 21952 21926 0 -1 4202496 201994 1241 0 0 8315 107 0 1 18 0 29 0 634275841 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0
/proc/21957/statm: 243003 125199 159 40 0 241547 0
[pid=21957/tid=21966] ppid=21952 vsize=972012 CPUtime=3.02 cores=4-31
/proc/21957/task/21966/stat : 21966 (plingeling) R 21952 21952 21926 0 -1 4202560 6715 1241 0 0 297 4 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4300969 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=21957/tid=21967] ppid=21952 vsize=972012 CPUtime=3.04 cores=4-31
/proc/21957/task/21967/stat : 21967 (plingeling) R 21952 21952 21926 0 -1 4202560 6475 1241 0 0 299 4 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4232869 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21957/tid=21968] ppid=21952 vsize=972012 CPUtime=3 cores=4-31
/proc/21957/task/21968/stat : 21968 (plingeling) R 21952 21952 21926 0 -1 4202560 5297 1241 0 0 297 2 0 1 24 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4236344 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=21957/tid=21969] ppid=21952 vsize=972012 CPUtime=2.62 cores=4-31
/proc/21957/task/21969/stat : 21969 (plingeling) R 21952 21952 21926 0 -1 4202560 5459 1241 0 0 257 4 0 1 20 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=21957/tid=21970] ppid=21952 vsize=972012 CPUtime=3.08 cores=4-31
/proc/21957/task/21970/stat : 21970 (plingeling) R 21952 21952 21926 0 -1 4202560 5609 1241 0 0 305 2 0 1 25 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4215096 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21957/tid=21971] ppid=21952 vsize=972012 CPUtime=3.01 cores=4-31
/proc/21957/task/21971/stat : 21971 (plingeling) R 21952 21952 21926 0 -1 4202560 4865 1241 0 0 298 2 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4215625 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=21957/tid=21972] ppid=21952 vsize=972012 CPUtime=3.02 cores=4-31
/proc/21957/task/21972/stat : 21972 (plingeling) R 21952 21952 21926 0 -1 4202560 5810 1241 0 0 299 2 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4309270 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=21957/tid=21973] ppid=21952 vsize=972012 CPUtime=3.05 cores=4-31
/proc/21957/task/21973/stat : 21973 (plingeling) R 21952 21952 21926 0 -1 4202560 4110 1241 0 0 302 2 0 1 24 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4305483 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21957/tid=21974] ppid=21952 vsize=972012 CPUtime=3.03 cores=4-31
/proc/21957/task/21974/stat : 21974 (plingeling) R 21952 21952 21926 0 -1 4202560 5021 1241 0 0 299 3 0 1 24 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4232894 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=21957/tid=21975] ppid=21952 vsize=972012 CPUtime=2.94 cores=4-31
/proc/21957/task/21975/stat : 21975 (plingeling) R 21952 21952 21926 0 -1 4202560 5673 1241 0 0 289 4 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4217774 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=21957/tid=21976] ppid=21952 vsize=972012 CPUtime=3.06 cores=4-31
/proc/21957/task/21976/stat : 21976 (plingeling) R 21952 21952 21926 0 -1 4202560 4781 1241 0 0 302 3 0 1 24 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4230435 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=21957/tid=21977] ppid=21952 vsize=972012 CPUtime=3 cores=4-31
/proc/21957/task/21977/stat : 21977 (plingeling) R 21952 21952 21926 0 -1 4202560 5667 1241 0 0 295 4 0 1 22 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210765 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=21957/tid=21978] ppid=21952 vsize=972012 CPUtime=3.02 cores=4-31
/proc/21957/task/21978/stat : 21978 (plingeling) R 21952 21952 21926 0 -1 4202560 4580 1241 0 0 299 2 0 1 23 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4232894 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=21957/tid=21979] ppid=21952 vsize=972012 CPUtime=2.93 cores=4-31
/proc/21957/task/21979/stat : 21979 (plingeling) R 21952 21952 21926 0 -1 4202560 7934 1241 0 0 287 5 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4216153 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=21957/tid=21980] ppid=21952 vsize=972012 CPUtime=3.03 cores=4-31
/proc/21957/task/21980/stat : 21980 (plingeling) R 21952 21952 21926 0 -1 4202560 5049 1241 0 0 299 3 0 1 21 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4300648 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21957/tid=21981] ppid=21952 vsize=972012 CPUtime=3.03 cores=4-31
/proc/21957/task/21981/stat : 21981 (plingeling) R 21952 21952 21926 0 -1 4202560 5830 1241 0 0 299 3 0 1 23 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4275198 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=21957/tid=21982] ppid=21952 vsize=972012 CPUtime=2.37 cores=4-31
/proc/21957/task/21982/stat : 21982 (plingeling) R 21952 21952 21926 0 -1 4202560 4142 1241 0 0 234 2 0 1 17 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4231387 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=21957/tid=21983] ppid=21952 vsize=972012 CPUtime=2.97 cores=4-31
/proc/21957/task/21983/stat : 21983 (plingeling) S 21952 21952 21926 0 -1 4202560 4280 1241 0 0 293 3 0 1 25 0 29 0 634276159 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 258651060958 0 0 4096 17442 18446604633242025440 0 0 -1 19 0 0 0
[pid=21957/tid=21984] ppid=21952 vsize=972012 CPUtime=3.03 cores=4-31
/proc/21957/task/21984/stat : 21984 (plingeling) R 21952 21952 21926 0 -1 4202560 5174 1241 0 0 299 3 0 1 21 0 29 0 634276160 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4233360 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=21957/tid=21985] ppid=21952 vsize=972012 CPUtime=2.52 cores=4-31
/proc/21957/task/21985/stat : 21985 (plingeling) R 21952 21952 21926 0 -1 4202560 4145 1241 0 0 248 3 0 1 20 0 29 0 634276160 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330849 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21957/tid=21986] ppid=21952 vsize=972012 CPUtime=2 cores=4-31
/proc/21957/task/21986/stat : 21986 (plingeling) R 21952 21952 21926 0 -1 4202560 4292 1241 0 0 197 2 0 1 20 0 29 0 634276160 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 258650616147 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21957/tid=21987] ppid=21952 vsize=972012 CPUtime=3.03 cores=4-31
/proc/21957/task/21987/stat : 21987 (plingeling) R 21952 21952 21926 0 -1 4202560 7018 1241 0 0 299 3 0 1 25 0 29 0 634276160 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4231370 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=21957/tid=21988] ppid=21952 vsize=972012 CPUtime=3.03 cores=4-31
/proc/21957/task/21988/stat : 21988 (plingeling) R 21952 21952 21926 0 -1 4202560 5681 1241 0 0 299 3 0 1 21 0 29 0 634276160 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4214624 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=21957/tid=21989] ppid=21952 vsize=972012 CPUtime=3.01 cores=4-31
/proc/21957/task/21989/stat : 21989 (plingeling) R 21952 21952 21926 0 -1 4202560 3905 1241 0 0 298 2 0 1 25 0 29 0 634276161 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4217518 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=21957/tid=21990] ppid=21952 vsize=972012 CPUtime=2.99 cores=4-31
/proc/21957/task/21990/stat : 21990 (plingeling) R 21952 21952 21926 0 -1 4202560 5050 1241 0 0 296 2 0 1 22 0 29 0 634276161 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4232872 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=21957/tid=21991] ppid=21952 vsize=972012 CPUtime=3 cores=4-31
/proc/21957/task/21991/stat : 21991 (plingeling) R 21952 21952 21926 0 -1 4202560 5321 1241 0 0 297 2 0 1 25 0 29 0 634276161 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4233369 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=21957/tid=21992] ppid=21952 vsize=972012 CPUtime=2.22 cores=4-31
/proc/21957/task/21992/stat : 21992 (plingeling) R 21952 21952 21926 0 -1 4202560 3272 1241 0 0 221 0 0 1 21 0 29 0 634276161 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 4301875 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=21957/tid=21993] ppid=21952 vsize=972012 CPUtime=3 cores=4-31
/proc/21957/task/21993/stat : 21993 (plingeling) S 21952 21952 21926 0 -1 4202560 3496 1241 0 0 297 2 0 1 21 0 29 0 634276161 995340288 125199 268435456000 4194304 4356188 140735836311168 18446744073709551615 258651060958 0 0 4096 17442 18446744071566924144 0 0 -1 25 0 0 0
Current children cumulated CPU time (s) 103.12
Current children cumulated vsize (KiB) 1310204

[startup+12.7017 s]
/proc/loadavg: 25.82 30.58 31.54 32/446 21993
/proc/meminfo: memFree=254962300/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 15 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633294 0 0 17 4 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
[pid=21953] ppid=21952 vsize=90492 CPUtime=12.68 cores=0
/proc/21953/stat : 21953 (cryptominisat) R 21952 21952 21926 0 -1 4202496 23845 0 0 0 1262 6 0 0 25 0 1 0 634275841 92663808 15938 268435456000 4194304 4587354 140736994357024 18446744073709551615 4451376 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21953/statm: 22623 15938 334 96 0 19185 0
[pid=21954] ppid=21952 vsize=60400 CPUtime=12.68 cores=1
/proc/21954/stat : 21954 (clasp) R 21952 21952 21926 0 -1 4202496 14724 0 0 0 1264 4 0 0 25 0 1 0 634275841 61849600 12273 268435456000 4194304 4785740 140734430712624 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21954/statm: 15100 12273 338 145 0 12145 0
[pid=21956] ppid=21952 vsize=155736 CPUtime=12.68 cores=3
/proc/21956/stat : 21956 (march_hi) R 21952 21952 21926 0 -1 4202496 80195 0 0 0 1250 18 0 0 25 0 1 0 634275841 159473664 21498 268435456000 4194304 4331988 140736440634288 18446744073709551615 4298078 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21956/statm: 38934 21498 174 34 0 37376 0
[pid=21957] ppid=21952 vsize=903728 CPUtime=258.82 cores=4-31
/proc/21957/stat : 21957 (plingeling) S 21952 21952 21926 0 -1 4202496 213771 1241 0 0 25770 111 0 1 18 0 29 0 634275841 925417472 111283 268435456000 4194304 4356188 140735836311168 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0

################
# More data... #
################

[pid=21953] ppid=21952 vsize=1512888 CPUtime=5081.33 cores=0
/proc/21953/stat : 21953 (cryptominisat) R 21952 21952 21926 0 -1 4202496 715107 0 0 0 507682 451 0 0 25 0 1 0 634275841 1549197312 36512 268435456000 4194304 4587354 140736994357024 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21953/statm: 378222 36512 334 96 0 374784 0
[pid=21954] ppid=21952 vsize=374024 CPUtime=5081.33 cores=1
/proc/21954/stat : 21954 (clasp) R 21952 21952 21926 0 -1 4202496 90532 0 0 0 508078 55 0 0 25 0 1 0 634275841 383000576 88081 268435456000 4194304 4785740 140734430712624 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21954/statm: 93506 88081 338 145 0 90551 0
[pid=21956] ppid=21952 vsize=191928 CPUtime=5081.33 cores=3
/proc/21956/stat : 21956 (march_hi) R 21952 21952 21926 0 -1 4202496 88156 0 0 0 508107 26 0 0 25 0 1 0 634275841 196534272 29459 268435456000 4194304 4331988 140736440634288 18446744073709551615 4292195 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21956/statm: 47982 29459 174 34 0 46424 0
[pid=21957] ppid=21952 vsize=2411788 CPUtime=140634 cores=4-31
/proc/21957/stat : 21957 (plingeling) S 21952 21952 21926 0 -1 4202496 2225844 1241 0 0 14061934 1505 0 1 18 0 29 0 634275841 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0
/proc/21957/statm: 602947 480863 159 40 0 601491 0
[pid=21957/tid=21966] ppid=21952 vsize=2411788 CPUtime=4961.46 cores=4-31
/proc/21957/task/21966/stat : 21966 (plingeling) R 21952 21952 21926 0 -1 4202560 74882 1241 0 0 496089 56 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=21957/tid=21967] ppid=21952 vsize=2411788 CPUtime=4957.56 cores=4-31
/proc/21957/task/21967/stat : 21967 (plingeling) R 21952 21952 21926 0 -1 4202560 78330 1241 0 0 495712 43 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21957/tid=21968] ppid=21952 vsize=2411788 CPUtime=5078.05 cores=4-31
/proc/21957/task/21968/stat : 21968 (plingeling) R 21952 21952 21926 0 -1 4202560 97704 1241 0 0 507752 52 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=21957/tid=21969] ppid=21952 vsize=2411788 CPUtime=4955.29 cores=4-31
/proc/21957/task/21969/stat : 21969 (plingeling) R 21952 21952 21926 0 -1 4202560 46037 1241 0 0 495509 19 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=21957/tid=21970] ppid=21952 vsize=2411788 CPUtime=5078.12 cores=4-31
/proc/21957/task/21970/stat : 21970 (plingeling) R 21952 21952 21926 0 -1 4202560 69970 1241 0 0 507775 36 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21957/tid=21971] ppid=21952 vsize=2411788 CPUtime=5078.05 cores=4-31
/proc/21957/task/21971/stat : 21971 (plingeling) R 21952 21952 21926 0 -1 4202560 65805 1241 0 0 507737 67 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=21957/tid=21972] ppid=21952 vsize=2411788 CPUtime=5066.16 cores=4-31
/proc/21957/task/21972/stat : 21972 (plingeling) R 21952 21952 21926 0 -1 4202560 66241 1241 0 0 506548 67 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=21957/tid=21973] ppid=21952 vsize=2411788 CPUtime=4985.31 cores=4-31
/proc/21957/task/21973/stat : 21973 (plingeling) R 21952 21952 21926 0 -1 4202560 113254 1241 0 0 498444 86 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=21957/tid=21974] ppid=21952 vsize=2411788 CPUtime=4976.06 cores=4-31
/proc/21957/task/21974/stat : 21974 (plingeling) R 21952 21952 21926 0 -1 4202560 95312 1241 0 0 497551 54 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21957/tid=21975] ppid=21952 vsize=2411788 CPUtime=4963.21 cores=4-31
/proc/21957/task/21975/stat : 21975 (plingeling) R 21952 21952 21926 0 -1 4202560 77656 1241 0 0 496275 45 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=21957/tid=21976] ppid=21952 vsize=2411788 CPUtime=5053.44 cores=4-31
/proc/21957/task/21976/stat : 21976 (plingeling) R 21952 21952 21926 0 -1 4202560 70426 1241 0 0 505312 31 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=21957/tid=21977] ppid=21952 vsize=2411788 CPUtime=5042.45 cores=4-31
/proc/21957/task/21977/stat : 21977 (plingeling) R 21952 21952 21926 0 -1 4202560 46542 1241 0 0 504228 16 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=21957/tid=21978] ppid=21952 vsize=2411788 CPUtime=5068.5 cores=4-31
/proc/21957/task/21978/stat : 21978 (plingeling) R 21952 21952 21926 0 -1 4202560 61888 1241 0 0 506811 38 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=21957/tid=21979] ppid=21952 vsize=2411788 CPUtime=4912.79 cores=4-31
/proc/21957/task/21979/stat : 21979 (plingeling) R 21952 21952 21926 0 -1 4202560 63340 1241 0 0 491244 34 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=21957/tid=21980] ppid=21952 vsize=2411788 CPUtime=4996.32 cores=4-31
/proc/21957/task/21980/stat : 21980 (plingeling) R 21952 21952 21926 0 -1 4202560 73796 1241 0 0 499595 36 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=21957/tid=21981] ppid=21952 vsize=2411788 CPUtime=5069.8 cores=4-31
/proc/21957/task/21981/stat : 21981 (plingeling) R 21952 21952 21926 0 -1 4202560 125685 1241 0 0 506870 109 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21957/tid=21982] ppid=21952 vsize=2411788 CPUtime=5049.83 cores=4-31
/proc/21957/task/21982/stat : 21982 (plingeling) R 21952 21952 21926 0 -1 4202560 86143 1241 0 0 504926 56 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=21957/tid=21983] ppid=21952 vsize=2411788 CPUtime=5078 cores=4-31
/proc/21957/task/21983/stat : 21983 (plingeling) R 21952 21952 21926 0 -1 4202560 74348 1241 0 0 507742 57 0 1 25 0 29 0 634276159 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=21957/tid=21984] ppid=21952 vsize=2411788 CPUtime=5077.98 cores=4-31
/proc/21957/task/21984/stat : 21984 (plingeling) R 21952 21952 21926 0 -1 4202560 89591 1241 0 0 507745 52 0 1 25 0 29 0 634276160 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210596 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=21957/tid=21985] ppid=21952 vsize=2411788 CPUtime=5032.37 cores=4-31
/proc/21957/task/21985/stat : 21985 (plingeling) R 21952 21952 21926 0 -1 4202560 36965 1241 0 0 503224 12 0 1 25 0 29 0 634276160 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210705 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=21957/tid=21986] ppid=21952 vsize=2411788 CPUtime=4871.97 cores=4-31
/proc/21957/task/21986/stat : 21986 (plingeling) R 21952 21952 21926 0 -1 4202560 93643 1241 0 0 487135 61 0 1 25 0 29 0 634276160 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4279490 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=21957/tid=21987] ppid=21952 vsize=2411788 CPUtime=5078.09 cores=4-31
/proc/21957/task/21987/stat : 21987 (plingeling) R 21952 21952 21926 0 -1 4202560 86955 1241 0 0 507710 98 0 1 25 0 29 0 634276160 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=21957/tid=21988] ppid=21952 vsize=2411788 CPUtime=5001.44 cores=4-31
/proc/21957/task/21988/stat : 21988 (plingeling) R 21952 21952 21926 0 -1 4202560 89347 1241 0 0 500072 71 0 1 25 0 29 0 634276160 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=21957/tid=21989] ppid=21952 vsize=2411788 CPUtime=5032.55 cores=4-31
/proc/21957/task/21989/stat : 21989 (plingeling) R 21952 21952 21926 0 -1 4202560 135937 1241 0 0 503137 117 0 1 25 0 29 0 634276161 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=21957/tid=21990] ppid=21952 vsize=2411788 CPUtime=5078.05 cores=4-31
/proc/21957/task/21990/stat : 21990 (plingeling) R 21952 21952 21926 0 -1 4202560 91773 1241 0 0 507773 31 0 1 25 0 29 0 634276161 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4225594 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=21957/tid=21991] ppid=21952 vsize=2411788 CPUtime=4944.17 cores=4-31
/proc/21957/task/21991/stat : 21991 (plingeling) R 21952 21952 21926 0 -1 4202560 60393 1241 0 0 494368 48 0 1 25 0 29 0 634276161 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21957/tid=21992] ppid=21952 vsize=2411788 CPUtime=5066.15 cores=4-31
/proc/21957/task/21992/stat : 21992 (plingeling) R 21952 21952 21926 0 -1 4202560 76411 1241 0 0 506545 69 0 1 25 0 29 0 634276161 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=21957/tid=21993] ppid=21952 vsize=2411788 CPUtime=5078.03 cores=4-31
/proc/21957/task/21993/stat : 21993 (plingeling) R 21952 21952 21926 0 -1 4202560 20127 1241 0 0 507789 13 0 1 25 0 29 0 634276161 2469670912 480863 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 25 0 0 0
Current children cumulated CPU time (s) 155878
Current children cumulated vsize (KiB) 4508952



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 31.22 31.17 31.07 32/446 22142
/proc/meminfo: memFree=253138524/264257624 swapFree=67111528/67111528
[pid=21952] ppid=21950 vsize=18324 CPUtime=0.04 cores=0-31
/proc/21952/stat : 21952 (ppfolio) S 21950 21952 21926 0 -1 4202496 515 1194 0 0 0 0 1 3 15 0 1 0 634275840 18763776 387 268435456000 4194304 4287625 140737432884288 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633294 0 0 17 0 0 0 0
/proc/21952/statm: 4581 387 338 23 0 91 0
[pid=21953] ppid=21952 vsize=1512888 CPUtime=5099.05 cores=0
/proc/21953/stat : 21953 (cryptominisat) R 21952 21952 21926 0 -1 4202496 715107 0 0 0 509454 451 0 0 25 0 1 0 634275841 1549197312 36512 268435456000 4194304 4587354 140736994357024 18446744073709551615 4238671 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21953/statm: 378222 36512 334 96 0 374784 0
[pid=21954] ppid=21952 vsize=374572 CPUtime=5099.04 cores=1
/proc/21954/stat : 21954 (clasp) R 21952 21952 21926 0 -1 4202496 90671 0 0 0 509849 55 0 0 25 0 1 0 634275841 383561728 88220 268435456000 4194304 4785740 140734430712624 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21954/statm: 93643 88220 338 145 0 90688 0
[pid=21956] ppid=21952 vsize=191928 CPUtime=5099.05 cores=3
/proc/21956/stat : 21956 (march_hi) R 21952 21952 21926 0 -1 4202496 88172 0 0 0 509879 26 0 0 25 0 1 0 634275841 196534272 29475 268435456000 4194304 4331988 140736440634288 18446744073709551615 4299840 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21956/statm: 47982 29475 174 34 0 46424 0
[pid=21957] ppid=21952 vsize=2356496 CPUtime=141120 cores=4-31
/proc/21957/stat : 21957 (plingeling) S 21952 21952 21926 0 -1 4202496 2238133 1241 0 0 14110477 1516 0 1 18 0 29 0 634275841 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 14 0 0 0
/proc/21957/statm: 589124 468064 159 40 0 587668 0
[pid=21957/tid=21966] ppid=21952 vsize=2356496 CPUtime=4979.18 cores=4-31
/proc/21957/task/21966/stat : 21966 (plingeling) R 21952 21952 21926 0 -1 4202560 74882 1241 0 0 497861 56 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=21957/tid=21967] ppid=21952 vsize=2356496 CPUtime=4975.28 cores=4-31
/proc/21957/task/21967/stat : 21967 (plingeling) R 21952 21952 21926 0 -1 4202560 78842 1241 0 0 497484 43 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21957/tid=21968] ppid=21952 vsize=2356496 CPUtime=5095.77 cores=4-31
/proc/21957/task/21968/stat : 21968 (plingeling) R 21952 21952 21926 0 -1 4202560 98728 1241 0 0 509523 53 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=21957/tid=21969] ppid=21952 vsize=2356496 CPUtime=4973.01 cores=4-31
/proc/21957/task/21969/stat : 21969 (plingeling) R 21952 21952 21926 0 -1 4202560 46037 1241 0 0 497281 19 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210740 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=21957/tid=21970] ppid=21952 vsize=2356496 CPUtime=5095.84 cores=4-31
/proc/21957/task/21970/stat : 21970 (plingeling) R 21952 21952 21926 0 -1 4202560 69970 1241 0 0 509547 36 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21957/tid=21971] ppid=21952 vsize=2356496 CPUtime=5095.76 cores=4-31
/proc/21957/task/21971/stat : 21971 (plingeling) R 21952 21952 21926 0 -1 4202560 66317 1241 0 0 509508 67 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4279630 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=21957/tid=21972] ppid=21952 vsize=2356496 CPUtime=5083.88 cores=4-31
/proc/21957/task/21972/stat : 21972 (plingeling) R 21952 21952 21926 0 -1 4202560 66241 1241 0 0 508320 67 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4233969 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=21957/tid=21973] ppid=21952 vsize=2356496 CPUtime=5003.03 cores=4-31
/proc/21957/task/21973/stat : 21973 (plingeling) R 21952 21952 21926 0 -1 4202560 113254 1241 0 0 500216 86 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=21957/tid=21974] ppid=21952 vsize=2356496 CPUtime=4993.78 cores=4-31
/proc/21957/task/21974/stat : 21974 (plingeling) R 21952 21952 21926 0 -1 4202560 95312 1241 0 0 499323 54 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21957/tid=21975] ppid=21952 vsize=2356496 CPUtime=4980.93 cores=4-31
/proc/21957/task/21975/stat : 21975 (plingeling) R 21952 21952 21926 0 -1 4202560 77656 1241 0 0 498047 45 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=21957/tid=21976] ppid=21952 vsize=2356496 CPUtime=5071.16 cores=4-31
/proc/21957/task/21976/stat : 21976 (plingeling) R 21952 21952 21926 0 -1 4202560 70426 1241 0 0 507084 31 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=21957/tid=21977] ppid=21952 vsize=2356496 CPUtime=5060.17 cores=4-31
/proc/21957/task/21977/stat : 21977 (plingeling) R 21952 21952 21926 0 -1 4202560 46542 1241 0 0 506000 16 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=21957/tid=21978] ppid=21952 vsize=2356496 CPUtime=5080.84 cores=4-31
/proc/21957/task/21978/stat : 21978 (plingeling) R 21952 21952 21926 0 -1 4202560 61888 1241 0 0 508045 38 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=21957/tid=21979] ppid=21952 vsize=2356496 CPUtime=4930.51 cores=4-31
/proc/21957/task/21979/stat : 21979 (plingeling) R 21952 21952 21926 0 -1 4202560 63340 1241 0 0 493016 34 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=21957/tid=21980] ppid=21952 vsize=2356496 CPUtime=5014.04 cores=4-31
/proc/21957/task/21980/stat : 21980 (plingeling) R 21952 21952 21926 0 -1 4202560 73796 1241 0 0 501367 36 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=21957/tid=21981] ppid=21952 vsize=2356496 CPUtime=5087.52 cores=4-31
/proc/21957/task/21981/stat : 21981 (plingeling) R 21952 21952 21926 0 -1 4202560 125685 1241 0 0 508642 109 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4210823 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21957/tid=21982] ppid=21952 vsize=2356496 CPUtime=5067.54 cores=4-31
/proc/21957/task/21982/stat : 21982 (plingeling) R 21952 21952 21926 0 -1 4202560 90239 1241 0 0 506696 57 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=21957/tid=21983] ppid=21952 vsize=2356496 CPUtime=5095.72 cores=4-31
/proc/21957/task/21983/stat : 21983 (plingeling) R 21952 21952 21926 0 -1 4202560 74348 1241 0 0 509514 57 0 1 25 0 29 0 634276159 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=21957/tid=21984] ppid=21952 vsize=2356496 CPUtime=5095.7 cores=4-31
/proc/21957/task/21984/stat : 21984 (plingeling) R 21952 21952 21926 0 -1 4202560 89591 1241 0 0 509517 52 0 1 25 0 29 0 634276160 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=21957/tid=21985] ppid=21952 vsize=2356496 CPUtime=5050.09 cores=4-31
/proc/21957/task/21985/stat : 21985 (plingeling) R 21952 21952 21926 0 -1 4202560 36965 1241 0 0 504996 12 0 1 25 0 29 0 634276160 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=21957/tid=21986] ppid=21952 vsize=2356496 CPUtime=4889.68 cores=4-31
/proc/21957/task/21986/stat : 21986 (plingeling) R 21952 21952 21926 0 -1 4202560 93643 1241 0 0 488906 61 0 1 25 0 29 0 634276160 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=21957/tid=21987] ppid=21952 vsize=2356496 CPUtime=5095.81 cores=4-31
/proc/21957/task/21987/stat : 21987 (plingeling) R 21952 21952 21926 0 -1 4202560 89004 1241 0 0 509481 99 0 1 25 0 29 0 634276160 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=21957/tid=21988] ppid=21952 vsize=2356496 CPUtime=5013.99 cores=4-31
/proc/21957/task/21988/stat : 21988 (plingeling) R 21952 21952 21926 0 -1 4202560 89347 1241 0 0 501327 71 0 1 25 0 29 0 634276160 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=21957/tid=21989] ppid=21952 vsize=2356496 CPUtime=5050.28 cores=4-31
/proc/21957/task/21989/stat : 21989 (plingeling) R 21952 21952 21926 0 -1 4202560 139009 1241 0 0 504904 123 0 1 25 0 29 0 634276161 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=21957/tid=21990] ppid=21952 vsize=2356496 CPUtime=5095.76 cores=4-31
/proc/21957/task/21990/stat : 21990 (plingeling) R 21952 21952 21926 0 -1 4202560 91773 1241 0 0 509544 31 0 1 25 0 29 0 634276161 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4279432 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=21957/tid=21991] ppid=21952 vsize=2356496 CPUtime=4961.89 cores=4-31
/proc/21957/task/21991/stat : 21991 (plingeling) R 21952 21952 21926 0 -1 4202560 60393 1241 0 0 496140 48 0 1 25 0 29 0 634276161 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21957/tid=21992] ppid=21952 vsize=2356496 CPUtime=5083.86 cores=4-31
/proc/21957/task/21992/stat : 21992 (plingeling) R 21952 21952 21926 0 -1 4202560 77435 1241 0 0 508313 72 0 1 25 0 29 0 634276161 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=21957/tid=21993] ppid=21952 vsize=2356496 CPUtime=5095.75 cores=4-31
/proc/21957/task/21993/stat : 21993 (plingeling) R 21952 21952 21926 0 -1 4202560 20127 1241 0 0 509561 13 0 1 25 0 29 0 634276161 2413051904 468064 268435456000 4194304 4356188 140735836311168 18446744073709551615 4237364 0 0 4096 17442 0 0 0 -1 25 0 0 0
Current children cumulated CPU time (s) 156417
Current children cumulated vsize (KiB) 4454208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21952 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=17997
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=42993
# CPU time returned by wait4() is 0.06099
# while last known CPU time is 156417
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.04
CPU time (s): 156417
CPU user time (s): 156397
CPU system time (s): 20.52
CPU usage (%): 3066.98
Max. virtual memory (cumulated for all children) (KiB): 5888668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.017997
system time used= 0.042993
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1709
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 475
involuntary context switches= 3

runsolver used 26.8239 second user time and 117.035 second system time

The end

Launcher Data

Begin job on node200 at 2011-05-12 21:18:14
IDJOB=3347521
IDBENCH=83105
IDSOLVER=1808
FILE ID=node200/3347521-1305227894
RUNJOBID= node200-1305227894-21940
PBS_JOBID= 13282101
Free space on /tmp= 62048 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom24.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347521-1305227894/watcher-3347521-1305227894 -o /tmp/evaluation-result-3347521-1305227894/solver-3347521-1305227894 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347521-1305227894.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 16e1f2a4ab0c9df60ac0d098f9f252bb
RANDOM SEED=338313848

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255633972 kB
Buffers:        430408 kB
Cached:        7792632 kB
SwapCached:          0 kB
Active:        7367604 kB
Inactive:       924036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255633972 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           13812 kB
Writeback:           0 kB
AnonPages:       70640 kB
Mapped:          14024 kB
Slab:           249304 kB
PageTables:       4244 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   188748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62032 MiB
End job on node200 at 2011-05-12 22:43:16