Trace number 3310328

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.3 5003.52

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_1_keyfind_1.cnf
MD5SUM5092a9db644d53c7bc023e4dff206812
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1192
Number of clauses10656
Sum of the clauses size56868
Maximum clause length8
Minimum clause length1
Number of clauses of size 1264
Number of clauses of size 2128
Number of clauses of size 32016
Number of clauses of size 4320
Number of clauses of size 52048
Number of clauses of size over 55880

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310328-1304012130/watcher-3310328-1304012130 -o /tmp/evaluation-result-3310328-1304012130/solver-3310328-1304012130 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310328-1304012130.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.86 7.80 7.92 2/170 25116
/proc/meminfo: memFree=24526168/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 4 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0

[startup+0.133349 s]
/proc/loadavg: 6.86 7.80 7.92 2/170 25116
/proc/meminfo: memFree=24526168/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) R 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200339 s]
/proc/loadavg: 6.86 7.80 7.92 2/170 25116
/proc/meminfo: memFree=24526168/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) R 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30032 s]
/proc/loadavg: 6.86 7.80 7.92 2/170 25116
/proc/meminfo: memFree=24526168/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) R 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700247 s]
/proc/loadavg: 6.86 7.80 7.92 2/170 25116
/proc/meminfo: memFree=24526168/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) R 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 22 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5011 s]
/proc/loadavg: 6.86 7.80 7.92 9/180 25131
/proc/meminfo: memFree=24488392/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 16 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1301124 CPUtime=1.49 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 4794 0 0 0 149 0 0 0 20 0 1 0 512810721 1332350976 2675 33554432000 4194304 4587354 140737443102576 18446744073709551615 4238449 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 325281 2675 338 96 0 321843 0
[pid=25118] ppid=25116 vsize=16656 CPUtime=1.49 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 1626 0 0 0 149 0 0 0 20 0 1 0 512810721 17055744 1507 33554432000 4194304 4785740 140734127770416 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 4164 1507 341 145 0 1209 0
[pid=25119] ppid=25116 vsize=456880 CPUtime=1.49 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 675 0 0 0 149 0 0 0 20 0 1 0 512810721 467845120 572 33554432000 134512640 134534564 4292117216 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114220 572 95 6 0 112886 0
[pid=25120] ppid=25116 vsize=15712 CPUtime=1.48 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 4366 0 0 0 148 0 0 0 20 0 1 0 512810721 16089088 1963 33554432000 4194304 4331988 140733781962224 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 3928 1963 175 34 0 2370 0
[pid=25121] ppid=25116 vsize=125532 CPUtime=5.9 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 5407 1259 0 0 590 0 0 0 18 0 5 0 512810721 128544768 3536 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 31383 3536 163 40 0 29927 0
[pid=25121/tid=25128] ppid=25116 vsize=125532 CPUtime=1.47 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 974 1259 0 0 147 0 0 0 24 0 5 0 512810723 128544768 3536 33554432000 4194304 4356188 140734208862144 18446744073709551615 4234076 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=125532 CPUtime=1.47 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 1000 1259 0 0 147 0 0 0 23 0 5 0 512810723 128544768 3536 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331841 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=125532 CPUtime=1.47 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 845 1259 0 0 147 0 0 0 23 0 5 0 512810723 128544768 3536 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=125532 CPUtime=1.46 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 1303 1259 0 0 146 0 0 0 23 0 5 0 512810723 128544768 3536 33554432000 4194304 4356188 140734208862144 18446744073709551615 4210579 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.85
Current children cumulated vsize (KiB) 1934228

[startup+3.10081 s]
/proc/loadavg: 6.95 7.80 7.92 9/180 25131
/proc/meminfo: memFree=24485284/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1300120 CPUtime=3.09 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 6851 0 0 0 308 1 0 0 25 0 1 0 512810721 1331322880 2754 33554432000 4194304 4587354 140737443102576 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 325030 2754 338 96 0 321592 0
[pid=25118] ppid=25116 vsize=17604 CPUtime=3.09 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 1875 0 0 0 309 0 0 0 25 0 1 0 512810721 18026496 1756 33554432000 4194304 4785740 140734127770416 18446744073709551615 4287070 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 4401 1756 341 145 0 1446 0
[pid=25119] ppid=25116 vsize=456880 CPUtime=3.09 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 675 0 0 0 309 0 0 0 25 0 1 0 512810721 467845120 572 33554432000 134512640 134534564 4292117216 18446744073709551615 7595408 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114220 572 95 6 0 112886 0
[pid=25120] ppid=25116 vsize=15932 CPUtime=3.08 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 4400 0 0 0 308 0 0 0 25 0 1 0 512810721 16314368 1997 33554432000 4194304 4331988 140733781962224 18446744073709551615 4299865 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 3983 1997 175 34 0 2425 0
[pid=25121] ppid=25116 vsize=129388 CPUtime=12.3 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 6852 1259 0 0 1229 1 0 0 18 0 5 0 512810721 132493312 4501 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 32347 4501 163 40 0 30891 0
[pid=25121/tid=25128] ppid=25116 vsize=129388 CPUtime=3.07 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 1295 1259 0 0 307 0 0 0 25 0 5 0 512810723 132493312 4501 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=129388 CPUtime=3.07 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 1483 1259 0 0 307 0 0 0 25 0 5 0 512810723 132493312 4501 33554432000 4194304 4356188 140734208862144 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=129388 CPUtime=3.07 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 1133 1259 0 0 307 0 0 0 25 0 5 0 512810723 132493312 4501 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=129388 CPUtime=3.05 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 1656 1259 0 0 305 0 0 0 25 0 5 0 512810723 132493312 4501 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.65
Current children cumulated vsize (KiB) 1938248

[startup+6.30123 s]
/proc/loadavg: 6.95 7.80 7.92 9/180 25131
/proc/meminfo: memFree=24476380/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1306080 CPUtime=6.29 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 10803 0 0 0 628 1 0 0 25 0 1 0 512810721 1337425920 4159 33554432000 4194304 4587354 140737443102576 18446744073709551615 4244806 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 326520 4159 338 96 0 323082 0
[pid=25118] ppid=25116 vsize=19004 CPUtime=6.29 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 2198 0 0 0 629 0 0 0 25 0 1 0 512810721 19460096 2079 33554432000 4194304 4785740 140734127770416 18446744073709551615 4287096 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 4751 2079 341 145 0 1796 0
[pid=25119] ppid=25116 vsize=456880 CPUtime=6.29 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 675 0 0 0 629 0 0 0 25 0 1 0 512810721 467845120 572 33554432000 134512640 134534564 4292117216 18446744073709551615 134528993 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114220 572 95 6 0 112886 0
[pid=25120] ppid=25116 vsize=15932 CPUtime=6.29 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 4437 0 0 0 629 0 0 0 25 0 1 0 512810721 16314368 2034 33554432000 4194304 4331988 140733781962224 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 3983 2034 175 34 0 2425 0
[pid=25121] ppid=25116 vsize=130820 CPUtime=25.08 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 7594 1259 0 0 2507 1 0 0 18 0 5 0 512810721 133959680 4859 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 32705 4859 163 40 0 31249 0
[pid=25121/tid=25128] ppid=25116 vsize=130820 CPUtime=6.27 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 1489 1259 0 0 627 0 0 0 25 0 5 0 512810723 133959680 4859 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=130820 CPUtime=6.27 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 1612 1259 0 0 627 0 0 0 25 0 5 0 512810723 133959680 4859 33554432000 4194304 4356188 140734208862144 18446744073709551615 4279481 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=130820 CPUtime=6.27 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 1294 1259 0 0 627 0 0 0 25 0 5 0 512810723 133959680 4859 33554432000 4194304 4356188 140734208862144 18446744073709551615 4273874 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=130820 CPUtime=6.24 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 1914 1259 0 0 624 0 0 0 25 0 5 0 512810723 133959680 4859 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.24
Current children cumulated vsize (KiB) 1947040

[startup+12.7011 s]
/proc/loadavg: 7.11 7.81 7.92 9/180 25131
/proc/meminfo: memFree=24470924/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1314772 CPUtime=12.69 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 16831 0 0 0 1267 2 0 0 25 0 1 0 512810721 1346326528 4365 33554432000 4194304 4587354 140737443102576 18446744073709551615 212687371924 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 328693 4365 338 96 0 325255 0
[pid=25118] ppid=25116 vsize=20640 CPUtime=12.69 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 2586 0 0 0 1269 0 0 0 25 0 1 0 512810721 21135360 2467 33554432000 4194304 4785740 140734127770416 18446744073709551615 4287088 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 5160 2467 341 145 0 2205 0
[pid=25119] ppid=25116 vsize=456880 CPUtime=12.69 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 675 0 0 0 1269 0 0 0 25 0 1 0 512810721 467845120 572 33554432000 134512640 134534564 4292117216 18446744073709551615 134529024 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114220 572 95 6 0 112886 0
[pid=25120] ppid=25116 vsize=16388 CPUtime=12.69 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 4536 0 0 0 1269 0 0 0 25 0 1 0 512810721 16781312 2133 33554432000 4194304 4331988 140733781962224 18446744073709551615 4299190 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 4097 2133 175 34 0 2539 0
[pid=25121] ppid=25116 vsize=132104 CPUtime=50.64 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 8971 1259 0 0 5063 1 0 0 18 0 5 0 512810721 135274496 5180 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 33026 5180 163 40 0 31570 0
[pid=25121/tid=25128] ppid=25116 vsize=132104 CPUtime=12.67 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 1713 1259 0 0 1267 0 0 0 25 0 5 0 512810723 135274496 5180 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=132104 CPUtime=12.67 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 1964 1259 0 0 1267 0 0 0 25 0 5 0 512810723 135274496 5180 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=132104 CPUtime=12.67 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 1550 1259 0 0 1267 0 0 0 25 0 5 0 512810723 135274496 5180 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331133 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=132104 CPUtime=12.6 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 2459 1259 0 0 1260 0 0 0 25 0 5 0 512810723 135274496 5180 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.4
Current children cumulated vsize (KiB) 1959108

[startup+25.5007 s]
/proc/loadavg: 7.25 7.81 7.92 9/180 25131
/proc/meminfo: memFree=24460956/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1311244 CPUtime=25.49 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 25465 0 0 0 2546 3 0 0 25 0 1 0 512810721 1342713856 5444 33554432000 4194304 4587354 140737443102576 18446744073709551615 4238442 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=25119] ppid=25116 vsize=456884 CPUtime=4781.63 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 684 0 0 0 478162 1 0 0 25 0 1 0 512810721 467849216 581 33554432000 134512640 134534564 4292117216 18446744073709551615 134530260 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114221 581 103 6 0 112887 0
[pid=25120] ppid=25116 vsize=281104 CPUtime=4782.43 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 55325 0 0 0 478201 42 0 0 25 0 1 0 512810721 287850496 52922 33554432000 4194304 4331988 140733781962224 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 70276 52922 175 34 0 68718 0
[pid=25121] ppid=25116 vsize=244248 CPUtime=19103 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 466431 1259 0 0 1910222 76 0 0 18 0 5 0 512810721 250109952 33183 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 61062 33183 163 40 0 59606 0
[pid=25121/tid=25128] ppid=25116 vsize=244248 CPUtime=4782.26 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 76405 1259 0 0 478214 12 0 0 25 0 5 0 512810723 250109952 33183 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=244248 CPUtime=4781.93 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 131057 1259 0 0 478173 20 0 0 25 0 5 0 512810723 250109952 33183 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=244248 CPUtime=4782.41 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 107062 1259 0 0 478225 16 0 0 25 0 5 0 512810723 250109952 33183 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331039 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=244248 CPUtime=4756.33 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 150622 1259 0 0 475607 26 0 0 25 0 5 0 512810723 250109952 33183 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231.9
Current children cumulated vsize (KiB) 2563280

[startup+4842.31 s]
/proc/loadavg: 8.04 8.03 8.00 9/180 25272
/proc/meminfo: memFree=23942736/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1493728 CPUtime=4842.42 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 532242 0 0 0 484027 215 0 0 25 0 1 0 512810721 1529577472 44348 33554432000 4194304 4587354 140737443102576 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 373432 44348 338 96 0 369994 0
[pid=25118] ppid=25116 vsize=83996 CPUtime=4842.42 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 17843 0 0 0 484238 4 0 0 25 0 1 0 512810721 86011904 16842 33554432000 4194304 4785740 140734127770416 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 20999 16842 341 145 0 18044 0
[pid=25119] ppid=25116 vsize=456884 CPUtime=4841.64 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 684 0 0 0 484163 1 0 0 25 0 1 0 512810721 467849216 581 33554432000 134512640 134534564 4292117216 18446744073709551615 134530509 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114221 581 103 6 0 112887 0
[pid=25120] ppid=25116 vsize=281104 CPUtime=4842.44 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 55970 0 0 0 484201 43 0 0 25 0 1 0 512810721 287850496 53567 33554432000 4194304 4331988 140733781962224 18446744073709551615 4210940 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 70276 53567 175 34 0 68718 0
[pid=25121] ppid=25116 vsize=236056 CPUtime=19342.7 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 468095 1259 0 0 1934190 76 0 0 18 0 5 0 512810721 241721344 31135 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 59014 31135 163 40 0 57558 0
[pid=25121/tid=25128] ppid=25116 vsize=236056 CPUtime=4842.26 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 76917 1259 0 0 484214 12 0 0 25 0 5 0 512810723 241721344 31135 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=236056 CPUtime=4841.92 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 131057 1259 0 0 484172 20 0 0 25 0 5 0 512810723 241721344 31135 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332260 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=236056 CPUtime=4842.41 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 108214 1259 0 0 484225 16 0 0 25 0 5 0 512810723 241721344 31135 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=236056 CPUtime=4816.01 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 150622 1259 0 0 481575 26 0 0 25 0 5 0 512810723 241721344 31135 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38711.6
Current children cumulated vsize (KiB) 2570092

[startup+4902.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/180 25273
/proc/meminfo: memFree=23915568/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1462940 CPUtime=4902.42 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 535451 0 0 0 490025 217 0 0 25 0 1 0 512810721 1498050560 44348 33554432000 4194304 4587354 140737443102576 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 365735 44348 338 96 0 362297 0
[pid=25118] ppid=25116 vsize=84876 CPUtime=4902.41 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 18086 0 0 0 490237 4 0 0 25 0 1 0 512810721 86913024 17037 33554432000 4194304 4785740 140734127770416 18446744073709551615 4287076 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 21219 17037 341 145 0 18264 0
[pid=25119] ppid=25116 vsize=456884 CPUtime=4901.64 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 684 0 0 0 490163 1 0 0 25 0 1 0 512810721 467849216 581 33554432000 134512640 134534564 4292117216 18446744073709551615 134530538 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114221 581 103 6 0 112887 0
[pid=25120] ppid=25116 vsize=281104 CPUtime=4902.43 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 56643 0 0 0 490200 43 0 0 25 0 1 0 512810721 287850496 54240 33554432000 4194304 4331988 140733781962224 18446744073709551615 4237147 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 70276 54240 175 34 0 68718 0
[pid=25121] ppid=25116 vsize=260760 CPUtime=19582.3 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 475967 1259 0 0 1958155 78 0 0 18 0 5 0 512810721 267018240 37311 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 65190 37311 163 40 0 63734 0
[pid=25121/tid=25128] ppid=25116 vsize=260760 CPUtime=4902.26 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 77045 1259 0 0 490214 12 0 0 25 0 5 0 512810723 267018240 37311 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=260760 CPUtime=4901.93 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 131857 1259 0 0 490172 21 0 0 25 0 5 0 512810723 267018240 37311 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=260760 CPUtime=4902.41 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 111190 1259 0 0 490224 17 0 0 25 0 5 0 512810723 267018240 37311 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=260760 CPUtime=4875.68 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 154590 1259 0 0 487542 26 0 0 25 0 5 0 512810723 267018240 37311 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39191.2
Current children cumulated vsize (KiB) 2564888

[startup+4962.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/180 25275
/proc/meminfo: memFree=23909228/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1462940 CPUtime=4962.42 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 536383 0 0 0 496024 218 0 0 25 0 1 0 512810721 1498050560 45263 33554432000 4194304 4587354 140737443102576 18446744073709551615 4238647 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 365735 45263 338 96 0 362297 0
[pid=25118] ppid=25116 vsize=86016 CPUtime=4962.41 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 18355 0 0 0 496237 4 0 0 25 0 1 0 512810721 88080384 17306 33554432000 4194304 4785740 140734127770416 18446744073709551615 4278093 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 21504 17306 341 145 0 18549 0
[pid=25119] ppid=25116 vsize=456884 CPUtime=4961.64 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 684 0 0 0 496163 1 0 0 25 0 1 0 512810721 467849216 581 33554432000 134512640 134534564 4292117216 18446744073709551615 134528404 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114221 581 103 6 0 112887 0
[pid=25120] ppid=25116 vsize=281104 CPUtime=4962.43 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 57302 0 0 0 496200 43 0 0 25 0 1 0 512810721 287850496 54899 33554432000 4194304 4331988 140733781962224 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 70276 54899 175 34 0 68718 0
[pid=25121] ppid=25116 vsize=259992 CPUtime=19822 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 479519 1259 0 0 1982121 78 0 0 18 0 5 0 512810721 266231808 37119 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 64998 37119 163 40 0 63542 0
[pid=25121/tid=25128] ppid=25116 vsize=259992 CPUtime=4962.26 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 77109 1259 0 0 496214 12 0 0 25 0 5 0 512810723 266231808 37119 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=259992 CPUtime=4961.92 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 134641 1259 0 0 496171 21 0 0 25 0 5 0 512810723 266231808 37119 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=259992 CPUtime=4962.42 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 111190 1259 0 0 496225 17 0 0 25 0 5 0 512810723 266231808 37119 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=259992 CPUtime=4935.35 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 155294 1259 0 0 493509 26 0 0 25 0 5 0 512810723 266231808 37119 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670.9
Current children cumulated vsize (KiB) 2565260



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.5 s]
/proc/loadavg: 8.12 8.05 8.01 9/180 25276
/proc/meminfo: memFree=23900408/32951124 swapFree=67111524/67111528
[pid=25116] ppid=25114 vsize=18324 CPUtime=0 cores=0-7
/proc/25116/stat : 25116 (ppfolio) S 25114 25116 25090 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 512810721 18763776 390 33554432000 4194304 4287625 140737415013264 18446744073709551615 212687695375 0 0 4096 65536 4605476530804490239 0 0 17 6 0 0 0
/proc/25116/statm: 4581 390 341 23 0 91 0
[pid=25117] ppid=25116 vsize=1462940 CPUtime=5003.62 cores=0
/proc/25117/stat : 25117 (cryptominisat) R 25116 25116 25090 0 -1 4202496 538420 0 0 0 500144 218 0 0 25 0 1 0 512810721 1498050560 47264 33554432000 4194304 4587354 140737443102576 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25117/statm: 365735 47264 338 96 0 362297 0
[pid=25118] ppid=25116 vsize=86300 CPUtime=5003.62 cores=1
/proc/25118/stat : 25118 (clasp) R 25116 25116 25090 0 -1 4202496 18403 0 0 0 500358 4 0 0 25 0 1 0 512810721 88371200 17354 33554432000 4194304 4785740 140734127770416 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/25118/statm: 21575 17354 341 145 0 18620 0
[pid=25119] ppid=25116 vsize=456884 CPUtime=5002.85 cores=2
/proc/25119/stat : 25119 (TNM) R 25116 25116 25090 0 -1 4202496 684 0 0 0 500284 1 0 0 25 0 1 0 512810721 467849216 581 33554432000 134512640 134534564 4292117216 18446744073709551615 134530522 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25119/statm: 114221 581 103 6 0 112887 0
[pid=25120] ppid=25116 vsize=281104 CPUtime=5003.64 cores=3
/proc/25120/stat : 25120 (march_hi) R 25116 25116 25090 0 -1 4202496 57783 0 0 0 500320 44 0 0 25 0 1 0 512810721 287850496 55380 33554432000 4194304 4331988 140733781962224 18446744073709551615 4242589 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/25120/statm: 70276 55380 175 34 0 68718 0
[pid=25121] ppid=25116 vsize=258712 CPUtime=19986.6 cores=4-7
/proc/25121/stat : 25121 (plingeling) S 25116 25116 25090 0 -1 4202496 480799 1259 0 0 1998580 79 0 0 18 0 5 0 512810721 264921088 36799 33554432000 4194304 4356188 140734208862144 18446744073709551615 212699477989 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/25121/statm: 64678 36799 163 40 0 63222 0
[pid=25121/tid=25128] ppid=25116 vsize=258712 CPUtime=5003.46 cores=4-7
/proc/25121/task/25128/stat : 25128 (plingeling) R 25116 25116 25090 0 -1 4202560 77365 1259 0 0 500334 12 0 0 25 0 5 0 512810723 264921088 36799 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25121/tid=25129] ppid=25116 vsize=258712 CPUtime=5003.12 cores=4-7
/proc/25121/task/25129/stat : 25129 (plingeling) R 25116 25116 25090 0 -1 4202560 134641 1259 0 0 500291 21 0 0 25 0 5 0 512810723 264921088 36799 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25121/tid=25130] ppid=25116 vsize=258712 CPUtime=5003.62 cores=4-7
/proc/25121/task/25130/stat : 25130 (plingeling) R 25116 25116 25090 0 -1 4202560 111702 1259 0 0 500345 17 0 0 25 0 5 0 512810723 264921088 36799 33554432000 4194304 4356188 140734208862144 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25121/tid=25131] ppid=25116 vsize=258712 CPUtime=4976.33 cores=4-7
/proc/25121/task/25131/stat : 25131 (plingeling) R 25116 25116 25090 0 -1 4202560 155806 1259 0 0 497607 26 0 0 25 0 5 0 512810723 264921088 36799 33554432000 4194304 4356188 140734208862144 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 2564264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25116 and gives
#  childrusage.ru_utime.tv_sec=10006
#  childrusage.ru_utime.tv_usec=430791
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=70989
# CPU time returned by wait4() is 10006.5
# while last known CPU time is 40000.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.52
CPU time (s): 40000.3
CPU user time (s): 39996.9
CPU system time (s): 3.46
CPU usage (%): 799.444
Max. virtual memory (cumulated for all children) (KiB): 3607528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10006.4
system time used= 0.070989
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19623
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 652
involuntary context switches= 32206

runsolver used 7.62384 second user time and 19.669 second system time

The end

Launcher Data 

Begin job on node139 at 2011-04-28 19:35:30
IDJOB=3310328
IDBENCH=83412
IDSOLVER=1638
FILE ID=node139/3310328-1304012130
RUNJOBID= node139-1304012130-25104
PBS_JOBID= 13168859
Free space on /tmp= 72552 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_1_keyfind_1.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310328-1304012130/watcher-3310328-1304012130 -o /tmp/evaluation-result-3310328-1304012130/solver-3310328-1304012130 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310328-1304012130.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 5092a9db644d53c7bc023e4dff206812
RANDOM SEED=1079205864

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24526696 kB
Buffers:       2008156 kB
Cached:        5834568 kB
SwapCached:          4 kB
Active:         670480 kB
Inactive:      7234788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24526696 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10152 kB
Writeback:           0 kB
AnonPages:       62432 kB
Mapped:          14252 kB
Slab:           452156 kB
PageTables:       4976 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   183560 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72544 MiB
End job on node139 at 2011-04-28 20:58:55