Trace number 3219879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39971.2 5000.02

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S536077088-015-UNKNOWN.cnf
MD5SUM7eb6d5b5c1c99a6b88954b61ac97b4f7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219879-1304154460/watcher-3219879-1304154460 -o /tmp/evaluation-result-3219879-1304154460/solver-3219879-1304154460 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3219879-1304154460.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.44 7.91 7.96 1/170 5773
/proc/meminfo: memFree=25128448/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 517 0 0 0 0 0 0 0 23 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 2826088480822 0 0 17 5 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0

[startup+0.0312241 s]
/proc/loadavg: 7.44 7.91 7.96 1/170 5773
/proc/meminfo: memFree=25128448/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) R 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.887035 s]
/proc/loadavg: 7.44 7.91 7.96 1/170 5773
/proc/meminfo: memFree=25128448/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.901031 s]
/proc/loadavg: 7.44 7.91 7.96 1/170 5773
/proc/meminfo: memFree=25128448/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00102 s]
/proc/loadavg: 7.44 7.91 7.96 1/170 5773
/proc/meminfo: memFree=25128448/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 17 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50093 s]
/proc/loadavg: 7.44 7.91 7.96 1/170 5773
/proc/meminfo: memFree=25128448/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10064 s]
/proc/loadavg: 7.64 7.94 7.97 9/180 5788
/proc/meminfo: memFree=25073560/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=191620 CPUtime=3.08 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 9477 0 0 0 307 1 0 0 25 0 1 0 507861827 196218880 2810 33554432000 4194304 4587354 140734623235424 18446744073709551615 233509994174 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 47905 2810 327 96 0 44467 0
[pid=5775] ppid=5773 vsize=25472 CPUtime=3.08 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 3967 0 0 0 308 0 0 0 25 0 1 0 507861827 26083328 3699 33554432000 4194304 4785740 140735863778512 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 6368 3699 340 145 0 3413 0
[pid=5776] ppid=5773 vsize=456220 CPUtime=3.09 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1457 0 0 0 309 0 0 0 25 0 1 0 507861827 467169280 1354 33554432000 134512640 134534564 4290670528 18446744073709551615 134524666 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 114055 1354 91 6 0 112721 0
[pid=5777] ppid=5773 vsize=17024 CPUtime=3.09 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 7763 0 0 0 308 1 0 0 25 0 1 0 507861827 17432576 2243 33554432000 4194304 4331988 140736989445584 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 4256 2243 174 34 0 2698 0
[pid=5778] ppid=5773 vsize=127496 CPUtime=12.11 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 9410 1248 0 0 1210 1 0 0 18 0 5 0 507861827 130555904 3948 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 31874 3948 162 40 0 30418 0
[pid=5778/tid=5785] ppid=5773 vsize=127496 CPUtime=3.01 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 1120 1248 0 0 301 0 0 0 24 0 5 0 507861834 130555904 3948 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=127496 CPUtime=3.01 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 1166 1248 0 0 301 0 0 0 25 0 5 0 507861834 130555904 3948 33554432000 4194304 4356188 140734077357920 18446744073709551615 4234124 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=127496 CPUtime=3.01 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 1236 1248 0 0 301 0 0 0 25 0 5 0 507861835 130555904 3948 33554432000 4194304 4356188 140734077357920 18446744073709551615 4332136 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=127496 CPUtime=3 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 1271 1248 0 0 300 0 0 0 25 0 5 0 507861835 130555904 3948 33554432000 4194304 4356188 140734077357920 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.45
Current children cumulated vsize (KiB) 836156

[startup+6.30107 s]
/proc/loadavg: 7.67 7.94 7.97 9/180 5789
/proc/meminfo: memFree=25052108/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=209740 CPUtime=6.29 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 15466 0 0 0 627 2 0 0 25 0 1 0 507861827 214773760 7337 33554432000 4194304 4587354 140734623235424 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 52435 7337 337 96 0 48997 0
[pid=5775] ppid=5773 vsize=28160 CPUtime=6.29 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 4593 0 0 0 628 1 0 0 25 0 1 0 507861827 28835840 4325 33554432000 4194304 4785740 140735863778512 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 7040 4325 340 145 0 4085 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=6.29 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 629 0 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134528891 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=17024 CPUtime=6.29 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 7764 0 0 0 628 1 0 0 25 0 1 0 507861827 17432576 2244 33554432000 4194304 4331988 140736989445584 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 4256 2244 174 34 0 2698 0
[pid=5778] ppid=5773 vsize=132564 CPUtime=24.89 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 11733 1248 0 0 2488 1 0 0 18 0 5 0 507861827 135745536 5247 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 33141 5247 162 40 0 31685 0
[pid=5778/tid=5785] ppid=5773 vsize=132564 CPUtime=6.21 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 1921 1248 0 0 621 0 0 0 25 0 5 0 507861834 135745536 5247 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=132564 CPUtime=6.21 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 1423 1248 0 0 621 0 0 0 25 0 5 0 507861834 135745536 5247 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331510 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=132564 CPUtime=6.21 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 1316 1248 0 0 621 0 0 0 25 0 5 0 507861835 135745536 5247 33554432000 4194304 4356188 140734077357920 18446744073709551615 4271986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=132564 CPUtime=6.18 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 2456 1248 0 0 618 0 0 0 25 0 5 0 507861835 135745536 5247 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331281 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.05
Current children cumulated vsize (KiB) 866520

[startup+12.7009 s]
/proc/loadavg: 7.70 7.94 7.97 9/180 5789
/proc/meminfo: memFree=25022256/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=220656 CPUtime=12.7 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 22065 0 0 0 1267 3 0 0 25 0 1 0 507861827 225951744 12352 33554432000 4194304 4587354 140734623235424 18446744073709551615 4365361 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 55164 12352 337 96 0 51726 0
[pid=5775] ppid=5773 vsize=32568 CPUtime=12.69 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 5691 0 0 0 1268 1 0 0 25 0 1 0 507861827 33349632 5423 33554432000 4194304 4785740 140735863778512 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 8142 5423 340 145 0 5187 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=12.69 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 1269 0 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=17024 CPUtime=12.69 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 7764 0 0 0 1268 1 0 0 25 0 1 0 507861827 17432576 2244 33554432000 4194304 4331988 140736989445584 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 4256 2244 174 34 0 2698 0
[pid=5778] ppid=5773 vsize=136388 CPUtime=50.48 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 15570 1248 0 0 5046 2 0 0 18 0 5 0 507861827 139661312 6203 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 34097 6203 162 40 0 32641 0
[pid=5778/tid=5785] ppid=5773 vsize=136388 CPUtime=12.61 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 3339 1248 0 0 1261 0 0 0 25 0 5 0 507861834 139661312 6203 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=136388 CPUtime=12.61 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 2550 1248 0 0 1261 0 0 0 25 0 5 0 507861834 139661312 6203 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=136388 CPUtime=12.61 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 1990 1248 0 0 1261 0 0 0 25 0 5 0 507861835 139661312 6203 33554432000 4194304 4356188 140734077357920 18446744073709551615 4279630 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=136388 CPUtime=12.55 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 3074 1248 0 0 1255 0 0 0 25 0 5 0 507861835 139661312 6203 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.25
Current children cumulated vsize (KiB) 885668

[startup+25.5006 s]
/proc/loadavg: 7.74 7.94 7.97 9/180 5789
/proc/meminfo: memFree=25012672/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 7 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=224460 CPUtime=25.48 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 31829 0 0 0 2544 4 0 0 25 0 1 0 507861827 229847040 13241 33554432000 4194304 4587354 140734623235424 18446744073709551615 4364897 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 56115 13241 337 96 0 52677 0
[pid=5775] ppid=5773 vsize=37464 CPUtime=25.49 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 6841 0 0 0 2548 1 0 0 25 0 1 0 507861827 38363136 6573 33554432000 4194304 4785740 140735863778512 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 9366 6573 340 145 0 6411 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=25.48 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 2548 0 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=19324 CPUtime=25.49 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 8236 0 0 0 2548 1 0 0 25 0 1 0 507861827 19787776 2716 33554432000 4194304 4331988 140736989445584 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 4831 2716 175 34 0 3273 0
[pid=5778] ppid=5773 vsize=137580 CPUtime=101.58 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 19548 1248 0 0 10156 2 0 0 18 0 5 0 507861827 140881920 6469 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 34395 6469 162 40 0 32939 0
[pid=5778/tid=5785] ppid=5773 vsize=137580 CPUtime=25.4 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 4013 1248 0 0 2540 0 0 0 25 0 5 0 507861834 140881920 6469 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=137580 CPUtime=25.4 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 3480 1248 0 0 2540 0 0 0 25 0 5 0 507861834 140881920 6469 33554432000 4194304 4356188 140734077357920 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=137580 CPUtime=25.4 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 3401 1248 0 0 2540 0 0 0 25 0 5 0 507861835 140881920 6469 33554432000 4194304 4356188 140734077357920 18446744073709551615 4225577 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=137580 CPUtime=25.27 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 4037 1248 0 0 2527 0 0 0 25 0 5 0 507861835 140881920 6469 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.52
Current children cumulated vsize (KiB) 897860

################
# More data... #
################

[pid=5776] ppid=5773 vsize=460708 CPUtime=4842.11 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 484208 3 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=472224 CPUtime=4842.41 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 120205 0 0 0 484161 80 0 0 25 0 1 0 507861827 483557376 114685 33554432000 4194304 4331988 140736989445584 18446744073709551615 4237419 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 118056 114685 175 34 0 116498 0
[pid=5778] ppid=5773 vsize=213548 CPUtime=19341.2 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 399531 1248 0 0 1934054 69 0 0 18 0 5 0 507861827 218673152 25493 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 53387 25493 162 40 0 51931 0
[pid=5778/tid=5785] ppid=5773 vsize=213548 CPUtime=4841.66 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 105392 1248 0 0 484148 18 0 0 25 0 5 0 507861834 218673152 25493 33554432000 4194304 4356188 140734077357920 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=213548 CPUtime=4842.33 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 88507 1248 0 0 484218 15 0 0 25 0 5 0 507861834 218673152 25493 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=213548 CPUtime=4841.21 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 83790 1248 0 0 484108 13 0 0 25 0 5 0 507861835 218673152 25493 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=213548 CPUtime=4815.94 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 117225 1248 0 0 481573 21 0 0 25 0 5 0 507861835 218673152 25493 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.4
Current children cumulated vsize (KiB) 1795416

[startup+4902.31 s]
/proc/loadavg: 8.08 8.06 8.01 9/180 5934
/proc/meminfo: memFree=24152964/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 0 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=428100 CPUtime=4902.4 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 1238632 0 0 0 489721 519 0 0 25 0 1 0 507861827 438374400 55653 33554432000 4194304 4587354 140734623235424 18446744073709551615 4364908 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 107025 55653 337 96 0 103587 0
[pid=5775] ppid=5773 vsize=204224 CPUtime=4902.26 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 44623 0 0 0 490214 12 0 0 25 0 1 0 507861827 209125376 44020 33554432000 4194304 4785740 140735863778512 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 51056 44020 340 145 0 48101 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=4902.12 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 490209 3 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=695988 CPUtime=4902.42 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 121690 0 0 0 490161 81 0 0 25 0 1 0 507861827 712691712 116170 33554432000 4194304 4331988 140736989445584 18446744073709551615 4287604 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 173997 116170 175 34 0 172439 0
[pid=5778] ppid=5773 vsize=222764 CPUtime=19580.9 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 404267 1248 0 0 1958023 70 0 0 18 0 5 0 507861827 228110336 27797 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 55691 27797 162 40 0 54235 0
[pid=5778/tid=5785] ppid=5773 vsize=222764 CPUtime=4901.66 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 107632 1248 0 0 490148 18 0 0 25 0 5 0 507861834 228110336 27797 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=222764 CPUtime=4902.34 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 88699 1248 0 0 490219 15 0 0 25 0 5 0 507861834 228110336 27797 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=222764 CPUtime=4901.21 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 83982 1248 0 0 490108 13 0 0 25 0 5 0 507861835 228110336 27797 33554432000 4194304 4356188 140734077357920 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=222764 CPUtime=4875.61 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 119337 1248 0 0 487540 21 0 0 25 0 5 0 507861835 228110336 27797 33554432000 4194304 4356188 140734077357920 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.1
Current children cumulated vsize (KiB) 2030108

[startup+4962.3 s]
/proc/loadavg: 8.09 8.06 8.01 9/180 5936
/proc/meminfo: memFree=24262796/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 0 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=261712 CPUtime=4962.4 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 1244400 0 0 0 495717 523 0 0 25 0 1 0 507861827 267993088 22563 33554432000 4194304 4587354 140734623235424 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 65428 22563 337 96 0 61990 0
[pid=5775] ppid=5773 vsize=204224 CPUtime=4962.26 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 44643 0 0 0 496214 12 0 0 25 0 1 0 507861827 209125376 44040 33554432000 4194304 4785740 140735863778512 18446744073709551615 233509995205 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 51056 44040 340 145 0 48101 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=4962.12 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 496209 3 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=695988 CPUtime=4962.42 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 123036 0 0 0 496160 82 0 0 25 0 1 0 507861827 712691712 117516 33554432000 4194304 4331988 140736989445584 18446744073709551615 4226242 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 173997 117516 175 34 0 172439 0
[pid=5778] ppid=5773 vsize=240428 CPUtime=19820.6 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 411115 1248 0 0 1981987 71 0 0 18 0 5 0 507861827 246198272 32213 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 60107 32213 162 40 0 58651 0
[pid=5778/tid=5785] ppid=5773 vsize=240428 CPUtime=4961.67 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 109680 1248 0 0 496148 19 0 0 25 0 5 0 507861834 246198272 32213 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331355 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=240428 CPUtime=4962.34 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 90939 1248 0 0 496218 16 0 0 25 0 5 0 507861834 246198272 32213 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331504 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=240428 CPUtime=4961.2 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 86222 1248 0 0 496107 13 0 0 25 0 5 0 507861835 246198272 32213 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=240428 CPUtime=4935.28 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 119657 1248 0 0 493507 21 0 0 25 0 5 0 507861835 246198272 32213 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39669.8
Current children cumulated vsize (KiB) 1881384



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.05 8.05 8.00 9/180 5937
/proc/meminfo: memFree=24309780/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 0 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=294660 CPUtime=5000.1 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 1253507 0 0 0 499483 527 0 0 25 0 1 0 507861827 301731840 16297 33554432000 4194304 4587354 140734623235424 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 73665 16297 337 96 0 70227 0
[pid=5775] ppid=5773 vsize=204224 CPUtime=4999.96 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 44659 0 0 0 499984 12 0 0 25 0 1 0 507861827 209125376 44056 33554432000 4194304 4785740 140735863778512 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 51056 44056 340 145 0 48101 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=4999.82 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 499979 3 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134530667 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=695988 CPUtime=5000.13 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 123928 0 0 0 499930 83 0 0 25 0 1 0 507861827 712691712 118408 33554432000 4194304 4331988 140736989445584 18446744073709551615 4299299 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 173997 118408 175 34 0 172439 0
[pid=5778] ppid=5773 vsize=212780 CPUtime=19971.2 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 413163 1248 0 0 1997049 71 0 0 18 0 5 0 507861827 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 53195 25301 162 40 0 51739 0
[pid=5778/tid=5785] ppid=5773 vsize=212780 CPUtime=4999.38 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 109680 1248 0 0 499919 19 0 0 25 0 5 0 507861834 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331326 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=212780 CPUtime=5000.04 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 90939 1248 0 0 499988 16 0 0 25 0 5 0 507861834 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4332239 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=212780 CPUtime=4998.9 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 86222 1248 0 0 499877 13 0 0 25 0 5 0 507861835 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=212780 CPUtime=4972.78 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 121705 1248 0 0 497256 22 0 0 25 0 5 0 507861835 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39971.2
Current children cumulated vsize (KiB) 1886684

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000 s]
/proc/loadavg: 8.05 8.05 8.00 9/180 5937
/proc/meminfo: memFree=24309780/32951124 swapFree=67111524/67111528
[pid=5773] ppid=5771 vsize=18324 CPUtime=0 cores=0-7
/proc/5773/stat : 5773 (ppfolio) S 5771 5773 5706 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 507861827 18763776 389 33554432000 4194304 4287625 140736960633424 18446744073709551615 233510317583 0 0 4096 65536 4610490578705055743 0 0 17 0 0 0 0
/proc/5773/statm: 4581 389 341 23 0 91 0
[pid=5774] ppid=5773 vsize=294660 CPUtime=5000.1 cores=0
/proc/5774/stat : 5774 (cryptominisat) R 5773 5773 5706 0 -1 4202496 1253507 0 0 0 499483 527 0 0 25 0 1 0 507861827 301731840 16297 33554432000 4194304 4587354 140734623235424 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/5774/statm: 73665 16297 337 96 0 70227 0
[pid=5775] ppid=5773 vsize=204224 CPUtime=4999.96 cores=1
/proc/5775/stat : 5775 (clasp) R 5773 5773 5706 0 -1 4202496 44659 0 0 0 499984 12 0 0 25 0 1 0 507861827 209125376 44056 33554432000 4194304 4785740 140735863778512 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/5775/statm: 51056 44056 340 145 0 48101 0
[pid=5776] ppid=5773 vsize=460708 CPUtime=4999.82 cores=2
/proc/5776/stat : 5776 (TNM) R 5773 5773 5706 0 -1 4202496 1816 0 0 0 499979 3 0 0 25 0 1 0 507861827 471764992 1713 33554432000 134512640 134534564 4290670528 18446744073709551615 134530667 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/5776/statm: 115177 1713 95 6 0 113843 0
[pid=5777] ppid=5773 vsize=695988 CPUtime=5000.13 cores=3
/proc/5777/stat : 5777 (march_hi) R 5773 5773 5706 0 -1 4202496 123928 0 0 0 499930 83 0 0 25 0 1 0 507861827 712691712 118408 33554432000 4194304 4331988 140736989445584 18446744073709551615 4299299 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/5777/statm: 173997 118408 175 34 0 172439 0
[pid=5778] ppid=5773 vsize=212780 CPUtime=19971.2 cores=4-7
/proc/5778/stat : 5778 (plingeling) S 5773 5773 5706 0 -1 4202496 413163 1248 0 0 1997049 71 0 0 18 0 5 0 507861827 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 233522100197 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/5778/statm: 53195 25301 162 40 0 51739 0
[pid=5778/tid=5785] ppid=5773 vsize=212780 CPUtime=4999.38 cores=4-7
/proc/5778/task/5785/stat : 5785 (plingeling) R 5773 5773 5706 0 -1 4202560 109680 1248 0 0 499919 19 0 0 25 0 5 0 507861834 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331326 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5778/tid=5786] ppid=5773 vsize=212780 CPUtime=5000.04 cores=4-7
/proc/5778/task/5786/stat : 5786 (plingeling) R 5773 5773 5706 0 -1 4202560 90939 1248 0 0 499988 16 0 0 25 0 5 0 507861834 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4332239 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5778/tid=5787] ppid=5773 vsize=212780 CPUtime=4998.9 cores=4-7
/proc/5778/task/5787/stat : 5787 (plingeling) R 5773 5773 5706 0 -1 4202560 86222 1248 0 0 499877 13 0 0 25 0 5 0 507861835 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5778/tid=5788] ppid=5773 vsize=212780 CPUtime=4972.78 cores=4-7
/proc/5778/task/5788/stat : 5788 (plingeling) R 5773 5773 5706 0 -1 4202560 121705 1248 0 0 497256 22 0 0 25 0 5 0 507861835 217886720 25301 33554432000 4194304 4356188 140734077357920 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39971.2
Current children cumulated vsize (KiB) 1886684

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5773 and gives
#  childrusage.ru_utime.tv_sec=9994
#  childrusage.ru_utime.tv_usec=638583
#  childrusage.ru_stime.tv_sec=5
#  childrusage.ru_stime.tv_usec=321191
# CPU time returned by wait4() is 9999.96
# while last known CPU time is 39971.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39971.2
CPU user time (s): 39964.2
CPU system time (s): 6.96
CPU usage (%): 799.422
Max. virtual memory (cumulated for all children) (KiB): 6946060

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 9994.64
system time used= 5.32119
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1255843
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 708
involuntary context switches= 81282

runsolver used 8.13376 second user time and 19.1481 second system time

The end

Launcher Data 

Begin job on node145 at 2011-04-30 11:07:40
IDJOB=3219879
IDBENCH=82663
IDSOLVER=1638
FILE ID=node145/3219879-1304154460
RUNJOBID= node145-1304154457-5720
PBS_JOBID= 13170907
Free space on /tmp= 73028 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S536077088-015-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219879-1304154460/watcher-3219879-1304154460 -o /tmp/evaluation-result-3219879-1304154460/solver-3219879-1304154460 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3219879-1304154460.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7eb6d5b5c1c99a6b88954b61ac97b4f7
RANDOM SEED=474743316

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25128852 kB
Buffers:       1288448 kB
Cached:        5936236 kB
SwapCached:          4 kB
Active:         856888 kB
Inactive:      6431464 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25128852 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           11376 kB
Writeback:           0 kB
AnonPages:       64120 kB
Mapped:          14436 kB
Slab:           466788 kB
PageTables:       5236 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186412 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73020 MiB
End job on node145 at 2011-04-30 12:31:02