Trace number 3275066

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.3 5003.72

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2100c215164gyes7.cnf
MD5SUM140eea74f7e66501965365160d02fa4d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2100
Number of clauses215164
Sum of the clauses size432288
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2215094
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 570

Solver Data 

0.00/0.01	This is pico-portfolio, a naive parallel portfolio
0.00/0.01	Copyright (C) 2011 Olivier Roussel
0.00/0.01	Using 8 processing units
0.00/0.01	This portfolio uses the following solvers:
0.00/0.01	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.01	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.01	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.01	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.01	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.01	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.01	Starting clasp 1.3.6 on core(s) 1
0.00/0.01	Starting TNM 2009 on core(s) 2
0.00/0.01	Starting march_hi 2009 on core(s) 3
0.00/0.01	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275066-1304145202/watcher-3275066-1304145202 -o /tmp/evaluation-result-3275066-1304145202/solver-3275066-1304145202 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275066-1304145202.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.13 2.78 3.13 1/170 10186
/proc/meminfo: memFree=30498444/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) R 10184 10186 10160 0 -1 4194304 493 0 0 0 0 0 0 0 25 0 1 0 258711469 18763776 388 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660482453 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/10186/statm: 4581 388 339 23 0 91 0

[startup+0.083005 s]
/proc/loadavg: 2.13 2.78 3.13 1/170 10186
/proc/meminfo: memFree=30498444/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100998 s]
/proc/loadavg: 2.13 2.78 3.13 1/170 10186
/proc/meminfo: memFree=30498444/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300933 s]
/proc/loadavg: 2.13 2.78 3.13 1/170 10186
/proc/meminfo: memFree=30498444/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700861 s]
/proc/loadavg: 2.13 2.78 3.13 1/170 10186
/proc/meminfo: memFree=30498444/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 20 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50072 s]
/proc/loadavg: 2.13 2.78 3.13 9/180 10201
/proc/meminfo: memFree=30366752/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=68596 CPUtime=1.49 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 13020 0 0 0 148 1 0 0 25 0 1 0 258711470 70242304 11644 33554432000 4194304 4587354 140734847906192 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 17149 11644 326 96 0 13711 0
[pid=10188] ppid=10186 vsize=26944 CPUtime=1.49 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 5674 0 0 0 149 0 0 0 20 0 1 0 258711470 27590656 3975 33554432000 4194304 4785740 140735277676528 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 6736 3975 340 145 0 3781 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=1.49 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 148 1 0 0 20 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134530538 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=36640 CPUtime=1.47 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 16423 0 0 0 145 2 0 0 25 0 1 0 258711470 37519360 4011 33554432000 4194304 4331988 140734675300096 18446744073709551615 4210400 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 9160 4011 175 34 0 7602 0
[pid=10192] ppid=10186 vsize=91344 CPUtime=5.37 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 15616 1249 0 0 536 1 0 0 25 0 5 0 258711471 93536256 11260 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 22836 11260 162 40 0 21380 0
[pid=10192/tid=10198] ppid=10186 vsize=91344 CPUtime=1.3 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 3134 1249 0 0 130 0 0 0 19 0 5 0 258711485 93536256 11260 33554432000 4194304 4356188 140737078936880 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=91344 CPUtime=1.29 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 2670 1249 0 0 129 0 0 0 25 0 5 0 258711485 93536256 11260 33554432000 4194304 4356188 140737078936880 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=91344 CPUtime=1.33 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 3327 1249 0 0 133 0 0 0 25 0 5 0 258711485 93536256 11260 33554432000 4194304 4356188 140737078936880 18446744073709551615 4312092 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=91344 CPUtime=1.3 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 1790 1249 0 0 130 0 0 0 25 0 5 0 258711485 93536256 11260 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331039 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.31
Current children cumulated vsize (KiB) 709328

[startup+3.10044 s]
/proc/loadavg: 2.13 2.78 3.13 9/180 10201
/proc/meminfo: memFree=30354848/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1585220 CPUtime=3.08 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 14799 0 0 0 307 1 0 0 25 0 1 0 258711470 1623265280 11995 33554432000 4194304 4587354 140734847906192 18446744073709551615 4450823 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 396305 11995 337 96 0 392867 0
[pid=10188] ppid=10186 vsize=27604 CPUtime=3.09 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 5951 0 0 0 309 0 0 0 25 0 1 0 258711470 28266496 4252 33554432000 4194304 4785740 140735277676528 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 6901 4253 340 145 0 3946 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=3.09 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 308 1 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=36916 CPUtime=3.07 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 16491 0 0 0 305 2 0 0 25 0 1 0 258711470 37801984 4079 33554432000 4194304 4331988 140734675300096 18446744073709551615 4239578 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 9229 4079 176 34 0 7671 0
[pid=10192] ppid=10186 vsize=104144 CPUtime=11.77 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 18816 1249 0 0 1175 2 0 0 25 0 5 0 258711471 106643456 14460 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 26036 14460 162 40 0 24580 0
[pid=10192/tid=10198] ppid=10186 vsize=104144 CPUtime=2.9 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 3390 1249 0 0 290 0 0 0 24 0 5 0 258711485 106643456 14460 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331323 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=104144 CPUtime=2.89 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 3310 1249 0 0 289 0 0 0 25 0 5 0 258711485 106643456 14460 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=104144 CPUtime=2.93 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 3710 1249 0 0 293 0 0 0 25 0 5 0 258711485 106643456 14460 33554432000 4194304 4356188 140737078936880 18446744073709551615 4234151 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=104144 CPUtime=2.89 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 3711 1249 0 0 289 0 0 0 25 0 5 0 258711485 106643456 14460 33554432000 4194304 4356188 140737078936880 18446744073709551615 4241569 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.1
Current children cumulated vsize (KiB) 2239688

[startup+6.30088 s]
/proc/loadavg: 2.60 2.87 3.16 9/180 10201
/proc/meminfo: memFree=30327080/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1585220 CPUtime=6.28 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 14799 0 0 0 627 1 0 0 25 0 1 0 258711470 1623265280 11995 33554432000 4194304 4587354 140734847906192 18446744073709551615 4365136 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 396305 11995 337 96 0 392867 0
[pid=10188] ppid=10186 vsize=38304 CPUtime=6.29 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 8613 0 0 0 628 1 0 0 25 0 1 0 258711470 39223296 6914 33554432000 4194304 4785740 140735277676528 18446744073709551615 4287096 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 9576 6914 340 145 0 6621 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=6.29 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 628 1 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=37236 CPUtime=6.28 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 16578 0 0 0 626 2 0 0 25 0 1 0 258711470 38129664 4165 33554432000 4194304 4331988 140734675300096 18446744073709551615 268660323013 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 9309 4165 175 34 0 7751 0
[pid=10192] ppid=10186 vsize=115588 CPUtime=24.55 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 21677 1249 0 0 2453 2 0 0 25 0 5 0 258711471 118362112 17321 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 28897 17321 162 40 0 27441 0
[pid=10192/tid=10198] ppid=10186 vsize=115588 CPUtime=6.1 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 4202 1249 0 0 610 0 0 0 25 0 5 0 258711485 118362112 17321 33554432000 4194304 4356188 140737078936880 18446744073709551615 4279481 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=115588 CPUtime=6.08 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 3823 1249 0 0 608 0 0 0 25 0 5 0 258711485 118362112 17321 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=115588 CPUtime=6.13 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 3710 1249 0 0 613 0 0 0 25 0 5 0 258711485 118362112 17321 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331832 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=115588 CPUtime=6.07 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 5247 1249 0 0 607 0 0 0 25 0 5 0 258711485 118362112 17321 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.69
Current children cumulated vsize (KiB) 2262152

[startup+12.7008 s]
/proc/loadavg: 3.03 2.96 3.18 9/180 10201
/proc/meminfo: memFree=30280328/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1585628 CPUtime=12.68 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 20608 0 0 0 1266 2 0 0 25 0 1 0 258711470 1623683072 15439 33554432000 4194304 4587354 140734847906192 18446744073709551615 4365345 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 396407 15439 337 96 0 392969 0
[pid=10188] ppid=10186 vsize=55568 CPUtime=12.69 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 12883 0 0 0 1267 2 0 0 25 0 1 0 258711470 56901632 11184 33554432000 4194304 4785740 140735277676528 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 13892 11184 340 145 0 10937 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=12.69 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 1268 1 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=38508 CPUtime=12.68 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 16848 0 0 0 1266 2 0 0 25 0 1 0 258711470 39432192 4434 33554432000 4194304 4331988 140734675300096 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 9627 4434 175 34 0 8069 0
[pid=10192] ppid=10186 vsize=131680 CPUtime=50.12 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 25700 1249 0 0 5009 3 0 0 25 0 5 0 258711471 134840320 21344 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 32920 21344 162 40 0 31464 0
[pid=10192/tid=10198] ppid=10186 vsize=131680 CPUtime=12.5 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 5610 1249 0 0 1250 0 0 0 25 0 5 0 258711485 134840320 21344 33554432000 4194304 4356188 140737078936880 18446744073709551615 4281652 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=131680 CPUtime=12.48 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 5103 1249 0 0 1248 0 0 0 25 0 5 0 258711485 134840320 21344 33554432000 4194304 4356188 140737078936880 18446744073709551615 268660330692 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=131680 CPUtime=12.53 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 4093 1249 0 0 1253 0 0 0 25 0 5 0 258711485 134840320 21344 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=131680 CPUtime=12.44 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 6199 1249 0 0 1244 0 0 0 25 0 5 0 258711485 134840320 21344 33554432000 4194304 4356188 140737078936880 18446744073709551615 4284244 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.86
Current children cumulated vsize (KiB) 2297188

[startup+25.5005 s]
/proc/loadavg: 4.13 3.20 3.26 9/180 10202
/proc/meminfo: memFree=30239160/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1598980 CPUtime=25.49 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 25564 0 0 0 2546 3 0 0 25 0 1 0 258711470 1637355520 20393 33554432000 4194304 4587354 140734847906192 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=10189] ppid=10186 vsize=467480 CPUtime=4842.37 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 484233 4 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=577988 CPUtime=4842.39 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 105744 0 0 0 484175 64 0 0 25 0 1 0 258711470 591859712 93330 33554432000 4194304 4331988 140734675300096 18446744073709551615 4228224 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 144497 93330 175 34 0 142939 0
[pid=10192] ppid=10186 vsize=487596 CPUtime=19341.2 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 2697719 1249 0 0 1933757 362 0 0 25 0 5 0 258711471 499298304 110323 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 121899 110323 162 40 0 120443 0
[pid=10192/tid=10198] ppid=10186 vsize=487596 CPUtime=4842.22 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 807149 1249 0 0 484117 105 0 0 25 0 5 0 258711485 499298304 110323 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=487596 CPUtime=4842.2 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 570996 1249 0 0 484140 80 0 0 25 0 5 0 258711485 499298304 110323 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=487596 CPUtime=4841.77 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 715778 1249 0 0 484081 96 0 0 25 0 5 0 258711485 499298304 110323 33554432000 4194304 4356188 140737078936880 18446744073709551615 4210575 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=487596 CPUtime=4814.86 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 599101 1249 0 0 481406 80 0 0 25 0 5 0 258711485 499298304 110323 33554432000 4194304 4356188 140737078936880 18446744073709551615 4279765 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.7
Current children cumulated vsize (KiB) 3724848

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 10344
/proc/meminfo: memFree=28980204/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1879984 CPUtime=4902.4 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 1177389 0 0 0 489701 539 0 0 25 0 1 0 258711470 1925103616 89643 33554432000 4194304 4587354 140734847906192 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 469996 89643 337 96 0 466558 0
[pid=10188] ppid=10186 vsize=301816 CPUtime=4902.39 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 70356 0 0 0 490216 23 0 0 25 0 1 0 258711470 309059584 68657 33554432000 4194304 4785740 140735277676528 18446744073709551615 4286985 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 75454 68657 340 145 0 72499 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=4902.37 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 490233 4 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134530320 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=577988 CPUtime=4902.39 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 107404 0 0 0 490173 66 0 0 25 0 1 0 258711470 591859712 94990 33554432000 4194304 4331988 140734675300096 18446744073709551615 4297266 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 144497 94990 175 34 0 142939 0
[pid=10192] ppid=10186 vsize=536748 CPUtime=19580.9 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 2740727 1249 0 0 1957720 367 0 0 25 0 5 0 258711471 549629952 122611 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 134187 122611 162 40 0 132731 0
[pid=10192/tid=10198] ppid=10186 vsize=536748 CPUtime=4902.21 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 822509 1249 0 0 490115 106 0 0 25 0 5 0 258711485 549629952 122611 33554432000 4194304 4356188 140737078936880 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=536748 CPUtime=4902.19 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 580212 1249 0 0 490138 81 0 0 25 0 5 0 258711485 549629952 122611 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=536748 CPUtime=4901.76 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 728066 1249 0 0 490079 97 0 0 25 0 5 0 258711485 549629952 122611 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=536748 CPUtime=4874.53 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 605245 1249 0 0 487373 80 0 0 25 0 5 0 258711485 549629952 122611 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.4
Current children cumulated vsize (KiB) 3782340

[startup+4962.3 s]
/proc/loadavg: 8.22 8.07 8.02 10/181 10348
/proc/meminfo: memFree=28949220/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1856932 CPUtime=4962.4 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 1190107 0 0 0 495694 546 0 0 25 0 1 0 258711470 1901498368 92152 33554432000 4194304 4587354 140734847906192 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 464233 92152 337 96 0 460795 0
[pid=10188] ppid=10186 vsize=301816 CPUtime=4962.39 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 70363 0 0 0 496216 23 0 0 25 0 1 0 258711470 309059584 68664 33554432000 4194304 4785740 140735277676528 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 75454 68664 340 145 0 72499 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=4962.37 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 496233 4 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=577988 CPUtime=4962.39 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 108550 0 0 0 496172 67 0 0 25 0 1 0 258711470 591859712 96136 33554432000 4194304 4331988 140734675300096 18446744073709551615 4226499 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 144497 96136 175 34 0 142939 0
[pid=10192] ppid=10186 vsize=516268 CPUtime=19819.8 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 2781687 1249 0 0 1981607 373 0 0 25 0 5 0 258711471 528658432 117491 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 129067 117491 162 40 0 127611 0
[pid=10192/tid=10198] ppid=10186 vsize=516268 CPUtime=4962.22 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 827629 1249 0 0 496115 107 0 0 25 0 5 0 258711485 528658432 117491 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=516268 CPUtime=4962.2 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 595572 1249 0 0 496137 83 0 0 25 0 5 0 258711485 528658432 117491 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=516268 CPUtime=4961.76 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 742402 1249 0 0 496077 99 0 0 25 0 5 0 258711485 528658432 117491 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=516268 CPUtime=4933.45 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 611389 1249 0 0 493264 81 0 0 25 0 5 0 258711485 528658432 117491 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39669.3
Current children cumulated vsize (KiB) 3738808



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.7 s]
/proc/loadavg: 8.20 8.09 8.02 9/180 10349
/proc/meminfo: memFree=29064572/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1888928 CPUtime=5003.81 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 1197848 0 0 0 499831 550 0 0 25 0 1 0 258711470 1934262272 89760 33554432000 4194304 4587354 140734847906192 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 472232 89760 337 96 0 468794 0
[pid=10188] ppid=10186 vsize=301816 CPUtime=5003.8 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 70367 0 0 0 500357 23 0 0 25 0 1 0 258711470 309059584 68668 33554432000 4194304 4785740 140735277676528 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 75454 68668 340 145 0 72499 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=5003.79 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 500374 5 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=577988 CPUtime=5003.8 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 109196 0 0 0 500313 67 0 0 25 0 1 0 258711470 591859712 96782 33554432000 4194304 4331988 140734675300096 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 144497 96782 175 34 0 142939 0
[pid=10192] ppid=10186 vsize=438444 CPUtime=19985.1 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 2803191 1249 0 0 1998135 376 0 0 25 0 5 0 258711471 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 109611 98035 162 40 0 108155 0
[pid=10192/tid=10198] ppid=10186 vsize=438444 CPUtime=5003.63 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 832749 1249 0 0 500255 108 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=438444 CPUtime=5003.6 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 597620 1249 0 0 500277 83 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=438444 CPUtime=5003.16 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 752642 1249 0 0 500215 101 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=438444 CPUtime=4974.56 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 615485 1249 0 0 497374 82 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 3692980

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.7 s]
/proc/loadavg: 8.20 8.09 8.02 9/180 10349
/proc/meminfo: memFree=29064572/32951124 swapFree=67111524/67111528
[pid=10186] ppid=10184 vsize=18324 CPUtime=0 cores=0-7
/proc/10186/stat : 10186 (ppfolio) S 10184 10186 10160 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 258711469 18763776 390 33554432000 4194304 4287625 140734205089552 18446744073709551615 268660682255 0 0 4096 65536 18390493200566452223 0 0 17 4 0 0 0
/proc/10186/statm: 4581 390 341 23 0 91 0
[pid=10187] ppid=10186 vsize=1888928 CPUtime=5003.81 cores=0
/proc/10187/stat : 10187 (cryptominisat) R 10186 10186 10160 0 -1 4202496 1197848 0 0 0 499831 550 0 0 25 0 1 0 258711470 1934262272 89760 33554432000 4194304 4587354 140734847906192 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10187/statm: 472232 89760 337 96 0 468794 0
[pid=10188] ppid=10186 vsize=301816 CPUtime=5003.8 cores=1
/proc/10188/stat : 10188 (clasp) R 10186 10186 10160 0 -1 4202496 70367 0 0 0 500357 23 0 0 25 0 1 0 258711470 309059584 68668 33554432000 4194304 4785740 140735277676528 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10188/statm: 75454 68668 340 145 0 72499 0
[pid=10189] ppid=10186 vsize=467480 CPUtime=5003.79 cores=2
/proc/10189/stat : 10189 (TNM) R 10186 10186 10160 0 -1 4202496 5164 0 0 0 500374 5 0 0 25 0 1 0 258711470 478699520 5060 33554432000 134512640 134534564 4290791248 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10189/statm: 116870 5060 95 6 0 115536 0
[pid=10190] ppid=10186 vsize=577988 CPUtime=5003.8 cores=3
/proc/10190/stat : 10190 (march_hi) R 10186 10186 10160 0 -1 4202496 109196 0 0 0 500313 67 0 0 25 0 1 0 258711470 591859712 96782 33554432000 4194304 4331988 140734675300096 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10190/statm: 144497 96782 175 34 0 142939 0
[pid=10192] ppid=10186 vsize=438444 CPUtime=19985.1 cores=4-7
/proc/10192/stat : 10192 (plingeling) S 10186 10186 10160 0 -1 4202496 2803191 1249 0 0 1998135 376 0 0 25 0 5 0 258711471 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/10192/statm: 109611 98035 162 40 0 108155 0
[pid=10192/tid=10198] ppid=10186 vsize=438444 CPUtime=5003.63 cores=4-7
/proc/10192/task/10198/stat : 10198 (plingeling) R 10186 10186 10160 0 -1 4202560 832749 1249 0 0 500255 108 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10192/tid=10199] ppid=10186 vsize=438444 CPUtime=5003.6 cores=4-7
/proc/10192/task/10199/stat : 10199 (plingeling) R 10186 10186 10160 0 -1 4202560 597620 1249 0 0 500277 83 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10192/tid=10200] ppid=10186 vsize=438444 CPUtime=5003.16 cores=4-7
/proc/10192/task/10200/stat : 10200 (plingeling) R 10186 10186 10160 0 -1 4202560 752642 1249 0 0 500215 101 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10192/tid=10201] ppid=10186 vsize=438444 CPUtime=4974.56 cores=4-7
/proc/10192/task/10201/stat : 10201 (plingeling) R 10186 10186 10160 0 -1 4202560 615485 1249 0 0 497374 82 0 0 25 0 5 0 258711485 448966656 98035 33554432000 4194304 4356188 140737078936880 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 3692980

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10186 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=744315
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=57991
# CPU time returned by wait4() is 5003.8
# while last known CPU time is 40000.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.72
CPU time (s): 40000.3
CPU user time (s): 39990.1
CPU system time (s): 10.21
CPU usage (%): 799.412
Max. virtual memory (cumulated for all children) (KiB): 5282328

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.74
system time used= 0.057991
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5688
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 482
involuntary context switches= 10195

runsolver used 8.31074 second user time and 18.9921 second system time

The end

Launcher Data 

Begin job on node107 at 2011-04-30 08:33:22
IDJOB=3275066
IDBENCH=71367
IDSOLVER=1638
FILE ID=node107/3275066-1304145202
RUNJOBID= node107-1304145202-10174
PBS_JOBID= 13170869
Free space on /tmp= 72624 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2100c215164gyes7.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275066-1304145202/watcher-3275066-1304145202 -o /tmp/evaluation-result-3275066-1304145202/solver-3275066-1304145202 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275066-1304145202.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 140eea74f7e66501965365160d02fa4d
RANDOM SEED=662482368

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30498724 kB
Buffers:        381608 kB
Cached:        1657336 kB
SwapCached:          4 kB
Active:         147152 kB
Inactive:      1954196 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30498724 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           12968 kB
Writeback:           0 kB
AnonPages:       63440 kB
Mapped:          14104 kB
Slab:           286324 kB
PageTables:       4460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   180840 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72612 MiB
End job on node107 at 2011-04-30 09:56:48