Trace number 1797293

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
kw_pre 2009-03-21? (TO) 1200 1200.51

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_12_UNKNOWN.cnf
MD5SUMd18a114d646a89f18fb3efba2be009e6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1898
Number of clauses118441
Sum of the clauses size352559
Maximum clause length13
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22994
Number of clauses of size 3115424
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1797293-1242088143/watcher-1797293-1242088143 -o /tmp/evaluation-result-1797293-1242088143/solver-1797293-1242088143 -C 1200 -W 1800 -M 1800 HOME/kw_pre HOME/instance-1797293-1242088143.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.02 1.00 0.99 3/64 15854
/proc/meminfo: memFree=1293720/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) R 15852 15854 15790 0 -1 4194304 262 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 230 1992294400 4194304 4889804 548682068832 18446744073709551615 233632754335 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/15854/statm: 1339 230 191 169 0 50 0
[pid=15855] ppid=15854 vsize=3664 CPUtime=0
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 565 0 0 0 0 0 0 0 18 0 1 0 236848332 3751936 541 1992294400 4194304 6416590 548682068912 18446744073709551615 5489867 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 916 549 205 542 0 365 0

[startup+0.099566 s]
/proc/loadavg: 1.02 1.00 0.99 3/64 15854
/proc/meminfo: memFree=1293720/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=7080 CPUtime=0.09
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 1181 0 0 0 9 0 0 0 19 0 1 0 236848332 7249920 1157 1992294400 4194304 6416590 548682068912 18446744073709551615 5489867 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 1770 1157 215 542 0 1219 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12436

[startup+0.101565 s]
/proc/loadavg: 1.02 1.00 0.99 3/64 15854
/proc/meminfo: memFree=1293720/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=7080 CPUtime=0.09
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 1191 0 0 0 9 0 0 0 19 0 1 0 236848332 7249920 1167 1992294400 4194304 6416590 548682068912 18446744073709551615 4376967 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 1770 1167 215 542 0 1219 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12436

[startup+0.30158 s]
/proc/loadavg: 1.02 1.00 0.99 3/64 15854
/proc/meminfo: memFree=1293720/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=11480 CPUtime=0.28
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 2381 0 0 0 28 0 0 0 21 0 1 0 236848332 11755520 2357 1992294400 4194304 6416590 548682068912 18446744073709551615 5280272 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 2870 2358 215 542 0 2319 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 16836

[startup+0.701613 s]
/proc/loadavg: 1.02 1.00 0.99 3/64 15854
/proc/meminfo: memFree=1293720/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=20544 CPUtime=0.69
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 4713 0 0 0 68 1 0 0 25 0 1 0 236848332 21037056 4689 1992294400 4194304 6416590 548682068912 18446744073709551615 4567184 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 5136 4689 233 542 0 4585 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 25900

[startup+1.50168 s]
/proc/loadavg: 1.02 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1275592/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=20544 CPUtime=1.49
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 4713 0 0 0 148 1 0 0 25 0 1 0 236848332 21037056 4689 1992294400 4194304 6416590 548682068912 18446744073709551615 4567268 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 5136 4689 233 542 0 4585 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 25900

[startup+3.10181 s]
/proc/loadavg: 1.02 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1270152/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=26276 CPUtime=3.08
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 5946 0 0 0 306 2 0 0 25 0 1 0 236848332 26906624 5922 1992294400 4194304 6416590 548682068912 18446744073709551615 4567182 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 6569 5922 242 542 0 6018 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 31632

[startup+6.30107 s]
/proc/loadavg: 1.02 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1270472/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=27604 CPUtime=6.29
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 6437 0 0 0 625 4 0 0 25 0 1 0 236848332 28266496 6240 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 6901 6240 250 542 0 6350 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 32960

[startup+12.7016 s]
/proc/loadavg: 1.01 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1262728/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=36428 CPUtime=12.68
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 8562 0 0 0 1262 6 0 0 25 0 1 0 236848332 37302272 8281 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 9107 8281 254 542 0 8556 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 41784

[startup+25.5016 s]
/proc/loadavg: 1.01 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1250440/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=48444 CPUtime=25.48
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 11305 0 0 0 2539 9 0 0 25 0 1 0 236848332 49606656 10843 1992294400 4194304 6416590 548682068912 18446744073709551615 4340741 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 12111 10843 254 542 0 11560 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 53800

[startup+51.1017 s]
/proc/loadavg: 1.01 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1241672/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=58200 CPUtime=51.07
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 13675 0 0 0 5092 15 0 0 25 0 1 0 236848332 59596800 13043 1992294400 4194304 6416590 548682068912 18446744073709551615 4294648 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 14550 13043 254 542 0 13999 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 63556

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1226632/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=74492 CPUtime=102.26
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 17748 0 0 0 10202 24 0 0 25 0 1 0 236848332 76279808 16754 1992294400 4194304 6416590 548682068912 18446744073709551615 4294886 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 18623 16754 254 542 0 18072 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 79848

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1213256/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=91264 CPUtime=162.23
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 21686 0 0 0 16189 34 0 0 25 0 1 0 236848332 93454336 20142 1992294400 4194304 6416590 548682068912 18446744073709551615 4294639 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 22816 20142 254 542 0 22265 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 96620

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1200648/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=105772 CPUtime=222.18
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 24823 0 0 0 22179 39 0 0 25 0 1 0 236848332 108310528 23279 1992294400 4194304 6416590 548682068912 18446744073709551615 4294639 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 26443 23279 254 542 0 25892 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 111128

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1194824/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=113608 CPUtime=282.16
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 26608 0 0 0 28173 43 0 0 25 0 1 0 236848332 116334592 24823 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 28402 24823 254 542 0 27851 0
Current children cumulated CPU time (s) 282.16
Current children cumulated vsize (KiB) 118964

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15856
/proc/meminfo: memFree=1167752/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=150420 CPUtime=342.14
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 33600 0 0 0 34166 48 0 0 25 0 1 0 236848332 154030080 31815 1992294400 4194304 6416590 548682068912 18446744073709551615 4294671 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 37605 31815 254 542 0 37054 0
Current children cumulated CPU time (s) 342.14

################
# More data... #
################

/proc/15855/statm: 45419 37950 254 542 0 44868 0
Current children cumulated CPU time (s) 582.05
Current children cumulated vsize (KiB) 187032

[startup+642.302 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15858
/proc/meminfo: memFree=1132680/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=192096 CPUtime=642.03
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 42228 0 0 0 64139 64 0 0 25 0 1 0 236848332 196706304 40166 1992294400 4194304 6416590 548682068912 18446744073709551615 4294886 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 48024 40166 254 542 0 47473 0
Current children cumulated CPU time (s) 642.03
Current children cumulated vsize (KiB) 197452

[startup+702.302 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15858
/proc/meminfo: memFree=1126408/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=200492 CPUtime=701.99
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 44340 0 0 0 70132 67 0 0 25 0 1 0 236848332 205303808 41960 1992294400 4194304 6416590 548682068912 18446744073709551615 4294585 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 50123 41960 254 542 0 49572 0
Current children cumulated CPU time (s) 701.99
Current children cumulated vsize (KiB) 205848

[startup+762.306 s]
/proc/loadavg: 1.00 1.00 0.99 2/66 15858
/proc/meminfo: memFree=1122056/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=204980 CPUtime=761.97
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 45235 0 0 0 76126 71 0 0 25 0 1 0 236848332 209899520 42855 1992294400 4194304 6416590 548682068912 18446744073709551615 5553607 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 51245 42855 254 542 0 50694 0
Current children cumulated CPU time (s) 761.97
Current children cumulated vsize (KiB) 210336

[startup+822.302 s]
/proc/loadavg: 1.04 1.01 1.00 2/66 15858
/proc/meminfo: memFree=1119688/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=208184 CPUtime=821.94
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 45841 0 0 0 82122 72 0 0 25 0 1 0 236848332 213180416 43461 1992294400 4194304 6416590 548682068912 18446744073709551615 4294943 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 52046 43461 254 542 0 51495 0
Current children cumulated CPU time (s) 821.94
Current children cumulated vsize (KiB) 213540

[startup+882.301 s]
/proc/loadavg: 1.12 1.04 1.01 2/66 15858
/proc/meminfo: memFree=1118344/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=209464 CPUtime=881.92
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 46542 0 0 0 88117 75 0 0 25 0 1 0 236848332 214491136 43796 1992294400 4194304 6416590 548682068912 18446744073709551615 4294639 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 52366 43796 254 542 0 51815 0
Current children cumulated CPU time (s) 881.92
Current children cumulated vsize (KiB) 214820

[startup+942.301 s]
/proc/loadavg: 1.08 1.04 1.00 2/66 15858
/proc/meminfo: memFree=1113096/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=216184 CPUtime=941.89
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 47874 0 0 0 94112 77 0 0 25 0 1 0 236848332 221372416 45128 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 54046 45128 254 542 0 53495 0
Current children cumulated CPU time (s) 941.89
Current children cumulated vsize (KiB) 221540

[startup+1002.3 s]
/proc/loadavg: 1.03 1.03 1.00 2/66 15858
/proc/meminfo: memFree=1096520/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=236668 CPUtime=1001.88
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 51990 0 0 0 100107 81 0 0 25 0 1 0 236848332 242348032 49244 1992294400 4194304 6416590 548682068912 18446744073709551615 4336628 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 59167 49244 254 542 0 58616 0
Current children cumulated CPU time (s) 1001.88
Current children cumulated vsize (KiB) 242024

[startup+1062.3 s]
/proc/loadavg: 1.01 1.03 1.00 2/66 15858
/proc/meminfo: memFree=1093832/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=239548 CPUtime=1061.85
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 52673 0 0 0 106101 84 0 0 25 0 1 0 236848332 245297152 49927 1992294400 4194304 6416590 548682068912 18446744073709551615 4294609 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 59887 49927 254 542 0 59336 0
Current children cumulated CPU time (s) 1061.85
Current children cumulated vsize (KiB) 244904

[startup+1122.3 s]
/proc/loadavg: 1.00 1.02 1.00 2/66 15858
/proc/meminfo: memFree=1087880/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=247876 CPUtime=1121.82
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 54142 0 0 0 112093 89 0 0 25 0 1 0 236848332 253825024 51396 1992294400 4194304 6416590 548682068912 18446744073709551615 4295356 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 61969 51396 254 542 0 61418 0
Current children cumulated CPU time (s) 1121.82
Current children cumulated vsize (KiB) 253232

[startup+1182.3 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 15858
/proc/meminfo: memFree=1078408/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=259972 CPUtime=1181.81
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 56935 0 0 0 118085 96 0 0 25 0 1 0 236848332 266211328 53705 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 64993 53705 254 542 0 64442 0
Current children cumulated CPU time (s) 1181.81
Current children cumulated vsize (KiB) 265328



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 15858
/proc/meminfo: memFree=1077512/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=261200 CPUtime=1200
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 57215 0 0 0 119904 96 0 0 25 0 1 0 236848332 267468800 53985 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 65300 53985 254 542 0 64749 0
Current children cumulated CPU time (s) 1200
Current children cumulated vsize (KiB) 266556

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 15858
/proc/meminfo: memFree=1077512/2055920 swapFree=4191900/4192956
[pid=15854] ppid=15852 vsize=5356 CPUtime=0
/proc/15854/stat : 15854 (kw_pre) S 15852 15854 15790 0 -1 4194304 280 0 0 0 0 0 0 0 18 0 1 0 236848332 5484544 231 1992294400 4194304 4889804 548682068832 18446744073709551615 233632752452 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/15854/statm: 1339 231 192 169 0 50 0
[pid=15855] ppid=15854 vsize=261200 CPUtime=1200
/proc/15855/stat : 15855 (kw_preprocessor) R 15854 15854 15790 0 -1 0 57215 0 0 0 119904 96 0 0 25 0 1 0 236848332 267468800 53985 1992294400 4194304 6416590 548682068912 18446744073709551615 4294579 0 0 4096 0 0 0 0 17 0 0 0
/proc/15855/statm: 65300 53985 254 542 0 64749 0
Current children cumulated CPU time (s) 1200
Current children cumulated vsize (KiB) 266556

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15854 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.001999
# while last known CPU time is 1200
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.51
CPU time (s): 1200
CPU user time (s): 1199.04
CPU system time (s): 0.96
CPU usage (%): 99.9573
Max. virtual memory (cumulated for all children) (KiB): 267264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 280
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1

runsolver used 1.00485 second user time and 3.37149 second system time

The end

Launcher Data 

Begin job on node3 at 2009-05-12 02:29:03
IDJOB=1797293
IDBENCH=71092
IDSOLVER=646
FILE ID=node3/1797293-1242088143
PBS_JOBID= 9277716
Free space on /tmp= 66276 MiB

SOLVER NAME= kw_pre 2009-03-21
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_12_UNKNOWN.cnf
COMMAND LINE= HOME/kw_pre BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1797293-1242088143/watcher-1797293-1242088143 -o /tmp/evaluation-result-1797293-1242088143/solver-1797293-1242088143 -C 1200 -W 1800 -M 1800  HOME/kw_pre HOME/instance-1797293-1242088143.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= d18a114d646a89f18fb3efba2be009e6
RANDOM SEED=989348421

node3.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1294264 kB
Buffers:         76236 kB
Cached:         582832 kB
SwapCached:        260 kB
Active:          46660 kB
Inactive:       626224 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1294264 kB
SwapTotal:     4192956 kB
SwapFree:      4191900 kB
Dirty:            4884 kB
Writeback:           0 kB
Mapped:          22308 kB
Slab:            74936 kB
Committed_AS:   883268 kB
PageTables:       1372 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66272 MiB
End job on node3 at 2009-05-12 02:49:06