Trace number 3309550

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587? (TO) 5000.1 4999.97

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUMce0d180356398dfbcfd2bbbb1cb3f9e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark363.759
Satisfiable
(Un)Satisfiability was proved
Number of variables1260306
Number of clauses6771840
Sum of the clauses size16095280
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 26714640
Number of clauses of size 3320
Number of clauses of size 41280
Number of clauses of size 53200
Number of clauses of size over 551680

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309550-1303992259/watcher-3309550-1303992259 -o /tmp/evaluation-result-3309550-1303992259/solver-3309550-1303992259 -C 5000 -W 5100 -M 15500 lingeling HOME/instance-3309550-1303992259.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 2/177 19423
/proc/meminfo: memFree=10937380/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=7356 CPUtime=0 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 416 0 0 0 0 0 0 0 23 0 1 0 491642175 7532544 359 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510297344 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 1839 359 109 53 0 262 0

[startup+0.00688389 s]
/proc/loadavg: 2.02 2.01 2.00 2/177 19423
/proc/meminfo: memFree=10937380/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=7616 CPUtime=0 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 482 0 0 0 0 0 0 0 23 0 1 0 491642175 7798784 425 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510297344 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 1904 425 110 53 0 327 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 7616

[startup+0.100875 s]
/proc/loadavg: 2.02 2.01 2.00 2/177 19423
/proc/meminfo: memFree=10937380/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=12972 CPUtime=0.09 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 1792 0 0 0 9 0 0 0 23 0 1 0 491642175 13283328 1735 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510297344 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 3243 1735 113 53 0 1666 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12972

[startup+0.300844 s]
/proc/loadavg: 2.02 2.01 2.00 2/177 19423
/proc/meminfo: memFree=10937380/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=30320 CPUtime=0.29 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 6162 0 0 0 28 1 0 0 25 0 1 0 491642175 31047680 6104 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510297344 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 7580 6104 113 53 0 6003 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30320

[startup+0.700768 s]
/proc/loadavg: 2.02 2.01 2.00 2/177 19423
/proc/meminfo: memFree=10937380/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=65140 CPUtime=0.69 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 14931 0 0 0 66 3 0 0 25 0 1 0 491642175 66703360 14809 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510297344 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 16285 14809 113 53 0 14708 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 65140

[startup+1.50062 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 19424
/proc/meminfo: memFree=10860376/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=157812 CPUtime=1.49 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 38099 0 0 0 143 6 0 0 25 0 1 0 491642175 161599488 37977 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510297344 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 39453 37977 113 53 0 37876 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 157812

[startup+3.10031 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 19424
/proc/meminfo: memFree=10785604/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=261572 CPUtime=3.09 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 77867 0 0 0 297 12 0 0 25 0 1 0 491642175 267849728 63924 33554432000 4194304 4409164 140734388360032 18446744073709551615 4261866 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 65393 63924 120 53 0 63816 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 261572

[startup+6.30076 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 19424
/proc/meminfo: memFree=10660240/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=259056 CPUtime=6.29 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 109278 0 0 0 613 16 0 0 25 0 1 0 491642175 265273344 62315 33554432000 4194304 4409164 140734388360032 18446744073709551615 4288908 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 64764 62315 131 53 0 63187 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 259056

[startup+12.7006 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 19424
/proc/meminfo: memFree=10658944/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=282312 CPUtime=12.69 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 232701 0 0 0 1241 28 0 0 25 0 1 0 491642175 289087488 69093 33554432000 4194304 4409164 140734388360032 18446744073709551615 4325508 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 70578 69093 136 53 0 69001 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 282312

[startup+25.5003 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 19425
/proc/meminfo: memFree=10664312/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=282312 CPUtime=25.49 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 232701 0 0 0 2521 28 0 0 25 0 1 0 491642175 289087488 69093 33554432000 4194304 4409164 140734388360032 18446744073709551615 4248647 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/19423/statm: 70578 69093 136 53 0 69001 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 282312

[startup+51.1007 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 19426
/proc/meminfo: memFree=10652384/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=294940 CPUtime=51.09 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 245289 0 0 0 5080 29 0 0 25 0 1 0 491642175 302018560 72259 33554432000 4194304 4409164 140734388360032 18446744073709551615 4350987 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 73735 72259 140 53 0 72158 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 294940

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19427
/proc/meminfo: memFree=10602148/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=344864 CPUtime=102.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 257773 0 0 0 10197 33 0 0 25 0 1 0 491642175 353140736 84742 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510322071 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 86216 84742 141 53 0 84639 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 344864

[startup+162.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19428
/proc/meminfo: memFree=10598124/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=349028 CPUtime=162.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 305851 0 0 0 16190 40 0 0 25 0 1 0 491642175 357404672 85783 33554432000 4194304 4409164 140734388360032 18446744073709551615 4325508 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 87257 85783 141 53 0 85680 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 349028

[startup+222.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19430
/proc/meminfo: memFree=10559144/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=383424 CPUtime=222.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 314452 0 0 0 22189 41 0 0 25 0 1 0 491642175 392626176 94382 33554432000 4194304 4409164 140734388360032 18446744073709551615 4244759 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 95856 94382 141 53 0 94279 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 383424

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19432
/proc/meminfo: memFree=10520892/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=421584 CPUtime=282.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 326931 0 0 0 28186 44 0 0 25 0 1 0 491642175 431702016 103922 33554432000 4194304 4409164 140734388360032 18446744073709551615 4269669 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 105396 103922 141 53 0 103819 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 421584

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19433
/proc/meminfo: memFree=10508556/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=432412 CPUtime=342.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 362410 0 0 0 34181 49 0 0 25 0 1 0 491642175 442789888 106629 33554432000 4194304 4409164 140734388360032 18446744073709551615 4226358 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 108103 106629 141 53 0 106526 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 432412

[startup+402.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19435
/proc/meminfo: memFree=10480232/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=464796 CPUtime=402.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 370506 0 0 0 40179 51 0 0 25 0 1 0 491642175 475951104 114725 33554432000 4194304 4409164 140734388360032 18446744073709551615 4325508 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 116199 114725 141 53 0 114622 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 464796

[startup+462.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19436
/proc/meminfo: memFree=10480680/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=464792 CPUtime=462.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 370506 0 0 0 46178 52 0 0 25 0 1 0 491642175 475947008 114724 33554432000 4194304 4409164 140734388360032 18446744073709551615 4244759 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 116198 114724 141 53 0 114621 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 464792

[startup+522.301 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 19438
/proc/meminfo: memFree=10407220/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=538140 CPUtime=522.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 441528 0 0 0 52168 62 0 0 25 0 1 0 491642175 551055360 133061 33554432000 4194304 4409164 140734388360032 18446744073709551615 4271386 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 134535 133061 141 53 0 132958 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 538140

[startup+582.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 19440
/proc/meminfo: memFree=10359064/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=586132 CPUtime=582.3 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 457421 0 0 0 58164 66 0 0 25 0 1 0 491642175 600199168 145058 33554432000 4194304 4409164 140734388360032 18446744073709551615 4226446 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 146533 145058 141 53 0 144956 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 586132

[startup+642.301 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19571
/proc/meminfo: memFree=8239280/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=2655912 CPUtime=4062.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3030112 0 0 0 405795 446 0 0 25 0 1 0 491642175 2719653888 662504 33554432000 4194304 4409164 140734388360032 18446744073709551615 233510322071 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 663978 662504 141 53 0 662401 0
Current children cumulated CPU time (s) 4062.41
Current children cumulated vsize (KiB) 2655912

[startup+4122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19573
/proc/meminfo: memFree=8239132/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=2655912 CPUtime=4122.4 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3030112 0 0 0 411792 448 0 0 25 0 1 0 491642175 2719653888 662504 33554432000 4194304 4409164 140734388360032 18446744073709551615 4348202 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 663978 662504 141 53 0 662401 0
Current children cumulated CPU time (s) 4122.4
Current children cumulated vsize (KiB) 2655912

[startup+4182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19575
/proc/meminfo: memFree=8238988/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=2655912 CPUtime=4182.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3030112 0 0 0 417789 452 0 0 25 0 1 0 491642175 2719653888 662504 33554432000 4194304 4409164 140734388360032 18446744073709551615 4348193 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 663978 662504 141 53 0 662401 0
Current children cumulated CPU time (s) 4182.41
Current children cumulated vsize (KiB) 2655912

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19576
/proc/meminfo: memFree=10171388/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=789004 CPUtime=4242.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3194554 0 0 0 423761 480 0 0 25 0 1 0 491642175 807940096 195809 33554432000 4194304 4409164 140734388360032 18446744073709551615 4358257 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 197251 195809 141 53 0 195674 0
Current children cumulated CPU time (s) 4242.41
Current children cumulated vsize (KiB) 789004

[startup+4302.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 19578
/proc/meminfo: memFree=10121272/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=810700 CPUtime=4302.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3199978 0 0 0 429758 483 0 0 25 0 1 0 491642175 830156800 201233 33554432000 4194304 4409164 140734388360032 18446744073709551615 4358357 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 202675 201233 141 53 0 201098 0
Current children cumulated CPU time (s) 4302.41
Current children cumulated vsize (KiB) 810700

[startup+4362.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/178 19579
/proc/meminfo: memFree=9935628/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=995904 CPUtime=4362.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3246279 0 0 0 435752 489 0 0 25 0 1 0 491642175 1019805696 247534 33554432000 4194304 4409164 140734388360032 18446744073709551615 4230753 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 248976 247534 141 53 0 247399 0
Current children cumulated CPU time (s) 4362.41
Current children cumulated vsize (KiB) 995904

[startup+4422.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 19581
/proc/meminfo: memFree=9920480/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1027576 CPUtime=4422.42 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3254197 0 0 0 441749 493 0 0 25 0 1 0 491642175 1052237824 255452 33554432000 4194304 4409164 140734388360032 18446744073709551615 4231013 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 256894 255452 141 53 0 255317 0
Current children cumulated CPU time (s) 4422.42
Current children cumulated vsize (KiB) 1027576

[startup+4482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 19583
/proc/meminfo: memFree=9601656/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1298736 CPUtime=4482.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3413864 0 0 0 447731 510 0 0 25 0 1 0 491642175 1329905664 323242 33554432000 4194304 4409164 140734388360032 18446744073709551615 4358691 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 324684 323242 141 53 0 323107 0
Current children cumulated CPU time (s) 4482.41
Current children cumulated vsize (KiB) 1298736

[startup+4542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 19584
/proc/meminfo: memFree=9582540/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1298736 CPUtime=4542.41 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3413864 0 0 0 453728 513 0 0 25 0 1 0 491642175 1329905664 323242 33554432000 4194304 4409164 140734388360032 18446744073709551615 4256819 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 324684 323242 141 53 0 323107 0
Current children cumulated CPU time (s) 4542.41
Current children cumulated vsize (KiB) 1298736

[startup+4602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19586
/proc/meminfo: memFree=9853464/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=960772 CPUtime=4602.42 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3413864 0 0 0 459727 515 0 0 25 0 1 0 491642175 983830528 238751 33554432000 4194304 4409164 140734388360032 18446744073709551615 4300073 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 240193 238751 141 53 0 238616 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 960772

[startup+4662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19587
/proc/meminfo: memFree=9853324/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=928680 CPUtime=4662.42 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3413864 0 0 0 465727 515 0 0 25 0 1 0 491642175 950968320 230728 33554432000 4194304 4409164 140734388360032 18446744073709551615 4243376 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 232170 230728 141 53 0 230593 0
Current children cumulated CPU time (s) 4662.42
Current children cumulated vsize (KiB) 928680

[startup+4722.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19589
/proc/meminfo: memFree=9395376/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519564 CPUtime=4722.43 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 471713 530 0 0 25 0 1 0 491642175 1556033536 378449 33554432000 4194304 4409164 140734388360032 18446744073709551615 4256791 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379891 378449 141 53 0 378314 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 1519564

[startup+4782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19591
/proc/meminfo: memFree=9382336/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519564 CPUtime=4782.43 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 477710 533 0 0 25 0 1 0 491642175 1556033536 378449 33554432000 4194304 4409164 140734388360032 18446744073709551615 4258701 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379891 378449 141 53 0 378314 0
Current children cumulated CPU time (s) 4782.43
Current children cumulated vsize (KiB) 1519564

[startup+4842.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 19595
/proc/meminfo: memFree=9288444/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519564 CPUtime=4842.43 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 483708 535 0 0 25 0 1 0 491642175 1556033536 378449 33554432000 4194304 4409164 140734388360032 18446744073709551615 4258732 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379891 378449 141 53 0 378314 0
Current children cumulated CPU time (s) 4842.43
Current children cumulated vsize (KiB) 1519564

[startup+4902.3 s]
/proc/loadavg: 2.08 2.03 2.00 3/178 19597
/proc/meminfo: memFree=9440720/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519564 CPUtime=4902.43 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 489706 537 0 0 25 0 1 0 491642175 1556033536 378449 33554432000 4194304 4409164 140734388360032 18446744073709551615 4359752 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379891 378449 141 53 0 378314 0
Current children cumulated CPU time (s) 4902.43
Current children cumulated vsize (KiB) 1519564

[startup+4962.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/178 19598
/proc/meminfo: memFree=9347096/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519564 CPUtime=4962.43 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 495704 539 0 0 25 0 1 0 491642175 1556033536 378449 33554432000 4194304 4409164 140734388360032 18446744073709551615 4257010 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379891 378449 141 53 0 378314 0
Current children cumulated CPU time (s) 4962.43
Current children cumulated vsize (KiB) 1519564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.01 2.02 2.00 3/178 19600
/proc/meminfo: memFree=9330092/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519332 CPUtime=5000.04 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 499464 540 0 0 25 0 1 0 491642175 1555795968 378391 33554432000 4194304 4409164 140734388360032 18446744073709551615 4256901 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379833 378391 141 53 0 378256 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 1519332

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.01 2.02 2.00 3/178 19600
/proc/meminfo: memFree=9330092/32951124 swapFree=67111528/67111528
[pid=19423] ppid=19421 vsize=1519332 CPUtime=5000.04 cores=0,2,4,6
/proc/19423/stat : 19423 (lingeling) R 19421 19423 18667 0 -1 4202496 3561649 0 0 0 499464 540 0 0 25 0 1 0 491642175 1555795968 378391 33554432000 4194304 4409164 140734388360032 18446744073709551615 4256901 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/19423/statm: 379833 378391 141 53 0 378256 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 1519332

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.97
CPU time (s): 5000.1
CPU user time (s): 4994.64
CPU system time (s): 5.46217
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 2656104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4994.64
system time used= 5.46217
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3561649
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 7463

runsolver used 9.03063 second user time and 16.9454 second system time

The end

Launcher Data 

Begin job on node145 at 2011-04-28 14:04:23
IDJOB=3309550
IDBENCH=82374
IDSOLVER=1693
FILE ID=node145/3309550-1303992259
RUNJOBID= node145-1303987378-18685
PBS_JOBID= 13168730
Free space on /tmp= 72056 MiB

SOLVER NAME= Lingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309550-1303992259/watcher-3309550-1303992259 -o /tmp/evaluation-result-3309550-1303992259/solver-3309550-1303992259 -C 5000 -W 5100 -M 15500  lingeling HOME/instance-3309550-1303992259.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ce0d180356398dfbcfd2bbbb1cb3f9e5
RANDOM SEED=1786817827

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10937660 kB
Buffers:       2201248 kB
Cached:       19003900 kB
SwapCached:          0 kB
Active:       11222516 kB
Inactive:     10215576 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10937660 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          134152 kB
Writeback:           0 kB
AnonPages:      232292 kB
Mapped:          15336 kB
Slab:           511928 kB
PageTables:       5044 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   374312 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72072 MiB
End job on node145 at 2011-04-28 15:27:45