Trace number 3372430

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587f (fixed)? (TO) 5000.16 4999.98

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUMce0d180356398dfbcfd2bbbb1cb3f9e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark363.759
Satisfiable
(Un)Satisfiability was proved
Number of variables1260306
Number of clauses6771840
Sum of the clauses size16095280
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 26714640
Number of clauses of size 3320
Number of clauses of size 41280
Number of clauses of size 53200
Number of clauses of size over 551680

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372430-1305421747/watcher-3372430-1305421747 -o /tmp/evaluation-result-3372430-1305421747/solver-3372430-1305421747 -C 5000 -W 5100 -M 15500 lingeling HOME/instance-3372430-1305421747.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.09 7.89 7.94 3/364 2280
/proc/meminfo: memFree=25505536/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=7356 CPUtime=0 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 414 0 0 0 0 0 0 0 21 0 1 0 634590723 7532544 358 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726404864 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 1839 358 107 53 0 262 0

[startup+0.0613501 s]
/proc/loadavg: 7.09 7.89 7.94 3/364 2280
/proc/meminfo: memFree=25505536/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=12332 CPUtime=0.05 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 1632 0 0 0 5 0 0 0 21 0 1 0 634590723 12627968 1576 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726404864 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 3083 1576 113 53 0 1506 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 12332

[startup+0.100332 s]
/proc/loadavg: 7.09 7.89 7.94 3/364 2280
/proc/meminfo: memFree=25505536/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=12972 CPUtime=0.09 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 1792 0 0 0 9 0 0 0 21 0 1 0 634590723 13283328 1736 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726404864 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 3243 1736 113 53 0 1666 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12972

[startup+0.300296 s]
/proc/loadavg: 7.09 7.89 7.94 3/364 2280
/proc/meminfo: memFree=25505536/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=30320 CPUtime=0.29 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 6162 0 0 0 28 1 0 0 22 0 1 0 634590723 31047680 6105 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726404864 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 7580 6105 113 53 0 6003 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30320

[startup+0.700192 s]
/proc/loadavg: 7.09 7.89 7.94 3/364 2280
/proc/meminfo: memFree=25505536/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=65140 CPUtime=0.69 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 14931 0 0 0 66 3 0 0 24 0 1 0 634590723 66703360 14810 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726404864 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 16285 14810 113 53 0 14708 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 65140

[startup+1.93695 s]
/proc/loadavg: 7.09 7.89 7.94 3/364 2280
/proc/meminfo: memFree=25505536/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=157812 CPUtime=1.93 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 38099 0 0 0 185 8 0 0 25 0 1 0 634590723 161599488 37978 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726404864 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 39453 37978 113 53 0 37876 0
Current children cumulated CPU time (s) 1.93
Current children cumulated vsize (KiB) 157812

[startup+3.10077 s]
/proc/loadavg: 7.09 7.89 7.94 3/365 2281
/proc/meminfo: memFree=25350420/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=261572 CPUtime=3.09 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 77867 0 0 0 295 14 0 0 25 0 1 0 634590723 267849728 63925 33554432000 4194304 4409284 140737326384048 18446744073709551615 4261866 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 65393 63925 120 53 0 63816 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 261572

[startup+6.30116 s]
/proc/loadavg: 6.85 7.82 7.92 3/365 2281
/proc/meminfo: memFree=25228456/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=259056 CPUtime=6.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 109278 0 0 0 612 18 0 0 25 0 1 0 634590723 265273344 62316 33554432000 4194304 4409284 140737326384048 18446744073709551615 4288977 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 64764 62316 131 53 0 63187 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 259056

[startup+12.7009 s]
/proc/loadavg: 6.46 7.73 7.89 3/365 2281
/proc/meminfo: memFree=25217808/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=282312 CPUtime=12.69 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 232701 0 0 0 1238 31 0 0 25 0 1 0 634590723 289087488 69094 33554432000 4194304 4409284 140737326384048 18446744073709551615 4325538 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 70578 69094 136 53 0 69001 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 282312

[startup+25.5005 s]
/proc/loadavg: 5.47 7.44 7.80 3/365 2282
/proc/meminfo: memFree=25207812/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=282312 CPUtime=25.49 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 232701 0 0 0 2518 31 0 0 25 0 1 0 634590723 289087488 69094 33554432000 4194304 4409284 140737326384048 18446744073709551615 4248756 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 70578 69094 136 53 0 69001 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 282312

[startup+51.1007 s]
/proc/loadavg: 4.29 7.01 7.64 3/365 2282
/proc/meminfo: memFree=25175572/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=294940 CPUtime=51.09 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 245289 0 0 0 5076 33 0 0 25 0 1 0 634590723 302018560 72260 33554432000 4194304 4409284 140737326384048 18446744073709551615 4226443 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 73735 72260 140 53 0 72158 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 294940

[startup+102.314 s]
/proc/loadavg: 2.99 6.23 7.34 3/365 2284
/proc/meminfo: memFree=25074636/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=344864 CPUtime=102.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 257773 0 0 0 10195 35 0 0 25 0 1 0 634590723 353140736 84743 33554432000 4194304 4409284 140737326384048 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 86216 84743 141 53 0 84639 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 344864

[startup+162.301 s]
/proc/loadavg: 2.36 5.46 7.00 3/365 2285
/proc/meminfo: memFree=25023748/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=349028 CPUtime=162.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 305851 0 0 0 16187 43 0 0 25 0 1 0 634590723 357404672 85784 33554432000 4194304 4409284 140737326384048 18446744073709551615 4325588 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 87257 85784 141 53 0 85680 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 349028

[startup+222.3 s]
/proc/loadavg: 2.13 4.83 6.69 3/365 2287
/proc/meminfo: memFree=25021348/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=383424 CPUtime=222.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 314452 0 0 0 22186 44 0 0 25 0 1 0 634590723 392626176 94383 33554432000 4194304 4409284 140737326384048 18446744073709551615 264726429591 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 95856 94383 141 53 0 94279 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 383424

[startup+282.301 s]
/proc/loadavg: 2.05 4.31 6.39 3/365 2289
/proc/meminfo: memFree=24986592/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=421584 CPUtime=282.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 326931 0 0 0 28182 48 0 0 25 0 1 0 634590723 431702016 103923 33554432000 4194304 4409284 140737326384048 18446744073709551615 4271337 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 105396 103923 141 53 0 103819 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 421584

[startup+342.301 s]
/proc/loadavg: 2.10 3.92 6.12 3/365 2290
/proc/meminfo: memFree=24941052/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=432412 CPUtime=342.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 362410 0 0 0 34176 54 0 0 25 0 1 0 634590723 442789888 106630 33554432000 4194304 4409284 140737326384048 18446744073709551615 4226472 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 108103 106630 141 53 0 106526 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 432412

[startup+402.3 s]
/proc/loadavg: 2.08 3.58 5.87 3/365 2292
/proc/meminfo: memFree=24901084/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=464796 CPUtime=402.31 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 370506 0 0 0 40174 57 0 0 25 0 1 0 634590723 475951104 114726 33554432000 4194304 4409284 140737326384048 18446744073709551615 4325588 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 116199 114726 141 53 0 114622 0
Current children cumulated CPU time (s) 402.31
Current children cumulated vsize (KiB) 464796

[startup+462.301 s]
/proc/loadavg: 2.17 3.33 5.64 3/365 2293
/proc/meminfo: memFree=24867076/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=464792 CPUtime=462.3 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 370506 0 0 0 46173 57 0 0 25 0 1 0 634590723 475947008 114725 33554432000 4194304 4409284 140737326384048 18446744073709551615 4226443 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 116198 114725 141 53 0 114621 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 464792

[startup+522.301 s]
/proc/loadavg: 2.06 3.09 5.41 3/365 2295
/proc/meminfo: memFree=24795108/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=538140 CPUtime=522.31 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 441528 0 0 0 52163 68 0 0 25 0 1 0 634590723 551055360 133062 33554432000 4194304 4409284 140737326384048 18446744073709551615 4209166 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 134535 133062 141 53 0 132958 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 538140

[startup+582.3 s]
/proc/loadavg: 2.09 2.90 5.20 3/365 2297
/proc/meminfo: memFree=24750316/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=586132 CPUtime=582.31 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 457421 0 0 0 58159 72 0 0 25 0 1 0 634590723 600199168 145059 33554432000 4194304 4409284 140737326384048 18446744073709551615 4360264 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 146533 145059 141 53 0 144956 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 586132

[startup+642.301 s]

################
# More data... #
################

[startup+4002.3 s]
/proc/loadavg: 1.00 1.00 1.17 2/359 4721
/proc/meminfo: memFree=22808564/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=2655912 CPUtime=4002.44 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3030112 0 0 0 399768 476 0 0 25 0 1 0 634590723 2719653888 662505 33554432000 4194304 4409284 140737326384048 18446744073709551615 4257010 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 663978 662505 141 53 0 662401 0
Current children cumulated CPU time (s) 4002.44
Current children cumulated vsize (KiB) 2655912

[startup+4062.31 s]
/proc/loadavg: 1.07 1.02 1.17 2/359 4722
/proc/meminfo: memFree=22808776/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=2655912 CPUtime=4062.45 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3030112 0 0 0 405767 478 0 0 25 0 1 0 634590723 2719653888 662505 33554432000 4194304 4409284 140737326384048 18446744073709551615 4358609 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 663978 662505 141 53 0 662401 0
Current children cumulated CPU time (s) 4062.45
Current children cumulated vsize (KiB) 2655912

[startup+4122.3 s]
/proc/loadavg: 1.03 1.01 1.16 2/359 4724
/proc/meminfo: memFree=22808488/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=2655912 CPUtime=4122.44 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3030112 0 0 0 411761 483 0 0 25 0 1 0 634590723 2719653888 662505 33554432000 4194304 4409284 140737326384048 18446744073709551615 4244753 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 663978 662505 141 53 0 662401 0
Current children cumulated CPU time (s) 4122.44
Current children cumulated vsize (KiB) 2655912

[startup+4182.3 s]
/proc/loadavg: 1.01 1.00 1.14 2/359 4726
/proc/meminfo: memFree=24922152/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=547608 CPUtime=4182.45 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3094080 0 0 0 417744 501 0 0 25 0 1 0 634590723 560750592 135461 33554432000 4194304 4409284 140737326384048 18446744073709551615 4348289 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 136902 135461 141 53 0 135325 0
Current children cumulated CPU time (s) 4182.45
Current children cumulated vsize (KiB) 547608

[startup+4242.3 s]
/proc/loadavg: 1.00 1.00 1.13 2/359 4727
/proc/meminfo: memFree=24679316/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=789004 CPUtime=4242.44 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3194554 0 0 0 423730 514 0 0 25 0 1 0 634590723 807940096 195810 33554432000 4194304 4409284 140737326384048 18446744073709551615 4358959 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 197251 195810 141 53 0 195674 0
Current children cumulated CPU time (s) 4242.44
Current children cumulated vsize (KiB) 789004

[startup+4302.3 s]
/proc/loadavg: 1.00 1.00 1.12 2/359 4729
/proc/meminfo: memFree=24657576/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=810700 CPUtime=4302.45 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3199978 0 0 0 429728 517 0 0 25 0 1 0 634590723 830156800 201234 33554432000 4194304 4409284 140737326384048 18446744073709551615 4347349 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 202675 201234 141 53 0 201098 0
Current children cumulated CPU time (s) 4302.45
Current children cumulated vsize (KiB) 810700

[startup+4362.3 s]
/proc/loadavg: 1.00 1.00 1.11 2/359 4730
/proc/meminfo: memFree=24440168/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1027576 CPUtime=4362.45 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3254197 0 0 0 435721 524 0 0 25 0 1 0 634590723 1052237824 255453 33554432000 4194304 4409284 140737326384048 18446744073709551615 4358356 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 256894 255453 141 53 0 255317 0
Current children cumulated CPU time (s) 4362.45
Current children cumulated vsize (KiB) 1027576

[startup+4422.3 s]
/proc/loadavg: 1.42 1.13 1.14 2/359 10750
/proc/meminfo: memFree=24436388/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1027576 CPUtime=4422.46 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3254197 0 0 0 441719 527 0 0 25 0 1 0 634590723 1052237824 255453 33554432000 4194304 4409284 140737326384048 18446744073709551615 4226387 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 256894 255453 141 53 0 255317 0
Current children cumulated CPU time (s) 4422.46
Current children cumulated vsize (KiB) 1027576

[startup+4482.3 s]
/proc/loadavg: 1.17 1.11 1.13 2/359 10752
/proc/meminfo: memFree=24166980/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1298736 CPUtime=4482.46 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3413864 0 0 0 447700 546 0 0 25 0 1 0 634590723 1329905664 323243 33554432000 4194304 4409284 140737326384048 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 324684 323243 141 53 0 323107 0
Current children cumulated CPU time (s) 4482.46
Current children cumulated vsize (KiB) 1298736

[startup+4542.3 s]
/proc/loadavg: 1.05 1.08 1.12 2/359 10753
/proc/meminfo: memFree=24166944/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1298736 CPUtime=4542.46 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3413864 0 0 0 453698 548 0 0 25 0 1 0 634590723 1329905664 323243 33554432000 4194304 4409284 140737326384048 18446744073709551615 4256205 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 324684 323243 141 53 0 323107 0
Current children cumulated CPU time (s) 4542.46
Current children cumulated vsize (KiB) 1298736

[startup+4602.3 s]
/proc/loadavg: 1.14 1.11 1.13 2/359 10758
/proc/meminfo: memFree=24504628/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=960772 CPUtime=4602.46 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3413864 0 0 0 459696 550 0 0 25 0 1 0 634590723 983830528 238752 33554432000 4194304 4409284 140737326384048 18446744073709551615 4300392 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 240193 238752 141 53 0 238616 0
Current children cumulated CPU time (s) 4602.46
Current children cumulated vsize (KiB) 960772

[startup+4662.3 s]
/proc/loadavg: 1.05 1.09 1.11 2/359 10759
/proc/meminfo: memFree=24536844/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=928680 CPUtime=4662.46 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3413864 0 0 0 465696 550 0 0 25 0 1 0 634590723 950968320 230729 33554432000 4194304 4409284 140737326384048 18446744073709551615 4296742 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 232170 230729 141 53 0 230593 0
Current children cumulated CPU time (s) 4662.46
Current children cumulated vsize (KiB) 928680

[startup+4722.31 s]
/proc/loadavg: 1.02 1.07 1.10 2/359 10761
/proc/meminfo: memFree=23945208/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1519564 CPUtime=4722.47 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3561649 0 0 0 471681 566 0 0 25 0 1 0 634590723 1556033536 378450 33554432000 4194304 4409284 140737326384048 18446744073709551615 4231593 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 379891 378450 141 53 0 378314 0
Current children cumulated CPU time (s) 4722.47
Current children cumulated vsize (KiB) 1519564

[startup+4782.3 s]
/proc/loadavg: 1.00 1.05 1.09 2/359 10763
/proc/meminfo: memFree=23945416/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1519564 CPUtime=4782.47 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3561649 0 0 0 477677 570 0 0 25 0 1 0 634590723 1556033536 378450 33554432000 4194304 4409284 140737326384048 18446744073709551615 4358342 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 379891 378450 141 53 0 378314 0
Current children cumulated CPU time (s) 4782.47
Current children cumulated vsize (KiB) 1519564

[startup+4842.3 s]
/proc/loadavg: 1.00 1.04 1.08 2/359 10764
/proc/meminfo: memFree=23945376/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1519564 CPUtime=4842.47 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3561649 0 0 0 483674 573 0 0 25 0 1 0 634590723 1556033536 378450 33554432000 4194304 4409284 140737326384048 18446744073709551615 4358619 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 379891 378450 141 53 0 378314 0
Current children cumulated CPU time (s) 4842.47
Current children cumulated vsize (KiB) 1519564

[startup+4902.3 s]
/proc/loadavg: 1.00 1.03 1.08 2/359 10766
/proc/meminfo: memFree=23945336/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1519564 CPUtime=4902.47 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3561649 0 0 0 489672 575 0 0 25 0 1 0 634590723 1556033536 378450 33554432000 4194304 4409284 140737326384048 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 379891 378450 141 53 0 378314 0
Current children cumulated CPU time (s) 4902.47
Current children cumulated vsize (KiB) 1519564

[startup+4962.3 s]
/proc/loadavg: 1.00 1.02 1.07 2/359 10767
/proc/meminfo: memFree=23945424/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1519332 CPUtime=4962.47 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3561649 0 0 0 495670 577 0 0 25 0 1 0 634590723 1555795968 378392 33554432000 4194304 4409284 140737326384048 18446744073709551615 4358619 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 379833 378392 141 53 0 378256 0
Current children cumulated CPU time (s) 4962.47
Current children cumulated vsize (KiB) 1519332



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 1.00 1.02 1.07 2/359 10768
/proc/meminfo: memFree=23945276/32951124 swapFree=63083164/67111528
[pid=2280] ppid=2278 vsize=1519332 CPUtime=5000.08 cores=0,2,4,6
/proc/2280/stat : 2280 (lingeling) R 2278 2280 1566 0 -1 4202496 3561649 0 0 0 499430 578 0 0 25 0 1 0 634590723 1555795968 378392 33554432000 4194304 4409284 140737326384048 18446744073709551615 4244778 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/2280/statm: 379833 378392 141 53 0 378256 0
Current children cumulated CPU time (s) 5000.08
Current children cumulated vsize (KiB) 1519332

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.98
CPU time (s): 5000.16
CPU user time (s): 4994.31
CPU system time (s): 5.85211
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 2656104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4994.31
system time used= 5.85211
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3561649
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 7451

runsolver used 19.0441 second user time and 39.0661 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-15 03:09:11
IDJOB=3372430
IDBENCH=82374
IDSOLVER=1850
FILE ID=node141/3372430-1305421747
RUNJOBID= node141-1305421747-2251
PBS_JOBID= 13324546
Free space on /tmp= 73144 MiB

SOLVER NAME= Lingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372430-1305421747/watcher-3372430-1305421747 -o /tmp/evaluation-result-3372430-1305421747/solver-3372430-1305421747 -C 5000 -W 5100 -M 15500  lingeling HOME/instance-3372430-1305421747.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ce0d180356398dfbcfd2bbbb1cb3f9e5
RANDOM SEED=288080712

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25505692 kB
Buffers:        239628 kB
Cached:        4957516 kB
SwapCached:      15708 kB
Active:        2183824 kB
Inactive:      5018736 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25505692 kB
SwapTotal:    67111528 kB
SwapFree:     63083164 kB
Dirty:          158124 kB
Writeback:           0 kB
AnonPages:     1996952 kB
Mapped:          13224 kB
Slab:           140152 kB
PageTables:      38052 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 86291156 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73228 MiB
End job on node141 at 2011-05-15 04:32:33