Trace number 3348516

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: cir_minisat 2011-03-02? (TO) 1300.16 1300.13

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
MD5SUM48f03e5fbe31fc85b9a464480fc8aa5a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark752.735
Satisfiable
(Un)Satisfiability was proved
Number of variables1575206
Number of clauses8464620
Sum of the clauses size20118920
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 28393300
Number of clauses of size 3400
Number of clauses of size 41600
Number of clauses of size 54000
Number of clauses of size over 564600

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3348516-1304970796/watcher-3348516-1304970796 -o /tmp/evaluation-result-3348516-1304970796/solver-3348516-1304970796 -C 2400 -W 1300 -M 7680 HOME/cir_minisat HOME/instance-3348516-1304970796.cnf 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.19 1.88 2.66 4/361 20967
/proc/meminfo: memFree=28477940/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=21784 CPUtime=0 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 1179 0 0 0 0 0 0 0 22 0 1 0 608682779 22306816 1107 33554432000 4194304 4254575 140735453164784 18446744073709551615 4201603 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 5446 1107 213 15 0 2089 0

[startup+0.054177 s]
/proc/loadavg: 1.19 1.88 2.66 4/361 20967
/proc/meminfo: memFree=28477940/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=29720 CPUtime=0.04 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 2746 0 0 0 4 0 0 0 22 0 1 0 608682779 30433280 2644 33554432000 4194304 4254575 140735453164784 18446744073709551615 4221992 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 7430 2644 213 15 0 4073 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29720

[startup+0.101181 s]
/proc/loadavg: 1.19 1.88 2.66 4/361 20967
/proc/meminfo: memFree=28477940/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=34220 CPUtime=0.09 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 4080 0 0 0 8 1 0 0 22 0 1 0 608682779 35041280 3927 33554432000 4194304 4254575 140735453164784 18446744073709551615 216634515200 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 8555 3927 213 15 0 5198 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34220

[startup+0.301137 s]
/proc/loadavg: 1.19 1.88 2.66 4/361 20967
/proc/meminfo: memFree=28477940/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=82840 CPUtime=0.29 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 15999 0 0 0 26 3 0 0 23 0 1 0 608682779 84828160 15094 33554432000 4194304 4254575 140735453164784 18446744073709551615 216634176197 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 20710 15095 213 15 0 17353 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 82840

[startup+0.701075 s]
/proc/loadavg: 1.19 1.88 2.66 4/361 20967
/proc/meminfo: memFree=28477940/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=198208 CPUtime=0.69 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 41128 0 0 0 61 8 0 0 25 0 1 0 608682779 202964992 38525 33554432000 4194304 4254575 140735453164784 18446744073709551615 4241321 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 49552 38526 213 15 0 46195 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 198208

[startup+1.50093 s]
/proc/loadavg: 1.19 1.88 2.66 5/362 20968
/proc/meminfo: memFree=28246100/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=376884 CPUtime=1.49 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 90822 0 0 0 133 16 0 0 25 0 1 0 608682779 385929216 84888 33554432000 4194304 4254575 140735453164784 18446744073709551615 216634176197 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 94221 84890 213 15 0 90864 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 376884

[startup+3.10067 s]
/proc/loadavg: 1.19 1.88 2.66 5/362 20968
/proc/meminfo: memFree=28034680/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=534920 CPUtime=3.09 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 118071 0 0 0 288 21 0 0 25 0 1 0 608682779 547758080 109016 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209475 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 133730 109016 232 15 0 130373 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 534920

[startup+6.3011 s]
/proc/loadavg: 1.42 1.92 2.67 5/362 20968
/proc/meminfo: memFree=28011260/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=541900 CPUtime=6.29 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 121074 0 0 0 608 21 0 0 25 0 1 0 608682779 554905600 112017 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209230 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 135475 112017 232 15 0 132118 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 541900

[startup+12.701 s]
/proc/loadavg: 1.62 1.95 2.68 5/362 20968
/proc/meminfo: memFree=27986636/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=542852 CPUtime=12.69 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 121944 0 0 0 1248 21 0 0 25 0 1 0 608682779 555880448 112886 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209251 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 135713 112886 232 15 0 132356 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 542852

[startup+25.5007 s]
/proc/loadavg: 2.15 2.05 2.70 5/362 20968
/proc/meminfo: memFree=27903356/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=626408 CPUtime=25.49 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 128923 0 0 0 2527 22 0 0 25 0 1 0 608682779 641441792 119864 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209438 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 156602 119864 233 15 0 153245 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 626408

[startup+51.1002 s]
/proc/loadavg: 2.78 2.21 2.73 5/362 20969
/proc/meminfo: memFree=27777548/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=630924 CPUtime=51.09 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 137157 0 0 0 5085 24 0 0 25 0 1 0 608682779 646066176 128097 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209344 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 157731 128097 233 15 0 154374 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 630924

[startup+102.313 s]
/proc/loadavg: 3.54 2.50 2.80 5/362 20970
/proc/meminfo: memFree=27452724/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=773256 CPUtime=102.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 167143 0 0 0 10203 27 0 0 25 0 1 0 608682779 791814144 158070 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209332 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 193314 158070 233 15 0 189957 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 773256

[startup+162.301 s]
/proc/loadavg: 3.83 2.77 2.87 5/362 20972
/proc/meminfo: memFree=27101292/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=994728 CPUtime=162.29 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 211723 0 0 0 16194 35 0 0 25 0 1 0 608682779 1018601472 202638 33554432000 4194304 4254575 140735453164784 18446744073709551615 4223029 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 248682 202638 233 15 0 245325 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 994728

[startup+222.301 s]
/proc/loadavg: 3.93 2.99 2.94 5/362 20974
/proc/meminfo: memFree=26787772/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=994728 CPUtime=222.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 229095 0 0 0 22192 38 0 0 25 0 1 0 608682779 1018601472 220007 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209455 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 248682 220007 233 15 0 245325 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 994728

[startup+282.3 s]
/proc/loadavg: 4.06 3.20 3.01 5/362 20975
/proc/meminfo: memFree=26465308/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1343976 CPUtime=282.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 246653 0 0 0 28190 40 0 0 25 0 1 0 608682779 1376231424 237562 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209265 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 335994 237562 233 15 0 332637 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 1343976

[startup+342.301 s]
/proc/loadavg: 4.02 3.34 3.07 5/362 20977
/proc/meminfo: memFree=26115680/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1353416 CPUtime=342.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 281536 0 0 0 34187 43 0 0 25 0 1 0 608682779 1385897984 272435 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209344 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 338354 272435 233 15 0 334997 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 1353416

[startup+402.301 s]
/proc/loadavg: 4.01 3.46 3.13 5/362 20978
/proc/meminfo: memFree=25767452/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1354192 CPUtime=402.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 318579 0 0 0 40180 50 0 0 25 0 1 0 608682779 1386692608 309467 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209236 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 338548 309467 233 15 0 335191 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 1354192

[startup+462.301 s]
/proc/loadavg: 4.04 3.57 3.19 5/362 20989
/proc/meminfo: memFree=25408912/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1924236 CPUtime=462.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 363533 0 0 0 46174 56 0 0 25 0 1 0 608682779 1970417664 354412 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209186 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 481059 354412 233 15 0 477702 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 1924236

[startup+522.301 s]
/proc/loadavg: 4.01 3.65 3.23 5/362 20991
/proc/meminfo: memFree=25034596/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1934420 CPUtime=522.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 403339 0 0 0 52168 62 0 0 25 0 1 0 608682779 1980846080 394206 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209251 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 483605 394206 233 15 0 480248 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 1934420

[startup+582.3 s]
/proc/loadavg: 4.00 3.71 3.28 5/362 20992
/proc/meminfo: memFree=24728624/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1934420 CPUtime=582.3 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 432907 0 0 0 58163 67 0 0 25 0 1 0 608682779 1980846080 423760 33554432000 4194304 4254575 140735453164784 18446744073709551615 4216779 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 483605 423760 233 15 0 480248 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 1934420

[startup+642.301 s]
/proc/loadavg: 4.00 3.76 3.32 5/362 20997
/proc/meminfo: memFree=24383688/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=1937012 CPUtime=642.32 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 459115 0 0 0 64162 70 0 0 25 0 1 0 608682779 1983500288 449955 33554432000 4194304 4254575 140735453164784 18446744073709551615 4210104 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 484253 449955 233 15 0 480896 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 1937012

[startup+702.301 s]
/proc/loadavg: 4.03 3.81 3.37 5/362 20998
/proc/meminfo: memFree=24005256/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2863604 CPUtime=702.31 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 496584 0 0 0 70157 74 0 0 25 0 1 0 608682779 2932330496 487410 33554432000 4194304 4254575 140735453164784 18446744073709551615 4224050 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 715901 487410 233 15 0 712544 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 2863604

[startup+762.314 s]
/proc/loadavg: 4.01 3.84 3.40 5/362 21000
/proc/meminfo: memFree=23661084/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2865484 CPUtime=762.32 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 522682 0 0 0 76155 77 0 0 25 0 1 0 608682779 2934255616 513492 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209200 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 716371 513492 233 15 0 713014 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 2865484

[startup+822.301 s]
/proc/loadavg: 4.13 3.90 3.45 5/362 21002
/proc/meminfo: memFree=23399400/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2866592 CPUtime=822.31 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 536545 0 0 0 82152 79 0 0 25 0 1 0 608682779 2935390208 527352 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209200 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 716648 527352 233 15 0 713291 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 2866592

[startup+882.3 s]
/proc/loadavg: 4.04 3.92 3.48 5/362 21003
/proc/meminfo: memFree=23125052/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2866592 CPUtime=882.31 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 544044 0 0 0 88150 81 0 0 25 0 1 0 608682779 2935390208 534848 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209332 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 716648 534848 233 15 0 713291 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 2866592

[startup+942.301 s]
/proc/loadavg: 4.01 3.93 3.51 5/362 21005
/proc/meminfo: memFree=22806308/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2877572 CPUtime=942.31 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 565655 0 0 0 94147 84 0 0 25 0 1 0 608682779 2946633728 556452 33554432000 4194304 4254575 140735453164784 18446744073709551615 4223129 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 719393 556452 233 15 0 716036 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 2877572

[startup+1002.3 s]
/proc/loadavg: 4.06 3.95 3.54 5/362 21006
/proc/meminfo: memFree=22471940/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2877572 CPUtime=1002.31 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 600255 0 0 0 100140 91 0 0 25 0 1 0 608682779 2946633728 591039 33554432000 4194304 4254575 140735453164784 18446744073709551615 4216768 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 719393 591039 233 15 0 716036 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 2877572

[startup+1062.3 s]
/proc/loadavg: 4.02 3.96 3.57 5/362 21008
/proc/meminfo: memFree=22166380/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2877968 CPUtime=1062.31 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 630632 0 0 0 106136 95 0 0 25 0 1 0 608682779 2947039232 621409 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209251 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 719492 621409 233 15 0 716135 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 2877968

[startup+1122.3 s]
/proc/loadavg: 4.00 3.97 3.59 5/362 21010
/proc/meminfo: memFree=21815280/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2881240 CPUtime=1122.32 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 658580 0 0 0 112133 99 0 0 25 0 1 0 608682779 2950389760 649351 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209312 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 720310 649351 233 15 0 716953 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 2881240

[startup+1182.3 s]
/proc/loadavg: 4.00 3.97 3.61 5/362 21011
/proc/meminfo: memFree=21464432/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2881240 CPUtime=1182.32 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 666769 0 0 0 118131 101 0 0 25 0 1 0 608682779 2950389760 657538 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209392 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 720310 657538 233 15 0 716953 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 2881240

[startup+1242.3 s]
/proc/loadavg: 4.05 3.99 3.64 5/362 21013
/proc/meminfo: memFree=21135660/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2881240 CPUtime=1242.32 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 686308 0 0 0 124128 104 0 0 25 0 1 0 608682779 2950389760 677069 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209218 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 720310 677069 233 15 0 716953 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 2881240



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.02 3.99 3.66 5/362 21100
/proc/meminfo: memFree=25769936/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=2881376 CPUtime=1300.03 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4202496 709131 0 0 0 129896 107 0 0 25 0 1 0 608682779 2950529024 699886 33554432000 4194304 4254575 140735453164784 18446744073709551615 4209251 0 0 4096 8388610 0 0 0 17 0 0 0 0
/proc/20967/statm: 720344 699886 233 15 0 716987 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 2881376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.11 s]
/proc/loadavg: 4.02 3.99 3.66 5/363 21101
/proc/meminfo: memFree=28194156/32951124 swapFree=53501176/67111528
[pid=20967] ppid=20965 vsize=0 CPUtime=1300.15 cores=0,2
/proc/20967/stat : 20967 (cir_minisat) R 20965 20967 20502 0 -1 4203524 709131 0 0 0 129896 119 0 0 25 0 1 0 608682779 0 0 33554432000 0 0 0 0 0 0 0 4096 8388610 18446744073709551615 0 0 17 0 0 0 0
/proc/20967/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1300.15
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.13
CPU time (s): 1300.16
CPU user time (s): 1298.96
CPU system time (s): 1.19482
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 2881376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1298.96
system time used= 1.19482
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 709131
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1625

runsolver used 4.51631 second user time and 9.69253 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-09 21:53:22
IDJOB=3348516
IDBENCH=82388
IDSOLVER=1810
FILE ID=node103/3348516-1304970796
RUNJOBID= node103-1304970796-20925
PBS_JOBID= 13285647
Free space on /tmp= 48664 MiB

SOLVER NAME= minisat hack: cir_minisat 2011-03-02
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
COMMAND LINE= HOME/cir_minisat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3348516-1304970796/watcher-3348516-1304970796 -o /tmp/evaluation-result-3348516-1304970796/solver-3348516-1304970796 -C 2400 -W 1300 -M 7680  HOME/cir_minisat HOME/instance-3348516-1304970796.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 48f03e5fbe31fc85b9a464480fc8aa5a
RANDOM SEED=957615947

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28478220 kB
Buffers:        188424 kB
Cached:        1649932 kB
SwapCached:     339736 kB
Active:         978268 kB
Inactive:      3246056 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28478220 kB
SwapTotal:    67111528 kB
SwapFree:     53501176 kB
Dirty:          207644 kB
Writeback:           0 kB
AnonPages:     2056936 kB
Mapped:          10964 kB
Slab:           131276 kB
PageTables:      53808 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 78495468 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 48688 MiB
End job on node103 at 2011-05-09 22:15:04