Trace number 3309529

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587? (TO) 5000.1 4999.99

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
MD5SUMfce318b20c1a474ab81b77594d3f6f99
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark510.889
Satisfiable
(Un)Satisfiability was proved
Number of variables945406
Number of clauses5079060
Sum of the clauses size12071640
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 25035980
Number of clauses of size 3240
Number of clauses of size 4960
Number of clauses of size 52400
Number of clauses of size over 538760

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309529-1303991477/watcher-3309529-1303991477 -o /tmp/evaluation-result-3309529-1303991477/solver-3309529-1303991477 -C 5000 -W 5100 -M 15500 lingeling HOME/instance-3309529-1303991477.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 7469
/proc/meminfo: memFree=14055596/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=7356 CPUtime=0 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 418 0 0 0 0 0 0 0 23 0 1 0 510747850 7532544 360 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089698048 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 1839 360 109 53 0 262 0

[startup+0.067503 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 7469
/proc/meminfo: memFree=14055596/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=12332 CPUtime=0.06 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 1634 0 0 0 6 0 0 0 23 0 1 0 510747850 12627968 1576 33554432000 4194304 4409164 140737306347088 18446744073709551615 4200439 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 3083 1576 113 53 0 1506 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 12332

[startup+0.100496 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 7469
/proc/meminfo: memFree=14055596/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=12972 CPUtime=0.09 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 1794 0 0 0 9 0 0 0 23 0 1 0 510747850 13283328 1736 33554432000 4194304 4409164 140737306347088 18446744073709551615 4200771 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 3243 1736 113 53 0 1666 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12972

[startup+0.300463 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 7469
/proc/meminfo: memFree=14055596/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=30320 CPUtime=0.29 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 6164 0 0 0 28 1 0 0 25 0 1 0 510747850 31047680 6105 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089698048 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 7580 6105 113 53 0 6003 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30320

[startup+0.700431 s]
/proc/loadavg: 2.00 2.00 2.00 2/177 7469
/proc/meminfo: memFree=14055596/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=65140 CPUtime=0.69 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 14933 0 0 0 67 2 0 0 25 0 1 0 510747850 66703360 14810 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089698048 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 16285 14810 113 53 0 14708 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 65140

[startup+1.50037 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7470
/proc/meminfo: memFree=13978344/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=125044 CPUtime=1.49 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 29909 0 0 0 143 6 0 0 25 0 1 0 510747850 128045056 29786 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089698048 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 31261 29786 113 53 0 29684 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 125044

[startup+3.10097 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7470
/proc/meminfo: memFree=13907176/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=190576 CPUtime=3.09 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 61350 0 0 0 299 10 0 0 25 0 1 0 510747850 195149824 46148 33554432000 4194304 4409164 140737306347088 18446744073709551615 4281278 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 47644 46148 125 53 0 46067 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 190576

[startup+6.3004 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7470
/proc/meminfo: memFree=13872000/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=238160 CPUtime=6.29 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 82169 0 0 0 616 13 0 0 25 0 1 0 510747850 243875840 56007 33554432000 4194304 4409164 140737306347088 18446744073709551615 4268465 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 59540 56007 134 53 0 57963 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 238160

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7471
/proc/meminfo: memFree=13866444/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=194760 CPUtime=12.69 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 106139 0 0 0 1253 16 0 0 25 0 1 0 510747850 199434240 47207 33554432000 4194304 4409164 140737306347088 18446744073709551615 4325486 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 48690 47207 137 53 0 47113 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 194760

[startup+25.5011 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7471
/proc/meminfo: memFree=13857052/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=194760 CPUtime=25.5 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 106139 0 0 0 2534 16 0 0 25 0 1 0 510747850 199434240 47207 33554432000 4194304 4409164 140737306347088 18446744073709551615 4248756 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 48690 47207 137 53 0 47113 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 194760

[startup+51.1006 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7472
/proc/meminfo: memFree=13853096/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=207492 CPUtime=51.1 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 109645 0 0 0 5093 17 0 0 25 0 1 0 510747850 212471808 50400 33554432000 4194304 4409164 140737306347088 18446744073709551615 4350793 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 51873 50400 141 53 0 50296 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 207492

[startup+102.307 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 7473
/proc/meminfo: memFree=13815764/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=248216 CPUtime=102.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 153093 0 0 0 10206 24 0 0 25 0 1 0 510747850 254173184 60581 33554432000 4194304 4409164 140737306347088 18446744073709551615 4226443 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 62054 60581 141 53 0 60477 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 248216

[startup+162.301 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 7475
/proc/meminfo: memFree=13771844/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=277616 CPUtime=162.29 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 160443 0 0 0 16204 25 0 0 25 0 1 0 510747850 284278784 67931 33554432000 4194304 4409164 140737306347088 18446744073709551615 4248229 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 69404 67931 141 53 0 67827 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 277616

[startup+222.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/178 7476
/proc/meminfo: memFree=13779368/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=271212 CPUtime=222.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 160443 0 0 0 22202 28 0 0 25 0 1 0 510747850 277721088 66330 33554432000 4194304 4409164 140737306347088 18446744073709551615 4230481 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 67803 66330 141 53 0 66226 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 271212

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 2.00 4/178 7478
/proc/meminfo: memFree=13773140/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=311564 CPUtime=282.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 203758 0 0 0 28194 36 0 0 25 0 1 0 510747850 319041536 76418 33554432000 4194304 4409164 140737306347088 18446744073709551615 4259221 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 77891 76418 141 53 0 76314 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 311564

[startup+342.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7479
/proc/meminfo: memFree=13682104/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=376460 CPUtime=342.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 219982 0 0 0 34190 40 0 0 25 0 1 0 510747850 385495040 92642 33554432000 4194304 4409164 140737306347088 18446744073709551615 4300050 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 94115 92642 141 53 0 92538 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 376460

[startup+402.301 s]
/proc/loadavg: 2.04 2.01 2.00 3/178 7481
/proc/meminfo: memFree=13695968/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=376460 CPUtime=402.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 219982 0 0 0 40190 40 0 0 25 0 1 0 510747850 385495040 92642 33554432000 4194304 4409164 140737306347088 18446744073709551615 4248769 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 94115 92642 141 53 0 92538 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 376460

[startup+462.301 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 7483
/proc/meminfo: memFree=13688504/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=387876 CPUtime=462.31 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 237714 0 0 0 46185 46 0 0 25 0 1 0 510747850 397185024 95528 33554432000 4194304 4409164 140737306347088 18446744073709551615 4350903 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 96969 95528 141 53 0 95392 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 387876

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7484
/proc/meminfo: memFree=13565472/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=493340 CPUtime=522.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 299902 0 0 0 52175 55 0 0 25 0 1 0 510747850 505180160 121862 33554432000 4194304 4409164 140737306347088 18446744073709551615 4359769 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 123335 121862 141 53 0 121758 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 493340

[startup+582.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7495
/proc/meminfo: memFree=13563780/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=493340 CPUtime=582.3 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 299902 0 0 0 58172 58 0 0 25 0 1 0 510747850 505180160 121862 33554432000 4194304 4409164 140737306347088 18446744073709551615 4244759 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 123335 121862 141 53 0 121758 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 493340

[startup+642.301 s]

################
# More data... #
################

[startup+4062.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7754
/proc/meminfo: memFree=10617280/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=3379156 CPUtime=4062.4 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 2910260 0 0 0 405753 487 0 0 25 0 1 0 510747850 3460255744 843348 33554432000 4194304 4409164 140737306347088 18446744073709551615 4348193 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 844789 843348 141 53 0 843212 0
Current children cumulated CPU time (s) 4062.4
Current children cumulated vsize (KiB) 3379156

[startup+4122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7755
/proc/meminfo: memFree=13400916/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=572356 CPUtime=4122.39 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3019620 0 0 0 411726 513 0 0 25 0 1 0 510747850 586092544 141648 33554432000 4194304 4409164 140737306347088 18446744073709551615 4315470 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 143089 141648 141 53 0 141512 0
Current children cumulated CPU time (s) 4122.39
Current children cumulated vsize (KiB) 572356

[startup+4182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7766
/proc/meminfo: memFree=13288008/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=678864 CPUtime=4182.39 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3046247 0 0 0 417721 518 0 0 25 0 1 0 510747850 695156736 168275 33554432000 4194304 4409164 140737306347088 18446744073709551615 4258768 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 169716 168275 141 53 0 168139 0
Current children cumulated CPU time (s) 4182.39
Current children cumulated vsize (KiB) 678864

[startup+4242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7767
/proc/meminfo: memFree=13499064/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=467948 CPUtime=4242.4 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3047473 0 0 0 423720 520 0 0 25 0 1 0 510747850 479178752 115546 33554432000 4194304 4409164 140737306347088 18446744073709551615 4267235 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 116987 115546 141 53 0 115410 0
Current children cumulated CPU time (s) 4242.4
Current children cumulated vsize (KiB) 467948

[startup+4302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7769
/proc/meminfo: memFree=13233904/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=773124 CPUtime=4302.39 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3123929 0 0 0 429710 529 0 0 25 0 1 0 510747850 791678976 191840 33554432000 4194304 4409164 140737306347088 18446744073709551615 4226443 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 193281 191840 141 53 0 191704 0
Current children cumulated CPU time (s) 4302.39
Current children cumulated vsize (KiB) 773124

[startup+4362.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 7773
/proc/meminfo: memFree=13127980/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=878080 CPUtime=4362.39 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3150168 0 0 0 435704 535 0 0 25 0 1 0 510747850 899153920 218079 33554432000 4194304 4409164 140737306347088 18446744073709551615 4244753 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 219520 218079 141 53 0 217943 0
Current children cumulated CPU time (s) 4362.39
Current children cumulated vsize (KiB) 878080

[startup+4422.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/178 7775
/proc/meminfo: memFree=13088760/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=877908 CPUtime=4422.39 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3150168 0 0 0 441700 539 0 0 25 0 1 0 510747850 898977792 218036 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089722775 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 219477 218036 141 53 0 217900 0
Current children cumulated CPU time (s) 4422.39
Current children cumulated vsize (KiB) 877908

[startup+4482.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 7777
/proc/meminfo: memFree=12892052/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1080948 CPUtime=4482.4 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3200928 0 0 0 447692 548 0 0 25 0 1 0 510747850 1106890752 268796 33554432000 4194304 4409164 140737306347088 18446744073709551615 4256901 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 270237 268796 141 53 0 268660 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 1080948

[startup+4542.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 7778
/proc/meminfo: memFree=12799492/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1173340 CPUtime=4542.4 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3224026 0 0 0 453688 552 0 0 25 0 1 0 510747850 1201500160 291894 33554432000 4194304 4409164 140737306347088 18446744073709551615 4230441 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 293335 291894 141 53 0 291758 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 1173340

[startup+4602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 7780
/proc/meminfo: memFree=12703236/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1262840 CPUtime=4602.41 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3246401 0 0 0 459685 556 0 0 25 0 1 0 510747850 1293148160 314269 33554432000 4194304 4409164 140737306347088 18446744073709551615 4359752 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 315710 314269 141 53 0 314133 0
Current children cumulated CPU time (s) 4602.41
Current children cumulated vsize (KiB) 1262840

[startup+4662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7782
/proc/meminfo: memFree=12702544/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1262840 CPUtime=4662.4 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3246401 0 0 0 465680 560 0 0 25 0 1 0 510747850 1293148160 314269 33554432000 4194304 4409164 140737306347088 18446744073709551615 4257039 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 315710 314269 141 53 0 314133 0
Current children cumulated CPU time (s) 4662.4
Current children cumulated vsize (KiB) 1262840

[startup+4722.31 s]
/proc/loadavg: 2.08 2.02 2.01 3/178 7783
/proc/meminfo: memFree=12702368/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1262840 CPUtime=4722.41 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3246401 0 0 0 471678 563 0 0 25 0 1 0 510747850 1293148160 314269 33554432000 4194304 4409164 140737306347088 18446744073709551615 4257039 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 315710 314269 141 53 0 314133 0
Current children cumulated CPU time (s) 4722.41
Current children cumulated vsize (KiB) 1262840

[startup+4782.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/178 7785
/proc/meminfo: memFree=12092736/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1871052 CPUtime=4782.41 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3465183 0 0 0 477656 585 0 0 25 0 1 0 510747850 1915957248 466322 33554432000 4194304 4409164 140737306347088 18446744073709551615 4226196 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 467763 466322 141 53 0 466186 0
Current children cumulated CPU time (s) 4782.41
Current children cumulated vsize (KiB) 1871052

[startup+4842.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/178 7786
/proc/meminfo: memFree=12861372/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1140632 CPUtime=4842.4 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3498355 0 0 0 483646 594 0 0 25 0 1 0 510747850 1168007168 283717 33554432000 4194304 4409164 140737306347088 18446744073709551615 4264048 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 285158 283717 141 53 0 283581 0
Current children cumulated CPU time (s) 4842.4
Current children cumulated vsize (KiB) 1140632

[startup+4902.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 7788
/proc/meminfo: memFree=11959968/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1994564 CPUtime=4902.41 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3711838 0 0 0 489623 618 0 0 25 0 1 0 510747850 2042433536 497200 33554432000 4194304 4409164 140737306347088 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 4902.41
Current children cumulated vsize (KiB) 1994564

[startup+4962.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/178 7790
/proc/meminfo: memFree=11968604/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1994564 CPUtime=4962.41 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3711838 0 0 0 495621 620 0 0 25 0 1 0 510747850 2042433536 497200 33554432000 4194304 4409164 140737306347088 18446744073709551615 4358257 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 4962.41
Current children cumulated vsize (KiB) 1994564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 7791
/proc/meminfo: memFree=11976020/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1994564 CPUtime=5000.02 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3711838 0 0 0 499379 623 0 0 25 0 1 0 510747850 2042433536 497200 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089722775 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 1994564

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 7791
/proc/meminfo: memFree=11976020/32950928 swapFree=67111528/67111528
[pid=7469] ppid=7467 vsize=1994564 CPUtime=5000.02 cores=0,2,4,6
/proc/7469/stat : 7469 (lingeling) R 7467 7469 7202 0 -1 4202496 3711838 0 0 0 499379 623 0 0 25 0 1 0 510747850 2042433536 497200 33554432000 4194304 4409164 140737306347088 18446744073709551615 248089722775 0 0 4096 17506 0 0 0 17 0 0 0 0
/proc/7469/statm: 498641 497200 141 53 0 497064 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 1994564

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.99
CPU time (s): 5000.1
CPU user time (s): 4993.8
CPU system time (s): 6.30804
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 3380776

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4993.8
system time used= 6.30804
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3711838
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 15878

runsolver used 8.59369 second user time and 17.0104 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-28 13:51:21
IDJOB=3309529
IDBENCH=82367
IDSOLVER=1693
FILE ID=node123/3309529-1303991477
RUNJOBID= node123-1303987382-7220
PBS_JOBID= 13168750
Free space on /tmp= 72720 MiB

SOLVER NAME= Lingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309529-1303991477/watcher-3309529-1303991477 -o /tmp/evaluation-result-3309529-1303991477/solver-3309529-1303991477 -C 5000 -W 5100 -M 15500  lingeling HOME/instance-3309529-1303991477.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fce318b20c1a474ab81b77594d3f6f99
RANDOM SEED=775168366

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14056000 kB
Buffers:       2188244 kB
Cached:       16011552 kB
SwapCached:          0 kB
Active:        9027968 kB
Inactive:      9316828 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14056000 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           97992 kB
Writeback:           0 kB
AnonPages:      144400 kB
Mapped:          15340 kB
Slab:           487920 kB
PageTables:       4860 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   291640 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72708 MiB
End job on node123 at 2011-04-28 15:14:42