Trace number 3349699

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: LR_NOGL_NOSHR 2011-03-02? (TO) 1300.07 1300.03

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-8-ipc5-h19-sat.cnf
MD5SUM409f4401e9e8b60ee665ac5567a13e41
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1110.09
Satisfiable
(Un)Satisfiability was proved
Number of variables359341
Number of clauses1254773
Sum of the clauses size3046189
Maximum clause length57
Minimum clause length1
Number of clauses of size 1256
Number of clauses of size 2896240
Number of clauses of size 3346435
Number of clauses of size 4830
Number of clauses of size 5571
Number of clauses of size over 510441

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3349699-1304968102/watcher-3349699-1304968102 -o /tmp/evaluation-result-3349699-1304968102/solver-3349699-1304968102 -C 2400 -W 1300 -M 7680 HOME/lr_gl_shr HOME/instance-3349699-1304968102.cnf -verb=0 -model -no-shrinking -no-glucose 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 3/355 26616
/proc/meminfo: memFree=13301940/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=21084 CPUtime=0.01 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 897 0 0 0 1 0 0 0 21 0 1 0 687040989 21590016 808 33554432000 4194304 4300056 140735719133552 18446744073709551615 256415052485 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 5271 809 222 26 0 1903 0

[startup+0.0316329 s]
/proc/loadavg: 0.00 0.00 0.00 3/355 26616
/proc/meminfo: memFree=13301940/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=23876 CPUtime=0.02 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 1789 0 0 0 2 0 0 0 21 0 1 0 687040989 24449024 1621 33554432000 4194304 4300056 140735719133552 18446744073709551615 256415391488 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 5969 1623 222 26 0 2601 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 23876

[startup+0.100626 s]
/proc/loadavg: 0.00 0.00 0.00 3/355 26616
/proc/meminfo: memFree=13301940/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=34596 CPUtime=0.09 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 5255 0 0 0 9 0 0 0 21 0 1 0 687040989 35426304 4662 33554432000 4194304 4300056 140735719133552 18446744073709551615 4286249 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 8649 4663 222 26 0 5281 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34596

[startup+0.300588 s]
/proc/loadavg: 0.00 0.00 0.00 3/355 26616
/proc/meminfo: memFree=13301940/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=76168 CPUtime=0.29 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 15586 0 0 0 27 2 0 0 22 0 1 0 687040989 77996032 13646 33554432000 4194304 4300056 140735719133552 18446744073709551615 4223657 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 19042 13647 248 26 0 15674 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 76168

[startup+0.70053 s]
/proc/loadavg: 0.00 0.00 0.00 3/355 26616
/proc/meminfo: memFree=13301940/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=156516 CPUtime=0.68 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 34932 0 0 0 63 5 0 0 23 0 1 0 687040989 160272384 30536 33554432000 4194304 4300056 140735719133552 18446744073709551615 256415052485 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 39129 30536 266 26 0 35761 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 156516

[startup+1.50036 s]
/proc/loadavg: 0.16 0.03 0.01 3/354 26640
/proc/meminfo: memFree=13170988/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=213812 CPUtime=1.49 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 48587 0 0 0 142 7 0 0 25 0 1 0 687040989 218943488 43690 33554432000 4194304 4300056 140735719133552 18446744073709551615 4284280 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 53453 43691 246 26 0 50085 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 213812

[startup+3.10105 s]
/proc/loadavg: 0.16 0.03 0.01 4/359 26650
/proc/meminfo: memFree=13097400/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=215608 CPUtime=3.09 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 62873 0 0 0 299 10 0 0 25 0 1 0 687040989 220782592 47081 33554432000 4194304 4300056 140735719133552 18446744073709551615 4230355 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 53902 47081 246 26 0 50534 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 215608

[startup+6.30044 s]
/proc/loadavg: 0.16 0.03 0.01 4/359 26650
/proc/meminfo: memFree=13076444/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=192096 CPUtime=6.28 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 68744 0 0 0 617 11 0 0 25 0 1 0 687040989 196706304 40673 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256042 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 48024 40673 263 26 0 44656 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 192096

[startup+12.7012 s]
/proc/loadavg: 0.68 0.15 0.05 4/359 26650
/proc/meminfo: memFree=13119740/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=192096 CPUtime=12.69 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 69229 0 0 0 1257 12 0 0 25 0 1 0 687040989 196706304 41150 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256322 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 48024 41150 264 26 0 44656 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 192096

[startup+25.5008 s]
/proc/loadavg: 0.88 0.21 0.07 3/354 26668
/proc/meminfo: memFree=13228336/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=203772 CPUtime=25.48 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 70327 0 0 0 2536 12 0 0 25 0 1 0 687040989 208662528 42233 33554432000 4194304 4300056 140735719133552 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 50943 42233 264 26 0 47575 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 203772

[startup+51.1009 s]
/proc/loadavg: 1.77 0.46 0.16 5/364 26688
/proc/meminfo: memFree=13069308/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=203772 CPUtime=51.08 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 71821 0 0 0 5095 13 0 0 25 0 1 0 687040989 208662528 43693 33554432000 4194304 4300056 140735719133552 18446744073709551615 4251385 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 50943 43693 264 26 0 47575 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 203772

[startup+102.314 s]
/proc/loadavg: 3.17 1.07 0.38 5/364 26690
/proc/meminfo: memFree=13109424/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=222740 CPUtime=102.3 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 74288 0 0 0 10216 14 0 0 25 0 1 0 687040989 228085760 46096 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256570 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 55685 46096 264 26 0 52317 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 222740

[startup+162.301 s]
/proc/loadavg: 3.70 1.60 0.60 5/364 26691
/proc/meminfo: memFree=12918832/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=222740 CPUtime=162.29 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 77660 0 0 0 16213 16 0 0 25 0 1 0 687040989 228085760 49429 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 55685 49429 264 26 0 52317 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 222740

[startup+222.301 s]
/proc/loadavg: 3.89 2.04 0.81 5/364 26693
/proc/meminfo: memFree=12970072/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=253560 CPUtime=222.3 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 80224 0 0 0 22213 17 0 0 25 0 1 0 687040989 259645440 51948 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256008 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 63390 51948 264 26 0 60022 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 253560

[startup+282.301 s]
/proc/loadavg: 4.10 2.42 1.02 5/364 26695
/proc/meminfo: memFree=12828156/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=253560 CPUtime=282.3 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 82644 0 0 0 28212 18 0 0 25 0 1 0 687040989 259645440 54311 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256337 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 63390 54311 264 26 0 60022 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 253560

[startup+342.301 s]
/proc/loadavg: 4.11 2.72 1.21 5/364 26696
/proc/meminfo: memFree=12891344/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=253560 CPUtime=342.29 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 85152 0 0 0 34210 19 0 0 25 0 1 0 687040989 259645440 56775 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256057 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 63390 56775 264 26 0 60022 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 253560

[startup+402.301 s]
/proc/loadavg: 4.04 2.95 1.38 5/364 26698
/proc/meminfo: memFree=12739024/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=303648 CPUtime=402.3 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 87619 0 0 0 40210 20 0 0 25 0 1 0 687040989 310935552 59197 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 75912 59197 264 26 0 72544 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 303648

[startup+462.3 s]
/proc/loadavg: 4.01 3.14 1.54 5/364 26699
/proc/meminfo: memFree=12932156/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=306092 CPUtime=462.3 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 90172 0 0 0 46209 21 0 0 25 0 1 0 687040989 313438208 61705 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256480 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 76523 61705 264 26 0 73155 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 306092

[startup+522.301 s]
/proc/loadavg: 4.08 3.31 1.70 5/364 26701
/proc/meminfo: memFree=12829052/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=306092 CPUtime=522.31 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 92742 0 0 0 52209 22 0 0 25 0 1 0 687040989 313438208 64228 33554432000 4194304 4300056 140735719133552 18446744073709551615 4273475 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 76523 64228 264 26 0 73155 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 306092

[startup+582.3 s]
/proc/loadavg: 4.03 3.43 1.84 5/364 26703
/proc/meminfo: memFree=12915932/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=308812 CPUtime=582.3 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 95621 0 0 0 58208 22 0 0 25 0 1 0 687040989 316223488 67063 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 77203 67063 264 26 0 73835 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 308812

[startup+642.301 s]
/proc/loadavg: 4.08 3.56 1.98 5/364 26704
/proc/meminfo: memFree=12771772/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=310732 CPUtime=642.32 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 98249 0 0 0 64208 24 0 0 25 0 1 0 687040989 318189568 69659 33554432000 4194304 4300056 140735719133552 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 77683 69659 264 26 0 74315 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 310732

[startup+702.3 s]
/proc/loadavg: 4.03 3.64 2.11 5/364 26706
/proc/meminfo: memFree=12586712/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=397364 CPUtime=702.31 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 101473 0 0 0 70206 25 0 0 25 0 1 0 687040989 406900736 72842 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256548 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 99341 72842 264 26 0 95973 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 397364

[startup+762.314 s]
/proc/loadavg: 4.01 3.70 2.22 5/364 26707
/proc/meminfo: memFree=12788160/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=397364 CPUtime=762.33 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 104286 0 0 0 76207 26 0 0 25 0 1 0 687040989 406900736 75615 33554432000 4194304 4300056 140735719133552 18446744073709551615 4255961 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 99341 75615 264 26 0 95973 0
Current children cumulated CPU time (s) 762.33
Current children cumulated vsize (KiB) 397364

[startup+822.3 s]
/proc/loadavg: 4.08 3.78 2.34 5/364 26709
/proc/meminfo: memFree=12684584/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=398004 CPUtime=822.31 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 106417 0 0 0 82205 26 0 0 25 0 1 0 687040989 407556096 77697 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256548 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 99501 77697 264 26 0 96133 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 398004

[startup+882.301 s]
/proc/loadavg: 4.15 3.86 2.46 5/364 26711
/proc/meminfo: memFree=12774324/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=399612 CPUtime=882.32 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 109437 0 0 0 88204 28 0 0 25 0 1 0 687040989 409202688 80675 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256683 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 99903 80675 264 26 0 96535 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 399612

[startup+942.301 s]
/proc/loadavg: 4.05 3.89 2.55 5/364 26712
/proc/meminfo: memFree=12588004/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=401504 CPUtime=942.32 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 113150 0 0 0 94203 29 0 0 25 0 1 0 687040989 411140096 84342 33554432000 4194304 4300056 140735719133552 18446744073709551615 4251385 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 100376 84342 264 26 0 97008 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 401504

[startup+1002.3 s]
/proc/loadavg: 4.02 3.90 2.64 5/364 26714
/proc/meminfo: memFree=12522996/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=406180 CPUtime=1002.32 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 116676 0 0 0 100201 31 0 0 25 0 1 0 687040989 415928320 87823 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256093 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 101545 87823 264 26 0 98177 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 406180

[startup+1062.3 s]
/proc/loadavg: 4.05 3.93 2.73 5/364 26715
/proc/meminfo: memFree=12703232/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=409888 CPUtime=1062.33 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 119469 0 0 0 106201 32 0 0 25 0 1 0 687040989 419725312 90565 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256033 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 102472 90565 264 26 0 99104 0
Current children cumulated CPU time (s) 1062.33
Current children cumulated vsize (KiB) 409888

[startup+1122.3 s]
/proc/loadavg: 4.02 3.94 2.80 5/364 26717
/proc/meminfo: memFree=12609816/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=411940 CPUtime=1122.32 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 121846 0 0 0 112200 32 0 0 25 0 1 0 687040989 421826560 92901 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 102985 92901 264 26 0 99617 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 411940

[startup+1182.3 s]
/proc/loadavg: 4.06 3.97 2.88 5/364 26718
/proc/meminfo: memFree=12491468/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=417592 CPUtime=1182.33 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 124660 0 0 0 118200 33 0 0 25 0 1 0 687040989 427614208 95681 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256570 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 104398 95681 264 26 0 101030 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 417592

[startup+1242.3 s]
/proc/loadavg: 4.02 3.97 2.95 5/364 26720
/proc/meminfo: memFree=12726128/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=417592 CPUtime=1242.33 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 126729 0 0 0 124199 34 0 0 25 0 1 0 687040989 427614208 97703 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256241 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 104398 97703 264 26 0 101030 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 417592



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.01 3.97 3.01 5/364 26722
/proc/meminfo: memFree=12564636/32950928 swapFree=67111200/67111528
[pid=26616] ppid=26614 vsize=552140 CPUtime=1300.05 cores=4,6
/proc/26616/stat : 26616 (lr_gl_shr) R 26614 26616 26572 0 -1 4202496 128884 0 0 0 129969 36 0 0 25 0 1 0 687040989 565391360 99818 33554432000 4194304 4300056 140735719133552 18446744073709551615 4256082 0 0 4096 8388610 0 0 0 17 4 0 0 0
/proc/26616/statm: 138035 99818 264 26 0 134667 0
Current children cumulated CPU time (s) 1300.05
Current children cumulated vsize (KiB) 552140

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.03
CPU time (s): 1300.07
CPU user time (s): 1299.7
CPU system time (s): 0.377942
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 552140

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.7
system time used= 0.377942
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 128884
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 789

runsolver used 4.85226 second user time and 10.5264 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-09 21:08:23
IDJOB=3349699
IDBENCH=20410
IDSOLVER=1814
FILE ID=node115/3349699-1304968102
RUNJOBID= node115-1304968098-26591
PBS_JOBID= 13285635
Free space on /tmp= 50332 MiB

SOLVER NAME= minisat hack: LR_NOGL_NOSHR 2011-03-02
BENCH NAME= SAT07/industrial/palacios/hard/sortnet-8-ipc5-h19-sat.cnf
COMMAND LINE= HOME/lr_gl_shr BENCHNAME -verb=0 -model -no-shrinking -no-glucose
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3349699-1304968102/watcher-3349699-1304968102 -o /tmp/evaluation-result-3349699-1304968102/solver-3349699-1304968102 -C 2400 -W 1300 -M 7680  HOME/lr_gl_shr HOME/instance-3349699-1304968102.cnf -verb=0 -model -no-shrinking -no-glucose

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 409f4401e9e8b60ee665ac5567a13e41
RANDOM SEED=857564786

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13302352 kB
Buffers:        201240 kB
Cached:        8894432 kB
SwapCached:          0 kB
Active:       10714852 kB
Inactive:      8486912 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13302352 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:           45512 kB
Writeback:           0 kB
AnonPages:    10105872 kB
Mapped:          28264 kB
Slab:           340272 kB
PageTables:      41312 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 69758652 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 50344 MiB
End job on node115 at 2011-05-09 21:30:05