Trace number 3264641

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
tts 5-4? (TO) 1300.09 1300.07

General information on the benchmark

NameSAT04/handmade/marijn/equilarge-l/
equilarge_l2.used-as.sat04-894.cnf
MD5SUMb3ddb2ee2bb2b83e1c98b2a9018351fc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark590.41
Satisfiable
(Un)Satisfiability was proved
Number of variables4487
Number of clauses18555
Sum of the clauses size54310
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21355
Number of clauses of size 317200
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.01	c Command: HOME/tts-5-4 HOME/instance-3264641-1303581850.cnf 
0.00/0.01	c Using SATTIMEOUT of 2400
0.00/0.01	c Using SATRAM of 7680
0.00/0.01	c Size of subset node = 32
0.00/0.01	c Variables = 4487
0.00/0.01	c Clauses = 18555
0.00/0.01	c Literals = 54310
0.00/0.01	c Reduced size:
0.00/0.01	c Variables = 4487
0.00/0.01	c Clauses = 18555
0.00/0.01	c Literals = 54310
0.00/0.01	c a2
0.00/0.03	c a1
0.19/0.26	c Independent sub-problems = 1
0.19/0.26	c Sub-problem with 4487 variables and 18555 clauses
0.19/0.26	c using permutation method 4
0.19/0.26	c count = 2
0.19/0.26	c Ordering finished 0.260 seconds
0.19/0.26	c mapped 0.260 seconds
0.19/0.26	c permuted 0.260 seconds
0.19/0.26	c about to sort
0.19/0.27	c sorted
0.29/0.31	c clauses now 18555
0.29/0.31	c init finished 0.270 seconds
0.29/0.31	c tree built 0.300 seconds
0.29/0.31	c 
0.29/0.31	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.29/0.31	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.29/0.31	c ................................ | ..........                    |                                  0.3         0.0             
0.29/0.31	c ................................ | ..........                  1 |                                  0.3         3.3             
0.29/0.31	c ................................ | ..........                  2 |                                  0.3         6.7             
0.29/0.31	c ................................ | ..........                  3 |                                  0.3        10.0             
0.29/0.31	c ................................ | ..........                  4 |                                  0.3        13.3             
0.29/0.31	c ................................ | ..........                  5 |                                  0.3        16.7             
0.29/0.31	c ................................ | ..........               1000 |              52                  0.3      3225.8           22
47.99/48.01	c ................................ | ..........            2088000 | 34384        210027             48.0     43500.0      5524985
95.99/96.05	c ................................ | ..........            3325000 | 54712        319342             96.0     34621.0      8400227
143.99/144.02	c ................................ | ..........            4549000 | 72507        451736            144.0     31588.1     10147724
191.99/192.03	c ................................ | ..........            5516000 | 87524        511947            192.0     28724.7     11885450
240.00/240.00	c ................................ | *.........            6528000 | 104378       591410            240.0     27200.0     14201157
287.99/288.05	c ................................ | *.........            7512000 | 122663       662310            288.0     26079.7     16431303
335.99/336.06	c ................................ | *.........            8355000 | 140373       710725            336.1     24862.4     17963930
384.00/384.03	c ................................ | *.........            9233000 | 155391       766041            384.0     24042.4     19360346
432.00/432.03	c ................................ | *.........           10124000 | 169594       834325            432.0     23434.1     20755377
480.00/480.01	c ................................ | **........           11126000 | 183638       944524            480.0     23178.2     22167248
528.00/528.01	c ................................ | **........           11929000 | 196891       994987            528.0     22592.4     23145209
576.00/576.04	c ................................ | **........           12745000 | 208669       1059069           576.0     22125.2     24356946
624.00/624.03	c ................................ | **........           13666000 | 221697       1160371           624.0     21899.6     25661571
672.00/672.05	c ................................ | **........           14484000 | 234777       1223925           672.0     21552.0     26620658
720.00/720.00	c ................................ | ***.......           15237000 | 246780       1270981           720.0     21162.5     27658389
768.00/768.02	c ................................ | ***.......           16063000 | 262202       1312204           768.0     20914.5     28649562
816.00/816.00	c ................................ | ***.......           16872000 | 276971       1352132           816.0     20676.2     29685191
864.01/864.01	c ................................ | ***.......           17714000 | 292286       1403239           864.0     20501.8     30807939
911.91/912.00	c ................................ | ***.......           18506000 | 306072       1441274           912.0     20291.7     31702965
960.00/960.02	c ................................ | ****......           19184000 | 319071       1482405           960.0     19982.7     33798202
1008.01/1008.05	c ................................ | ****......           19711000 | 330064       1510990          1008.1     19553.4     35171055
1056.12/1056.11	c ................................ | ****......           20189000 | 340301       1539538          1056.1     19116.2     36838659
1104.00/1104.09	c ................................ | ****......           20654000 | 350033       1568926          1104.1     18706.6     37996752
1152.01/1152.05	c ................................ | ****......           21116000 | 358264       1604343          1152.1     18328.9     39269537
1200.01/1200.03	c ................................ | *****.....           21527000 | 365940       1628800          1200.0     17938.4     40515035
1248.11/1248.10	c ................................ | *****.....           21959000 | 374468       1656170          1248.1     17593.8     41884620
1296.01/1296.09	c ................................ | *****.....           22419000 | 382701       1686701          1296.1     17297.3     43378272

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264641-1303581850/watcher-3264641-1303581850 -o /tmp/evaluation-result-3264641-1303581850/solver-3264641-1303581850 -C 2400 -W 1300 -M 7680 HOME/tts-5-4 HOME/instance-3264641-1303581850.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.91 3.74 3/179 32073
/proc/meminfo: memFree=13953124/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=7240 CPUtime=0 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 406 0 0 0 0 0 0 0 21 0 1 0 469783686 7413760 351 33554432000 4194304 4337412 140733923393744 18446744073709551615 251813900997 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 1810 351 131 35 0 251 0

[startup+0.103458 s]
/proc/loadavg: 3.68 3.91 3.74 3/179 32073
/proc/meminfo: memFree=13953124/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=11872 CPUtime=0.1 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 1621 0 0 0 10 0 0 0 21 0 1 0 469783686 12156928 1491 33554432000 4194304 4337412 140733923393744 18446744073709551615 4295284 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 2968 1491 139 35 0 1409 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 11872

[startup+0.200448 s]
/proc/loadavg: 3.68 3.91 3.74 3/179 32073
/proc/meminfo: memFree=13953124/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=11872 CPUtime=0.19 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 1644 0 0 0 19 0 0 0 22 0 1 0 469783686 12156928 1514 33554432000 4194304 4337412 140733923393744 18446744073709551615 4244389 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 2968 1514 139 35 0 1409 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 11872

[startup+0.300324 s]
/proc/loadavg: 3.68 3.91 3.74 3/179 32073
/proc/meminfo: memFree=13953124/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=26264 CPUtime=0.29 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 5244 0 0 0 29 0 0 0 22 0 1 0 469783686 26894336 5077 33554432000 4194304 4337412 140733923393744 18446744073709551615 4277673 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 6566 5077 150 35 0 5007 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26264

[startup+0.70032 s]
/proc/loadavg: 3.68 3.91 3.74 3/179 32073
/proc/meminfo: memFree=13953124/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=34624 CPUtime=0.69 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 7337 0 0 0 69 0 0 0 24 0 1 0 469783686 35454976 7170 33554432000 4194304 4337412 140733923393744 18446744073709551615 4287057 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 8656 7170 156 35 0 7097 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 34624

[startup+1.50012 s]
/proc/loadavg: 3.68 3.91 3.74 5/190 32094
/proc/meminfo: memFree=13844912/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=47800 CPUtime=1.49 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 10136 0 0 0 148 1 0 0 25 0 1 0 469783686 48947200 9969 33554432000 4194304 4337412 140733923393744 18446744073709551615 4283352 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 11950 9969 156 35 0 10391 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 47800

[startup+3.10091 s]
/proc/loadavg: 3.70 3.91 3.74 5/190 32094
/proc/meminfo: memFree=13782292/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=63840 CPUtime=3.09 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 14656 0 0 0 308 1 0 0 25 0 1 0 469783686 65372160 14489 33554432000 4194304 4337412 140733923393744 18446744073709551615 4233676 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 15960 14489 156 35 0 14401 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 63840

[startup+6.30031 s]
/proc/loadavg: 3.70 3.91 3.74 5/190 32094
/proc/meminfo: memFree=13652088/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=82872 CPUtime=6.29 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 19250 0 0 0 627 2 0 0 25 0 1 0 469783686 84860928 19083 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253262 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 20718 19083 156 35 0 19159 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 82872

[startup+12.7002 s]
/proc/loadavg: 3.81 3.93 3.75 5/190 32095
/proc/meminfo: memFree=13211396/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=112872 CPUtime=12.69 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 26699 0 0 0 1265 4 0 0 25 0 1 0 469783686 115580928 26532 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253687 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 28218 26532 156 35 0 26659 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 112872

[startup+25.5011 s]
/proc/loadavg: 3.85 3.93 3.75 5/190 32096
/proc/meminfo: memFree=12396856/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=155648 CPUtime=25.5 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 36973 0 0 0 2544 6 0 0 25 0 1 0 469783686 159383552 36806 33554432000 4194304 4337412 140733923393744 18446744073709551615 251813635181 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 38912 36807 156 35 0 37353 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 155648

[startup+51.1008 s]
/proc/loadavg: 3.90 3.94 3.75 5/190 32097
/proc/meminfo: memFree=11187392/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=221388 CPUtime=51.09 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 53974 0 0 0 5100 9 0 0 25 0 1 0 469783686 226701312 53807 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 55347 53807 156 35 0 53788 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 221388

[startup+102.3 s]
/proc/loadavg: 4.01 3.96 3.77 5/190 32098
/proc/meminfo: memFree=9761392/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=311744 CPUtime=102.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 76408 0 0 0 10218 12 0 0 25 0 1 0 469783686 319225856 76241 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 77936 76241 156 35 0 76377 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 311744

[startup+162.301 s]
/proc/loadavg: 4.04 3.98 3.79 5/190 32099
/proc/meminfo: memFree=8806960/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=384652 CPUtime=162.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 94579 0 0 0 16214 16 0 0 25 0 1 0 469783686 393883648 94412 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253487 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 96163 94412 156 35 0 94604 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 384652

[startup+222.307 s]
/proc/loadavg: 4.01 3.98 3.80 5/190 32101
/proc/meminfo: memFree=7929904/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=468884 CPUtime=222.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 115738 0 0 0 22211 19 0 0 25 0 1 0 469783686 480137216 115571 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 117221 115571 156 35 0 115662 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 468884

[startup+282.301 s]
/proc/loadavg: 4.00 3.98 3.81 5/190 32103
/proc/meminfo: memFree=7264500/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=555980 CPUtime=282.29 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 137669 0 0 0 28205 24 0 0 25 0 1 0 469783686 569323520 137502 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253537 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 138995 137502 156 35 0 137436 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 555980

[startup+342.301 s]
/proc/loadavg: 4.00 3.98 3.82 5/190 32104
/proc/meminfo: memFree=6696448/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=623648 CPUtime=342.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 153821 0 0 0 34202 28 0 0 25 0 1 0 469783686 638615552 153654 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253681 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 155912 153654 156 35 0 154353 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 623648

[startup+402.301 s]
/proc/loadavg: 4.08 4.00 3.83 5/190 32106
/proc/meminfo: memFree=6355444/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=675676 CPUtime=402.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 167431 0 0 0 40199 31 0 0 25 0 1 0 469783686 691892224 167264 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 168919 167264 156 35 0 167360 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 675676

[startup+462.301 s]
/proc/loadavg: 4.03 4.00 3.84 5/190 32107
/proc/meminfo: memFree=5690256/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=734752 CPUtime=462.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 181662 0 0 0 46196 34 0 0 25 0 1 0 469783686 752386048 181495 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253456 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 183688 181495 156 35 0 182129 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 734752

[startup+522.301 s]
/proc/loadavg: 4.01 4.00 3.84 5/190 32109
/proc/meminfo: memFree=4933784/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=784972 CPUtime=522.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 194515 0 0 0 52192 38 0 0 25 0 1 0 469783686 803811328 194348 33554432000 4194304 4337412 140733923393744 18446744073709551615 251813635227 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 196243 194348 156 35 0 194684 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 784972

[startup+582.3 s]
/proc/loadavg: 4.00 4.00 3.85 5/190 32111
/proc/meminfo: memFree=4426188/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=837660 CPUtime=582.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 207757 0 0 0 58188 42 0 0 25 0 1 0 469783686 857763840 207590 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253456 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 209415 207590 156 35 0 207856 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 837660

[startup+642.3 s]
/proc/loadavg: 4.00 4.00 3.85 5/190 32112
/proc/meminfo: memFree=4217448/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=881360 CPUtime=642.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 218520 0 0 0 64185 45 0 0 25 0 1 0 469783686 902512640 218353 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253456 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 220340 218353 156 35 0 218781 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 881360

[startup+702.3 s]
/proc/loadavg: 4.07 4.01 3.87 5/190 32114
/proc/meminfo: memFree=4042596/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=927528 CPUtime=702.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 230392 0 0 0 70181 49 0 0 25 0 1 0 469783686 949788672 230225 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 231882 230225 156 35 0 230323 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 927528

[startup+762.3 s]
/proc/loadavg: 4.10 4.03 3.88 5/190 32115
/proc/meminfo: memFree=3686160/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=966384 CPUtime=762.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 240102 0 0 0 76179 52 0 0 25 0 1 0 469783686 989577216 239935 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 241596 239935 156 35 0 240037 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 966384

[startup+822.3 s]
/proc/loadavg: 4.04 4.03 3.89 5/190 32117
/proc/meminfo: memFree=3370164/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1011628 CPUtime=822.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 251358 0 0 0 82174 56 0 0 25 0 1 0 469783686 1035907072 251191 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253636 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 252907 251191 156 35 0 251348 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 1011628

[startup+882.307 s]
/proc/loadavg: 4.01 4.02 3.89 5/190 32119
/proc/meminfo: memFree=3092440/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1054140 CPUtime=882.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 261603 0 0 0 88171 60 0 0 25 0 1 0 469783686 1079439360 261436 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253636 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 263535 261436 156 35 0 261976 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 1054140

[startup+942.301 s]
/proc/loadavg: 4.00 4.01 3.90 5/190 32120
/proc/meminfo: memFree=2985540/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1099120 CPUtime=942.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 272960 0 0 0 94167 64 0 0 25 0 1 0 469783686 1125498880 272793 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253636 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 274780 272793 156 35 0 273221 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 1099120

[startup+1002.3 s]
/proc/loadavg: 4.00 4.01 3.91 5/190 32122
/proc/meminfo: memFree=2795088/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1179492 CPUtime=1002.3 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 292242 0 0 0 100163 67 0 0 25 0 1 0 469783686 1207799808 292075 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253636 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 294873 292075 156 35 0 293314 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 1179492

[startup+1062.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/190 32123
/proc/meminfo: memFree=2677528/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1239848 CPUtime=1062.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 307353 0 0 0 106160 71 0 0 25 0 1 0 469783686 1269604352 307186 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253537 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 309962 307186 156 35 0 308403 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 1239848

[startup+1122.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/190 32125
/proc/meminfo: memFree=2572536/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1288088 CPUtime=1122.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 319522 0 0 0 112158 73 0 0 25 0 1 0 469783686 1319002112 319355 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253636 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 322022 319355 156 35 0 320463 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 1288088

[startup+1182.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/190 32127
/proc/meminfo: memFree=2140696/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1342320 CPUtime=1182.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 333581 0 0 0 118154 77 0 0 25 0 1 0 469783686 1374535680 333414 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253677 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 335580 333414 156 35 0 334021 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 1342320

[startup+1242.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/190 32128
/proc/meminfo: memFree=1999932/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1393292 CPUtime=1242.31 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 345688 0 0 0 124151 80 0 0 25 0 1 0 469783686 1426731008 345521 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253677 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 348323 345521 156 35 0 346764 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 1393292



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 4.00 3.91 5/191 32131
/proc/meminfo: memFree=2975472/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1447524 CPUtime=1300.01 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 359449 0 0 0 129918 83 0 0 25 0 1 0 469783686 1482264576 359282 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253559 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 361881 359282 156 35 0 360322 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 1447524

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.00 4.00 3.91 5/191 32131
/proc/meminfo: memFree=2975472/32950928 swapFree=67111528/67111528
[pid=32073] ppid=32071 vsize=1447524 CPUtime=1300.01 cores=4,6
/proc/32073/stat : 32073 (tts-5-4) R 32071 32073 31283 0 -1 4202496 359449 0 0 0 129918 83 0 0 25 0 1 0 469783686 1482264576 359282 33554432000 4194304 4337412 140733923393744 18446744073709551615 4253559 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/32073/statm: 361881 359282 156 35 0 360322 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 1447524

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.07
CPU time (s): 1300.09
CPU user time (s): 1299.19
CPU system time (s): 0.898863
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 1447524

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.19
system time used= 0.898863
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 359449
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 655

runsolver used 2.04569 second user time and 5.05223 second system time

The end

Launcher Data 

Begin job on node126 at 2011-04-23 20:04:10
IDJOB=3264641
IDBENCH=84761
IDSOLVER=1653
FILE ID=node126/3264641-1303581850
RUNJOBID= node126-1303581850-32052
PBS_JOBID= 13150328
Free space on /tmp= 71388 MiB

SOLVER NAME= tts 5-4
BENCH NAME= SAT04/handmade/marijn/equilarge-l/equilarge_l2.used-as.sat04-894.cnf
COMMAND LINE= DIR/tts-5-4 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264641-1303581850/watcher-3264641-1303581850 -o /tmp/evaluation-result-3264641-1303581850/solver-3264641-1303581850 -C 2400 -W 1300 -M 7680  HOME/tts-5-4 HOME/instance-3264641-1303581850.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= b3ddb2ee2bb2b83e1c98b2a9018351fc
RANDOM SEED=814488960

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13953164 kB
Buffers:       1984600 kB
Cached:       16369664 kB
SwapCached:          0 kB
Active:        7623508 kB
Inactive:     10800964 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13953164 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             824 kB
Writeback:           0 kB
AnonPages:       70496 kB
Mapped:          14884 kB
Slab:           507496 kB
PageTables:       5148 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   216076 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71388 MiB
End job on node126 at 2011-04-23 20:25:52