Trace number 329021

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
TiniSatELite 2007-02-08? (TO) 1200.06 1201.01

General information on the benchmark

Nameindustrial/IBM_FV_2002_13_rule_1/
SAT_dat.k35.cnf
MD5SUM2c011180bbb09d53b6c397094ce9d269
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables35002
Number of clauses141775
Sum of the clauses size389197
Maximum clause length37
Minimum clause length1
Number of clauses of size 1473
Number of clauses of size 264991
Number of clauses of size 370830
Number of clauses of size 4226
Number of clauses of size 5425
Number of clauses of size over 54830

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.14	c ==============================================================================
0.00/0.14	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.14	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.14	c ==============================================================================
0.00/0.14	c |         0 |  141302   388724 |   42390       0        0     nan |  0.000 % |
0.00/0.78	c |         0 |  113315   413097 |      --       0       --      -- |     --   | -26085/30062
0.00/0.78	c ==============================================================================
0.00/0.78	c Result  :   #vars: 15407   #clauses: 113315   #literals: 413097
0.00/0.78	c CPU time:   0.757884 s
0.00/0.78	c ==============================================================================
1.07/1.14	c Tinisat 0.22
1.07/1.14	c solving /tmp/GTI_node6.alineos.net_12632.cnf
1.07/1.14	c 15407 variables, 113315 clauses

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node6/watcher-329021-1173129993 -o ROOT/results/node6/solver-329021-1173129993 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/329021-1173129993/TiniSatELite /tmp/evaluation/329021-1173129993/instance-329021-1173129993.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.97 0.99 3/77 12632
/proc/meminfo: memFree=1188672/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 274 0 0 0 0 0 0 0 18 0 1 0 332954037 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268583010386 0 0 4100 65536 18446744071563648864 0 0 17 1 0 0
/proc/12632/statm: 1338 232 195 169 0 49 0
[pid=12633] ppid=12632 vsize=5352 CPUtime=0
/proc/12633/stat : 12633 (TiniSatELite) S 12632 12632 11508 0 -1 4194368 52 25 0 0 0 0 0 0 20 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4096 65538 18446744071563356171 0 0 17 1 0 0
/proc/12633/statm: 1338 236 198 169 0 49 0
[pid=12635] ppid=12633 vsize=0 CPUtime=0
/proc/12635/stat : 12635 (sed) D 12633 12632 11508 0 -1 4194308 163 0 0 0 0 0 0 0 21 0 1 0 332954038 0 0 18446744073709551615 0 0 0 0 0 0 2147483391 4096 0 18446744072099781622 0 0 17 1 0 0
/proc/12635/statm: 
[startup+0.0267899 s]
/proc/loadavg: 0.91 0.97 0.99 3/77 12632
/proc/meminfo: memFree=1188672/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 307 252 0 0 0 0 0 0 18 0 1 0 332954037 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/12632/statm: 1338 234 197 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+0.101802 s]
/proc/loadavg: 0.91 0.97 0.99 3/77 12632
/proc/meminfo: memFree=1188672/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 307 252 0 0 0 0 0 0 18 0 1 0 332954037 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/12632/statm: 1338 234 197 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+0.301843 s]
/proc/loadavg: 0.91 0.97 0.99 3/77 12632
/proc/meminfo: memFree=1188672/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 307 252 0 0 0 0 0 0 18 0 1 0 332954037 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/12632/statm: 1338 234 197 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+0.701921 s]
/proc/loadavg: 0.91 0.97 0.99 3/77 12632
/proc/meminfo: memFree=1188672/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 307 252 0 0 0 0 0 0 18 0 1 0 332954037 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/12632/statm: 1338 234 197 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+1.50109 s]
/proc/loadavg: 0.91 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1183088/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=11048 CPUtime=0.53
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 2454 0 0 0 52 1 0 0 22 0 1 0 332954133 11313152 2125 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519905 0 0 4096 0 0 0 0 17 1 0 0
/proc/12638/statm: 2762 2125 52 110 0 2649 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 16400

[startup+3.10139 s]
/proc/loadavg: 0.91 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1174640/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=11048 CPUtime=2.12
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 2799 0 0 0 211 1 0 0 25 0 1 0 332954133 11313152 2470 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519912 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 2762 2470 52 110 0 2649 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 16400

[startup+6.30303 s]
/proc/loadavg: 0.92 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1172912/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=19276 CPUtime=5.32
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 3211 0 0 0 531 1 0 0 25 0 1 0 332954133 19738624 2882 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519574 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 4819 2882 52 110 0 4706 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 24628

[startup+12.7013 s]
/proc/loadavg: 0.93 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1169264/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=19276 CPUtime=11.71
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 4069 0 0 0 1170 1 0 0 25 0 1 0 332954133 19738624 3740 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519841 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 4819 3740 52 110 0 4706 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 24628

[startup+25.5018 s]
/proc/loadavg: 0.94 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1161968/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=35728 CPUtime=24.51
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 5900 0 0 0 2448 3 0 0 25 0 1 0 332954133 36585472 5571 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 8932 5571 52 110 0 8819 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 41080

[startup+51.1019 s]
/proc/loadavg: 0.96 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1152240/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=36244 CPUtime=50.08
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 8317 0 0 0 5003 5 0 0 25 0 1 0 332954133 37113856 7988 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 9061 7988 52 110 0 8948 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 41596

[startup+102.307 s]
/proc/loadavg: 0.98 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1126704/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=69148 CPUtime=101.25
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 14643 0 0 0 10112 13 0 0 25 0 1 0 332954133 70807552 14314 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519912 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 17287 14314 52 110 0 17174 0
Current children cumulated CPU time (s) 102.19
Current children cumulated vsize (KiB) 74500

[startup+162.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1106352/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=136408 CPUtime=161.19
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 19751 0 0 0 16101 18 0 0 25 0 1 0 332954133 139681792 19422 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 34102 19422 52 110 0 33989 0
Current children cumulated CPU time (s) 162.13
Current children cumulated vsize (KiB) 141760

[startup+222.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1088112/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=137324 CPUtime=221.14
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 24416 0 0 0 22091 23 0 0 25 0 1 0 332954133 140619776 23958 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519964 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 34331 23958 52 110 0 34218 0
Current children cumulated CPU time (s) 222.08
Current children cumulated vsize (KiB) 142676

[startup+282.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1071536/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=138128 CPUtime=281.11
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 28606 0 0 0 28084 27 0 0 25 0 1 0 332954133 141443072 28148 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 34532 28148 52 110 0 34419 0
Current children cumulated CPU time (s) 282.05
Current children cumulated vsize (KiB) 143480

[startup+342.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1051760/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=138404 CPUtime=341.06
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 33498 0 0 0 34074 32 0 0 25 0 1 0 332954133 141725696 33040 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134517119 0 0 4096 0 0 0 0 17 1 0 0
/proc/12638/statm: 34601 33040 52 110 0 34488 0
Current children cumulated CPU time (s) 342
Current children cumulated vsize (KiB) 143756

[startup+402.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=1031792/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=270008 CPUtime=401.01

################
# More data... #
################

[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=270668 CPUtime=520.92
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 46063 0 0 0 52050 42 0 0 25 0 1 0 332954133 277164032 45605 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134517432 0 0 4096 0 0 0 0 17 1 0 0
/proc/12638/statm: 67667 45605 52 110 0 67554 0
Current children cumulated CPU time (s) 521.86
Current children cumulated vsize (KiB) 276020

[startup+582.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=986096/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=271076 CPUtime=580.88
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 49860 0 0 0 58042 46 0 0 25 0 1 0 332954133 277581824 49402 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 67769 49402 52 110 0 67656 0
Current children cumulated CPU time (s) 581.82
Current children cumulated vsize (KiB) 276428

[startup+642.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=974320/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=272148 CPUtime=640.83
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 52799 0 0 0 64034 49 0 0 25 0 1 0 332954133 278679552 52341 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 68037 52341 52 110 0 67924 0
Current children cumulated CPU time (s) 641.77
Current children cumulated vsize (KiB) 277500

[startup+702.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=961584/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=273716 CPUtime=700.79
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 56236 0 0 0 70027 52 0 0 25 0 1 0 332954133 280285184 55521 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519921 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 68429 55521 52 110 0 68316 0
Current children cumulated CPU time (s) 701.73
Current children cumulated vsize (KiB) 279068

[startup+762.307 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=949424/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=274280 CPUtime=760.76
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 59265 0 0 0 76021 55 0 0 25 0 1 0 332954133 280862720 58550 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519836 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 68570 58550 52 110 0 68457 0
Current children cumulated CPU time (s) 761.7
Current children cumulated vsize (KiB) 279632

[startup+822.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=937776/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=274876 CPUtime=820.71
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 62233 0 0 0 82012 59 0 0 25 0 1 0 332954133 281473024 61518 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134515445 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 68719 61518 52 110 0 68606 0
Current children cumulated CPU time (s) 821.65
Current children cumulated vsize (KiB) 280228

[startup+882.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=926640/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=275016 CPUtime=880.67
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 64962 0 0 0 88005 62 0 0 25 0 1 0 332954133 281616384 64247 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 68754 64247 52 110 0 68641 0
Current children cumulated CPU time (s) 881.61
Current children cumulated vsize (KiB) 280368

[startup+942.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12638
/proc/meminfo: memFree=916848/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=275148 CPUtime=940.63
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 67432 0 0 0 93998 65 0 0 25 0 1 0 332954133 281751552 66717 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 68787 66717 52 110 0 68674 0
Current children cumulated CPU time (s) 941.57
Current children cumulated vsize (KiB) 280500

[startup+1002.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12640
/proc/meminfo: memFree=908144/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=539048 CPUtime=1000.57
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 69565 0 0 0 99991 66 0 0 25 0 1 0 332954133 551985152 68850 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519905 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 134762 68850 52 110 0 134649 0
Current children cumulated CPU time (s) 1001.51
Current children cumulated vsize (KiB) 544400

[startup+1062.3 s]
/proc/loadavg: 0.99 0.97 0.99 3/79 12640
/proc/meminfo: memFree=899952/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=539860 CPUtime=1060.53
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 71656 0 0 0 105984 69 0 0 25 0 1 0 332954133 552816640 70941 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134520134 0 0 4096 0 0 0 0 17 1 0 0
/proc/12638/statm: 134965 70941 52 110 0 134852 0
Current children cumulated CPU time (s) 1061.47
Current children cumulated vsize (KiB) 545212

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12640
/proc/meminfo: memFree=888368/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=540556 CPUtime=1120.48
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 74544 0 0 0 111976 72 0 0 25 0 1 0 332954133 553529344 73829 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519905 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 135139 73829 52 110 0 135026 0
Current children cumulated CPU time (s) 1121.42
Current children cumulated vsize (KiB) 545908

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12640
/proc/meminfo: memFree=879984/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=541384 CPUtime=1180.44
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 76632 0 0 0 117970 74 0 0 25 0 1 0 332954133 554377216 75917 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 135346 75917 52 110 0 135233 0
Current children cumulated CPU time (s) 1181.38
Current children cumulated vsize (KiB) 546736



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201 s]
/proc/loadavg: 0.99 0.97 0.99 2/79 12640
/proc/meminfo: memFree=876400/2055924 swapFree=4156956/4192956
[pid=12632] ppid=12630 vsize=5352 CPUtime=0.94
/proc/12632/stat : 12632 (TiniSatELite) S 12630 12632 11508 0 -1 4194304 331 6430 0 0 0 0 91 3 16 0 1 0 332954037 5480448 236 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12632/statm: 1338 236 197 169 0 49 0
[pid=12638] ppid=12632 vsize=541384 CPUtime=1199.12
/proc/12638/stat : 12638 (tinisat) R 12632 12632 11508 0 -1 4194304 77491 0 0 0 119838 74 0 0 25 0 1 0 332954133 554377216 76776 18446744073709551615 134512640 134966189 4294956736 18446744073709551615 134519843 0 0 4096 0 0 0 0 17 0 0 0
/proc/12638/statm: 135346 76776 52 110 0 135233 0
Current children cumulated CPU time (s) 1200.06
Current children cumulated vsize (KiB) 546736

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 12632 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=920860 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=38994
CPU time returned by wait4() is 0.959854
while last known CPU time is 1200.06

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1201.01
CPU time (s): 1200.06
CPU user time (s): 1199.29
CPU system time (s): 0.77
CPU usage (%): 99.9206
Max. virtual memory (cumulated for all children) (KiB): 546736

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.92086
system time used= 0.038994
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 35
involuntary context switches= 16

runsolver used 1.18682 second user time and 3.19151 second system time

The end

Launcher Data (download as text)

Begin job on node6 on Mon Mar  5 21:26:33 UTC 2007

IDJOB= 329021
IDBENCH= 20530
IDSOLVER= 99
FILE ID= node6/329021-1173129993

PBS_JOBID= 4014956

Free space on /tmp= 66430 MiB

SOLVER NAME= TiniSatELite 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/IBM_FV_2002_13_rule_1/SAT_dat.k35.cnf
COMMAND LINE= /tmp/evaluation/329021-1173129993/TiniSatELite /tmp/evaluation/329021-1173129993/instance-329021-1173129993.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node6/watcher-329021-1173129993 -o ROOT/results/node6/solver-329021-1173129993 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/329021-1173129993/TiniSatELite /tmp/evaluation/329021-1173129993/instance-329021-1173129993.cnf            

META MD5SUM SOLVER= 388ad77fe8f3a9a6ad5bf764ada795dd
MD5SUM BENCH=  2c011180bbb09d53b6c397094ce9d269

RANDOM SEED= 454819495

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node6.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.277
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.277
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1189144 kB
Buffers:         43168 kB
Cached:         730668 kB
SwapCached:       2520 kB
Active:         198576 kB
Inactive:       598812 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1189144 kB
SwapTotal:     4192956 kB
SwapFree:      4156956 kB
Dirty:            4516 kB
Writeback:           0 kB
Mapped:          31228 kB
Slab:            55056 kB
Committed_AS:  1230532 kB
PageTables:       1748 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66425 MiB

End job on node6 on Mon Mar  5 21:46:36 UTC 2007