Trace number 329740

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.07 1200.41

General information on the benchmark

Nameindustrial/IBM_FV_2002_31_1_rule_1/
SAT_dat.k35.cnf
MD5SUM07d9949e24a0b59bc9a141fd94f50f24
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables51145
Number of clauses228408
Sum of the clauses size587574
Maximum clause length20
Minimum clause length1
Number of clauses of size 1383
Number of clauses of size 2177786
Number of clauses of size 325137
Number of clauses of size 410250
Number of clauses of size 54464
Number of clauses of size over 510388

Solver Data (download as text)

0.00/0.00	c Parsing...
0.19/0.23	c ==============================================================================
0.19/0.23	c |           |     ORIGINAL     |              LEARNT              |          |
0.19/0.23	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.19/0.23	c ==============================================================================
0.19/0.23	c |         0 |  227613   577415 |   68283       0        0     nan |  0.000 % |
1.29/1.37	c |         0 |  109762   369366 |      --       0       --      -- |     --   | -61061/-56145
1.29/1.37	c ==============================================================================
1.29/1.37	c Result  :   #vars: 16309   #clauses: 109762   #literals: 369366
1.29/1.37	c CPU time:   1.2998 s
1.29/1.37	c ==============================================================================
1.48/1.54	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node61/watcher-329740-1173148147 -o ROOT/results/node61/solver-329740-1173148147 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/329740-1173148147/rsat.sh /tmp/evaluation/329740-1173148147/instance-329740-1173148147.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.97 0.98 3/64 3563
/proc/meminfo: memFree=1476824/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=0
/proc/3563/stat : 3563 (rsat.sh) R 3561 3563 3456 0 -1 4194304 264 0 0 0 0 0 0 0 18 0 1 0 334771665 5480448 231 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406507167 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/3563/statm: 1338 231 194 169 0 49 0
[pid=3564] ppid=3563 vsize=688 CPUtime=0
/proc/3564/stat : 3564 (SatElite) R 3563 3563 3456 0 -1 4194304 66 0 0 0 0 0 0 0 18 0 1 0 334771665 704512 48 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/3564/statm: 172 48 39 128 0 41 0

[startup+0.0736521 s]
/proc/loadavg: 0.99 0.97 0.98 3/64 3563
/proc/meminfo: memFree=1476824/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=0
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334771665 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 232 195 169 0 49 0
[pid=3564] ppid=3563 vsize=8404 CPUtime=0.06
/proc/3564/stat : 3564 (SatElite) R 3563 3563 3456 0 -1 4194304 1665 0 0 0 5 1 0 0 19 0 1 0 334771665 8605696 1647 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/3564/statm: 2101 1647 49 128 0 1970 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 13756

[startup+0.101654 s]
/proc/loadavg: 0.99 0.97 0.98 3/64 3563
/proc/meminfo: memFree=1476824/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=0
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334771665 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 232 195 169 0 49 0
[pid=3564] ppid=3563 vsize=10120 CPUtime=0.08
/proc/3564/stat : 3564 (SatElite) R 3563 3563 3456 0 -1 4194304 2275 0 0 0 7 1 0 0 19 0 1 0 334771665 10362880 2257 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/3564/statm: 2530 2257 49 128 0 2399 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 15472

[startup+0.301673 s]
/proc/loadavg: 0.99 0.97 0.98 3/64 3563
/proc/meminfo: memFree=1476824/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=0
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334771665 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 232 195 169 0 49 0
[pid=3564] ppid=3563 vsize=24984 CPUtime=0.28
/proc/3564/stat : 3564 (SatElite) R 3563 3563 3456 0 -1 4194304 5757 0 0 0 25 3 0 0 21 0 1 0 334771665 25583616 5736 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134562506 0 0 4096 3 0 0 0 17 1 0 0
/proc/3564/statm: 6246 5736 64 128 0 6115 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 30336

[startup+0.701712 s]
/proc/loadavg: 0.99 0.97 0.98 3/64 3563
/proc/meminfo: memFree=1476824/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=0
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334771665 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 232 195 169 0 49 0
[pid=3564] ppid=3563 vsize=28880 CPUtime=0.68
/proc/3564/stat : 3564 (SatElite) R 3563 3563 3456 0 -1 4194304 7223 0 0 0 63 5 0 0 25 0 1 0 334771665 29573120 6538 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/3564/statm: 7220 6538 69 128 0 7089 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 34232

[startup+1.50179 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3565
/proc/meminfo: memFree=1449096/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=0
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334771665 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 232 195 169 0 49 0
[pid=3564] ppid=3563 vsize=29260 CPUtime=1.48
/proc/3564/stat : 3564 (SatElite) R 3563 3563 3456 0 -1 4194304 8966 0 0 0 141 7 0 0 25 0 1 0 334771665 29962240 6707 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/3564/statm: 7315 6707 69 128 0 7184 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 34612

[startup+3.10194 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1467656/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=9244 CPUtime=1.54
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 2142 0 0 0 154 0 0 0 25 0 1 0 334771820 9465856 2128 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530158 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 2311 2128 86 211 0 2097 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 14596

[startup+6.30125 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1465864/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=11028 CPUtime=4.75
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 2562 0 0 0 474 1 0 0 25 0 1 0 334771820 11292672 2515 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523156 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 2757 2515 86 211 0 2543 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 16380

[startup+12.7029 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1462792/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=14080 CPUtime=11.14
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 3392 0 0 0 1113 1 0 0 25 0 1 0 334771820 14417920 3247 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 3520 3247 86 211 0 3306 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 19432

[startup+25.5011 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1461000/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=15948 CPUtime=23.93
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 4266 0 0 0 2391 2 0 0 25 0 1 0 334771820 16330752 3732 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 3987 3732 86 211 0 3773 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 21300

[startup+51.1015 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1455688/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=21052 CPUtime=49.52
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 5982 0 0 0 4949 3 0 0 25 0 1 0 334771820 21557248 5060 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 5263 5060 86 211 0 5049 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 26404

[startup+102.305 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1449352/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=27692 CPUtime=100.71
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 8493 0 0 0 10065 6 0 0 25 0 1 0 334771820 28356608 6601 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529262 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 6923 6601 86 211 0 6709 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 33044

[startup+162.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1434120/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=42216 CPUtime=160.69
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 13013 0 0 0 16059 10 0 0 25 0 1 0 334771820 43229184 10341 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530226 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 10554 10341 86 211 0 10340 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 47568

[startup+222.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1434120/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=42216 CPUtime=220.67
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 13026 0 0 0 22057 10 0 0 25 0 1 0 334771820 43229184 10354 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523307 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 10554 10354 86 211 0 10340 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 47568

[startup+282.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1421896/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=55708 CPUtime=280.67
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 16525 0 0 0 28053 14 0 0 25 0 1 0 334771820 57044992 13463 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 13927 13463 86 211 0 13713 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 61060

[startup+342.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1415816/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=61204 CPUtime=340.65
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 19483 0 0 0 34049 16 0 0 25 0 1 0 334771820 62672896 14880 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523174 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 15301 14880 86 211 0 15087 0

################
# More data... #
################

[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=63300 CPUtime=520.6
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 20017 0 0 0 52044 16 0 0 25 0 1 0 334771820 64819200 15315 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 15825 15315 86 211 0 15611 0
Current children cumulated CPU time (s) 522.13
Current children cumulated vsize (KiB) 68652

[startup+582.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1411656/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=65788 CPUtime=580.59
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 20681 0 0 0 58042 17 0 0 25 0 1 0 334771820 67366912 15979 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 16447 15979 86 211 0 16233 0
Current children cumulated CPU time (s) 582.12
Current children cumulated vsize (KiB) 71140

[startup+642.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1401416/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=78864 CPUtime=640.57
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 23968 0 0 0 64038 19 0 0 25 0 1 0 334771820 80756736 18496 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530076 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 19716 18496 86 211 0 19502 0
Current children cumulated CPU time (s) 642.1
Current children cumulated vsize (KiB) 84216

[startup+702.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1398536/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=80392 CPUtime=700.56
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 28183 0 0 0 70034 22 0 0 25 0 1 0 334771820 82321408 19182 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 20098 19182 86 211 0 19884 0
Current children cumulated CPU time (s) 702.09
Current children cumulated vsize (KiB) 85744

[startup+762.305 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3566
/proc/meminfo: memFree=1398536/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=80392 CPUtime=760.55
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 28183 0 0 0 76033 22 0 0 25 0 1 0 334771820 82321408 19182 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522879 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 20098 19182 86 211 0 19884 0
Current children cumulated CPU time (s) 762.08
Current children cumulated vsize (KiB) 85744

[startup+822.301 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1398536/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=80392 CPUtime=820.53
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 28183 0 0 0 82031 22 0 0 25 0 1 0 334771820 82321408 19182 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 20098 19182 86 211 0 19884 0
Current children cumulated CPU time (s) 822.06
Current children cumulated vsize (KiB) 85744

[startup+882.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1398600/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=80392 CPUtime=880.51
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 28183 0 0 0 88029 22 0 0 25 0 1 0 334771820 82321408 19182 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 20098 19182 86 211 0 19884 0
Current children cumulated CPU time (s) 882.04
Current children cumulated vsize (KiB) 85744

[startup+942.302 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1398536/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=80524 CPUtime=940.5
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 28202 0 0 0 94028 22 0 0 25 0 1 0 334771820 82456576 19201 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134526440 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 20131 19201 86 211 0 19917 0
Current children cumulated CPU time (s) 942.03
Current children cumulated vsize (KiB) 85876

[startup+1002.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1390088/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=89440 CPUtime=1000.48
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 30352 0 0 0 100023 25 0 0 25 0 1 0 334771820 91586560 21351 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 22360 21351 86 211 0 22146 0
Current children cumulated CPU time (s) 1002.01
Current children cumulated vsize (KiB) 94792

[startup+1062.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1380680/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=98840 CPUtime=1060.47
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 32730 0 0 0 106019 28 0 0 25 0 1 0 334771820 101212160 23726 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 24710 23726 86 211 0 24496 0
Current children cumulated CPU time (s) 1062
Current children cumulated vsize (KiB) 104192

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1371528/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=107804 CPUtime=1120.46
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 35025 0 0 0 112015 31 0 0 25 0 1 0 334771820 110391296 25985 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 26951 25985 86 211 0 26737 0
Current children cumulated CPU time (s) 1121.99
Current children cumulated vsize (KiB) 113156

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1361864/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=117432 CPUtime=1180.44
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 37479 0 0 0 118012 32 0 0 25 0 1 0 334771820 120250368 28404 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 29358 28404 86 211 0 29144 0
Current children cumulated CPU time (s) 1181.97
Current children cumulated vsize (KiB) 122784



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.4 s]
/proc/loadavg: 0.99 0.97 0.98 2/66 3568
/proc/meminfo: memFree=1359304/2055920 swapFree=4183424/4192956
[pid=3563] ppid=3561 vsize=5352 CPUtime=1.53
/proc/3563/stat : 3563 (rsat.sh) S 3561 3563 3456 0 -1 4194304 305 8967 0 0 0 0 145 8 16 0 1 0 334771665 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 246406505284 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/3563/statm: 1338 234 195 169 0 49 0
[pid=3566] ppid=3563 vsize=119760 CPUtime=1198.54
/proc/3566/stat : 3566 (rsat) R 3563 3563 3456 0 -1 4194304 38083 0 0 0 119821 33 0 0 25 0 1 0 334771820 122634240 29007 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3566/statm: 29940 29007 86 211 0 29726 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 125112

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 3563 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=456778 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=87986
CPU time returned by wait4() is 1.54476
while last known CPU time is 1200.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.41
CPU time (s): 1200.07
CPU user time (s): 1199.66
CPU system time (s): 0.41
CPU usage (%): 99.9714
Max. virtual memory (cumulated for all children) (KiB): 125112

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.45678
system time used= 0.087986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9272
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 4

runsolver used 1.03084 second user time and 2.51262 second system time

The end

Launcher Data (download as text)

Begin job on node61 on Tue Mar  6 02:29:07 UTC 2007

IDJOB= 329740
IDBENCH= 20547
IDSOLVER= 104
FILE ID= node61/329740-1173148147

PBS_JOBID= 4015215

Free space on /tmp= 66507 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/IBM_FV_2002_31_1_rule_1/SAT_dat.k35.cnf
COMMAND LINE= /tmp/evaluation/329740-1173148147/rsat.sh /tmp/evaluation/329740-1173148147/instance-329740-1173148147.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node61/watcher-329740-1173148147 -o ROOT/results/node61/solver-329740-1173148147 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/329740-1173148147/rsat.sh /tmp/evaluation/329740-1173148147/instance-329740-1173148147.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  07d9949e24a0b59bc9a141fd94f50f24

RANDOM SEED= 614641626

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node61.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1477232 kB
Buffers:         31584 kB
Cached:         470568 kB
SwapCached:       3496 kB
Active:          90780 kB
Inactive:       420764 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1477232 kB
SwapTotal:     4192956 kB
SwapFree:      4183424 kB
Dirty:            6796 kB
Writeback:           0 kB
Mapped:          15504 kB
Slab:            53336 kB
Committed_AS:   871080 kB
PageTables:       1388 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66506 MiB

End job on node61 on Tue Mar  6 02:49:10 UTC 2007