Trace number 315100

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.04 1200.51

General information on the benchmark

Nameindustrial/palacios/hard/
safe-50-h49-unsat.cnf
MD5SUMafc9746f162b3434bc79ea21bd1704d5
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables615037
Number of clauses2098249
Sum of the clauses size5069473
Maximum clause length101
Minimum clause length1
Number of clauses of size 150
Number of clauses of size 21488062
Number of clauses of size 3602029
Number of clauses of size 4238
Number of clauses of size 5148
Number of clauses of size over 57722

Solver Data (download as text)

0.00/0.00	c Parsing...
2.20/2.28	c ==============================================================================
2.20/2.28	c |           |     ORIGINAL     |              LEARNT              |          |
2.20/2.28	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
2.20/2.28	c ==============================================================================
2.20/2.28	c |         0 | 2098099  5069173 |  629429       0        0     nan |  0.000 % |
382.08/382.25	c |         0 |  769676  6992680 |      --       0       --      -- |     --   | -1328423/1923507
382.08/382.26	c ==============================================================================
382.08/382.26	c Result  :   #vars: 20526   #clauses: 769676   #literals: 6992680
382.08/382.26	c CPU time:   380.043 s
382.08/382.26	c ==============================================================================
385.08/385.23	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node5/watcher-315100-1172648899 -o ROOT/results/node5/solver-315100-1172648899 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/315100-1172648899/rsat.sh /tmp/evaluation/315100-1172648899/instance-315100-1172648899.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 29784
/proc/meminfo: memFree=886240/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=1172 CPUtime=0
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 178 0 0 0 0 0 0 0 20 0 1 0 284844755 1200128 160 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134548412 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 293 162 49 128 0 162 0

[startup+0.0617119 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 29784
/proc/meminfo: memFree=886240/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=6540 CPUtime=0.05
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 1493 0 0 0 5 0 0 0 20 0 1 0 284844755 6696960 1475 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 1635 1476 50 128 0 1504 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 11896

[startup+0.101715 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 29784
/proc/meminfo: memFree=886240/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=10916 CPUtime=0.09
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 2506 0 0 0 8 1 0 0 20 0 1 0 284844755 11177984 2488 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 2729 2489 50 128 0 2598 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 16272

[startup+0.301738 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 29784
/proc/meminfo: memFree=886240/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=37156 CPUtime=0.29
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 8162 0 0 0 25 4 0 0 21 0 1 0 284844755 38047744 8144 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 9289 8144 50 128 0 9158 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 42512

[startup+0.701782 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 29784
/proc/meminfo: memFree=886240/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=81856 CPUtime=0.69
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 19043 0 0 0 57 12 0 0 25 0 1 0 284844755 83820544 19025 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 20464 19026 50 128 0 20333 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 87212

[startup+1.50187 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=778576/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=171384 CPUtime=1.49
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 41034 0 0 0 124 25 0 0 25 0 1 0 284844755 175497216 41016 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 42846 41016 50 128 0 42715 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 176740

[startup+3.10106 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=648592/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=318872 CPUtime=3.09
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 66811 0 0 0 270 39 0 0 25 0 1 0 284844755 326524928 65246 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 79718 65246 69 128 0 79587 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 324228

[startup+6.30242 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=610960/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=325324 CPUtime=6.29
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 68426 0 0 0 583 46 0 0 25 0 1 0 284844755 333131776 66861 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134550882 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 81331 66861 69 128 0 81200 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 330680

[startup+12.7011 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=580816/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=336152 CPUtime=12.68
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 71149 0 0 0 1207 61 0 0 25 0 1 0 284844755 344219648 69584 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134685036 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 84038 69584 69 128 0 83907 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 341508

[startup+25.5016 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=534608/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=352384 CPUtime=25.48
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 75157 0 0 0 2457 91 0 0 25 0 1 0 284844755 360841216 73592 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134543856 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 88096 73592 69 128 0 87965 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 357740

[startup+51.1015 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=465360/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=381020 CPUtime=51.07
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 81709 0 0 0 4967 140 0 0 25 0 1 0 284844755 390164480 80144 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134543862 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 95255 80144 69 128 0 95124 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 386376

[startup+102.305 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=386320/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=422916 CPUtime=102.27
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 90607 0 0 0 10027 200 0 0 25 0 1 0 284844755 433065984 87839 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134543878 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 105729 87839 69 128 0 105598 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 428272

[startup+162.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=383184/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=426464 CPUtime=162.24
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 91427 0 0 0 16023 201 0 0 25 0 1 0 284844755 436699136 88659 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134567770 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 106616 88659 69 128 0 106485 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 431820

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=379152/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=430664 CPUtime=222.22
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 92420 0 0 0 22020 202 0 0 25 0 1 0 284844755 440999936 89652 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134574805 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 107666 89652 69 128 0 107535 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 436020

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=374800/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=435880 CPUtime=282.2
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 93536 0 0 0 28017 203 0 0 25 0 1 0 284844755 446341120 90768 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134543878 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 108970 90768 69 128 0 108839 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 441236

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29786
/proc/meminfo: memFree=368784/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=0
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 285 0 0 0 0 0 0 0 18 0 1 0 284844755 5484544 234 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/29784/statm: 1339 234 195 169 0 50 0
[pid=29785] ppid=29784 vsize=442224 CPUtime=342.19
/proc/29785/stat : 29785 (SatElite) R 29784 29784 28312 0 -1 4194304 95031 0 0 0 34014 205 0 0 25 0 1 0 284844755 452837376 92263 18446744073709551615 134512640 135038345 4294956672 18446744073709551615 134543878 0 0 4096 3 0 0 0 17 1 0 0
/proc/29785/statm: 110556 92263 69 128 0 110425 0

################
# More data... #
################

[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=137748 CPUtime=197
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 38138 0 0 0 19677 23 0 0 25 0 1 0 284883278 141053952 33469 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522762 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 34437 33469 86 211 0 34223 0
Current children cumulated CPU time (s) 582.11
Current children cumulated vsize (KiB) 143104

[startup+642.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29787
/proc/meminfo: memFree=563344/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=137748 CPUtime=256.99
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 38138 0 0 0 25675 24 0 0 25 0 1 0 284883278 141053952 33469 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 34437 33469 86 211 0 34223 0
Current children cumulated CPU time (s) 642.1
Current children cumulated vsize (KiB) 143104

[startup+702.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29787
/proc/meminfo: memFree=563344/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=137748 CPUtime=316.97
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 38139 0 0 0 31672 25 0 0 25 0 1 0 284883278 141053952 33470 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522898 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 34437 33470 86 211 0 34223 0
Current children cumulated CPU time (s) 702.08
Current children cumulated vsize (KiB) 143104

[startup+762.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/85 29813
/proc/meminfo: memFree=561760/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=137748 CPUtime=376.95
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 38257 0 0 0 37669 26 0 0 25 0 1 0 284883278 141053952 33588 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 34437 33588 86 211 0 34223 0
Current children cumulated CPU time (s) 762.06
Current children cumulated vsize (KiB) 143104

[startup+822.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/85 29911
/proc/meminfo: memFree=558944/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=140012 CPUtime=436.87
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 39001 0 0 0 43660 27 0 0 25 0 1 0 284883278 143372288 34331 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134530136 0 0 4096 1026 0 0 0 17 0 0 0
/proc/29787/statm: 35003 34331 86 211 0 34789 0
Current children cumulated CPU time (s) 821.98
Current children cumulated vsize (KiB) 145368

[startup+882.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=554832/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=144688 CPUtime=496.81
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 43302 0 0 0 49651 30 0 0 25 0 1 0 284883278 148160512 35555 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529233 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 36172 35555 86 211 0 35958 0
Current children cumulated CPU time (s) 881.92
Current children cumulated vsize (KiB) 150044

[startup+942.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=554832/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=144688 CPUtime=556.8
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 43302 0 0 0 55649 31 0 0 25 0 1 0 284883278 148160512 35555 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 36172 35555 86 211 0 35958 0
Current children cumulated CPU time (s) 941.91
Current children cumulated vsize (KiB) 150044

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=554896/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=144688 CPUtime=616.78
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 43303 0 0 0 61647 31 0 0 25 0 1 0 284883278 148160512 35556 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 36172 35556 86 211 0 35958 0
Current children cumulated CPU time (s) 1001.89
Current children cumulated vsize (KiB) 150044

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=554960/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=144688 CPUtime=676.76
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 43303 0 0 0 67644 32 0 0 25 0 1 0 284883278 148160512 35556 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134523251 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 36172 35556 86 211 0 35958 0
Current children cumulated CPU time (s) 1061.87
Current children cumulated vsize (KiB) 150044

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=554960/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=144688 CPUtime=736.74
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 43315 0 0 0 73642 32 0 0 25 0 1 0 284883278 148160512 35568 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 36172 35568 86 211 0 35958 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 150044

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=541136/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=158340 CPUtime=796.73
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 46850 0 0 0 79637 36 0 0 25 0 1 0 284883278 162140160 39099 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 39585 39099 86 211 0 39371 0
Current children cumulated CPU time (s) 1181.84
Current children cumulated vsize (KiB) 163696



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=535312/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=163616 CPUtime=814.93
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 48234 0 0 0 81455 38 0 0 25 0 1 0 284883278 167542784 40471 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 40904 40471 86 211 0 40690 0
Current children cumulated CPU time (s) 1200.04
Current children cumulated vsize (KiB) 168972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 29985
/proc/meminfo: memFree=535312/2055920 swapFree=4192812/4192956
[pid=29784] ppid=29782 vsize=5356 CPUtime=385.11
/proc/29784/stat : 29784 (rsat.sh) S 29782 29784 28312 0 -1 4194304 307 103039 0 0 0 0 38277 234 16 0 1 0 284844755 5484544 235 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/29784/statm: 1339 235 195 169 0 50 0
[pid=29787] ppid=29784 vsize=163616 CPUtime=814.93
/proc/29787/stat : 29787 (rsat) R 29784 29784 28312 0 -1 4194304 48234 0 0 0 81455 38 0 0 25 0 1 0 284883278 167542784 40471 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 1 0 0
/proc/29787/statm: 40904 40471 86 211 0 40690 0
Current children cumulated CPU time (s) 1200.04
Current children cumulated vsize (KiB) 168972

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 29784 and gives childrusage.ru_utime.tv_sec=382 childrusage.ru_utime.tv_usec=771809 childrusage.ru_stime.tv_sec=2 childrusage.ru_stime.tv_usec=344643
CPU time returned by wait4() is 385.116
while last known CPU time is 1200.04

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.51
CPU time (s): 1200.04
CPU user time (s): 1197.32
CPU system time (s): 2.72
CPU usage (%): 99.9606
Max. virtual memory (cumulated for all children) (KiB): 471540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 382.772
system time used= 2.34464
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 103346
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 8054

runsolver used 1.21981 second user time and 3.15652 second system time

The end

Launcher Data (download as text)

Begin job on node5 on Wed Feb 28 07:48:19 UTC 2007

IDJOB= 315100
IDBENCH= 20408
IDSOLVER= 104
FILE ID= node5/315100-1172648899

PBS_JOBID= 3980931

Free space on /tmp= 66495 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/palacias/hard/safe-50-h49-unsat.cnf
COMMAND LINE= /tmp/evaluation/315100-1172648899/rsat.sh /tmp/evaluation/315100-1172648899/instance-315100-1172648899.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node5/watcher-315100-1172648899 -o ROOT/results/node5/solver-315100-1172648899 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/315100-1172648899/rsat.sh /tmp/evaluation/315100-1172648899/instance-315100-1172648899.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  afc9746f162b3434bc79ea21bd1704d5

RANDOM SEED= 883210907

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node5.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.224
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.224
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        886712 kB
Buffers:         55212 kB
Cached:         993620 kB
SwapCached:          0 kB
Active:         465296 kB
Inactive:       627624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        886712 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:           40804 kB
Writeback:           0 kB
Mapped:          62980 kB
Slab:            61916 kB
Committed_AS:   963516 kB
PageTables:       1692 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66315 MiB

End job on node5 on Wed Feb 28 08:08:22 UTC 2007