Trace number 293313

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.07 1212.79

General information on the benchmark

Namerandom/OnTreshold/5SAT/v120/
unif-k5-r21.3-v120-c2556-S142115187-18.UNSAT.shuffled.cnf
MD5SUM8cabd92b6dab5971b671630141b8d8fe
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables120
Number of clauses2556
Sum of the clauses size12780
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52556
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |    2556    12780 |     766       0        0     nan |  0.000 % |
0.00/0.00	c ==============================================================================
0.00/0.00	c Result  :   #vars: 120   #clauses: 2556   #literals: 12780
0.00/0.00	c CPU time:   0.002999 s
0.00/0.00	c ==============================================================================
0.00/0.01	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node76/watcher-293313-1171768485 -o ROOT/results/node76/solver-293313-1171768485 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/293313-1171768485/rsat.sh /tmp/evaluation/293313-1171768485/instance-293313-1171768485.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 0.98 3/69 3978
/proc/meminfo: memFree=1194552/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 283 0 0 0 0 0 0 0 19 0 1 0 196806828 5492736 232 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 232 193 169 0 51 0
[pid=3979] ppid=3978 vsize=820 CPUtime=0
/proc/3979/stat : 3979 (SatElite) R 3978 3978 2124 0 -1 4194304 109 0 0 0 0 0 0 0 20 0 1 0 196806828 839680 91 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/3979/statm: 205 92 49 128 0 74 0

[startup+0.106851 s]
/proc/loadavg: 1.00 1.00 0.98 3/69 3978
/proc/meminfo: memFree=1194552/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5364

[startup+0.514898 s]
/proc/loadavg: 1.00 1.00 0.98 3/69 3978
/proc/meminfo: memFree=1194552/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5364

[startup+1.33599 s]
/proc/loadavg: 1.00 1.00 0.98 2/71 3981
/proc/meminfo: memFree=1191912/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=3580 CPUtime=1.31
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 914 0 0 0 131 0 0 0 25 0 1 0 196806829 3665920 739 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 895 739 86 211 0 681 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 8944

[startup+2.97818 s]
/proc/loadavg: 1.00 1.00 0.98 2/71 3981
/proc/meminfo: memFree=1190760/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=4872 CPUtime=2.95
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 1417 0 0 0 295 0 0 0 25 0 1 0 196806829 4988928 1013 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522826 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 1218 1013 86 211 0 1004 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 10236

[startup+6.25656 s]
/proc/loadavg: 1.00 1.00 0.98 2/71 3981
/proc/meminfo: memFree=1188328/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=6844 CPUtime=6.23
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 2343 0 0 0 622 1 0 0 25 0 1 0 196806829 7008256 1453 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 1711 1453 86 211 0 1497 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 12208

[startup+12.7153 s]
/proc/loadavg: 1.00 1.00 0.98 2/71 3981
/proc/meminfo: memFree=1186280/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=9104 CPUtime=12.69
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 2932 0 0 0 1267 2 0 0 25 0 1 0 196806829 9322496 2042 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 2276 2042 86 211 0 2062 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 14468

[startup+25.5208 s]
/proc/loadavg: 1.00 1.00 0.98 2/71 3981
/proc/meminfo: memFree=1184360/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=10800 CPUtime=25.48
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 3809 0 0 0 2546 2 0 0 25 0 1 0 196806829 11059200 2531 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 2700 2531 86 211 0 2486 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 16164

[startup+51.1407 s]
/proc/loadavg: 1.00 1.00 0.98 2/71 3981
/proc/meminfo: memFree=1181864/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=13512 CPUtime=51.1
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 5298 0 0 0 5107 3 0 0 25 0 1 0 196806829 13836288 3054 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 3378 3054 86 211 0 3164 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 18876

[startup+102.381 s]
/proc/loadavg: 1.06 1.01 0.98 2/71 3981
/proc/meminfo: memFree=1175656/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=19384 CPUtime=102.33
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 7661 0 0 0 10227 6 0 0 25 0 1 0 196806829 19849216 4593 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 4846 4593 86 211 0 4632 0
Current children cumulated CPU time (s) 102.33
Current children cumulated vsize (KiB) 24748

[startup+162.437 s]
/proc/loadavg: 1.05 1.02 0.99 2/71 3981
/proc/meminfo: memFree=1173160/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=21940 CPUtime=162.37
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 8341 0 0 0 16230 7 0 0 25 0 1 0 196806829 22466560 5273 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522898 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 5485 5273 86 211 0 5271 0
Current children cumulated CPU time (s) 162.37
Current children cumulated vsize (KiB) 27304

[startup+222.488 s]
/proc/loadavg: 1.02 1.02 0.99 2/71 3981
/proc/meminfo: memFree=1166952/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=35460 CPUtime=222.4
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 11818 0 0 0 22232 8 0 0 25 0 1 0 196806829 36311040 8364 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134532389 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 8865 8364 86 211 0 8651 0
Current children cumulated CPU time (s) 222.4
Current children cumulated vsize (KiB) 40824

[startup+282.541 s]
/proc/loadavg: 1.00 1.01 0.99 2/71 3981
/proc/meminfo: memFree=1166696/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=29300 CPUtime=282.44
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 11837 0 0 0 28235 9 0 0 25 0 1 0 196806829 30003200 6843 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522898 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 7325 6843 86 211 0 7111 0
Current children cumulated CPU time (s) 282.44
Current children cumulated vsize (KiB) 34664

[startup+342.597 s]
/proc/loadavg: 1.00 1.01 0.99 2/71 3981
/proc/meminfo: memFree=1166632/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=29432 CPUtime=342.48
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 11881 0 0 0 34239 9 0 0 25 0 1 0 196806829 30138368 6887 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 7358 6887 86 211 0 7144 0
Current children cumulated CPU time (s) 342.48
Current children cumulated vsize (KiB) 34796

[startup+402.655 s]
/proc/loadavg: 1.00 1.00 0.99 2/71 3981
/proc/meminfo: memFree=1161960/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=34288 CPUtime=402.53
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 13056 0 0 0 40243 10 0 0 25 0 1 0 196806829 35110912 8062 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 8572 8062 86 211 0 8358 0
Current children cumulated CPU time (s) 402.53
Current children cumulated vsize (KiB) 39652

[startup+462.746 s]
/proc/loadavg: 1.41 1.10 1.02 2/78 10652
/proc/meminfo: memFree=1146472/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=38104 CPUtime=460.12
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 14104 0 0 0 45998 14 0 0 25 0 1 0 196806829 39018496 9110 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134523283 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 9526 9110 86 211 0 9312 0
Current children cumulated CPU time (s) 460.12
Current children cumulated vsize (KiB) 43468

[startup+522.788 s]
/proc/loadavg: 2.30 1.41 1.13 2/78 27080
/proc/meminfo: memFree=1124456/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0

################
# More data... #
################

[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=40296 CPUtime=570.25
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 16704 0 0 0 56998 27 0 0 25 0 1 0 196806829 41263104 9871 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 10074 9871 86 211 0 9860 0
Current children cumulated CPU time (s) 570.25
Current children cumulated vsize (KiB) 45660

[startup+642.862 s]
/proc/loadavg: 1.32 1.38 1.16 2/71 6317
/proc/meminfo: memFree=1114152/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=40296 CPUtime=630.3
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 16705 0 0 0 63003 27 0 0 25 0 1 0 196806829 41263104 9872 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 10074 9872 86 211 0 9860 0
Current children cumulated CPU time (s) 630.3
Current children cumulated vsize (KiB) 45660

[startup+702.916 s]
/proc/loadavg: 1.19 1.32 1.15 2/71 6317
/proc/meminfo: memFree=1114152/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=40296 CPUtime=690.33
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 16705 0 0 0 69006 27 0 0 25 0 1 0 196806829 41263104 9872 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 10074 9872 86 211 0 9860 0
Current children cumulated CPU time (s) 690.33
Current children cumulated vsize (KiB) 45660

[startup+762.97 s]
/proc/loadavg: 1.07 1.26 1.14 2/71 6317
/proc/meminfo: memFree=1114152/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=40296 CPUtime=750.37
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 16712 0 0 0 75010 27 0 0 25 0 1 0 196806829 41263104 9879 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134523251 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 10074 9879 86 211 0 9860 0
Current children cumulated CPU time (s) 750.37
Current children cumulated vsize (KiB) 45660

[startup+823.025 s]
/proc/loadavg: 1.02 1.21 1.13 2/71 6317
/proc/meminfo: memFree=1112808/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=42132 CPUtime=810.42
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 17110 0 0 0 81014 28 0 0 25 0 1 0 196806829 43143168 10277 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 10533 10277 86 211 0 10319 0
Current children cumulated CPU time (s) 810.42
Current children cumulated vsize (KiB) 47496

[startup+883.087 s]
/proc/loadavg: 1.01 1.17 1.11 2/71 6317
/proc/meminfo: memFree=1109160/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=48760 CPUtime=870.46
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 18741 0 0 0 87017 29 0 0 25 0 1 0 196806829 49930240 11138 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 12190 11138 86 211 0 11976 0
Current children cumulated CPU time (s) 870.46
Current children cumulated vsize (KiB) 54124

[startup+943.145 s]
/proc/loadavg: 1.00 1.14 1.10 2/71 6317
/proc/meminfo: memFree=1105960/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=51924 CPUtime=930.5
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 19541 0 0 0 93020 30 0 0 25 0 1 0 196806829 53170176 11938 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 12981 11938 86 211 0 12767 0
Current children cumulated CPU time (s) 930.5
Current children cumulated vsize (KiB) 57288

[startup+1003.2 s]
/proc/loadavg: 1.00 1.11 1.09 2/71 6317
/proc/meminfo: memFree=1103336/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=54448 CPUtime=990.53
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 20214 0 0 0 99023 30 0 0 25 0 1 0 196806829 55754752 12611 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 13612 12611 86 211 0 13398 0
Current children cumulated CPU time (s) 990.53
Current children cumulated vsize (KiB) 59812

[startup+1063.25 s]
/proc/loadavg: 1.00 1.09 1.08 2/71 6317
/proc/meminfo: memFree=1100776/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=56932 CPUtime=1050.58
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 20833 0 0 0 105027 31 0 0 25 0 1 0 196806829 58298368 13230 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 14233 13230 86 211 0 14019 0
Current children cumulated CPU time (s) 1050.58
Current children cumulated vsize (KiB) 62296

[startup+1123.31 s]
/proc/loadavg: 1.00 1.07 1.08 2/71 6317
/proc/meminfo: memFree=1098344/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=59284 CPUtime=1110.62
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 21456 0 0 0 111030 32 0 0 25 0 1 0 196806829 60706816 13853 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 14821 13853 86 211 0 14607 0
Current children cumulated CPU time (s) 1110.62
Current children cumulated vsize (KiB) 64648

[startup+1183.37 s]
/proc/loadavg: 1.00 1.05 1.07 2/71 6317
/proc/meminfo: memFree=1095784/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=61812 CPUtime=1170.66
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 22100 0 0 0 117034 32 0 0 25 0 1 0 196806829 63295488 14497 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522866 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 15453 14497 86 211 0 15239 0
Current children cumulated CPU time (s) 1170.66
Current children cumulated vsize (KiB) 67176



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1212.78 s]
/proc/loadavg: 1.00 1.05 1.07 2/71 6317
/proc/meminfo: memFree=1094440/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=62984 CPUtime=1200.07
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 22423 0 0 0 119974 33 0 0 25 0 1 0 196806829 64495616 14820 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 15746 14820 86 211 0 15532 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 68348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1212.78 s]
/proc/loadavg: 1.00 1.05 1.07 2/71 6317
/proc/meminfo: memFree=1094440/2055888 swapFree=4087076/4096564
[pid=3978] ppid=3976 vsize=5364 CPUtime=0
/proc/3978/stat : 3978 (rsat.sh) S 3976 3978 2124 0 -1 4194304 305 152 0 0 0 0 0 0 19 0 1 0 196806828 5492736 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 206843734596 0 65536 4100 65538 18446744071563358023 0 0 17 1 0 0
/proc/3978/statm: 1341 233 193 169 0 51 0
[pid=3981] ppid=3978 vsize=62984 CPUtime=1200.07
/proc/3981/stat : 3981 (rsat) R 3978 3978 2124 0 -1 4194304 22423 0 0 0 119974 33 0 0 25 0 1 0 196806829 64495616 14820 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/3981/statm: 15746 14820 86 211 0 15532 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 68348

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 3978 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=8998 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=1999
CPU time returned by wait4() is 0.010997
while last known CPU time is 1200.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1212.79
CPU time (s): 1200.07
CPU user time (s): 1199.74
CPU system time (s): 0.33
CPU usage (%): 98.9512
Max. virtual memory (cumulated for all children) (KiB): 68348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.008998
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 457
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 3

runsolver used 1.16782 second user time and 2.39563 second system time

The end

Launcher Data (download as text)

Begin job on node76 on Sun Feb 18 03:14:45 UTC 2007

IDJOB= 293313
IDBENCH= 19861
IDSOLVER= 104
FILE ID= node76/293313-1171768485

PBS_JOBID= 3839489

Free space on /tmp= 66650 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/5SAT/v120/unif-k5-r21.3-v120-c2556-S142115187-18.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/293313-1171768485/rsat.sh /tmp/evaluation/293313-1171768485/instance-293313-1171768485.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node76/watcher-293313-1171768485 -o ROOT/results/node76/solver-293313-1171768485 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/293313-1171768485/rsat.sh /tmp/evaluation/293313-1171768485/instance-293313-1171768485.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  8cabd92b6dab5971b671630141b8d8fe

RANDOM SEED= 740921320

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node76.alineos.net 2.6.9-34.ELsmp #1 SMP Thu Mar 9 06:23:23 GMT 2006 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.219
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6006.18
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.219
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5999.41
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055888 kB
MemFree:       1194960 kB
Buffers:         40760 kB
Cached:         728396 kB
SwapCached:       3460 kB
Active:         525256 kB
Inactive:       254424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055888 kB
LowFree:       1194960 kB
SwapTotal:     4096564 kB
SwapFree:      4087076 kB
Dirty:            1768 kB
Writeback:           0 kB
Mapped:          15896 kB
Slab:            67616 kB
Committed_AS:   881552 kB
PageTables:       1424 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264388 kB
VmallocChunk: 536606243 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66650 MiB

End job on node76 on Sun Feb 18 03:35:00 UTC 2007