Trace number 297659

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.09 1200.65

General information on the benchmark

Namerandom/OnTreshold/3SAT/v450/
unif-k3-r4.25-v450-c1912-S1858313411-09.UNSAT.shuffled.cnf
MD5SUM742af8c49b83baf589639ee213385309
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark879.487
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1912
Sum of the clauses size5736
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31912
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |    1912     5736 |     573       0        0     nan |  0.000 % |
0.00/0.00	c |         0 |    1905     5764 |      --       0       --      -- |     --   | -7/28
0.00/0.00	c ==============================================================================
0.00/0.00	c Result  :   #vars: 443   #clauses: 1905   #literals: 5764
0.00/0.00	c CPU time:   0.004999 s
0.00/0.00	c ==============================================================================
0.00/0.01	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node44/watcher-297659-1171842984 -o ROOT/results/node44/solver-297659-1171842984 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/297659-1171842984/rsat.sh /tmp/evaluation/297659-1171842984/instance-297659-1171842984.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.03 1.02 1.00 3/64 11011
/proc/meminfo: memFree=766536/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 204254554 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/11011/statm: 1338 232 195 169 0 49 0
[pid=11012] ppid=11011 vsize=820 CPUtime=0
/proc/11012/stat : 11012 (SatElite) R 11011 11011 10852 0 -1 4194304 124 0 0 0 0 0 0 0 19 0 1 0 204254554 839680 106 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/11012/statm: 205 106 49 128 0 74 0

[startup+0.107377 s]
/proc/loadavg: 1.03 1.02 1.00 3/64 11011
/proc/meminfo: memFree=766536/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+0.515451 s]
/proc/loadavg: 1.03 1.02 1.00 3/64 11011
/proc/meminfo: memFree=766536/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+1.3356 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 11014
/proc/meminfo: memFree=764728/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=2948 CPUtime=1.31
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 692 0 0 0 131 0 0 0 25 0 1 0 204254555 3018752 581 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 737 581 86 211 0 523 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 8300

[startup+2.9719 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 11014
/proc/meminfo: memFree=763192/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=3728 CPUtime=2.95
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 956 0 0 0 295 0 0 0 25 0 1 0 204254555 3817472 780 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522843 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 932 780 86 211 0 718 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 9080

[startup+6.2545 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 11014
/proc/meminfo: memFree=761976/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=5160 CPUtime=6.23
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 1470 0 0 0 623 0 0 0 25 0 1 0 204254555 5283840 1098 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134526084 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 1290 1098 86 211 0 1076 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 10512

[startup+12.7117 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 11014
/proc/meminfo: memFree=760056/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=7188 CPUtime=12.69
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 2400 0 0 0 1268 1 0 0 25 0 1 0 204254555 7360512 1542 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 1797 1542 86 211 0 1583 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 12540

[startup+25.525 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 11014
/proc/meminfo: memFree=757048/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=9968 CPUtime=25.49
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 3516 0 0 0 2547 2 0 0 25 0 1 0 204254555 10207232 2270 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 2492 2270 86 211 0 2278 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 15320

[startup+51.1487 s]
/proc/loadavg: 1.01 1.01 1.00 2/66 11014
/proc/meminfo: memFree=753336/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=13980 CPUtime=51.11
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 5404 0 0 0 5107 4 0 0 25 0 1 0 204254555 14315520 3192 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 3495 3192 86 211 0 3281 0
Current children cumulated CPU time (s) 51.11
Current children cumulated vsize (KiB) 19332

[startup+102.391 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 11014
/proc/meminfo: memFree=747960/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=19364 CPUtime=102.33
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 6816 0 0 0 10228 5 0 0 25 0 1 0 204254555 19828736 4604 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 4841 4604 86 211 0 4627 0
Current children cumulated CPU time (s) 102.33
Current children cumulated vsize (KiB) 24716

[startup+162.451 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11014
/proc/meminfo: memFree=746744/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=20144 CPUtime=162.37
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 7839 0 0 0 16231 6 0 0 25 0 1 0 204254555 20627456 4833 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 5036 4833 86 211 0 4822 0
Current children cumulated CPU time (s) 162.37
Current children cumulated vsize (KiB) 25496

[startup+222.509 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11014
/proc/meminfo: memFree=740280/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=27772 CPUtime=222.42
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 9880 0 0 0 22234 8 0 0 25 0 1 0 204254555 28438528 6488 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 6943 6488 86 211 0 6729 0
Current children cumulated CPU time (s) 222.42
Current children cumulated vsize (KiB) 33124

[startup+282.571 s]
/proc/loadavg: 1.00 1.00 1.00 2/72 11078
/proc/meminfo: memFree=735992/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=30376 CPUtime=282.42
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 12148 0 0 0 28233 9 0 0 25 0 1 0 204254555 31105024 7196 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 7594 7196 86 211 0 7380 0
Current children cumulated CPU time (s) 282.42
Current children cumulated vsize (KiB) 35728

[startup+342.663 s]
/proc/loadavg: 1.05 1.01 1.00 2/72 11170
/proc/meminfo: memFree=735992/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=30376 CPUtime=342.43
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 12150 0 0 0 34233 10 0 0 25 0 1 0 204254555 31105024 7198 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 7594 7198 86 211 0 7380 0
Current children cumulated CPU time (s) 342.43
Current children cumulated vsize (KiB) 35728

[startup+402.745 s]
/proc/loadavg: 1.02 1.01 1.00 2/66 11212
/proc/meminfo: memFree=736568/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=31136 CPUtime=402.46
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 12303 0 0 0 40236 10 0 0 25 0 1 0 204254555 31883264 7351 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 7784 7351 86 211 0 7570 0
Current children cumulated CPU time (s) 402.46
Current children cumulated vsize (KiB) 36488

[startup+462.807 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=731896/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=35772 CPUtime=462.5
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 13491 0 0 0 46239 11 0 0 25 0 1 0 204254555 36630528 8539 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 8943 8539 86 211 0 8729 0
Current children cumulated CPU time (s) 462.5
Current children cumulated vsize (KiB) 41124

[startup+522.866 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=727288/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0

################
# More data... #
################

[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=44732 CPUtime=582.59
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 19688 0 0 0 58244 15 0 0 25 0 1 0 204254555 45805568 10285 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522417 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 11183 10285 86 211 0 10969 0
Current children cumulated CPU time (s) 582.59
Current children cumulated vsize (KiB) 50084

[startup+642.979 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=724664/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=44732 CPUtime=642.62
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 19688 0 0 0 64247 15 0 0 25 0 1 0 204254555 45805568 10285 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 11183 10285 86 211 0 10969 0
Current children cumulated CPU time (s) 642.62
Current children cumulated vsize (KiB) 50084

[startup+703.036 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=724664/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=44732 CPUtime=702.65
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 19697 0 0 0 70250 15 0 0 25 0 1 0 204254555 45805568 10294 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 11183 10294 86 211 0 10969 0
Current children cumulated CPU time (s) 702.65
Current children cumulated vsize (KiB) 50084

[startup+763.097 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=724664/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=44864 CPUtime=762.69
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 19718 0 0 0 76254 15 0 0 25 0 1 0 204254555 45940736 10315 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 11216 10315 86 211 0 11002 0
Current children cumulated CPU time (s) 762.69
Current children cumulated vsize (KiB) 50216

[startup+823.164 s]
/proc/loadavg: 1.05 1.01 1.00 2/66 11212
/proc/meminfo: memFree=724536/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=45128 CPUtime=822.74
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 19767 0 0 0 82258 16 0 0 25 0 1 0 204254555 46211072 10364 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523176 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 11282 10364 86 211 0 11068 0
Current children cumulated CPU time (s) 822.74
Current children cumulated vsize (KiB) 50480

[startup+883.227 s]
/proc/loadavg: 1.02 1.01 1.00 2/66 11212
/proc/meminfo: memFree=724472/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=45260 CPUtime=882.79
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 19793 0 0 0 88263 16 0 0 25 0 1 0 204254555 46346240 10390 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 11315 10390 86 211 0 11101 0
Current children cumulated CPU time (s) 882.79
Current children cumulated vsize (KiB) 50612

[startup+943.288 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=721912/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=48436 CPUtime=942.83
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 20506 0 0 0 94266 17 0 0 25 0 1 0 204254555 49598464 11037 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 12109 11037 86 211 0 11895 0
Current children cumulated CPU time (s) 942.83
Current children cumulated vsize (KiB) 53788

[startup+1003.34 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=718712/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=51404 CPUtime=1002.86
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 21337 0 0 0 100268 18 0 0 25 0 1 0 204254555 52637696 11835 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 12851 11835 86 211 0 12637 0
Current children cumulated CPU time (s) 1002.86
Current children cumulated vsize (KiB) 56756

[startup+1063.4 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=715704/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=54108 CPUtime=1062.9
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 22094 0 0 0 106271 19 0 0 25 0 1 0 204254555 55406592 12592 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 13527 12592 86 211 0 13313 0
Current children cumulated CPU time (s) 1062.9
Current children cumulated vsize (KiB) 59460

[startup+1123.46 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=712696/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=57040 CPUtime=1122.94
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 22877 0 0 0 112274 20 0 0 25 0 1 0 204254555 58408960 13342 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 14260 13342 86 211 0 14046 0
Current children cumulated CPU time (s) 1122.94
Current children cumulated vsize (KiB) 62392

[startup+1183.52 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=709752/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=59844 CPUtime=1182.98
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 23639 0 0 0 118278 20 0 0 25 0 1 0 204254555 61280256 14071 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 14961 14071 86 211 0 14747 0
Current children cumulated CPU time (s) 1182.98
Current children cumulated vsize (KiB) 65196



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.63 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=708984/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=60488 CPUtime=1200.09
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 23821 0 0 0 119988 21 0 0 25 0 1 0 204254555 61939712 14253 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 15122 14253 86 211 0 14908 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 65840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.63 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 11212
/proc/meminfo: memFree=708984/2055920 swapFree=4183224/4192956
[pid=11011] ppid=11009 vsize=5352 CPUtime=0
/proc/11011/stat : 11011 (rsat.sh) S 11009 11011 10852 0 -1 4194304 305 153 0 0 0 0 0 0 16 0 1 0 204254554 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 264840471364 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/11011/statm: 1338 234 195 169 0 49 0
[pid=11014] ppid=11011 vsize=60488 CPUtime=1200.09
/proc/11014/stat : 11014 (rsat) R 11011 11011 10852 0 -1 4194304 23821 0 0 0 119988 21 0 0 25 0 1 0 204254555 61939712 14253 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/11014/statm: 15122 14253 86 211 0 14908 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 65840

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 11011 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=6998 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=4999
CPU time returned by wait4() is 0.011997
while last known CPU time is 1200.09

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.65
CPU time (s): 1200.09
CPU user time (s): 1199.88
CPU system time (s): 0.21
CPU usage (%): 99.9538
Max. virtual memory (cumulated for all children) (KiB): 65840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.006998
system time used= 0.004999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 458
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 3

runsolver used 0.98285 second user time and 2.50062 second system time

The end

Launcher Data (download as text)

Begin job on node44 on Sun Feb 18 23:56:24 UTC 2007

IDJOB= 297659
IDBENCH= 19967
IDSOLVER= 104
FILE ID= node44/297659-1171842984

PBS_JOBID= 3839732

Free space on /tmp= 66562 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/OnTreshold/3SAT/v450/unif-k3-r4.25-v450-c1912-S1858313411-09.UNSAT.shuffled.cnf
COMMAND LINE= /tmp/evaluation/297659-1171842984/rsat.sh /tmp/evaluation/297659-1171842984/instance-297659-1171842984.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node44/watcher-297659-1171842984 -o ROOT/results/node44/solver-297659-1171842984 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/297659-1171842984/rsat.sh /tmp/evaluation/297659-1171842984/instance-297659-1171842984.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  742af8c49b83baf589639ee213385309

RANDOM SEED= 521909016

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node44.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.261
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        767008 kB
Buffers:         52460 kB
Cached:        1113560 kB
SwapCached:       4532 kB
Active:         837600 kB
Inactive:       338920 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        767008 kB
SwapTotal:     4192956 kB
SwapFree:      4183224 kB
Dirty:            1696 kB
Writeback:           0 kB
Mapped:          15468 kB
Slab:            98436 kB
Committed_AS:   464484 kB
PageTables:       1396 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66562 MiB

End job on node44 on Mon Feb 19 00:16:27 UTC 2007