Trace number 306556

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.04 1200.6

General information on the benchmark

Namerandom/LargeSize/3SAT/v7000/
unif-k3-r4.2-v7000-c29400-S2118640909-06.cnf
MD5SUMf797b412c0282263cc1dca0746fdda90
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark54.6397
Satisfiable
(Un)Satisfiability was proved
Number of variables7000
Number of clauses29400
Sum of the clauses size88200
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 329400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.03	c ==============================================================================
0.00/0.03	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.03	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.03	c ==============================================================================
0.00/0.03	c |         0 |   29400    88200 |    8819       0        0     nan |  0.000 % |
0.00/0.09	c |         0 |   29225    88696 |      --       0       --      -- |     --   | -175/496
0.00/0.09	c ==============================================================================
0.00/0.09	c Result  :   #vars: 6839   #clauses: 29225   #literals: 88696
0.00/0.09	c CPU time:   0.092985 s
0.00/0.09	c ==============================================================================
0.10/0.14	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node71/watcher-306556-1172101540 -o ROOT/results/node71/solver-306556-1172101540 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/306556-1172101540/rsat.sh /tmp/evaluation/306556-1172101540/instance-306556-1172101540.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.98 0.98 3/64 21811
/proc/meminfo: memFree=1361128/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0
/proc/21811/stat : 21811 (rsat.sh) R 21809 21811 21078 0 -1 4194304 264 0 0 0 0 0 0 0 18 0 1 0 230111808 5480448 231 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962372767 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/21811/statm: 1338 231 194 169 0 49 0
[pid=21812] ppid=21811 vsize=1556 CPUtime=0
/proc/21812/stat : 21812 (SatElite) R 21811 21811 21078 0 -1 4194304 265 0 0 0 0 0 0 0 18 0 1 0 230111808 1593344 247 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134548217 0 0 4096 3 0 0 0 17 1 0 0
/proc/21812/statm: 389 249 49 128 0 258 0

[startup+0.106837 s]
/proc/loadavg: 0.99 0.98 0.98 3/64 21811
/proc/meminfo: memFree=1361128/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 230111808 5480448 232 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 232 195 169 0 49 0
[pid=21812] ppid=21811 vsize=4092 CPUtime=0.1
/proc/21812/stat : 21812 (SatElite) R 21811 21811 21078 0 -1 4194304 1018 0 0 0 10 0 0 0 19 0 1 0 230111808 4190208 917 18446744073709551615 134512640 135038345 4294956768 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/21812/statm: 1023 917 70 128 0 892 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 9444

[startup+0.514924 s]
/proc/loadavg: 0.99 0.98 0.98 3/64 21811
/proc/meminfo: memFree=1361128/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 5352

[startup+1.3351 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1356696/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=6820 CPUtime=1.18
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 1539 0 0 0 117 1 0 0 25 0 1 0 230111822 6983680 1519 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134526045 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 1705 1519 86 211 0 1491 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 12172

[startup+2.97146 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1353176/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=11552 CPUtime=2.82
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 2731 0 0 0 281 1 0 0 25 0 1 0 230111822 11829248 2711 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 2888 2711 86 211 0 2674 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 16904

[startup+6.25417 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1348568/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=15524 CPUtime=6.11
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 3783 0 0 0 609 2 0 0 25 0 1 0 230111822 15896576 3698 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134526463 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 3881 3698 86 211 0 3667 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 20876

[startup+12.7106 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1338848/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=23508 CPUtime=12.55
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 6013 0 0 0 1252 3 0 0 25 0 1 0 230111822 24072192 5667 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529762 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 5877 5667 86 211 0 5663 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 28860

[startup+25.5233 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1329824/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=32820 CPUtime=25.36
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 8756 0 0 0 2531 5 0 0 25 0 1 0 230111822 33607680 7924 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529266 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 8205 7924 86 211 0 7991 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 38172

[startup+51.1459 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1312352/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=50064 CPUtime=50.97
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 13509 0 0 0 5089 8 0 0 25 0 1 0 230111822 51265536 12289 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 12516 12289 86 211 0 12302 0
Current children cumulated CPU time (s) 51.1
Current children cumulated vsize (KiB) 55416

[startup+102.388 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1283616/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=80348 CPUtime=102.2
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 21952 0 0 0 10205 15 0 0 25 0 1 0 230111822 82276352 19766 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 20087 19766 86 211 0 19873 0
Current children cumulated CPU time (s) 102.33
Current children cumulated vsize (KiB) 85700

[startup+162.453 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1250912/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=111364 CPUtime=162.25
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 30555 0 0 0 16203 22 0 0 25 0 1 0 230111822 114036736 27597 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 27841 27597 86 211 0 27627 0
Current children cumulated CPU time (s) 162.38
Current children cumulated vsize (KiB) 116716

[startup+222.517 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1208032/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=154936 CPUtime=222.29
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 43170 0 0 0 22195 34 0 0 25 0 1 0 230111822 158654464 38286 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134526447 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 38734 38286 86 211 0 38520 0
Current children cumulated CPU time (s) 222.42
Current children cumulated vsize (KiB) 160288

[startup+282.579 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1208096/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=154936 CPUtime=282.33
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 43170 0 0 0 28199 34 0 0 25 0 1 0 230111822 158654464 38286 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 38734 38286 86 211 0 38520 0
Current children cumulated CPU time (s) 282.46
Current children cumulated vsize (KiB) 160288

[startup+342.646 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1203296/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=161012 CPUtime=342.37
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 44697 0 0 0 34201 36 0 0 25 0 1 0 230111822 164876288 39813 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529231 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 40253 39813 86 211 0 40039 0
Current children cumulated CPU time (s) 342.5
Current children cumulated vsize (KiB) 166364

[startup+402.716 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1134944/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=227748 CPUtime=402.42
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 61509 0 0 0 40192 50 0 0 25 0 1 0 230111822 233213952 56625 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529120 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 56937 56625 86 211 0 56723 0
Current children cumulated CPU time (s) 402.55
Current children cumulated vsize (KiB) 233100

[startup+462.776 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1104800/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=257028 CPUtime=462.46
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 70474 0 0 0 46189 57 0 0 25 0 1 0 230111822 263196672 64050 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 64257 64050 86 211 0 64043 0
Current children cumulated CPU time (s) 462.59
Current children cumulated vsize (KiB) 262380

[startup+522.835 s]

################
# More data... #
################

[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=257028 CPUtime=522.49
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 70474 0 0 0 52192 57 0 0 25 0 1 0 230111822 263196672 64050 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523286 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 64257 64050 86 211 0 64043 0
Current children cumulated CPU time (s) 522.62
Current children cumulated vsize (KiB) 262380

[startup+582.896 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1104864/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=257028 CPUtime=582.53
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 70474 0 0 0 58196 57 0 0 25 0 1 0 230111822 263196672 64050 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530258 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 64257 64050 86 211 0 64043 0
Current children cumulated CPU time (s) 582.66
Current children cumulated vsize (KiB) 262380

[startup+642.956 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1099616/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=265444 CPUtime=642.57
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 72665 0 0 0 64198 59 0 0 25 0 1 0 230111822 271814656 65471 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 66361 65471 86 211 0 66147 0
Current children cumulated CPU time (s) 642.7
Current children cumulated vsize (KiB) 270796

[startup+703.021 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=1043808/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=320668 CPUtime=702.61
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 86635 0 0 0 70187 74 0 0 25 0 1 0 230111822 328364032 79441 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 80167 79441 86 211 0 79953 0
Current children cumulated CPU time (s) 702.74
Current children cumulated vsize (KiB) 326020

[startup+763.09 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=994912/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=762.66
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101861 0 0 0 76177 89 0 0 25 0 1 0 230111822 377638912 91591 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91591 86 211 0 91983 0
Current children cumulated CPU time (s) 762.79
Current children cumulated vsize (KiB) 374140

[startup+823.158 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=994336/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=822.7
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101861 0 0 0 82181 89 0 0 25 0 1 0 230111822 377638912 91591 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91591 86 211 0 91983 0
Current children cumulated CPU time (s) 822.83
Current children cumulated vsize (KiB) 374140

[startup+883.217 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 21814
/proc/meminfo: memFree=994336/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=882.74
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101861 0 0 0 88185 89 0 0 25 0 1 0 230111822 377638912 91591 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522765 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91591 86 211 0 91983 0
Current children cumulated CPU time (s) 882.87
Current children cumulated vsize (KiB) 374140

[startup+943.284 s]
/proc/loadavg: 0.99 0.98 0.98 2/72 21914
/proc/meminfo: memFree=993128/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=942.75
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101861 0 0 0 94184 91 0 0 25 0 1 0 230111822 377638912 91591 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91591 86 211 0 91983 0
Current children cumulated CPU time (s) 942.88
Current children cumulated vsize (KiB) 374140

[startup+1003.38 s]
/proc/loadavg: 0.99 0.98 0.98 2/72 21990
/proc/meminfo: memFree=993120/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=1002.78
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101861 0 0 0 100186 92 0 0 25 0 1 0 230111822 377638912 91591 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91591 86 211 0 91983 0
Current children cumulated CPU time (s) 1002.91
Current children cumulated vsize (KiB) 374140

[startup+1063.45 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 22012
/proc/meminfo: memFree=994144/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=1062.81
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101862 0 0 0 106189 92 0 0 25 0 1 0 230111822 377638912 91592 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522887 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91592 86 211 0 91983 0
Current children cumulated CPU time (s) 1062.94
Current children cumulated vsize (KiB) 374140

[startup+1123.51 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 22012
/proc/meminfo: memFree=994272/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=368788 CPUtime=1122.85
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 101862 0 0 0 112192 93 0 0 25 0 1 0 230111822 377638912 91592 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 92197 91592 86 211 0 91983 0
Current children cumulated CPU time (s) 1122.98
Current children cumulated vsize (KiB) 374140

[startup+1183.57 s]
/proc/loadavg: 0.99 0.98 0.98 2/66 22012
/proc/meminfo: memFree=976736/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=387020 CPUtime=1182.89
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 106416 0 0 0 118192 97 0 0 25 0 1 0 230111822 396308480 96146 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134525861 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 96755 96146 86 211 0 96541 0
Current children cumulated CPU time (s) 1183.02
Current children cumulated vsize (KiB) 392372



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.58 s]
/proc/loadavg: 1.06 1.00 0.99 2/66 22012
/proc/meminfo: memFree=963936/2055920 swapFree=4183908/4192956
[pid=21811] ppid=21809 vsize=5352 CPUtime=0.13
/proc/21811/stat : 21811 (rsat.sh) S 21809 21811 21078 0 -1 4194304 305 1019 0 0 0 0 13 0 15 0 1 0 230111808 5480448 234 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 231962370884 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21811/statm: 1338 234 195 169 0 49 0
[pid=21814] ppid=21811 vsize=399048 CPUtime=1199.91
/proc/21814/stat : 21814 (rsat) R 21811 21811 21078 0 -1 4194304 109474 0 0 0 119891 100 0 0 25 0 1 0 230111822 408625152 99204 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/21814/statm: 99762 99204 86 211 0 99548 0
Current children cumulated CPU time (s) 1200.04
Current children cumulated vsize (KiB) 404400

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 21811 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=132979 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=4999
CPU time returned by wait4() is 0.137978
while last known CPU time is 1200.04

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.6
CPU time (s): 1200.04
CPU user time (s): 1199.04
CPU system time (s): 1
CPU usage (%): 99.9538
Max. virtual memory (cumulated for all children) (KiB): 404400

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.132979
system time used= 0.004999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1324
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 2

runsolver used 1.05384 second user time and 2.48662 second system time

The end

Launcher Data (download as text)

Begin job on node71 on Wed Feb 21 23:45:40 UTC 2007

IDJOB= 306556
IDBENCH= 20184
IDSOLVER= 104
FILE ID= node71/306556-1172101540

PBS_JOBID= 3892869

Free space on /tmp= 66559 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/3SAT/v7000/unif-k3-r4.2-v7000-c29400-S2118640909-06.cnf
COMMAND LINE= /tmp/evaluation/306556-1172101540/rsat.sh /tmp/evaluation/306556-1172101540/instance-306556-1172101540.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node71/watcher-306556-1172101540 -o ROOT/results/node71/solver-306556-1172101540 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/306556-1172101540/rsat.sh /tmp/evaluation/306556-1172101540/instance-306556-1172101540.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  f797b412c0282263cc1dca0746fdda90

RANDOM SEED= 895177786

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node71.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.266
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.266
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1361600 kB
Buffers:         32748 kB
Cached:         600484 kB
SwapCached:       3112 kB
Active:         115148 kB
Inactive:       528888 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1361600 kB
SwapTotal:     4192956 kB
SwapFree:      4183908 kB
Dirty:            2196 kB
Writeback:           0 kB
Mapped:          16596 kB
Slab:            36316 kB
Committed_AS:   749016 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66560 MiB

End job on node71 on Thu Feb 22 00:05:43 UTC 2007