Trace number 329614

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.1 1200.51

General information on the benchmark

Nameindustrial/IBM_FV_2002_31_1_rule_1/
SAT_dat.k70.cnf
MD5SUM7df05251eeff9fbbbfcc94a219ac2c0b
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables104135
Number of clauses466268
Sum of the clauses size1199934
Maximum clause length20
Minimum clause length1
Number of clauses of size 1663
Number of clauses of size 2363146
Number of clauses of size 351212
Number of clauses of size 420925
Number of clauses of size 59084
Number of clauses of size over 521238

Solver Data (download as text)

0.00/0.00	c Parsing...
0.39/0.49	c ==============================================================================
0.39/0.49	c |           |     ORIGINAL     |              LEARNT              |          |
0.39/0.49	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.39/0.49	c ==============================================================================
0.39/0.49	c |         0 |  464773  1179345 |  139431       0        0     nan |  0.000 % |
2.88/2.97	c |         0 |  250847   843511 |      --       0       --      -- |     --   | -125741/-96955
2.88/2.98	c ==============================================================================
2.88/2.98	c Result  :   #vars: 37169   #clauses: 250847   #literals: 843511
2.88/2.98	c CPU time:   2.84057 s
2.88/2.98	c ==============================================================================
3.29/3.38	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node1/watcher-329614-1173145074 -o ROOT/results/node1/solver-329614-1173145074 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/329614-1173145074/rsat.sh /tmp/evaluation/329614-1173145074/instance-329614-1173145074.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.98 3/77 17607
/proc/meminfo: memFree=1084208/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=688 CPUtime=0
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 66 0 0 0 0 0 0 0 19 0 1 0 334462532 704512 48 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 172 48 39 128 0 41 0

[startup+0.0260699 s]
/proc/loadavg: 0.92 0.98 0.98 3/77 17607
/proc/meminfo: memFree=1084208/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=1832 CPUtime=0.01
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 353 0 0 0 1 0 0 0 19 0 1 0 334462532 1875968 335 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 458 336 49 128 0 327 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 7184

[startup+0.102078 s]
/proc/loadavg: 0.92 0.98 0.98 3/77 17607
/proc/meminfo: memFree=1084208/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=9724 CPUtime=0.08
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 2121 0 0 0 8 0 0 0 19 0 1 0 334462532 9957376 2103 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 2431 2105 49 128 0 2300 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 15076

[startup+0.301101 s]
/proc/loadavg: 0.92 0.98 0.98 3/77 17607
/proc/meminfo: memFree=1084208/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=32660 CPUtime=0.28
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 6605 0 0 0 24 4 0 0 21 0 1 0 334462532 33443840 6587 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 8165 6587 49 128 0 8034 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 38012

[startup+0.702147 s]
/proc/loadavg: 0.92 0.98 0.98 3/77 17607
/proc/meminfo: memFree=1084208/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=54888 CPUtime=0.69
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 12711 0 0 0 62 7 0 0 25 0 1 0 334462532 56205312 12664 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134574308 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 13722 12664 67 128 0 13591 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 60240

[startup+1.50224 s]
/proc/loadavg: 0.92 0.98 0.98 2/79 17609
/proc/meminfo: memFree=1033888/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=58480 CPUtime=1.48
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 14584 0 0 0 138 10 0 0 25 0 1 0 334462532 59883520 13354 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 14620 13354 69 128 0 14489 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 63832

[startup+3.10143 s]
/proc/loadavg: 0.92 0.98 0.98 2/79 17609
/proc/meminfo: memFree=1025440/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=0
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 283 0 0 0 0 0 0 0 18 0 1 0 334462532 5480448 232 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17607/statm: 1338 232 195 169 0 49 0
[pid=17608] ppid=17607 vsize=59584 CPUtime=3.09
/proc/17608/stat : 17608 (SatElite) R 17607 17607 16451 0 -1 4194304 18271 0 0 0 295 14 0 0 25 0 1 0 334462532 61014016 13728 18446744073709551615 134512640 135038345 4294956752 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/17608/statm: 14896 13728 69 128 0 14765 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 64936

[startup+6.3018 s]
/proc/loadavg: 0.93 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1059552/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=19032 CPUtime=2.9
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 4730 0 0 0 288 2 0 0 25 0 1 0 334462870 19488768 4481 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 4758 4481 86 211 0 4544 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 24384

[startup+12.7016 s]
/proc/loadavg: 0.93 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1056928/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=21380 CPUtime=9.3
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 5306 0 0 0 927 3 0 0 25 0 1 0 334462870 21893120 5057 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530105 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 5345 5057 86 211 0 5131 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 26732

[startup+25.501 s]
/proc/loadavg: 0.95 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1052000/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=26360 CPUtime=22.1
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 6634 0 0 0 2206 4 0 0 25 0 1 0 334462870 26992640 6287 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134529233 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 6590 6287 86 211 0 6376 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 31712

[startup+51.101 s]
/proc/loadavg: 0.96 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1046688/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=32020 CPUtime=47.67
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 8921 0 0 0 4761 6 0 0 25 0 1 0 334462870 32788480 7604 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530136 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 8005 7604 86 211 0 7791 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 37372

[startup+102.306 s]
/proc/loadavg: 0.98 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1037728/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=40504 CPUtime=98.85
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 11168 0 0 0 9877 8 0 0 25 0 1 0 334462870 41476096 9846 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522898 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 10126 9846 86 211 0 9912 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 45856

[startup+162.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1037024/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=41128 CPUtime=158.83
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 12074 0 0 0 15874 9 0 0 25 0 1 0 334462870 42115072 9980 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 10282 9980 86 211 0 10068 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 46480

[startup+222.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1023264/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=55364 CPUtime=218.82
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 17409 0 0 0 21868 14 0 0 25 0 1 0 334462870 56692736 13377 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 13841 13377 86 211 0 13627 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 60716

[startup+282.301 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17610
/proc/meminfo: memFree=1023264/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=55364 CPUtime=278.8
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 17409 0 0 0 27866 14 0 0 25 0 1 0 334462870 56692736 13377 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134530112 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 13841 13377 86 211 0 13627 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 60716

[startup+342.301 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=1009184/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=69332 CPUtime=338.78
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 20985 0 0 0 33860 18 0 0 25 0 1 0 334462870 70995968 16939 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 17333 16939 86 211 0 17119 0

################
# More data... #
################

[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=90224 CPUtime=578.71
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 29644 0 0 0 57844 27 0 0 25 0 1 0 334462870 92389376 21632 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 22556 21632 86 211 0 22342 0
Current children cumulated CPU time (s) 582.08
Current children cumulated vsize (KiB) 95576

[startup+642.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=990432/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=90224 CPUtime=638.69
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 29644 0 0 0 63842 27 0 0 25 0 1 0 334462870 92389376 21632 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 22556 21632 86 211 0 22342 0
Current children cumulated CPU time (s) 642.06
Current children cumulated vsize (KiB) 95576

[startup+702.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=980256/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=99976 CPUtime=698.68
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 32191 0 0 0 69838 30 0 0 25 0 1 0 334462870 102375424 24169 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134523286 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 24994 24169 86 211 0 24780 0
Current children cumulated CPU time (s) 702.05
Current children cumulated vsize (KiB) 105328

[startup+762.306 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=966368/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=113336 CPUtime=758.67
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 35644 0 0 0 75832 35 0 0 25 0 1 0 334462870 116056064 27615 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 28334 27615 86 211 0 28120 0
Current children cumulated CPU time (s) 762.04
Current children cumulated vsize (KiB) 118688

[startup+822.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=956064/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=123260 CPUtime=818.64
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 38243 0 0 0 81825 39 0 0 25 0 1 0 334462870 126218240 30198 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 30815 30198 86 211 0 30601 0
Current children cumulated CPU time (s) 822.01
Current children cumulated vsize (KiB) 128612

[startup+882.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952736/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126040 CPUtime=878.63
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42170 0 0 0 87821 42 0 0 25 0 1 0 334462870 129064960 30970 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522871 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31510 30970 86 211 0 31296 0
Current children cumulated CPU time (s) 882
Current children cumulated vsize (KiB) 131392

[startup+942.302 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952672/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126300 CPUtime=938.61
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42210 0 0 0 93819 42 0 0 25 0 1 0 334462870 129331200 31010 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31575 31010 86 211 0 31361 0
Current children cumulated CPU time (s) 941.98
Current children cumulated vsize (KiB) 131652

[startup+1002.3 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952672/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126300 CPUtime=998.58
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42221 0 0 0 99816 42 0 0 25 0 1 0 334462870 129331200 31021 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31575 31021 86 211 0 31361 0
Current children cumulated CPU time (s) 1001.95
Current children cumulated vsize (KiB) 131652

[startup+1062.3 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952672/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126300 CPUtime=1058.57
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42221 0 0 0 105814 43 0 0 25 0 1 0 334462870 129331200 31021 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31575 31021 86 211 0 31361 0
Current children cumulated CPU time (s) 1061.94
Current children cumulated vsize (KiB) 131652

[startup+1122.3 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952608/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126300 CPUtime=1118.55
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42239 0 0 0 111812 43 0 0 25 0 1 0 334462870 129331200 31039 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31575 31039 86 211 0 31361 0
Current children cumulated CPU time (s) 1121.92
Current children cumulated vsize (KiB) 131652

[startup+1182.3 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952480/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126556 CPUtime=1178.54
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42310 0 0 0 117810 44 0 0 25 0 1 0 334462870 129593344 31045 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31639 31045 86 211 0 31425 0
Current children cumulated CPU time (s) 1181.91
Current children cumulated vsize (KiB) 131908



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952416/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126648 CPUtime=1196.73
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42353 0 0 0 119629 44 0 0 25 0 1 0 334462870 129687552 31088 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31662 31088 86 211 0 31448 0
Current children cumulated CPU time (s) 1200.1
Current children cumulated vsize (KiB) 132000

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 0.99 0.98 0.98 2/79 17612
/proc/meminfo: memFree=952416/2055920 swapFree=4159124/4192956
[pid=17607] ppid=17605 vsize=5352 CPUtime=3.37
/proc/17607/stat : 17607 (rsat.sh) S 17605 17607 16451 0 -1 4194304 305 18272 0 0 0 0 320 17 16 0 1 0 334462532 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 259353273156 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/17607/statm: 1338 234 195 169 0 49 0
[pid=17610] ppid=17607 vsize=126648 CPUtime=1196.73
/proc/17610/stat : 17610 (rsat) R 17607 17607 16451 0 -1 4194304 42353 0 0 0 119629 44 0 0 25 0 1 0 334462870 129687552 31088 18446744073709551615 134512640 135377749 4294956864 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/17610/statm: 31662 31088 86 211 0 31448 0
Current children cumulated CPU time (s) 1200.1
Current children cumulated vsize (KiB) 132000

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 17607 and gives childrusage.ru_utime.tv_sec=3 childrusage.ru_utime.tv_usec=206512 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=176973
CPU time returned by wait4() is 3.38349
while last known CPU time is 1200.1

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.51
CPU time (s): 1200.1
CPU user time (s): 1199.49
CPU system time (s): 0.61
CPU usage (%): 99.9657
Max. virtual memory (cumulated for all children) (KiB): 144220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.20651
system time used= 0.176973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18577
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 74

runsolver used 1.3408 second user time and 3.03654 second system time

The end

Launcher Data (download as text)

Begin job on node1 on Tue Mar  6 01:37:55 UTC 2007

IDJOB= 329614
IDBENCH= 20544
IDSOLVER= 104
FILE ID= node1/329614-1173145074

PBS_JOBID= 4014971

Free space on /tmp= 66506 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/IBM_FV_2002_31_1_rule_1/SAT_dat.k70.cnf
COMMAND LINE= /tmp/evaluation/329614-1173145074/rsat.sh /tmp/evaluation/329614-1173145074/instance-329614-1173145074.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node1/watcher-329614-1173145074 -o ROOT/results/node1/solver-329614-1173145074 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/329614-1173145074/rsat.sh /tmp/evaluation/329614-1173145074/instance-329614-1173145074.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  7df05251eeff9fbbbfcc94a219ac2c0b

RANDOM SEED= 246527997

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node1.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.230
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.230
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1084680 kB
Buffers:         49476 kB
Cached:         822536 kB
SwapCached:      13688 kB
Active:         111216 kB
Inactive:       786600 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1084680 kB
SwapTotal:     4192956 kB
SwapFree:      4159124 kB
Dirty:           12336 kB
Writeback:           0 kB
Mapped:          32832 kB
Slab:            59032 kB
Committed_AS:  1111712 kB
PageTables:       1744 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66499 MiB

End job on node1 on Tue Mar  6 01:57:57 UTC 2007