Trace number 331084

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.05 1200.51

General information on the benchmark

Nameindustrial/vliw_unsat_2.0/
9dlx_vliw_at_b_iq8.cnf
MD5SUM776da55785376fd8eac6989ca812b102
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables371419
Number of clauses7170909
Sum of the clauses size20872419
Maximum clause length205
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 26770451
Number of clauses of size 392326
Number of clauses of size 48862
Number of clauses of size 523554
Number of clauses of size over 5275715

Solver Data (download as text)

0.00/0.00	c Parsing...
0.00/0.00	c num clause = 7170909, num vars = 371419
0.00/0.00	c Exiting...too many clauses
0.00/0.00	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node12/watcher-331084-1173179949 -o ROOT/results/node12/solver-331084-1173179949 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/331084-1173179949/rsat.sh /tmp/evaluation/331084-1173179949/instance-331084-1173179949.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 26945
/proc/meminfo: memFree=1085432/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=888 CPUtime=0
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 22 0 0 0 0 0 0 0 20 0 1 0 337950310 909312 7 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135053028 0 0 4096 0 0 0 0 17 1 0 0
/proc/26947/statm: 222 22 17 211 0 8 0

[startup+0.0376351 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 26945
/proc/meminfo: memFree=1085432/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=57144 CPUtime=0.02
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 623 0 0 0 2 0 0 0 20 0 1 0 337950310 58515456 602 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 14286 602 84 211 0 14072 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 62496

[startup+0.101647 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 26945
/proc/meminfo: memFree=1085432/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=60444 CPUtime=0.08
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 1538 0 0 0 8 0 0 0 20 0 1 0 337950310 61894656 1510 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135037357 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 15111 1512 84 211 0 14897 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 65796

[startup+0.301682 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 26945
/proc/meminfo: memFree=1085432/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=70344 CPUtime=0.28
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 4329 0 0 0 26 2 0 0 20 0 1 0 337950310 72032256 4281 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135037357 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 17586 4282 84 211 0 17372 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 75696

[startup+0.701753 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 26945
/proc/meminfo: memFree=1085432/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=89748 CPUtime=0.68
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 9755 0 0 0 62 6 0 0 24 0 1 0 337950310 91901952 9676 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 22437 9676 84 211 0 22223 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 95100

[startup+1.5019 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=1031592/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=127500 CPUtime=1.48
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 20329 0 0 0 136 12 0 0 25 0 1 0 337950310 130560000 20193 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135037357 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 31875 20193 84 211 0 31661 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 132852

[startup+3.10119 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=976552/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=203004 CPUtime=3.08
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 41472 0 0 0 284 24 0 0 25 0 1 0 337950310 207876096 41205 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 50751 41205 84 211 0 50537 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 208356

[startup+6.30176 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=793192/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=395424 CPUtime=6.28
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 95130 0 0 0 578 50 0 0 25 0 1 0 337950310 404914176 93836 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134984727 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 98889 93840 84 211 0 98675 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 400776

[startup+12.7029 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=695784/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=400564 CPUtime=12.68
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 163544 0 0 0 1205 63 0 0 25 0 1 0 337950310 410177536 98303 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 100141 98303 86 211 0 99927 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 405916

[startup+25.5012 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=691880/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=402152 CPUtime=25.48
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 437902 0 0 0 2427 121 0 0 25 0 1 0 337950310 411803648 99181 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134523176 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 100538 99181 86 211 0 100324 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 407504

[startup+51.1018 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=688488/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=406104 CPUtime=51.07
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 1513155 0 0 0 4766 341 0 0 25 0 1 0 337950310 415850496 100111 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 101526 100111 86 211 0 101312 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 411456

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=681896/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=412600 CPUtime=102.26
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 3454711 0 0 0 9492 734 0 0 25 0 1 0 337950310 422502400 101720 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 103150 101720 86 211 0 102936 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 417952

[startup+162.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=674856/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=419736 CPUtime=162.23
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 5110882 0 0 0 15152 1071 0 0 25 0 1 0 337950310 429809664 103482 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 104934 103482 86 211 0 104720 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 425088

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=668136/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=426536 CPUtime=222.2
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 6896840 0 0 0 20807 1413 0 0 25 0 1 0 337950310 436772864 105154 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 106634 105154 86 211 0 106420 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 431888

[startup+282.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=662632/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=432048 CPUtime=282.19
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 8257998 0 0 0 26540 1679 0 0 25 0 1 0 337950310 442417152 106538 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134526511 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 108012 106541 86 211 0 107798 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 437400

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=655080/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=440760 CPUtime=342.16
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 9530258 0 0 0 32274 1942 0 0 25 0 1 0 337950310 451338240 108424 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 110190 108424 86 211 0 109976 0

################
# More data... #
################

[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=472872 CPUtime=582.08
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 16876238 0 0 0 54746 3462 0 0 25 0 1 0 337950310 484220928 116684 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134522762 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 118218 116684 86 211 0 118004 0
Current children cumulated CPU time (s) 582.08
Current children cumulated vsize (KiB) 478224

[startup+642.303 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=616040/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=478556 CPUtime=642.06
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 18055761 0 0 0 60507 3699 0 0 25 0 1 0 337950310 490041344 118133 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 119639 118133 86 211 0 119425 0
Current children cumulated CPU time (s) 642.06
Current children cumulated vsize (KiB) 483908

[startup+702.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=610280/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=487184 CPUtime=702.03
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 18873457 0 0 0 66361 3842 0 0 25 0 1 0 337950310 498876416 119583 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 121796 119583 86 211 0 121582 0
Current children cumulated CPU time (s) 702.03
Current children cumulated vsize (KiB) 492536

[startup+762.305 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=602600/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=494900 CPUtime=762.01
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 19612575 0 0 0 72223 3978 0 0 25 0 1 0 337950310 506777600 121497 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134526511 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 123634 121463 86 211 0 123420 0
Current children cumulated CPU time (s) 762.01
Current children cumulated vsize (KiB) 500252

[startup+822.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=597864/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=499320 CPUtime=821.99
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 20147036 0 0 0 78125 4074 0 0 25 0 1 0 337950310 511303680 122680 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 124921 122684 86 211 0 124707 0
Current children cumulated CPU time (s) 821.99
Current children cumulated vsize (KiB) 504672

[startup+882.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=586792/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=510128 CPUtime=881.97
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 21282933 0 0 0 83923 4274 0 0 25 0 1 0 337950310 522371072 125436 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 127532 125436 86 211 0 127318 0
Current children cumulated CPU time (s) 881.97
Current children cumulated vsize (KiB) 515480

[startup+942.303 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=579304/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=517316 CPUtime=941.95
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 22137718 0 0 0 89777 4418 0 0 25 0 1 0 337950310 529731584 127295 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134530164 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 129329 127295 86 211 0 129115 0
Current children cumulated CPU time (s) 941.95
Current children cumulated vsize (KiB) 522668

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 3/79 26948
/proc/meminfo: memFree=570536/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=525876 CPUtime=1001.93
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 23066836 0 0 0 95600 4593 0 0 25 0 1 0 337950310 538497024 129472 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 131469 129472 86 211 0 131255 0
Current children cumulated CPU time (s) 1001.93
Current children cumulated vsize (KiB) 531228

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=557416/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=539204 CPUtime=1061.9
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 24295524 0 0 0 101357 4833 0 0 25 0 1 0 337950310 552144896 132830 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 134801 132830 86 211 0 134587 0
Current children cumulated CPU time (s) 1061.9
Current children cumulated vsize (KiB) 544556

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=549032/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=547460 CPUtime=1121.88
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 25295052 0 0 0 107172 5016 0 0 25 0 1 0 337950310 560599040 134885 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134526511 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 136865 134890 108 211 0 136651 0
Current children cumulated CPU time (s) 1121.88
Current children cumulated vsize (KiB) 552812

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=527464/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=569356 CPUtime=1181.86
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 26893096 0 0 0 112853 5333 0 0 25 0 1 0 337950310 583020544 140399 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 134525901 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 142339 140406 86 211 0 142125 0
Current children cumulated CPU time (s) 1181.86
Current children cumulated vsize (KiB) 574708



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=521704/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=573872 CPUtime=1200.05
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 27295779 0 0 0 114595 5410 0 0 25 0 1 0 337950310 587644928 141653 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 143468 141653 86 211 0 143254 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 579224

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/79 26948
/proc/meminfo: memFree=521704/2055920 swapFree=4156600/4192956
[pid=26945] ppid=26943 vsize=5352 CPUtime=0
/proc/26945/stat : 26945 (rsat.sh) S 26943 26945 26233 0 -1 4194304 305 75 0 0 0 0 0 0 18 0 1 0 337950310 5480448 234 18446744073709551615 4194304 4889804 548682069312 18446744073709551615 252429525828 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/26945/statm: 1338 234 195 169 0 49 0
[pid=26947] ppid=26945 vsize=573872 CPUtime=1200.05
/proc/26947/stat : 26947 (rsat) R 26945 26945 26233 0 -1 4194304 27295779 0 0 0 114595 5410 0 0 25 0 1 0 337950310 587644928 141653 18446744073709551615 134512640 135377749 4294956848 18446744073709551615 135041953 0 0 4096 1026 0 0 0 17 1 0 0
/proc/26947/statm: 143468 141653 86 211 0 143254 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 579224

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 26945 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=999 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=2999
CPU time returned by wait4() is 0.003998
while last known CPU time is 1200.05

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.51
CPU time (s): 1200.05
CPU user time (s): 1145.95
CPU system time (s): 54.1
CPU usage (%): 99.9614
Max. virtual memory (cumulated for all children) (KiB): 579324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 380
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 2

runsolver used 1.23281 second user time and 3.14252 second system time

The end

Launcher Data (download as text)

Begin job on node12 on Tue Mar  6 11:19:19 UTC 2007

IDJOB= 331084
IDBENCH= 20579
IDSOLVER= 104
FILE ID= node12/331084-1173179949

PBS_JOBID= 4015021

Free space on /tmp= 66250 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/vliw_unsat_2.0/9dlx_vliw_at_b_iq8.cnf
COMMAND LINE= /tmp/evaluation/331084-1173179949/rsat.sh /tmp/evaluation/331084-1173179949/instance-331084-1173179949.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node12/watcher-331084-1173179949 -o ROOT/results/node12/solver-331084-1173179949 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/331084-1173179949/rsat.sh /tmp/evaluation/331084-1173179949/instance-331084-1173179949.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  776da55785376fd8eac6989ca812b102

RANDOM SEED= 87813626

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node12.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.285
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.285
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1085776 kB
Buffers:         43476 kB
Cached:         830180 kB
SwapCached:      14832 kB
Active:         369308 kB
Inactive:       527160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1085776 kB
SwapTotal:     4192956 kB
SwapFree:      4156600 kB
Dirty:          158160 kB
Writeback:           0 kB
Mapped:          29848 kB
Slab:            59280 kB
Committed_AS:  1583648 kB
PageTables:       1692 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66250 MiB

End job on node12 on Tue Mar  6 11:39:21 UTC 2007