Trace number 314980

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2007-02-08? (TO) 1200.02 1200.51

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-8-ipc5-h18-unsat.cnf
MD5SUMb3381a58cbbd64d5d90a3b4fcd44bf6d
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables338487
Number of clauses1187589
Sum of the clauses size2886289
Maximum clause length57
Minimum clause length1
Number of clauses of size 1256
Number of clauses of size 2849854
Number of clauses of size 3326098
Number of clauses of size 4798
Number of clauses of size 5544
Number of clauses of size over 510039

Solver Data (download as text)

0.00/0.00	c Parsing...
1.19/1.30	c ==============================================================================
1.19/1.30	c |           |     ORIGINAL     |              LEARNT              |          |
1.19/1.30	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
1.19/1.30	c ==============================================================================
1.19/1.30	c |         0 | 1186821  2884753 |  356046       0        0     nan |  0.000 % |
20.56/20.60	c |         0 |  571173  2544294 |      --       0       --      -- |     --   | -615648/-340459
20.56/20.61	c ==============================================================================
20.56/20.61	c Result  :   #vars: 40759   #clauses: 571173   #literals: 2544294
20.56/20.61	c CPU time:   20.0669 s
20.56/20.61	c ==============================================================================
21.66/21.74	c Rsat version 2.00

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node33/watcher-314980-1172646623 -o ROOT/results/node33/solver-314980-1172646623 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/314980-1172646623/rsat.sh /tmp/evaluation/314980-1172646623/instance-314980-1172646623.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.95 3/64 18203
/proc/meminfo: memFree=1231704/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=688 CPUtime=0
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 106 0 0 0 0 0 0 0 19 0 1 0 189697711 704512 88 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134548217 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 205 91 49 128 0 74 0

[startup+0.0946849 s]
/proc/loadavg: 0.91 0.95 0.95 3/64 18203
/proc/meminfo: memFree=1231704/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=10848 CPUtime=0.08
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 2482 0 0 0 7 1 0 0 19 0 1 0 189697711 11108352 2464 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 2712 2465 50 128 0 2581 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 16200

[startup+0.101685 s]
/proc/loadavg: 0.91 0.95 0.95 3/64 18203
/proc/meminfo: memFree=1231704/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=11244 CPUtime=0.08
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 2653 0 0 0 7 1 0 0 19 0 1 0 189697711 11513856 2635 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 2811 2636 50 128 0 2680 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 16596

[startup+0.301726 s]
/proc/loadavg: 0.91 0.95 0.95 3/64 18203
/proc/meminfo: memFree=1231704/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=36836 CPUtime=0.29
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 8005 0 0 0 24 5 0 0 21 0 1 0 189697711 37720064 7987 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134699389 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 9209 7988 50 128 0 9078 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 42188

[startup+0.701808 s]
/proc/loadavg: 0.91 0.95 0.95 3/64 18203
/proc/meminfo: memFree=1231704/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=80484 CPUtime=0.69
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 18554 0 0 0 56 13 0 0 24 0 1 0 189697711 82415616 18536 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134681971 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 20121 18537 50 128 0 19990 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 85836

[startup+1.50197 s]
/proc/loadavg: 0.91 0.95 0.95 2/66 18205
/proc/meminfo: memFree=1128200/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=170316 CPUtime=1.49
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 36849 0 0 0 126 23 0 0 25 0 1 0 189697711 174403584 35999 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 42579 35999 69 128 0 42448 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 175668

[startup+3.1013 s]
/proc/loadavg: 0.91 0.95 0.95 2/66 18205
/proc/meminfo: memFree=1084872/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=175084 CPUtime=3.09
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 37975 0 0 0 282 27 0 0 25 0 1 0 189697711 179286016 37125 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134699485 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 43771 37125 69 128 0 43640 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 180436

[startup+6.30196 s]
/proc/loadavg: 1.00 0.97 0.96 2/66 18205
/proc/meminfo: memFree=1061256/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=191492 CPUtime=6.28
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 41246 0 0 0 593 35 0 0 25 0 1 0 189697711 196087808 40396 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134543657 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 47873 40396 69 128 0 47742 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 196844

[startup+12.7013 s]
/proc/loadavg: 1.08 0.99 0.96 2/66 18205
/proc/meminfo: memFree=1024016/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=0
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 284 0 0 0 0 0 0 0 18 0 1 0 189697711 5480448 233 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18203/statm: 1338 233 195 169 0 49 0
[pid=18204] ppid=18203 vsize=202192 CPUtime=12.67
/proc/18204/stat : 18204 (SatElite) R 18203 18203 16752 0 -1 4194304 44371 0 0 0 1219 48 0 0 25 0 1 0 189697711 207044608 42848 18446744073709551615 134512640 135038345 4294956688 18446744073709551615 134543859 0 0 4096 3 0 0 0 17 1 0 0
/proc/18204/statm: 50548 42848 69 128 0 50417 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 207544

[startup+25.5019 s]
/proc/loadavg: 1.13 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1143888/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=40204 CPUtime=3.75
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 10087 0 0 0 370 5 0 0 25 0 1 0 189699886 41168896 9778 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522833 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 10051 9778 86 211 0 9837 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 45556

[startup+51.1012 s]
/proc/loadavg: 1.08 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1140816/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=43940 CPUtime=29.34
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 11011 0 0 0 2928 6 0 0 25 0 1 0 189699886 44994560 10669 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 10985 10669 86 211 0 10771 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 49292

[startup+102.306 s]
/proc/loadavg: 1.04 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1135632/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=49224 CPUtime=80.52
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 12442 0 0 0 8044 8 0 0 25 0 1 0 189699886 50405376 11999 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 12306 11999 86 211 0 12092 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 54576

[startup+162.303 s]
/proc/loadavg: 1.01 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1130192/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=55052 CPUtime=140.5
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 13989 0 0 0 14040 10 0 0 25 0 1 0 189699886 56373248 13352 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529452 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 13763 13352 86 211 0 13549 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 60404

[startup+222.301 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1123536/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=61176 CPUtime=200.47
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 15631 0 0 0 20035 12 0 0 25 0 1 0 189699886 62644224 14991 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 15294 14991 86 211 0 15080 0
Current children cumulated CPU time (s) 222.17
Current children cumulated vsize (KiB) 66528

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1118352/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=67524 CPUtime=260.45
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 17309 0 0 0 26031 14 0 0 25 0 1 0 189699886 69144576 16282 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134524162 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 16881 16282 86 211 0 16667 0
Current children cumulated CPU time (s) 282.15
Current children cumulated vsize (KiB) 72876

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18206
/proc/meminfo: memFree=1113360/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=72052 CPUtime=320.44
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 18537 0 0 0 32028 16 0 0 25 0 1 0 189699886 73781248 17500 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 18013 17500 86 211 0 17799 0

################
# More data... #
################

[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=74008 CPUtime=560.34
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 20616 0 0 0 56017 17 0 0 25 0 1 0 189699886 75784192 18036 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134530101 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 18502 18036 86 211 0 18288 0
Current children cumulated CPU time (s) 582.04
Current children cumulated vsize (KiB) 79360

[startup+642.302 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1111248/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=74008 CPUtime=620.33
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 20616 0 0 0 62015 18 0 0 25 0 1 0 189699886 75784192 18036 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 18502 18036 86 211 0 18288 0
Current children cumulated CPU time (s) 642.03
Current children cumulated vsize (KiB) 79360

[startup+702.301 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1109008/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=76256 CPUtime=680.31
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 21196 0 0 0 68012 19 0 0 25 0 1 0 189699886 78086144 18612 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 19064 18612 86 211 0 18850 0
Current children cumulated CPU time (s) 702.01
Current children cumulated vsize (KiB) 81608

[startup+762.305 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1103952/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=80860 CPUtime=740.29
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 22433 0 0 0 74008 21 0 0 25 0 1 0 189699886 82800640 19839 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134530216 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 20215 19839 86 211 0 20001 0
Current children cumulated CPU time (s) 761.99
Current children cumulated vsize (KiB) 86212

[startup+822.303 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1098768/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=85744 CPUtime=800.26
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 23771 0 0 0 80004 22 0 0 25 0 1 0 189699886 87801856 21169 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 21436 21169 86 211 0 21222 0
Current children cumulated CPU time (s) 821.96
Current children cumulated vsize (KiB) 91096

[startup+882.301 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093648/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93608 CPUtime=860.24
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 25810 0 0 0 86000 24 0 0 25 0 1 0 189699886 95854592 22421 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23402 22421 86 211 0 23188 0
Current children cumulated CPU time (s) 881.94
Current children cumulated vsize (KiB) 98960

[startup+942.301 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093136/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=920.21
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 91996 25 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522794 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 941.91
Current children cumulated vsize (KiB) 99236

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093136/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=980.2
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 97994 26 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 1001.9
Current children cumulated vsize (KiB) 99236

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093136/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=1040.18
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 103992 26 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134523268 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 1061.88
Current children cumulated vsize (KiB) 99236

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093200/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=1100.15
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 109989 26 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522801 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 99236

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093200/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=1160.13
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 115987 26 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134522788 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 1181.83
Current children cumulated vsize (KiB) 99236



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093200/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=1178.32
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 117806 26 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 99236

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 0.97 2/66 18208
/proc/meminfo: memFree=1093200/2055920 swapFree=4181868/4192956
[pid=18203] ppid=18201 vsize=5352 CPUtime=21.7
/proc/18203/stat : 18203 (rsat.sh) S 18201 18203 16752 0 -1 4194304 306 51530 0 0 0 0 2109 61 18 0 1 0 189697711 5480448 234 18446744073709551615 4194304 4889804 548682069248 18446744073709551615 210824127300 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18203/statm: 1338 234 195 169 0 49 0
[pid=18206] ppid=18203 vsize=93884 CPUtime=1178.32
/proc/18206/stat : 18206 (rsat) R 18203 18203 16752 0 -1 4194304 28975 0 0 0 117806 26 0 0 25 0 1 0 189699886 96137216 22510 18446744073709551615 134512640 135377749 4294956784 18446744073709551615 134529141 0 0 4096 1026 0 0 0 17 1 0 0
/proc/18206/statm: 23471 22510 86 211 0 23257 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 99236

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 18203 and gives childrusage.ru_utime.tv_sec=21 childrusage.ru_utime.tv_usec=97792 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=617906
CPU time returned by wait4() is 21.7157
while last known CPU time is 1200.02

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1200.51
CPU time (s): 1200.02
CPU user time (s): 1199.15
CPU system time (s): 0.87
CPU usage (%): 99.959
Max. virtual memory (cumulated for all children) (KiB): 224152

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 21.0978
system time used= 0.617906
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51836
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 64

runsolver used 1.13283 second user time and 2.77458 second system time

The end

Launcher Data (download as text)

Begin job on node33 on Wed Feb 28 07:10:24 UTC 2007

IDJOB= 314980
IDBENCH= 20405
IDSOLVER= 104
FILE ID= node33/314980-1172646623

PBS_JOBID= 3981163

Free space on /tmp= 66503 MiB

SOLVER NAME= Rsat 2007-02-08
BENCH NAME= HOME/pub/bench/SAT07/industrial/palacias/hard/sortnet-8-ipc5-h18-unsat.cnf
COMMAND LINE= /tmp/evaluation/314980-1172646623/rsat.sh /tmp/evaluation/314980-1172646623/instance-314980-1172646623.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node33/watcher-314980-1172646623 -o ROOT/results/node33/solver-314980-1172646623 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/314980-1172646623/rsat.sh /tmp/evaluation/314980-1172646623/instance-314980-1172646623.cnf            

META MD5SUM SOLVER= 42fb71d21991acbdd759c16645f65450
MD5SUM BENCH=  b3381a58cbbd64d5d90a3b4fcd44bf6d

RANDOM SEED= 664206751

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node33.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1232112 kB
Buffers:         25480 kB
Cached:         723820 kB
SwapCached:       5296 kB
Active:         109196 kB
Inactive:       651348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1232112 kB
SwapTotal:     4192956 kB
SwapFree:      4181868 kB
Dirty:           23148 kB
Writeback:           0 kB
Mapped:          15264 kB
Slab:            49328 kB
Committed_AS:   309240 kB
PageTables:       1408 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66457 MiB

End job on node33 on Wed Feb 28 07:30:27 UTC 2007