Trace number 1529466

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
HydraSAT-Multi 2009-03-22-Multi? (TO) 1200.03 1200.51

General information on the benchmark

NameRANDOM/LARGE/7SAT/UNKNOWN/160/
unif-k7-r85-v160-c13600-S327274323-044.cnf
MD5SUM828620c36787edb17d919cfe2c324682
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables160
Number of clauses13600
Sum of the clauses size95200
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 513600

Solver Data 

0.00/0.00	c Trying configuration 1
700.03/700.31	HOME/hydrasat-multi.sh: line 48:  6209 CPU time limit exceeded (core dumped) $SOLVER1 $BENCHNAME $OPTIONS1
700.03/700.31	c Trying configuration 2

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1529466-1238384755/watcher-1529466-1238384755 -o /tmp/evaluation-result-1529466-1238384755/solver-1529466-1238384755 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/hydrasat-multi.sh HOME HOME/instance-1529466-1238384755.cnf 1800 497788157 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 6208
/proc/meminfo: memFree=1544488/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=1584 CPUtime=0
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 172 0 0 0 0 0 0 0 18 0 1 0 1111141154 1622016 154 1992294400 134512640 135813592 4294956176 18446744073709551615 135207862 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 396 154 116 317 0 76 0

[startup+0.0928361 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 6208
/proc/meminfo: memFree=1544488/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=3060 CPUtime=0.08
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 567 0 0 0 8 0 0 0 18 0 1 0 1111141154 3133440 549 1992294400 134512640 135813592 4294956176 18446744073709551615 134521120 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 765 549 123 317 0 445 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 8420

[startup+0.102837 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 6208
/proc/meminfo: memFree=1544488/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=3060 CPUtime=0.09
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 567 0 0 0 9 0 0 0 18 0 1 0 1111141154 3133440 549 1992294400 134512640 135813592 4294956176 18446744073709551615 134676855 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 765 549 123 317 0 445 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 8420

[startup+0.302875 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 6208
/proc/meminfo: memFree=1544488/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=3060 CPUtime=0.29
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 569 0 0 0 29 0 0 0 19 0 1 0 1111141154 3133440 551 1992294400 134512640 135813592 4294956176 18446744073709551615 135224161 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 765 551 125 317 0 445 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 8420

[startup+0.701953 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 6208
/proc/meminfo: memFree=1544488/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=3724 CPUtime=0.69
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 749 0 0 0 69 0 0 0 22 0 1 0 1111141154 3813376 730 1992294400 134512640 135813592 4294956176 18446744073709551615 134592202 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 931 730 150 317 0 611 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 9084

[startup+1.50111 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1541720/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=3984 CPUtime=1.49
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 812 0 0 0 149 0 0 0 25 0 1 0 1111141154 4079616 793 1992294400 134512640 135813592 4294956176 18446744073709551615 134664993 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 996 793 150 317 0 676 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 9344

[startup+3.10142 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1541272/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=4632 CPUtime=3.09
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 965 0 0 0 309 0 0 0 25 0 1 0 1111141154 4743168 946 1992294400 134512640 135813592 4294956176 18446744073709551615 134665338 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 1158 946 150 317 0 838 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 9992

[startup+6.30104 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1540760/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=4632 CPUtime=6.28
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 965 0 0 0 628 0 0 0 25 0 1 0 1111141154 4743168 946 1992294400 134512640 135813592 4294956176 18446744073709551615 134664971 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 1158 946 150 317 0 838 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 9992

[startup+12.7013 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1539872/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=5568 CPUtime=12.68
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 1197 0 0 0 1268 0 0 0 25 0 1 0 1111141154 5701632 1178 1992294400 134512640 135813592 4294956176 18446744073709551615 135224171 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 1392 1178 150 317 0 1072 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 10928

[startup+25.5028 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1539488/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=5968 CPUtime=25.48
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 1281 0 0 0 2547 1 0 0 25 0 1 0 1111141154 6111232 1262 1992294400 134512640 135813592 4294956176 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 1492 1262 150 317 0 1172 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 11328

[startup+51.1027 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1538720/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=7036 CPUtime=51.07
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 1529 0 0 0 5106 1 0 0 25 0 1 0 1111141154 7204864 1510 1992294400 134512640 135813592 4294956176 18446744073709551615 134665944 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 1759 1510 150 317 0 1439 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 12396

[startup+102.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1534368/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=11416 CPUtime=102.26
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 2589 0 0 0 10224 2 0 0 25 0 1 0 1111141154 11689984 2570 1992294400 134512640 135813592 4294956176 18446744073709551615 134665345 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 2854 2570 150 317 0 2534 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 16776

[startup+162.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1530336/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=15980 CPUtime=162.22
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 3692 0 0 0 16220 2 0 0 25 0 1 0 1111141154 16363520 3562 1992294400 134512640 135813592 4294956176 18446744073709551615 134665490 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 3995 3562 150 317 0 3675 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 21340

[startup+222.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1524512/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=22572 CPUtime=222.2
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 5153 0 0 0 22216 4 0 0 25 0 1 0 1111141154 23113728 5023 1992294400 134512640 135813592 4294956176 18446744073709551615 134665745 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 5643 5023 150 317 0 5323 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 27932

[startup+282.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1519584/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=27948 CPUtime=282.18
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 6500 0 0 0 28212 6 0 0 25 0 1 0 1111141154 28618752 6249 1992294400 134512640 135813592 4294956176 18446744073709551615 134665314 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 6987 6249 150 317 0 6667 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 33308

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1515104/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=32800 CPUtime=342.16
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 7622 0 0 0 34209 7 0 0 25 0 1 0 1111141154 33587200 7371 1992294400 134512640 135813592 4294956176 18446744073709551615 134665041 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 8200 7371 150 317 0 7880 0

################
# More data... #
################

/proc/6209/statm: 10181 9249 150 317 0 9861 0
Current children cumulated CPU time (s) 582.07
Current children cumulated vsize (KiB) 46084

[startup+642.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6210
/proc/meminfo: memFree=1506784/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5360 CPUtime=0
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 1111141154 5488640 239 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/6208/statm: 1340 239 197 169 0 51 0
[pid=6209] ppid=6208 vsize=41768 CPUtime=642.05
/proc/6209/stat : 6209 (hydrasat_cache4) R 6208 6208 6141 0 -1 4194304 9853 0 0 0 64194 11 0 0 25 0 1 0 1111141154 42770432 9441 1992294400 134512640 135813592 4294956176 18446744073709551615 134665074 0 0 4096 1 0 0 0 17 1 0 0
/proc/6209/statm: 10442 9441 150 317 0 10122 0
Current children cumulated CPU time (s) 642.05
Current children cumulated vsize (KiB) 47128

[startup+702.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6211
/proc/meminfo: memFree=1504096/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=3364 CPUtime=1.98
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 657 0 0 0 198 0 0 0 25 0 1 0 1111211185 3444736 640 1992294400 134512640 135995732 4294956032 18446744073709551615 134808032 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 841 640 172 362 0 476 0
Current children cumulated CPU time (s) 702.02
Current children cumulated vsize (KiB) 8728

[startup+762.306 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6211
/proc/meminfo: memFree=1499424/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=8764 CPUtime=61.95
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 1972 0 0 0 6194 1 0 0 25 0 1 0 1111211185 8974336 1955 1992294400 134512640 135995732 4294956032 18446744073709551615 134806544 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 2191 1955 172 362 0 1826 0
Current children cumulated CPU time (s) 761.99
Current children cumulated vsize (KiB) 14128

[startup+822.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6211
/proc/meminfo: memFree=1496352/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=12184 CPUtime=121.93
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 2754 0 0 0 12191 2 0 0 25 0 1 0 1111211185 12476416 2737 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 3046 2737 172 362 0 2681 0
Current children cumulated CPU time (s) 821.97
Current children cumulated vsize (KiB) 17548

[startup+882.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6211
/proc/meminfo: memFree=1493024/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=15580 CPUtime=181.91
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 3587 0 0 0 18187 4 0 0 25 0 1 0 1111211185 15953920 3536 1992294400 134512640 135995732 4294956032 18446744073709551615 135365630 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 3895 3536 172 362 0 3530 0
Current children cumulated CPU time (s) 881.95
Current children cumulated vsize (KiB) 20944

[startup+942.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1488864/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=20108 CPUtime=241.89
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 4643 0 0 0 24184 5 0 0 25 0 1 0 1111211185 20590592 4592 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 5027 4592 172 362 0 4662 0
Current children cumulated CPU time (s) 941.93
Current children cumulated vsize (KiB) 25472

[startup+1002.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1483872/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=25208 CPUtime=301.86
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 5952 0 0 0 30180 6 0 0 25 0 1 0 1111211185 25812992 5820 1992294400 134512640 135995732 4294956032 18446744073709551615 134807897 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 6302 5820 172 362 0 5937 0
Current children cumulated CPU time (s) 1001.9
Current children cumulated vsize (KiB) 30572

[startup+1062.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1479840/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=29560 CPUtime=361.84
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 6983 0 0 0 36176 8 0 0 25 0 1 0 1111211185 30269440 6851 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 7390 6851 172 362 0 7025 0
Current children cumulated CPU time (s) 1061.88
Current children cumulated vsize (KiB) 34924

[startup+1122.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1477152/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=32364 CPUtime=421.82
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 7721 0 0 0 42172 10 0 0 25 0 1 0 1111211185 33140736 7492 1992294400 134512640 135995732 4294956032 18446744073709551615 134807726 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 8091 7492 172 362 0 7726 0
Current children cumulated CPU time (s) 1121.86
Current children cumulated vsize (KiB) 37728

[startup+1182.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1473760/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=35832 CPUtime=481.79
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 8569 0 0 0 48168 11 0 0 25 0 1 0 1111211185 36691968 8340 1992294400 134512640 135995732 4294956032 18446744073709551615 134808175 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 8958 8340 172 362 0 8593 0
Current children cumulated CPU time (s) 1181.83
Current children cumulated vsize (KiB) 41196



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1473760/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=35832 CPUtime=499.99
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 8569 0 0 0 49988 11 0 0 25 0 1 0 1111211185 36691968 8340 1992294400 134512640 135995732 4294956032 18446744073709551615 134807853 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 8958 8340 172 362 0 8593 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 41196

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.5 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 6217
/proc/meminfo: memFree=1473760/2055920 swapFree=4179368/4192956
[pid=6208] ppid=6206 vsize=5364 CPUtime=700.04
/proc/6208/stat : 6208 (hydrasat-multi.) S 6206 6208 6141 0 -1 4194304 322 10726 0 0 0 0 69977 27 16 0 1 0 1111141154 5492736 245 1992294400 4194304 4889804 548682068736 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/6208/statm: 1341 245 202 169 0 52 0
[pid=6211] ppid=6208 vsize=35832 CPUtime=499.99
/proc/6211/stat : 6211 (hydrasat_cachew) R 6208 6208 6141 0 -1 4194304 8569 0 0 0 49988 11 0 0 25 0 1 0 1111211185 36691968 8340 1992294400 134512640 135995732 4294956032 18446744073709551615 134807853 0 0 4096 1 0 0 0 17 1 0 0
/proc/6211/statm: 8958 8340 172 362 0 8593 0
Current children cumulated CPU time (s) 1200.03
Current children cumulated vsize (KiB) 41196

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6208 and gives
#  childrusage.ru_utime.tv_sec=699
#  childrusage.ru_utime.tv_usec=778617
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=273958
# CPU time returned by wait4() is 700.053
# while last known CPU time is 1200.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.51
CPU time (s): 1200.03
CPU user time (s): 1199.65
CPU system time (s): 0.38
CPU usage (%): 99.9599
Max. virtual memory (cumulated for all children) (KiB): 47288

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 699.779
system time used= 0.273958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11048
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 610

runsolver used 1.3128 second user time and 3.06353 second system time

The end

Launcher Data 

Begin job on node23 at 2009-03-30 05:45:55
IDJOB=1529466
IDBENCH=70273
IDSOLVER=518
FILE ID=node23/1529466-1238384755
PBS_JOBID= 9061342
Free space on /tmp= 66452 MiB

SOLVER NAME= HydraSAT-Multi 2009-03-22-Multi
BENCH NAME= SAT09/RANDOM/LARGE/7SAT/UNKNOWN/160/unif-k7-r85-v160-c13600-S327274323-044.cnf
COMMAND LINE= DIR/hydrasat-multi.sh DIR BENCHNAME MEMLIMIT RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1529466-1238384755/watcher-1529466-1238384755 -o /tmp/evaluation-result-1529466-1238384755/solver-1529466-1238384755 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/hydrasat-multi.sh HOME HOME/instance-1529466-1238384755.cnf 1800 497788157

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 828620c36787edb17d919cfe2c324682
RANDOM SEED=497788157

node23.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1544968 kB
Buffers:         97676 kB
Cached:         310984 kB
SwapCached:       7500 kB
Active:          77552 kB
Inactive:       340000 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1544968 kB
SwapTotal:     4192956 kB
SwapFree:      4179368 kB
Dirty:            4428 kB
Writeback:           0 kB
Mapped:          14672 kB
Slab:            79488 kB
Committed_AS:  2950324 kB
PageTables:       1392 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66412 MiB
End job on node23 at 2009-03-30 06:05:57