Trace number 1722582

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Rsat 2009-03-22? (TO) 1200.09 1200.71

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_12_UNKNOWN.cnf
MD5SUMd18a114d646a89f18fb3efba2be009e6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1898
Number of clauses118441
Sum of the clauses size352559
Maximum clause length13
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22994
Number of clauses of size 3115424
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.00/0.00	c Parsing...
0.00/0.07	c ==============================================================================
0.00/0.07	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.07	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.07	c ==============================================================================
0.00/0.07	c |         0 |  118441   352559 |   35532       0        0     nan |  0.000 % |
0.69/0.76	c |         0 |  117566   500149 |      --       0       --      -- |     --   | -875/147590
0.69/0.76	c ==============================================================================
0.69/0.76	c Result  :   #vars: 1205   #clauses: 117566   #literals: 500149
0.69/0.76	c CPU time:   0.741887 s
0.69/0.76	c ==============================================================================
0.89/0.93	c Rsat version 3.02
0.97/1.00	c Base unit clause learned: 0

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1722582-1240677122/watcher-1722582-1240677122 -o /tmp/evaluation-result-1722582-1240677122/solver-1722582-1240677122 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/rsat.sh HOME/instance-1722582-1240677122.cnf HOME 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.84 0.95 0.99 3/64 21635
/proc/meminfo: memFree=1827832/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0
/proc/21635/stat : 21635 (rsat.sh) R 21633 21635 21598 0 -1 4194304 270 0 0 0 0 0 0 0 18 0 1 0 95745752 5484544 238 1992294400 4194304 4889804 548682068784 18446744073709551615 238487661215 0 65538 4100 65536 0 0 0 17 0 0 0
/proc/21635/statm: 1339 238 198 169 0 50 0
[pid=21636] ppid=21635 vsize=1656 CPUtime=0
/proc/21636/stat : 21636 (SatElite) R 21635 21635 21598 0 -1 4194304 266 0 0 0 0 0 0 0 18 0 1 0 95745752 1695744 249 1992294400 4194304 4959918 548682068688 18446744073709551615 4414439 0 0 4096 3 0 0 0 17 0 0 0
/proc/21636/statm: 414 255 64 186 0 224 0

[startup+0.0181259 s]
/proc/loadavg: 0.84 0.95 0.99 3/64 21635
/proc/meminfo: memFree=1827832/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 95745752 5484544 239 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21635/statm: 1339 239 199 169 0 50 0
[pid=21636] ppid=21635 vsize=3816 CPUtime=0
/proc/21636/stat : 21636 (SatElite) R 21635 21635 21598 0 -1 4194304 797 0 0 0 0 0 0 0 18 0 1 0 95745752 3907584 780 1992294400 4194304 4959918 548682068688 18446744073709551615 4414439 0 0 4096 3 0 0 0 17 0 0 0
/proc/21636/statm: 954 781 64 186 0 764 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9172

[startup+0.101133 s]
/proc/loadavg: 0.84 0.95 0.99 3/64 21635
/proc/meminfo: memFree=1827832/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 95745752 5484544 239 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21635/statm: 1339 239 199 169 0 50 0
[pid=21636] ppid=21635 vsize=16620 CPUtime=0.09
/proc/21636/stat : 21636 (SatElite) R 21635 21635 21598 0 -1 4194304 3976 0 0 0 8 1 0 0 19 0 1 0 95745752 17018880 3959 1992294400 4194304 4959918 548682068688 18446744073709551615 4240847 0 0 4096 3 0 0 0 17 0 0 0
/proc/21636/statm: 4155 3959 90 186 0 3965 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 21976

[startup+0.301155 s]
/proc/loadavg: 0.84 0.95 0.99 3/64 21635
/proc/meminfo: memFree=1827832/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 95745752 5484544 239 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21635/statm: 1339 239 199 169 0 50 0
[pid=21636] ppid=21635 vsize=19432 CPUtime=0.29
/proc/21636/stat : 21636 (SatElite) R 21635 21635 21598 0 -1 4194304 4658 0 0 0 27 2 0 0 22 0 1 0 95745752 19898368 4641 1992294400 4194304 4959918 548682068688 18446744073709551615 4414439 0 0 4096 3 0 0 0 17 0 0 0
/proc/21636/statm: 4858 4647 90 186 0 4668 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 24788

[startup+0.701202 s]
/proc/loadavg: 0.84 0.95 0.99 3/64 21635
/proc/meminfo: memFree=1827832/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 289 0 0 0 0 0 0 0 18 0 1 0 95745752 5484544 239 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21635/statm: 1339 239 199 169 0 50 0
[pid=21636] ppid=21635 vsize=22072 CPUtime=0.69
/proc/21636/stat : 21636 (SatElite) R 21635 21635 21598 0 -1 4194304 5029 0 0 0 67 2 0 0 25 0 1 0 95745752 22601728 5012 1992294400 4194304 4959918 548682068688 18446744073709551615 4268937 0 0 4096 3 0 0 0 17 0 0 0
/proc/21636/statm: 5518 5012 91 186 0 5328 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 27428

[startup+1.50129 s]
/proc/loadavg: 0.84 0.95 0.99 2/66 21638
/proc/meminfo: memFree=1816936/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=13452 CPUtime=0.56
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 2908 0 0 0 55 1 0 0 22 0 1 0 95745845 13774848 2889 1992294400 4194304 5460562 548682068800 18446744073709551615 4210646 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 3363 2889 116 309 0 3050 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 18808

[startup+3.10247 s]
/proc/loadavg: 0.84 0.95 0.99 2/66 21638
/proc/meminfo: memFree=1812328/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=15532 CPUtime=2.15
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 3394 0 0 0 214 1 0 0 25 0 1 0 95745845 15904768 3375 1992294400 4194304 5460562 548682068800 18446744073709551615 4198156 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 3883 3375 116 309 0 3570 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 20888

[startup+6.30184 s]
/proc/loadavg: 0.85 0.95 0.99 2/66 21638
/proc/meminfo: memFree=1808360/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=19468 CPUtime=5.35
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 4417 0 0 0 532 3 0 0 25 0 1 0 95745845 19935232 4332 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 4867 4332 116 309 0 4554 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 24824

[startup+12.7016 s]
/proc/loadavg: 0.87 0.95 0.99 2/66 21638
/proc/meminfo: memFree=1803760/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=23856 CPUtime=11.75
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 5554 0 0 0 1171 4 0 0 25 0 1 0 95745845 24428544 5339 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 5964 5339 116 309 0 5651 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 29212

[startup+25.502 s]
/proc/loadavg: 0.89 0.95 0.99 2/66 21638
/proc/meminfo: memFree=1801528/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=25952 CPUtime=24.55
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 6584 0 0 0 2450 5 0 0 25 0 1 0 95745845 26574848 5853 1992294400 4194304 5460562 548682068800 18446744073709551615 4205013 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 6488 5853 118 309 0 6175 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 31308

[startup+51.1019 s]
/proc/loadavg: 0.93 0.96 0.99 2/66 21638
/proc/meminfo: memFree=1800440/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=27232 CPUtime=50.11
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 6867 0 0 0 5006 5 0 0 25 0 1 0 95745845 27885568 6136 1992294400 4194304 5460562 548682068800 18446744073709551615 4198156 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 6808 6136 118 309 0 6495 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 32588

[startup+102.306 s]
/proc/loadavg: 0.97 0.96 0.99 2/66 21638
/proc/meminfo: memFree=1798520/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=28680 CPUtime=101.29
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 8248 0 0 0 10123 6 0 0 25 0 1 0 95745845 29368320 6557 1992294400 4194304 5460562 548682068800 18446744073709551615 4198106 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 7170 6557 118 309 0 6857 0
Current children cumulated CPU time (s) 102.2
Current children cumulated vsize (KiB) 34036

[startup+162.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21638
/proc/meminfo: memFree=1797304/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=30088 CPUtime=161.26
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 9029 0 0 0 16120 6 0 0 25 0 1 0 95745845 30810112 6858 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 7522 6858 118 309 0 7209 0
Current children cumulated CPU time (s) 162.17
Current children cumulated vsize (KiB) 35444

[startup+222.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21638
/proc/meminfo: memFree=1795896/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=31828 CPUtime=221.24
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 10360 0 0 0 22116 8 0 0 25 0 1 0 95745845 32591872 7229 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 7957 7229 118 309 0 7644 0
Current children cumulated CPU time (s) 222.15
Current children cumulated vsize (KiB) 37184

[startup+282.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21638
/proc/meminfo: memFree=1796344/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=31136 CPUtime=281.2
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 11144 0 0 0 28112 8 0 0 25 0 1 0 95745845 31883264 7155 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 7784 7155 118 309 0 7471 0
Current children cumulated CPU time (s) 282.11
Current children cumulated vsize (KiB) 36492

[startup+342.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21638
/proc/meminfo: memFree=1793400/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=33600 CPUtime=341.18
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 12790 0 0 0 34109 9 0 0 25 0 1 0 95745845 34406400 7841 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 8400 7841 118 309 0 8087 0

################
# More data... #
################

/proc/21638/statm: 10530 9825 118 309 0 10217 0
Current children cumulated CPU time (s) 581.98
Current children cumulated vsize (KiB) 47476

[startup+642.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1778744/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=49020 CPUtime=641.04
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 21527 0 0 0 64090 14 0 0 25 0 1 0 95745845 50196480 11420 1992294400 4194304 5460562 548682068800 18446744073709551615 4198137 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 12255 11420 118 309 0 11942 0
Current children cumulated CPU time (s) 641.95
Current children cumulated vsize (KiB) 54376

[startup+702.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1778104/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=49020 CPUtime=701.02
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 22668 0 0 0 70087 15 0 0 25 0 1 0 95745845 50196480 11569 1992294400 4194304 5460562 548682068800 18446744073709551615 4198137 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 12255 11569 118 309 0 11942 0
Current children cumulated CPU time (s) 701.93
Current children cumulated vsize (KiB) 54376

[startup+762.306 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1775032/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=52816 CPUtime=761
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 24414 0 0 0 76084 16 0 0 25 0 1 0 95745845 54083584 12323 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 13204 12323 118 309 0 12891 0
Current children cumulated CPU time (s) 761.91
Current children cumulated vsize (KiB) 58172

[startup+822.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1775032/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=52816 CPUtime=820.97
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 24416 0 0 0 82081 16 0 0 25 0 1 0 95745845 54083584 12325 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 13204 12325 118 309 0 12891 0
Current children cumulated CPU time (s) 821.88
Current children cumulated vsize (KiB) 58172

[startup+882.302 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1769784/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=57908 CPUtime=880.94
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 26680 0 0 0 88077 17 0 0 25 0 1 0 95745845 59297792 13597 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14477 13597 118 309 0 14164 0
Current children cumulated CPU time (s) 881.85
Current children cumulated vsize (KiB) 63264

[startup+942.301 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1769784/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=57908 CPUtime=940.89
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 26710 0 0 0 94072 17 0 0 25 0 1 0 95745845 59297792 13627 1992294400 4194304 5460562 548682068800 18446744073709551615 4198137 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14477 13627 118 309 0 14164 0
Current children cumulated CPU time (s) 941.8
Current children cumulated vsize (KiB) 63264

[startup+1002.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1768568/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=58280 CPUtime=1000.86
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 27994 0 0 0 100068 18 0 0 25 0 1 0 95745845 59678720 13919 1992294400 4194304 5460562 548682068800 18446744073709551615 4198172 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14570 13919 118 309 0 14257 0
Current children cumulated CPU time (s) 1001.77
Current children cumulated vsize (KiB) 63636

[startup+1062.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1768504/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=58280 CPUtime=1060.84
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 28005 0 0 0 106066 18 0 0 25 0 1 0 95745845 59678720 13930 1992294400 4194304 5460562 548682068800 18446744073709551615 4198165 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14570 13930 118 309 0 14257 0
Current children cumulated CPU time (s) 1061.75
Current children cumulated vsize (KiB) 63636

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1768440/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=58280 CPUtime=1120.81
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 28005 0 0 0 112063 18 0 0 25 0 1 0 95745845 59678720 13930 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14570 13930 118 309 0 14257 0
Current children cumulated CPU time (s) 1121.72
Current children cumulated vsize (KiB) 63636

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1768376/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=58280 CPUtime=1180.79
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 28005 0 0 0 118061 18 0 0 25 0 1 0 95745845 59678720 13930 1992294400 4194304 5460562 548682068800 18446744073709551615 4198064 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14570 13930 118 309 0 14257 0
Current children cumulated CPU time (s) 1181.7
Current children cumulated vsize (KiB) 63636



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.7 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1768376/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=58280 CPUtime=1199.18
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 28005 0 0 0 119900 18 0 0 25 0 1 0 95745845 59678720 13930 1992294400 4194304 5460562 548682068800 18446744073709551615 4198137 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14570 13930 118 309 0 14257 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 63636

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.7 s]
/proc/loadavg: 0.99 0.97 0.99 2/66 21640
/proc/meminfo: memFree=1768376/2055920 swapFree=4180792/4192956
[pid=21635] ppid=21633 vsize=5356 CPUtime=0.91
/proc/21635/stat : 21635 (rsat.sh) S 21633 21635 21598 0 -1 4194304 312 5034 0 0 0 0 88 3 16 0 1 0 95745752 5484544 241 1992294400 4194304 4889804 548682068784 18446744073709551615 238487659332 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21635/statm: 1339 241 199 169 0 50 0
[pid=21638] ppid=21635 vsize=58280 CPUtime=1199.18
/proc/21638/stat : 21638 (rsat) R 21635 21635 21598 0 -1 4194304 28005 0 0 0 119900 18 0 0 25 0 1 0 95745845 59678720 13930 1992294400 4194304 5460562 548682068800 18446744073709551615 4198137 0 0 4096 1026 0 0 0 17 0 0 0
/proc/21638/statm: 14570 13930 118 309 0 14257 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 63636

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21635 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=889864
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=39993
# CPU time returned by wait4() is 0.929857
# while last known CPU time is 1200.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.71
CPU time (s): 1200.09
CPU user time (s): 1199.88
CPU system time (s): 0.21
CPU usage (%): 99.948
Max. virtual memory (cumulated for all children) (KiB): 67732

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.889864
system time used= 0.039993
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5346
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 5

runsolver used 1.08283 second user time and 3.2945 second system time

The end

Launcher Data 

Begin job on node23 at 2009-04-25 18:32:02
IDJOB=1722582
IDBENCH=71092
IDSOLVER=545
FILE ID=node23/1722582-1240677122
PBS_JOBID= 9186663
Free space on /tmp= 66320 MiB

SOLVER NAME= Rsat 2009-03-22
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_12_UNKNOWN.cnf
COMMAND LINE= HOME/rsat.sh BENCHNAME TMPDIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1722582-1240677122/watcher-1722582-1240677122 -o /tmp/evaluation-result-1722582-1240677122/solver-1722582-1240677122 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/rsat.sh HOME/instance-1722582-1240677122.cnf HOME

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= d18a114d646a89f18fb3efba2be009e6
RANDOM SEED=1299398755

node23.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1828384 kB
Buffers:         21148 kB
Cached:         157052 kB
SwapCached:       5944 kB
Active:          75192 kB
Inactive:       111680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1828384 kB
SwapTotal:     4192956 kB
SwapFree:      4180792 kB
Dirty:            7940 kB
Writeback:           0 kB
Mapped:          13868 kB
Slab:            26760 kB
Committed_AS:   396360 kB
PageTables:       1388 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66312 MiB
End job on node23 at 2009-04-25 18:52:05