Trace number 3263701

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
riss Auto? (TO) 1300.03 1300.01

General information on the benchmark

NameSAT03/handmade/anton/SAT/
SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf
MD5SUM22bbcb4a25a1da66113c240898c75509
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.19197
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses28508
Sum of the clauses size57436
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 228493
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 515

Solver Data 

0.00/0.01	c *****************************************************
0.00/0.01	c *        riss, Copyright 2009 Norbert Manthey       *
0.00/0.01	c *   This program may be redistributed or modified   *
0.00/0.01	c * under the terms of the GNU General Public License *
0.00/0.01	c *****************************************************
0.00/0.01	c process id: 16338
0.00/0.01	c setup for 2400s
0.00/0.02	c parsetime: 5755us
0.00/0.02	c parsed 28508 clauses with 450 variables
1.19/1.22	c init all components done
1.19/1.22	c ====================
1.19/1.22	c trail size: 0

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263701-1304141867/watcher-3263701-1304141867 -o /tmp/evaluation-result-3263701-1304141867/solver-3263701-1304141867 -C 2400 -W 1300 -M 7680 HOME/rissAuto.sh HOME HOME/instance-3263701-1304141867.cnf 723476690 2400 7680 2 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.04 4.03 4.20 4/182 16337
/proc/meminfo: memFree=29486368/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0

[startup+0.040489 s]
/proc/loadavg: 4.04 4.03 4.20 4/182 16337
/proc/meminfo: memFree=29486368/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100482 s]
/proc/loadavg: 4.04 4.03 4.20 4/182 16337
/proc/meminfo: memFree=29486368/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300453 s]
/proc/loadavg: 4.04 4.03 4.20 4/182 16337
/proc/meminfo: memFree=29486368/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700372 s]
/proc/loadavg: 4.04 4.03 4.20 4/182 16337
/proc/meminfo: memFree=29486368/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50023 s]
/proc/loadavg: 3.96 4.01 4.19 5/194 16357
/proc/meminfo: memFree=29375300/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=54976 CPUtime=1.49 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 11389 0 0 0 148 1 0 0 20 0 1 0 506602053 56295424 9754 33554432000 4194304 5523604 140737403197920 18446744073709551615 5330811 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 13744 9754 374 325 0 9558 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 63676

[startup+3.10094 s]
/proc/loadavg: 3.96 4.01 4.19 5/194 16357
/proc/meminfo: memFree=29367808/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=56456 CPUtime=3.09 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 11754 0 0 0 308 1 0 0 25 0 1 0 506602053 57810944 10119 33554432000 4194304 5523604 140737403197920 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 14114 10119 374 325 0 9928 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 65156

[startup+6.30037 s]
/proc/loadavg: 3.96 4.01 4.19 5/194 16357
/proc/meminfo: memFree=29357764/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=59144 CPUtime=6.29 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 12432 0 0 0 628 1 0 0 25 0 1 0 506602053 60563456 10797 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333268 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 14786 10797 374 325 0 10600 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 67844

[startup+12.7002 s]
/proc/loadavg: 3.96 4.01 4.19 5/194 16357
/proc/meminfo: memFree=29346200/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=65268 CPUtime=12.69 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 13842 0 0 0 1267 2 0 0 25 0 1 0 506602053 66834432 12207 33554432000 4194304 5523604 140737403197920 18446744073709551615 4258195 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 16317 12207 374 325 0 12131 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 73968

[startup+25.501 s]
/proc/loadavg: 3.97 4.01 4.19 5/194 16357
/proc/meminfo: memFree=29330580/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=71304 CPUtime=25.49 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 15422 0 0 0 2547 2 0 0 25 0 1 0 506602053 73015296 13787 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333341 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 17826 13787 374 325 0 13640 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 80004

[startup+51.1004 s]
/proc/loadavg: 4.05 4.02 4.18 5/194 16358
/proc/meminfo: memFree=29294040/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=79224 CPUtime=51.09 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 17255 0 0 0 5107 2 0 0 25 0 1 0 506602053 81125376 15620 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332855 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 19806 15620 374 325 0 15620 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 87924

[startup+102.307 s]
/proc/loadavg: 4.02 4.02 4.17 5/194 16359
/proc/meminfo: memFree=29238344/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=99376 CPUtime=102.3 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 22190 0 0 0 10225 5 0 0 25 0 1 0 506602053 101761024 20298 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333341 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 24844 20298 374 325 0 20658 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 108076

[startup+162.301 s]
/proc/loadavg: 4.01 4.01 4.16 5/194 16361
/proc/meminfo: memFree=29196664/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=114592 CPUtime=162.29 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 25941 0 0 0 16223 6 0 0 25 0 1 0 506602053 117342208 24049 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333282 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 28648 24049 374 325 0 24462 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 123292

[startup+222.301 s]
/proc/loadavg: 4.00 4.01 4.15 5/194 16363
/proc/meminfo: memFree=29174928/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=114928 CPUtime=222.29 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 26134 0 0 0 22223 6 0 0 25 0 1 0 506602053 117686272 24242 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332878 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 28732 24242 374 325 0 24546 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 123628

[startup+282.3 s]
/proc/loadavg: 4.00 4.00 4.14 5/194 16364
/proc/meminfo: memFree=29138448/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=135088 CPUtime=282.29 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 31062 0 0 0 28219 10 0 0 25 0 1 0 506602053 138330112 29170 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333341 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 33772 29170 374 325 0 29586 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 143788

[startup+342.301 s]
/proc/loadavg: 4.00 4.00 4.13 5/194 16366
/proc/meminfo: memFree=29125144/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=135088 CPUtime=342.29 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 31076 0 0 0 34219 10 0 0 25 0 1 0 506602053 138330112 29184 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333268 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 33772 29184 374 325 0 29586 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 143788

[startup+402.301 s]
/proc/loadavg: 4.12 4.03 4.13 5/194 16367
/proc/meminfo: memFree=29092648/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7

################
# More data... #
################

/proc/16338/statm: 40961 35588 374 325 0 36775 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 172544

[startup+642.3 s]
/proc/loadavg: 4.04 4.02 4.09 5/194 16374
/proc/meminfo: memFree=29025092/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=164356 CPUtime=642.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 38116 0 0 0 64216 15 0 0 25 0 1 0 506602053 168300544 35711 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332878 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 41089 35711 374 325 0 36903 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 173056

[startup+702.301 s]
/proc/loadavg: 4.01 4.02 4.08 5/194 16375
/proc/meminfo: memFree=28999276/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=168432 CPUtime=702.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 39060 0 0 0 70216 15 0 0 25 0 1 0 506602053 172474368 36655 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332878 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 42108 36655 374 325 0 37922 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 177132

[startup+762.307 s]
/proc/loadavg: 4.00 4.01 4.08 5/194 16377
/proc/meminfo: memFree=28973480/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=180776 CPUtime=762.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 42192 0 0 0 76214 17 0 0 25 0 1 0 506602053 185114624 39787 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333360 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 45194 39787 374 325 0 41008 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 189476

[startup+822.3 s]
/proc/loadavg: 4.00 4.01 4.07 5/194 16379
/proc/meminfo: memFree=28962172/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=192480 CPUtime=822.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 45070 0 0 0 82212 19 0 0 25 0 1 0 506602053 197099520 42665 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332878 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 48120 42665 374 325 0 43934 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 201180

[startup+882.301 s]
/proc/loadavg: 4.00 4.00 4.07 5/194 16380
/proc/meminfo: memFree=28951856/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=201568 CPUtime=882.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47405 0 0 0 88211 20 0 0 25 0 1 0 506602053 206405632 45000 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333341 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50392 45000 374 325 0 46206 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 210268

[startup+942.301 s]
/proc/loadavg: 4.00 4.00 4.06 5/194 16382
/proc/meminfo: memFree=28947508/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=201568 CPUtime=942.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47407 0 0 0 94211 20 0 0 25 0 1 0 506602053 206405632 45002 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332878 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50392 45002 374 325 0 46206 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 210268

[startup+1002.3 s]
/proc/loadavg: 4.03 4.01 4.06 5/194 16383
/proc/meminfo: memFree=28942280/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=201568 CPUtime=1002.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47409 0 0 0 100211 20 0 0 25 0 1 0 506602053 206405632 45004 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333341 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50392 45004 374 325 0 46206 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 210268

[startup+1062.3 s]
/proc/loadavg: 4.01 4.01 4.05 5/194 16385
/proc/meminfo: memFree=28932204/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=201568 CPUtime=1062.31 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47419 0 0 0 106211 20 0 0 25 0 1 0 506602053 206405632 45014 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333360 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50392 45014 374 325 0 46206 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 210268

[startup+1122.3 s]
/proc/loadavg: 4.00 4.00 4.05 5/194 16387
/proc/meminfo: memFree=28910120/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=201568 CPUtime=1122.32 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47438 0 0 0 112211 21 0 0 25 0 1 0 506602053 206405632 45033 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333190 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50392 45033 374 325 0 46206 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 210268

[startup+1182.3 s]
/proc/loadavg: 4.06 4.02 4.05 5/194 16388
/proc/meminfo: memFree=28893488/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=201568 CPUtime=1182.32 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47501 0 0 0 118211 21 0 0 25 0 1 0 506602053 206405632 45096 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332878 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50392 45096 374 325 0 46206 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 210268

[startup+1242.3 s]
/proc/loadavg: 4.02 4.01 4.04 5/194 16390
/proc/meminfo: memFree=28874856/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=202232 CPUtime=1242.32 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 47739 0 0 0 124211 21 0 0 25 0 1 0 506602053 207085568 45334 33554432000 4194304 5523604 140737403197920 18446744073709551615 5332925 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 50558 45334 374 325 0 46372 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 210932



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.01 4.00 4.04 4/191 16392
/proc/meminfo: memFree=29023172/32951124 swapFree=67111348/67111528
[pid=16337] ppid=16335 vsize=8700 CPUtime=0 cores=5,7
/proc/16337/stat : 16337 (rissAuto.sh) S 16335 16337 15978 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 506602053 8908800 252 33554432000 4194304 4922060 140734433034128 18446744073709551615 254261435525 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/16337/statm: 2175 252 211 178 0 68 0
[pid=16338] ppid=16337 vsize=218064 CPUtime=1300.03 cores=5,7
/proc/16338/stat : 16338 (riss) R 16337 16337 15978 0 -1 4202496 51729 0 0 0 129980 23 0 0 25 0 1 0 506602053 223297536 49324 33554432000 4194304 5523604 140737403197920 18446744073709551615 5333190 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16338/statm: 54516 49324 375 325 0 50330 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 226764

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16337 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 1300.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.03
CPU user time (s): 1299.8
CPU system time (s): 0.23
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 226764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 332
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 2

runsolver used 1.93971 second user time and 5.16322 second system time

The end

Launcher Data 

Begin job on node140 at 2011-04-30 07:37:47
IDJOB=3263701
IDBENCH=84010
IDSOLVER=1600
FILE ID=node140/3263701-1304141867
RUNJOBID= node140-1304139263-15999
PBS_JOBID= 13170843
Free space on /tmp= 73292 MiB

SOLVER NAME= riss Auto
BENCH NAME= SAT03/handmade/anton/SAT/SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf
COMMAND LINE= DIR/rissAuto.sh DIR BENCHNAME RANDOMSEED TIMELIMIT MEMLIMIT NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263701-1304141867/watcher-3263701-1304141867 -o /tmp/evaluation-result-3263701-1304141867/solver-3263701-1304141867 -C 2400 -W 1300 -M 7680  HOME/rissAuto.sh HOME HOME/instance-3263701-1304141867.cnf 723476690 2400 7680 2

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 22bbcb4a25a1da66113c240898c75509
RANDOM SEED=723476690

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29486648 kB
Buffers:       1051644 kB
Cached:        1816560 kB
SwapCached:        180 kB
Active:         356832 kB
Inactive:      2611624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29486648 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            4800 kB
Writeback:           8 kB
AnonPages:       99632 kB
Mapped:          15480 kB
Slab:           432388 kB
PageTables:       5324 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   244984 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73288 MiB
End job on node140 at 2011-04-30 07:59:29