Trace number 3438323

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SApperloT2010 2011-05-15 (fixed)? (TO) 5000.06 4999.94

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_12_2_4_cmp.cnf
MD5SUM7ea97a36d5ab6c8a5aa99830d5253591
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark61.2837
Satisfiable
(Un)Satisfiability was proved
Number of variables12584
Number of clauses155712
Sum of the clauses size523920
Maximum clause length100
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 217404
Number of clauses of size 3103200
Number of clauses of size 417828
Number of clauses of size 517000
Number of clauses of size over 5280

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438323-1306884533/watcher-3438323-1306884533 -o /tmp/evaluation-result-3438323-1306884533/solver-3438323-1306884533 -C 5000 -W 5100 -M 15500 SApperloT2010 HOME/instance-3438323-1306884533.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/477 7452
/proc/meminfo: memFree=7381068/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=16680 CPUtime=0 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 1275 0 0 0 0 0 0 0 23 0 1 0 780868621 17080320 1214 33554432000 4194304 4394578 140737202894912 18446744073709551615 254261277381 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 4170 1214 248 49 0 1311 0

[startup+0.0327849 s]
/proc/loadavg: 0.00 0.00 0.00 2/477 7452
/proc/meminfo: memFree=7381068/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=19320 CPUtime=0.02 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 1918 0 0 0 2 0 0 0 23 0 1 0 780868621 19783680 1857 33554432000 4194304 4394578 140737202894912 18446744073709551615 254261274752 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 4830 1857 248 49 0 1971 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 19320

[startup+0.100785 s]
/proc/loadavg: 0.00 0.00 0.00 2/477 7452
/proc/meminfo: memFree=7381068/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=27108 CPUtime=0.09 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 3880 0 0 0 9 0 0 0 23 0 1 0 780868621 27758592 3819 33554432000 4194304 4394578 140737202894912 18446744073709551615 254261277381 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 6777 3820 248 49 0 3918 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27108

[startup+0.300765 s]
/proc/loadavg: 0.00 0.00 0.00 2/477 7452
/proc/meminfo: memFree=7381068/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=33492 CPUtime=0.29 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 5482 0 0 0 26 3 0 0 25 0 1 0 780868621 34295808 5115 33554432000 4194304 4394578 140737202894912 18446744073709551615 254261641111 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 8373 5115 256 49 0 5514 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 33492

[startup+0.70068 s]
/proc/loadavg: 0.00 0.00 0.00 2/477 7452
/proc/meminfo: memFree=7381068/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=50980 CPUtime=0.69 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 10766 0 0 0 65 4 0 0 25 0 1 0 780868621 52203520 9767 33554432000 4194304 4394578 140737202894912 18446744073709551615 4285734 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 12745 9767 267 49 0 9886 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 50980

[startup+1.50054 s]
/proc/loadavg: 0.00 0.00 0.00 3/478 7453
/proc/meminfo: memFree=7334816/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=57736 CPUtime=1.49 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 12469 0 0 0 145 4 0 0 25 0 1 0 780868621 59121664 11470 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298698 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 14434 11470 267 49 0 11575 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 57736

[startup+3.10025 s]
/proc/loadavg: 0.00 0.00 0.00 3/478 7453
/proc/meminfo: memFree=7326508/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=63796 CPUtime=3.09 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 13979 0 0 0 305 4 0 0 25 0 1 0 780868621 65327104 12980 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 15949 12980 267 49 0 13090 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 63796

[startup+6.30068 s]
/proc/loadavg: 0.16 0.03 0.01 3/478 7453
/proc/meminfo: memFree=7312760/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=72144 CPUtime=6.29 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 16041 0 0 0 625 4 0 0 25 0 1 0 780868621 73875456 15042 33554432000 4194304 4394578 140737202894912 18446744073709551615 4285691 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 18036 15042 267 49 0 15177 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 72144

[startup+12.7006 s]
/proc/loadavg: 0.31 0.07 0.02 3/478 7453
/proc/meminfo: memFree=7288248/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=94536 CPUtime=12.69 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 21607 0 0 0 1264 5 0 0 25 0 1 0 780868621 96804864 20608 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 23634 20608 267 49 0 20775 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 94536

[startup+25.5003 s]
/proc/loadavg: 0.68 0.16 0.05 3/478 7454
/proc/meminfo: memFree=7251720/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=126772 CPUtime=25.49 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 29600 0 0 0 2541 8 0 0 25 0 1 0 780868621 129814528 28601 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 31693 28601 267 49 0 28834 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 126772

[startup+51.1008 s]
/proc/loadavg: 1.13 0.31 0.10 3/478 7454
/proc/meminfo: memFree=7214868/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=154980 CPUtime=51.09 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 36580 0 0 0 5099 10 0 0 25 0 1 0 780868621 158699520 35581 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298311 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 38745 35581 267 49 0 35886 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 154980

[startup+102.318 s]
/proc/loadavg: 1.62 0.56 0.20 3/478 7456
/proc/meminfo: memFree=7187556/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=178740 CPUtime=102.3 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 42347 0 0 0 10219 11 0 0 25 0 1 0 780868621 183029760 41348 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 44685 41348 267 49 0 41826 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 178740

[startup+162.301 s]
/proc/loadavg: 1.86 0.82 0.31 3/478 7457
/proc/meminfo: memFree=7156284/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=200332 CPUtime=162.3 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 47645 0 0 0 16216 14 0 0 25 0 1 0 780868621 205139968 46646 33554432000 4194304 4394578 140737202894912 18446744073709551615 4286073 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 50083 46646 267 49 0 47224 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 200332

[startup+222.301 s]
/proc/loadavg: 2.04 1.06 0.42 3/478 7459
/proc/meminfo: memFree=7138532/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=212620 CPUtime=222.29 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 50683 0 0 0 22214 15 0 0 25 0 1 0 780868621 217722880 49684 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298993 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 53155 49684 267 49 0 50296 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 212620

[startup+282.301 s]
/proc/loadavg: 2.05 1.25 0.52 3/478 7461
/proc/meminfo: memFree=7125484/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=221816 CPUtime=282.3 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 52931 0 0 0 28214 16 0 0 25 0 1 0 780868621 227139584 51932 33554432000 4194304 4394578 140737202894912 18446744073709551615 4338286 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 55454 51932 267 49 0 52595 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 221816

[startup+342.3 s]
/proc/loadavg: 2.02 1.38 0.61 3/478 7489
/proc/meminfo: memFree=7100544/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=233972 CPUtime=342.3 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 55861 0 0 0 34213 17 0 0 25 0 1 0 780868621 239587328 54862 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298933 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 58493 54862 267 49 0 55634 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 233972

[startup+402.301 s]
/proc/loadavg: 2.00 1.49 0.70 3/478 7491
/proc/meminfo: memFree=7073236/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=243992 CPUtime=402.3 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 58288 0 0 0 40212 18 0 0 25 0 1 0 780868621 249847808 57289 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 60998 57289 267 49 0 58139 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 243992

[startup+462.3 s]
/proc/loadavg: 2.10 1.61 0.79 3/478 7492
/proc/meminfo: memFree=7047052/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=259412 CPUtime=462.3 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 61966 0 0 0 46212 18 0 0 25 0 1 0 780868621 265637888 60967 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298923 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 64853 60967 267 49 0 61994 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 259412

[startup+522.301 s]
/proc/loadavg: 2.11 1.71 0.87 3/478 7494
/proc/meminfo: memFree=7036112/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=264752 CPUtime=522.31 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 63167 0 0 0 52212 19 0 0 25 0 1 0 780868621 271106048 62168 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 66188 62168 267 49 0 63329 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 264752

[startup+582.301 s]
/proc/loadavg: 2.04 1.76 0.94 3/478 7496
/proc/meminfo: memFree=7021464/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=265568 CPUtime=582.31 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 63385 0 0 0 58212 19 0 0 25 0 1 0 780868621 271941632 62386 33554432000 4194304 4394578 140737202894912 18446744073709551615 4288302 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 66392 62386 267 49 0 63533 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 265568

[startup+642.3 s]

################
# More data... #
################

[startup+4062.32 s]
/proc/loadavg: 2.01 2.04 1.97 3/478 7600
/proc/meminfo: memFree=6763664/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=407944 CPUtime=4062.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 96442 0 0 0 406209 31 0 0 25 0 1 0 780868621 417734656 95443 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 101986 95443 267 49 0 99127 0
Current children cumulated CPU time (s) 4062.4
Current children cumulated vsize (KiB) 407944

[startup+4122.3 s]
/proc/loadavg: 2.00 2.03 1.97 3/478 7602
/proc/meminfo: memFree=6762276/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=407944 CPUtime=4122.39 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 96448 0 0 0 412208 31 0 0 25 0 1 0 780868621 417734656 95449 33554432000 4194304 4394578 140737202894912 18446744073709551615 4287850 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 101986 95449 267 49 0 99127 0
Current children cumulated CPU time (s) 4122.39
Current children cumulated vsize (KiB) 407944

[startup+4182.3 s]
/proc/loadavg: 2.00 2.02 1.97 3/478 7604
/proc/meminfo: memFree=6760268/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=410536 CPUtime=4182.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 96984 0 0 0 418208 32 0 0 25 0 1 0 780868621 420388864 95985 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298664 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 102634 95985 267 49 0 99775 0
Current children cumulated CPU time (s) 4182.4
Current children cumulated vsize (KiB) 410536

[startup+4242.3 s]
/proc/loadavg: 2.00 2.02 1.97 3/478 7605
/proc/meminfo: memFree=6760244/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=411112 CPUtime=4242.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 97088 0 0 0 424208 32 0 0 25 0 1 0 780868621 420978688 96089 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 102778 96089 267 49 0 99919 0
Current children cumulated CPU time (s) 4242.4
Current children cumulated vsize (KiB) 411112

[startup+4302.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/478 7607
/proc/meminfo: memFree=6756756/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=412864 CPUtime=4302.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 97521 0 0 0 430208 32 0 0 25 0 1 0 780868621 422772736 96522 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298857 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 103216 96522 267 49 0 100357 0
Current children cumulated CPU time (s) 4302.4
Current children cumulated vsize (KiB) 412864

[startup+4362.3 s]
/proc/loadavg: 2.00 2.00 1.97 3/478 7608
/proc/meminfo: memFree=6754260/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=414880 CPUtime=4362.39 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 98005 0 0 0 436207 32 0 0 25 0 1 0 780868621 424837120 97006 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 103720 97006 267 49 0 100861 0
Current children cumulated CPU time (s) 4362.39
Current children cumulated vsize (KiB) 414880

[startup+4422.3 s]
/proc/loadavg: 2.11 2.03 1.98 3/478 7610
/proc/meminfo: memFree=6743808/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=424804 CPUtime=4422.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 100422 0 0 0 442207 33 0 0 25 0 1 0 780868621 434999296 99423 33554432000 4194304 4394578 140737202894912 18446744073709551615 4346575 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106201 99423 267 49 0 103342 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 424804

[startup+4482.3 s]
/proc/loadavg: 2.08 2.04 1.98 3/478 7612
/proc/meminfo: memFree=6741668/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=426888 CPUtime=4482.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 100882 0 0 0 448207 33 0 0 25 0 1 0 780868621 437133312 99883 33554432000 4194304 4394578 140737202894912 18446744073709551615 4346547 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106722 99883 267 49 0 103863 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 426888

[startup+4542.3 s]
/proc/loadavg: 2.03 2.03 1.98 3/478 7613
/proc/meminfo: memFree=6741148/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=426888 CPUtime=4542.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 100897 0 0 0 454207 33 0 0 25 0 1 0 780868621 437133312 99898 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106722 99898 267 49 0 103863 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 426888

[startup+4602.3 s]
/proc/loadavg: 2.01 2.02 1.98 3/478 7615
/proc/meminfo: memFree=6739872/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=426888 CPUtime=4602.41 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 100932 0 0 0 460208 33 0 0 25 0 1 0 780868621 437133312 99933 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298673 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106722 99933 267 49 0 103863 0
Current children cumulated CPU time (s) 4602.41
Current children cumulated vsize (KiB) 426888

[startup+4662.3 s]
/proc/loadavg: 2.00 2.02 1.98 3/478 7616
/proc/meminfo: memFree=6736488/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=426888 CPUtime=4662.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 100941 0 0 0 466207 33 0 0 25 0 1 0 780868621 437133312 99942 33554432000 4194304 4394578 140737202894912 18446744073709551615 4297144 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106722 99942 267 49 0 103863 0
Current children cumulated CPU time (s) 4662.4
Current children cumulated vsize (KiB) 426888

[startup+4722.32 s]
/proc/loadavg: 2.00 2.01 1.98 3/478 7618
/proc/meminfo: memFree=6732612/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=427716 CPUtime=4722.42 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 101134 0 0 0 472209 33 0 0 25 0 1 0 780868621 437981184 100135 33554432000 4194304 4394578 140737202894912 18446744073709551615 4346561 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106929 100135 267 49 0 104070 0
Current children cumulated CPU time (s) 4722.42
Current children cumulated vsize (KiB) 427716

[startup+4782.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/478 7620
/proc/meminfo: memFree=6730476/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=427860 CPUtime=4782.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 101185 0 0 0 478207 33 0 0 25 0 1 0 780868621 438128640 100186 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298821 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106965 100186 267 49 0 104106 0
Current children cumulated CPU time (s) 4782.4
Current children cumulated vsize (KiB) 427860

[startup+4842.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/478 7621
/proc/meminfo: memFree=6723868/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=427860 CPUtime=4842.4 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 101200 0 0 0 484207 33 0 0 25 0 1 0 780868621 438128640 100201 33554432000 4194304 4394578 140737202894912 18446744073709551615 4298333 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106965 100201 267 49 0 104106 0
Current children cumulated CPU time (s) 4842.4
Current children cumulated vsize (KiB) 427860

[startup+4902.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/478 7623
/proc/meminfo: memFree=6718500/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=427860 CPUtime=4902.41 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 101203 0 0 0 490208 33 0 0 25 0 1 0 780868621 438128640 100204 33554432000 4194304 4394578 140737202894912 18446744073709551615 4346534 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 106965 100204 267 49 0 104106 0
Current children cumulated CPU time (s) 4902.41
Current children cumulated vsize (KiB) 427860

[startup+4962.3 s]
/proc/loadavg: 2.13 2.03 1.99 3/478 7624
/proc/meminfo: memFree=6715492/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=429316 CPUtime=4962.41 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 101558 0 0 0 496207 34 0 0 25 0 1 0 780868621 439619584 100559 33554432000 4194304 4394578 140737202894912 18446744073709551615 4335393 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 107329 100559 267 49 0 104470 0
Current children cumulated CPU time (s) 4962.41
Current children cumulated vsize (KiB) 429316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.12 2.04 2.00 3/478 7625
/proc/meminfo: memFree=6712492/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=431460 CPUtime=5000.02 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 102054 0 0 0 499968 34 0 0 25 0 1 0 780868621 441815040 101055 33554432000 4194304 4394578 140737202894912 18446744073709551615 4346558 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 107865 101055 267 49 0 105006 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 431460

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 2.12 2.04 2.00 3/478 7625
/proc/meminfo: memFree=6712492/32951124 swapFree=67057928/67111528
[pid=7452] ppid=7450 vsize=431460 CPUtime=5000.02 cores=1,3,5,7
/proc/7452/stat : 7452 (SApperloT2010) R 7450 7452 7414 0 -1 4202496 102054 0 0 0 499968 34 0 0 25 0 1 0 780868621 441815040 101055 33554432000 4194304 4394578 140737202894912 18446744073709551615 4346558 0 0 4096 6 0 0 0 17 1 0 0 0
/proc/7452/statm: 107865 101055 267 49 0 105006 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 431460

Child ended because it received signal 15 (SIGTERM)
Real time (s): 4999.94
CPU time (s): 5000.06
CPU user time (s): 4999.7
CPU system time (s): 0.361944
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 431460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.7
system time used= 0.361944
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 102054
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 6842

runsolver used 21.9967 second user time and 55.2936 second system time

The end

Launcher Data 

Begin job on node140 at 2011-06-01 01:28:53
IDJOB=3438323
IDBENCH=70908
IDSOLVER=1933
FILE ID=node140/3438323-1306884533
RUNJOBID= node140-1306884533-7433
PBS_JOBID= 13488436
Free space on /tmp= 57540 MiB

SOLVER NAME= SApperloT2010 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_12_2_4_cmp.cnf
COMMAND LINE= SApperloT2010 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438323-1306884533/watcher-3438323-1306884533 -o /tmp/evaluation-result-3438323-1306884533/solver-3438323-1306884533 -C 5000 -W 5100 -M 15500  SApperloT2010 HOME/instance-3438323-1306884533.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7ea97a36d5ab6c8a5aa99830d5253591
RANDOM SEED=2059460929

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       7381480 kB
Buffers:        226300 kB
Cached:       17747724 kB
SwapCached:       6932 kB
Active:       13335288 kB
Inactive:     11557664 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       7381480 kB
SwapTotal:    67111528 kB
SwapFree:     67057928 kB
Dirty:            3900 kB
Writeback:           0 kB
AnonPages:     6917312 kB
Mapped:          37888 kB
Slab:           555604 kB
PageTables:      52792 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 141402028 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 57540 MiB
End job on node140 at 2011-06-01 02:52:15