Trace number 3322751

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 4287.4 726.48

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/2dlx_ca_bp_f_liveness.cnf
MD5SUM99cd8de7f06ce8c087a5c7fb299dfb62
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables202253
Number of clauses4313014
Sum of the clauses size12562188
Maximum clause length651
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23935640
Number of clauses of size 3199653
Number of clauses of size 410363
Number of clauses of size 55846
Number of clauses of size over 5161511

Solver Data

0.34/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.34/0.67	c INFO: solving HOME/instance-3322751-1304356085.cnf
0.34/0.67	c INFO: computing task features
18.42/18.71	c INFO: computed variable-clause graph statistics
19.02/19.33	c INFO: computed clause balance statistics
91.92/92.22	c INFO: computed variable balance statistics
142.22/142.56	c INFO: computed small-clause counts
143.62/143.94	c INFO: computed Horn-clause counts
199.12/199.45	c INFO: computed variable graph statistics
199.12/199.46	c INFO: collected features for HOME/instance-3322751-1304356085.cnf in 197.87 s
199.12/199.50	c INFO: running lingeling-276@0 for 97 with 39801 remaining (b = 0.68)
199.23/199.54	c INFO: running precosat-570@0 for 97 with 39801 remaining (b = 0.36)
199.23/199.58	c INFO: running cryptominisat-2.9.0@0 for 485 with 39801 remaining (b = 0.34)
199.33/199.62	c INFO: running SApperloT@0 for 97 with 39801 remaining (b = 0.06)
199.33/199.66	c INFO: running lingeling-276@0 for 582 with 39801 remaining (b = 0.29)
199.42/199.70	c INFO: running cryptominisat-2.9.0@0 for 485 with 39800 remaining (b = 0.21)
199.42/199.74	c INFO: running lingeling-276@0 for 97 with 39800 remaining (b = 0.08)
199.42/199.78	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39800 remaining (b = 0.36)
991.22/298.89	c INFO: running lingeling-276@0 for 1261 with 39701 remaining (b = 0.24)
998.49/299.76	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39700 remaining (b = 0.29)
999.18/299.81	c INFO: running precosat-570@0 for 291 with 39700 remaining (b = 0.05)
1000.58/300.04	c INFO: running lingeling-276@0 for 1164 with 39700 remaining (b = 0.20)
3297.17/594.00	c INFO: running glucosER@0 for 291 with 39406 remaining (b = 0.22)
4169.79/707.88	c INFO: running precosat-570@0 for 388 with 39292 remaining (b = 0.18)
4256.95/720.91	c INFO: running precosat-570@0 for 97 with 39279 remaining (b = 0.09)

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322751-1304356085/watcher-3322751-1304356085 -o /tmp/evaluation-result-3322751-1304356085/solver-3322751-1304356085 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322751-1304356085.cnf -seed 1545527950 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.78 7.78 7.92 1/272 14694
/proc/meminfo: memFree=7735368/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=15380 CPUtime=0 cores=0-7
/proc/14694/stat : 14694 (python) S 14692 14694 13108 0 -1 4202496 820 0 0 0 0 0 0 0 20 0 1 0 625839273 15749120 704 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/14694/statm: 3845 704 334 364 0 332 0

[startup+0.0259081 s]
/proc/loadavg: 7.78 7.78 7.92 1/272 14694
/proc/meminfo: memFree=7735368/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=16396 CPUtime=0.01 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 1088 0 0 0 1 0 0 0 20 0 1 0 625839273 16789504 957 33554432000 4194304 5683644 140734873488128 18446744073709551615 5210636 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14694/statm: 4099 958 389 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+0.100923 s]
/proc/loadavg: 7.78 7.78 7.92 1/272 14694
/proc/meminfo: memFree=7735368/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=87708 CPUtime=0.07 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 2639 0 0 0 5 2 0 0 17 0 1 0 625839273 89812992 2355 33554432000 4194304 5683644 140734873488128 18446744073709551615 4619985 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14694/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 87708

[startup+0.30092 s]
/proc/loadavg: 7.78 7.78 7.92 1/272 14694
/proc/meminfo: memFree=7735368/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=135748 CPUtime=0.18 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 5962 934 1 0 13 5 0 0 17 0 1 0 625839273 139005952 4150 33554432000 4194304 5683644 140734873488128 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14694/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700832 s]
/proc/loadavg: 7.78 7.78 7.92 1/272 14694
/proc/meminfo: memFree=7735368/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=370916 CPUtime=0.42 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 21768 934 1 0 29 13 0 0 16 0 1 0 625839273 379817984 19449 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284925696 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14694/statm: 92729 19484 1758 364 0 28653 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 370916

[startup+1.50066 s]
/proc/loadavg: 7.16 7.65 7.87 2/273 14699
/proc/meminfo: memFree=7602556/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=420108 CPUtime=1.22 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 44153 934 1 0 105 17 0 0 17 0 1 0 625839273 430190592 41834 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284586693 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14694/statm: 105027 41834 1761 364 0 40951 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 420108

[startup+3.24237 s]
/proc/loadavg: 7.16 7.65 7.87 2/273 14699
/proc/meminfo: memFree=7602556/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=531928 CPUtime=2.96 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 71139 934 1 0 277 19 0 0 19 0 1 0 625839273 544694272 68820 33554432000 4194304 5683644 140734873488128 18446744073709551615 4602993 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14694/statm: 132982 68823 1761 364 0 68906 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 531928

[startup+6.30086 s]
/proc/loadavg: 6.67 7.54 7.84 2/273 14701
/proc/meminfo: memFree=7312124/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=713480 CPUtime=6.01 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 116092 934 1 0 577 24 0 0 25 0 1 0 625839273 730603520 113773 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284622340 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14694/statm: 178370 113773 1761 364 0 114294 0
Current children cumulated CPU time (s) 6.01
Current children cumulated vsize (KiB) 713480

[startup+12.7008 s]
/proc/loadavg: 6.21 7.43 7.80 2/273 14701
/proc/meminfo: memFree=6999652/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=1003564 CPUtime=12.41 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 188751 934 1 0 1206 35 0 0 25 0 1 0 625839273 1027649536 186432 33554432000 4194304 5683644 140734873488128 18446744073709551615 4623691 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14694/statm: 250891 186432 1761 364 0 186815 0
Current children cumulated CPU time (s) 12.41
Current children cumulated vsize (KiB) 1003564

[startup+25.5007 s]
/proc/loadavg: 5.41 7.22 7.73 2/273 14701
/proc/meminfo: memFree=6927068/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=1069632 CPUtime=25.22 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 500750 934 1 0 2439 83 0 0 25 0 1 0 625839273 1095303168 204793 33554432000 4194304 5683644 140734873488128 18446744073709551615 47037144875148 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14694/statm: 267408 204793 1826 364 0 203332 0
Current children cumulated CPU time (s) 25.22
Current children cumulated vsize (KiB) 1069632

[startup+51.1094 s]
/proc/loadavg: 3.67 6.62 7.51 2/273 14701
/proc/meminfo: memFree=6927556/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=1069632 CPUtime=50.83 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 500750 934 1 0 5000 83 0 0 25 0 1 0 625839273 1095303168 204793 33554432000 4194304 5683644 140734873488128 18446744073709551615 5005921 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14694/statm: 267408 204793 1826 364 0 203332 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 1069632

[startup+102.301 s]
/proc/loadavg: 2.16 5.75 7.17 2/273 14703
/proc/meminfo: memFree=6927084/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=1069632 CPUtime=102.02 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 500751 934 1 0 10119 83 0 0 25 0 1 0 625839273 1095303168 204794 33554432000 4194304 5683644 140734873488128 18446744073709551615 4539653 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14694/statm: 267408 204794 1827 364 0 203332 0
Current children cumulated CPU time (s) 102.02
Current children cumulated vsize (KiB) 1069632

[startup+162.301 s]
/proc/loadavg: 1.50 4.90 6.78 2/273 14705
/proc/meminfo: memFree=6926968/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=1069632 CPUtime=162.02 cores=0-7
/proc/14694/stat : 14694 (python) R 14692 14694 13108 0 -1 4202496 610269 934 1 0 16101 101 0 0 25 0 1 0 625839273 1095303168 204800 33554432000 4194304 5683644 140734873488128 18446744073709551615 47037144795264 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14694/statm: 267408 204800 1833 364 0 203332 0
Current children cumulated CPU time (s) 162.02
Current children cumulated vsize (KiB) 1069632

[startup+222.302 s]
/proc/loadavg: 3.64 4.77 6.61 9/297 14729
/proc/meminfo: memFree=3460688/32951124 swapFree=67103364/67111528
[pid=14694] ppid=14692 vsize=844608 CPUtime=199.51 cores=0-7
/proc/14694/stat : 14694 (python) S 14692 14694 13108 0 -1 4202496 615551 934 1 0 19839 112 0 0 22 0 9 0 625839273 864878592 111847 33554432000 4194304 5683644 140734873488128 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14694/statm: 211152 111847 1889 364 0 147049 0
[pid=14706] ppid=14694 vsize=697036 CPUtime=0.05 cores=0-7
/proc/14706/stat : 14706 (python) S 14694 14694 13108 0 -1 4202560 920 0 0 0 2 3 0 0 18 0 1 0 625859223 713764864 110188 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945935 0 0 16781312 514 12485403134140580097 0 0 17 2 0 0 0
/proc/14706/statm: 174259 110188 376 364 0 110177 0
[pid=14708] ppid=14706 vsize=200344 CPUtime=22.71 cores=0-7
/proc/14708/stat : 14708 (lingeling) R 14706 14708 14708 0 -1 4202496 76298 0 0 0 2256 15 0 0 25 0 1 0 625859224 205152256 49256 33554432000 4194304 4352236 140735261047024 18446744073709551615 4276696 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/14708/statm: 50086 49256 129 39 0 49166 0
[pid=14709] ppid=14694 vsize=772828 CPUtime=0.05 cores=0-7
/proc/14709/stat : 14709 (python) S 14694 14694 13108 0 -1 4202560 922 0 0 0 2 3 0 0 18 0 1 0 625859227 791375872 110188 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580100 0 0 17 7 0 0 0
/proc/14709/statm: 193207 110188 370 364 0 129122 0
[pid=14711] ppid=14709 vsize=558360 CPUtime=22.73 cores=0-7
/proc/14711/stat : 14711 (precosat) R 14709 14711 14711 0 -1 4202496 138177 0 0 0 2248 25 0 0 25 0 1 0 625859229 571760640 134506 33554432000 4194304 4890832 140736224915056 18446744073709551615 4303168 0 0 16781312 17442 0 0 0 17 3 0 0 0
/proc/14711/statm: 139590 134506 80 171 0 139417 0
[pid=14712] ppid=14694 vsize=783084 CPUtime=0.05 cores=0-7
/proc/14712/stat : 14712 (python) S 14694 14694 13108 0 -1 4202560 780 0 0 0 2 3 0 0 15 0 1 0 625859231 801878016 110308 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580100 0 0 17 1 0 0 0
/proc/14712/statm: 195771 110308 371 364 0 131683 0
[pid=14714] ppid=14712 vsize=1011600 CPUtime=22.68 cores=0-7
/proc/14714/stat : 14714 (cryptominisat-2) R 14712 14714 14714 0 -1 4202496 214675 0 0 0 2230 38 0 0 25 0 1 0 625859233 1035878400 209987 33554432000 4194304 4677096 140733202281392 18446744073709551615 4454464 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/14714/statm: 252900 209987 378 118 0 247859 0
[pid=14715] ppid=14694 vsize=793340 CPUtime=0.05 cores=0-7
/proc/14715/stat : 14715 (python) S 14694 14694 13108 0 -1 4202560 789 0 0 0 2 3 0 0 18 0 1 0 625859236 812380160 110297 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580098 0 0 17 7 0 0 0
/proc/14715/statm: 198335 110297 371 364 0 134244 0
[pid=14717] ppid=14715 vsize=186264 CPUtime=22.65 cores=0-7
/proc/14717/stat : 14717 (SApperloT-base) R 14715 14717 14717 0 -1 4202496 40578 0 0 0 2252 13 0 0 25 0 1 0 625859237 190734336 39965 33554432000 134512640 135674940 4292619904 18446744073709551615 134564660 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/14717/statm: 46566 39965 99 284 0 46280 0
[pid=14718] ppid=14694 vsize=803596 CPUtime=0.05 cores=0-7
/proc/14718/stat : 14718 (python) S 14694 14694 13108 0 -1 4202560 805 0 0 0 2 3 0 0 18 0 1 0 625859240 822882304 110371 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580100 0 0 17 1 0 0 0
/proc/14718/statm: 200899 110371 371 364 0 136805 0
[pid=14720] ppid=14718 vsize=199308 CPUtime=22.61 cores=0-7
/proc/14720/stat : 14720 (lingeling) R 14718 14720 14720 0 -1 4202496 76033 0 0 0 2243 18 0 0 25 0 1 0 625859241 204091392 48997 33554432000 4194304 4352236 140737365094384 18446744073709551615 4238648 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/14720/statm: 49827 48997 129 39 0 48907 0
[pid=14721] ppid=14694 vsize=813852 CPUtime=0.06 cores=0-7
/proc/14721/stat : 14721 (python) S 14694 14694 13108 0 -1 4202560 816 0 0 0 3 3 0 0 15 0 1 0 625859244 833384448 110328 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580097 0 0 17 1 0 0 0
/proc/14721/statm: 203463 110328 371 364 0 139366 0
[pid=14723] ppid=14721 vsize=1011600 CPUtime=22.24 cores=0-7
/proc/14723/stat : 14723 (cryptominisat-2) R 14721 14723 14723 0 -1 4202496 214990 0 0 0 2195 29 0 0 25 0 1 0 625859245 1035878400 210295 33554432000 4194304 4677096 140734013141792 18446744073709551615 224284581329 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/14723/statm: 252900 210295 378 118 0 247859 0
[pid=14724] ppid=14694 vsize=824108 CPUtime=0.05 cores=0-7
/proc/14724/stat : 14724 (python) S 14694 14694 13108 0 -1 4202560 817 0 0 0 1 4 0 0 18 0 1 0 625859248 843886592 110342 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580100 0 0 17 1 0 0 0
/proc/14724/statm: 206027 110342 371 364 0 141927 0
[pid=14726] ppid=14724 vsize=199364 CPUtime=22.3 cores=0-7
/proc/14726/stat : 14726 (lingeling) R 14724 14726 14726 0 -1 4202496 76047 0 0 0 2215 15 0 0 25 0 1 0 625859250 204148736 49010 33554432000 4194304 4352236 140735048385376 18446744073709551615 4207584 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/14726/statm: 49841 49010 129 39 0 48921 0
[pid=14727] ppid=14694 vsize=834364 CPUtime=0.05 cores=0-7
/proc/14727/stat : 14727 (python) S 14694 14694 13108 0 -1 4202560 866 0 0 0 3 2 0 0 15 0 1 0 625859252 854388736 110331 33554432000 4194304 5683644 140734873488128 18446744073709551615 224284945990 0 0 16781312 514 12485403134140580099 0 0 17 0 0 0 0
/proc/14727/statm: 208591 110331 377 364 0 144488 0
[pid=14729] ppid=14727 vsize=1011600 CPUtime=22.42 cores=0-7
/proc/14729/stat : 14729 (cryptominisat-2) R 14727 14729 14729 0 -1 4202496 214688 0 0 0 2200 42 0 0 25 0 1 0 625859253 1035878400 209986 33554432000 4194304 4677096 140737268257888 18446744073709551615 4454468 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/14729/statm: 252900 209986 378 118 0 247859 0
[pid=14694/tid=14707] ppid=14692 vsize=844608 CPUtime=0 cores=0-7
/proc/14694/task/14707/stat : 14707 (python) S 14692 14694 13108 0 -1 4202560 24 934 0 0 0 0 0 0 18 0 9 0 625859224 864878592 111847 33554432000 4194304 5683644 140734873488128 18446744073709551615 224296749489 0 0 16781312 2 18446604450591314944 0 0 -1 1 0 0 0
[pid=14694/tid=14710] ppid=14692 vsize=844608 CPUtime=0 cores=0-7
/proc/14694/task/14710/stat : 14710 (python) S 14692 14694 13108 0 -1 4202560 24 934 0 0 0 0 0 0 18 0 9 0 625859228 864878592 111847 33554432000 4194304 5683644 140734873488128 18446744073709551615 224296749489 0 0 16781312 2 18446604450591314944 0 0 -1 3 0 0 0
[pid=14694/tid=14713] ppid=14692 vsize=844608 CPUtime=0 cores=0-7
/proc/14694/task/14713/stat : 14713 (python) S 14692 14694 13108 0 -1 4202560 75 934 0 0 0 0 0 0 25 0 9 0 625859232 864878592 111847 33554432000 4194304 5683644 140734873488128 18446744073709551615 224296749489 0 0 16781312 2 18446604450591314944 0 0 -1 4 0 0 0
[pid=14694/tid=14716] ppid=14692 vsize=844608 CPUtime=0 cores=0-7
/proc/14694/task/14716/stat : 14716 (python) S 14692 14694 13108 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 9 0 625859237 864878592 111847 33554432000 4194304 5683644 140734873488128 18446744073709551615 224296749489 0 0 16781312 2 18446604450591314944 0 0 -1 5 0 0 0
[pid=14694/tid=14719] ppid=14692 vsize=844608 CPUtime=0 cores=0-7
/proc/14694/task/14719/stat : 14719 (python) S 14692 14694 13108 0 -1 4202560 33 934 0 0 0 0 0 0 25 0 9 0 625859241 864878592 111847 33554432000 4194304 5683644 140734873488128 18446744073709551615 224296749489 0 0 16781312 2 18446604450591314944 0 0 -1 4 0 0 0

################
# More data... #
################



Solver just ended. Dumping a history of the last processes samples

[startup+725.602 s]
/proc/loadavg: 8.78 7.88 7.39 1/293 14769
/proc/meminfo: memFree=7897228/32951124 swapFree=61019336/67111528
[pid=14694] ppid=14692 vsize=0 CPUtime=199.87 cores=0-7
/proc/14694/stat : 14694 (python) D 14692 14694 13108 0 -1 4203524 619694 934 21 0 19866 121 0 0 18 0 1 0 625839273 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 4
/proc/14694/statm: 0 0 0 0 0 0 0
[pid=14706] ppid=14694 vsize=0 CPUtime=1.16 cores=0-7
/proc/14706/stat : 14706 (python) Z 14694 14694 13108 0 -1 4203612 1162 0 2 0 60 56 0 0 18 0 1 0 625859223 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 65
/proc/14706/statm: 0 0 0 0 0 0 0
[pid=14709] ppid=14694 vsize=0 CPUtime=0.87 cores=0-7
/proc/14709/stat : 14709 (python) Z 14694 14694 13108 0 -1 4203612 1162 0 11 0 44 43 0 0 18 0 1 0 625859227 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 13
/proc/14709/statm: 0 0 0 0 0 0 0
[pid=14712] ppid=14694 vsize=0 CPUtime=1.17 cores=0-7
/proc/14712/stat : 14712 (python) Z 14694 14694 13108 0 -1 4203612 1067 0 42 0 60 57 0 0 16 0 1 0 625859231 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 221
/proc/14712/statm: 0 0 0 0 0 0 0
[pid=14715] ppid=14694 vsize=0 CPUtime=0.23 cores=0-7
/proc/14715/stat : 14715 (python) Z 14694 14694 13108 0 -1 4203612 963 0 0 0 10 13 0 0 18 0 1 0 625859236 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/14715/statm: 0 0 0 0 0 0 0
[pid=14718] ppid=14694 vsize=0 CPUtime=1.16 cores=0-7
/proc/14718/stat : 14718 (python) Z 14694 14694 13108 0 -1 4203612 806 0 0 0 56 60 0 0 15 0 1 0 625859240 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 28
/proc/14718/statm: 0 0 0 0 0 0 0
[pid=14721] ppid=14694 vsize=0 CPUtime=1.2 cores=0-7
/proc/14721/stat : 14721 (python) Z 14694 14694 13108 0 -1 4203612 1042 0 17 0 58 62 0 0 16 0 1 0 625859244 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 715
/proc/14721/statm: 0 0 0 0 0 0 0
[pid=14724] ppid=14694 vsize=0 CPUtime=0.22 cores=0-7
/proc/14724/stat : 14724 (python) Z 14694 14694 13108 0 -1 4203612 994 0 0 0 9 13 0 0 18 0 1 0 625859248 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/14724/statm: 0 0 0 0 0 0 0
[pid=14727] ppid=14694 vsize=0 CPUtime=1.24 cores=0-7
/proc/14727/stat : 14727 (python) Z 14694 14694 13108 0 -1 4203612 873 0 1 0 63 61 0 0 15 0 1 0 625859252 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 76
/proc/14727/statm: 0 0 0 0 0 0 0
[pid=14733] ppid=14694 vsize=0 CPUtime=0.95 cores=0-7
/proc/14733/stat : 14733 (python) Z 14694 14694 13108 0 -1 4203612 837 0 0 0 49 46 0 0 15 0 1 0 625869163 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14733/statm: 0 0 0 0 0 0 0
[pid=14737] ppid=14694 vsize=0 CPUtime=1 cores=0-7
/proc/14737/stat : 14737 (python) Z 14694 14694 13108 0 -1 4203612 845 0 2 0 50 50 0 0 15 0 1 0 625869250 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 116
/proc/14737/statm: 0 0 0 0 0 0 0
[pid=14752] ppid=14694 vsize=0 CPUtime=0.29 cores=0-7
/proc/14752/stat : 14752 (python) Z 14694 14694 13108 0 -1 4203612 845 0 4 0 14 15 0 0 15 0 1 0 625898673 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/14752/statm: 0 0 0 0 0 0 0
[pid=14762] ppid=14694 vsize=0 CPUtime=0.05 cores=0-7
/proc/14762/stat : 14762 (python) Z 14694 14694 13108 0 -1 4203612 861 0 0 0 2 3 0 0 15 0 1 0 625910062 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14762/statm: 0 0 0 0 0 0 0
[pid=14766] ppid=14694 vsize=0 CPUtime=0.02 cores=0-7
/proc/14766/stat : 14766 (python) Z 14694 14694 13108 0 -1 4203612 864 0 0 0 0 2 0 0 16 0 1 0 625911364 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/14766/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 209.43
Current children cumulated vsize (KiB) 0

[startup+726.001 s]
/proc/loadavg: 8.78 7.88 7.39 1/293 14769
/proc/meminfo: memFree=7897228/32951124 swapFree=61019336/67111528
[pid=14694] ppid=14692 vsize=0 CPUtime=199.87 cores=0-7
/proc/14694/stat : 14694 (python) D 14692 14694 13108 0 -1 4203524 619694 934 21 0 19866 121 0 0 18 0 1 0 625839273 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 4
/proc/14694/statm: 0 0 0 0 0 0 0
[pid=14706] ppid=14694 vsize=0 CPUtime=1.16 cores=0-7
/proc/14706/stat : 14706 (python) Z 14694 14694 13108 0 -1 4203612 1162 0 2 0 60 56 0 0 18 0 1 0 625859223 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 65
/proc/14706/statm: 0 0 0 0 0 0 0
[pid=14709] ppid=14694 vsize=0 CPUtime=0.87 cores=0-7
/proc/14709/stat : 14709 (python) Z 14694 14694 13108 0 -1 4203612 1162 0 11 0 44 43 0 0 18 0 1 0 625859227 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 13
/proc/14709/statm: 0 0 0 0 0 0 0
[pid=14712] ppid=14694 vsize=0 CPUtime=1.17 cores=0-7
/proc/14712/stat : 14712 (python) Z 14694 14694 13108 0 -1 4203612 1067 0 42 0 60 57 0 0 16 0 1 0 625859231 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 221
/proc/14712/statm: 0 0 0 0 0 0 0
[pid=14715] ppid=14694 vsize=0 CPUtime=0.23 cores=0-7
/proc/14715/stat : 14715 (python) Z 14694 14694 13108 0 -1 4203612 963 0 0 0 10 13 0 0 18 0 1 0 625859236 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/14715/statm: 0 0 0 0 0 0 0
[pid=14718] ppid=14694 vsize=0 CPUtime=1.16 cores=0-7
/proc/14718/stat : 14718 (python) Z 14694 14694 13108 0 -1 4203612 806 0 0 0 56 60 0 0 15 0 1 0 625859240 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 28
/proc/14718/statm: 0 0 0 0 0 0 0
[pid=14721] ppid=14694 vsize=0 CPUtime=1.2 cores=0-7
/proc/14721/stat : 14721 (python) Z 14694 14694 13108 0 -1 4203612 1042 0 17 0 58 62 0 0 16 0 1 0 625859244 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 715
/proc/14721/statm: 0 0 0 0 0 0 0
[pid=14724] ppid=14694 vsize=0 CPUtime=0.22 cores=0-7
/proc/14724/stat : 14724 (python) Z 14694 14694 13108 0 -1 4203612 994 0 0 0 9 13 0 0 18 0 1 0 625859248 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/14724/statm: 0 0 0 0 0 0 0
[pid=14727] ppid=14694 vsize=0 CPUtime=1.24 cores=0-7
/proc/14727/stat : 14727 (python) Z 14694 14694 13108 0 -1 4203612 873 0 1 0 63 61 0 0 15 0 1 0 625859252 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 76
/proc/14727/statm: 0 0 0 0 0 0 0
[pid=14733] ppid=14694 vsize=0 CPUtime=0.95 cores=0-7
/proc/14733/stat : 14733 (python) Z 14694 14694 13108 0 -1 4203612 837 0 0 0 49 46 0 0 15 0 1 0 625869163 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14733/statm: 0 0 0 0 0 0 0
[pid=14737] ppid=14694 vsize=0 CPUtime=1 cores=0-7
/proc/14737/stat : 14737 (python) Z 14694 14694 13108 0 -1 4203612 845 0 2 0 50 50 0 0 15 0 1 0 625869250 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 116
/proc/14737/statm: 0 0 0 0 0 0 0
[pid=14752] ppid=14694 vsize=0 CPUtime=0.29 cores=0-7
/proc/14752/stat : 14752 (python) Z 14694 14694 13108 0 -1 4203612 845 0 4 0 14 15 0 0 15 0 1 0 625898673 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/14752/statm: 0 0 0 0 0 0 0
[pid=14762] ppid=14694 vsize=0 CPUtime=0.05 cores=0-7
/proc/14762/stat : 14762 (python) Z 14694 14694 13108 0 -1 4203612 861 0 0 0 2 3 0 0 15 0 1 0 625910062 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14762/statm: 0 0 0 0 0 0 0
[pid=14766] ppid=14694 vsize=0 CPUtime=0.02 cores=0-7
/proc/14766/stat : 14766 (python) Z 14694 14694 13108 0 -1 4203612 864 0 0 0 0 2 0 0 16 0 1 0 625911364 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/14766/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 209.43
Current children cumulated vsize (KiB) 0

[startup+726.401 s]
/proc/loadavg: 8.78 7.88 7.39 1/293 14769
/proc/meminfo: memFree=7897228/32951124 swapFree=61019336/67111528
[pid=14694] ppid=14692 vsize=0 CPUtime=199.87 cores=0-7
/proc/14694/stat : 14694 (python) D 14692 14694 13108 0 -1 4203524 619694 934 21 0 19866 121 0 0 18 0 1 0 625839273 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 4
/proc/14694/statm: 0 0 0 0 0 0 0
[pid=14706] ppid=14694 vsize=0 CPUtime=1.16 cores=0-7
/proc/14706/stat : 14706 (python) Z 14694 14694 13108 0 -1 4203612 1162 0 2 0 60 56 0 0 18 0 1 0 625859223 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 65
/proc/14706/statm: 0 0 0 0 0 0 0
[pid=14709] ppid=14694 vsize=0 CPUtime=0.87 cores=0-7
/proc/14709/stat : 14709 (python) Z 14694 14694 13108 0 -1 4203612 1162 0 11 0 44 43 0 0 18 0 1 0 625859227 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 13
/proc/14709/statm: 0 0 0 0 0 0 0
[pid=14712] ppid=14694 vsize=0 CPUtime=1.17 cores=0-7
/proc/14712/stat : 14712 (python) Z 14694 14694 13108 0 -1 4203612 1067 0 42 0 60 57 0 0 16 0 1 0 625859231 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 221
/proc/14712/statm: 0 0 0 0 0 0 0
[pid=14715] ppid=14694 vsize=0 CPUtime=0.23 cores=0-7
/proc/14715/stat : 14715 (python) Z 14694 14694 13108 0 -1 4203612 963 0 0 0 10 13 0 0 18 0 1 0 625859236 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/14715/statm: 0 0 0 0 0 0 0
[pid=14718] ppid=14694 vsize=0 CPUtime=1.16 cores=0-7
/proc/14718/stat : 14718 (python) Z 14694 14694 13108 0 -1 4203612 806 0 0 0 56 60 0 0 15 0 1 0 625859240 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 28
/proc/14718/statm: 0 0 0 0 0 0 0
[pid=14721] ppid=14694 vsize=0 CPUtime=1.2 cores=0-7
/proc/14721/stat : 14721 (python) Z 14694 14694 13108 0 -1 4203612 1042 0 17 0 58 62 0 0 16 0 1 0 625859244 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 715
/proc/14721/statm: 0 0 0 0 0 0 0
[pid=14724] ppid=14694 vsize=0 CPUtime=0.22 cores=0-7
/proc/14724/stat : 14724 (python) Z 14694 14694 13108 0 -1 4203612 994 0 0 0 9 13 0 0 18 0 1 0 625859248 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/14724/statm: 0 0 0 0 0 0 0
[pid=14727] ppid=14694 vsize=0 CPUtime=1.24 cores=0-7
/proc/14727/stat : 14727 (python) Z 14694 14694 13108 0 -1 4203612 873 0 1 0 63 61 0 0 15 0 1 0 625859252 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 76
/proc/14727/statm: 0 0 0 0 0 0 0
[pid=14733] ppid=14694 vsize=0 CPUtime=0.95 cores=0-7
/proc/14733/stat : 14733 (python) Z 14694 14694 13108 0 -1 4203612 837 0 0 0 49 46 0 0 15 0 1 0 625869163 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14733/statm: 0 0 0 0 0 0 0
[pid=14737] ppid=14694 vsize=0 CPUtime=1 cores=0-7
/proc/14737/stat : 14737 (python) Z 14694 14694 13108 0 -1 4203612 845 0 2 0 50 50 0 0 15 0 1 0 625869250 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 116
/proc/14737/statm: 0 0 0 0 0 0 0
[pid=14752] ppid=14694 vsize=0 CPUtime=0.29 cores=0-7
/proc/14752/stat : 14752 (python) Z 14694 14694 13108 0 -1 4203612 845 0 4 0 14 15 0 0 15 0 1 0 625898673 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/14752/statm: 0 0 0 0 0 0 0
[pid=14762] ppid=14694 vsize=0 CPUtime=0.05 cores=0-7
/proc/14762/stat : 14762 (python) Z 14694 14694 13108 0 -1 4203612 861 0 0 0 2 3 0 0 15 0 1 0 625910062 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14762/statm: 0 0 0 0 0 0 0
[pid=14766] ppid=14694 vsize=0 CPUtime=0.02 cores=0-7
/proc/14766/stat : 14766 (python) Z 14694 14694 13108 0 -1 4203612 864 0 0 0 0 2 0 0 16 0 1 0 625911364 0 0 33554432000 0 0 0 0 0 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/14766/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 209.43
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14694 and gives
#  childrusage.ru_utime.tv_sec=198
#  childrusage.ru_utime.tv_usec=666798
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=218814
# CPU time returned by wait4() is 199.886
# while last known CPU time is 209.43
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 4077.97
#  lost CPU user time (s): 4066.46
#  lost CPU system time (s): 11.51

Real time (s): 726.48
CPU time (s): 4287.4
CPU user time (s): 4269.87
CPU system time (s): 17.53
CPU usage (%): 590.161
Max. virtual memory (cumulated for all children) (KiB): 31749516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 198.667
system time used= 1.21881
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 620628
page faults= 21
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3025
involuntary context switches= 613

runsolver used 3.13352 second user time and 7.62784 second system time

The end

Launcher Data

Begin job on node118 at 2011-05-02 19:08:06
IDJOB=3322751
IDBENCH=88165
IDSOLVER=1710
FILE ID=node118/3322751-1304356085
RUNJOBID= node118-1304335528-13122
PBS_JOBID= 13178014
Free space on /tmp= 73192 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/2dlx_ca_bp_f_liveness.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322751-1304356085/watcher-3322751-1304356085 -o /tmp/evaluation-result-3322751-1304356085/solver-3322751-1304356085 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322751-1304356085.cnf -seed 1545527950 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 99cd8de7f06ce8c087a5c7fb299dfb62
RANDOM SEED=1545527950

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       7735524 kB
Buffers:        510820 kB
Cached:        2400044 kB
SwapCached:       2908 kB
Active:       22469800 kB
Inactive:      2321316 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       7735524 kB
SwapTotal:    67111528 kB
SwapFree:     67103364 kB
Dirty:          124552 kB
Writeback:           4 kB
AnonPages:    21879264 kB
Mapped:          24748 kB
Slab:           300408 kB
PageTables:      57080 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 43596340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73160 MiB
End job on node118 at 2011-05-02 19:20:14