Trace number 3285828

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
synit_sat 2011-03-03Signal 70.3143 71.9446

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUM6c2d25eda70423643946d76935ceb950
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1512832
Number of clauses8233086
Sum of the clauses size19530286
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 28165680
Number of clauses of size 31280
Number of clauses of size 41600
Number of clauses of size 51600
Number of clauses of size over 562080

Solver Data 

0.00/0.00	c start  0 total 0
3.49/3.59	c Find Units :        846
4.30/4.40	c Find Invs  :          0
5.09/5.10	c Find Ands  :        640 AvgFaninNum: 2
5.09/5.10	c Find Xors  :          0 AvgFaninNum: nan
5.09/5.10	c Find Ite   :          0
5.09/5.11	c UnDirect variable: 0
5.09/5.11	c UnDirect to Direct Gate: 0
5.09/5.11	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
5.09/5.13	c Break Cycle : 0
5.09/5.13	c Total Root : 640 Undef Var: 1512192
5.09/5.18	c After covering, Total Root: 640 Leaf: 1486
5.09/5.18	c Variable( cover/uncovered/unused ): 2126 1510706 0
5.09/5.18	c Unit Clauses: 846
5.09/5.18	c Binary Clauses( cover/uncovered ): 1280 8164400
5.09/5.18	c Clauses( cover/uncovered ): 640 65920
5.09/5.18	c Total Clauses( cover/uncovered ): 2766 8230320 0.0335962%
5.09/5.18	c Covered Ands: 640 Invs: 0 Xors: 0 Ites: 0
11.00/11.03	c Uncover Clauses avg size: 2.37232 max size: 1178
11.09/11.14	c Final circuit: i/l/o/s 1511346       0 7514113   9383412
11.09/11.14	c cover rate 0.0335962
11.09/11.14	c rocky end  11.14 total 11.14
22.79/22.84	c covering time  11.69 total 22.83
26.19/26.23	tcmalloc: large alloc 1073741824 bytes == 0x17d9a9000 @ 
60.29/60.30	terminate called after throwing an instance of 'std::bad_alloc'
60.29/60.31	  what():  std::bad_alloc

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285828-1303765161/watcher-3285828-1303765161 -o /tmp/evaluation-result-3285828-1303765161/solver-3285828-1303765161 -C 2400 -W 1300 -M 7680 HOME/synit_sat HOME/instance-3285828-1303765161.cnf 1983333902 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.72 3.46 3.56 4/189 24441
/proc/meminfo: memFree=8708392/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=29716 CPUtime=0 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 1689 0 0 0 0 0 0 0 22 0 1 0 488117069 30429184 1626 33554432000 4194304 4947581 140733501782720 18446744073709551615 4283938 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24441/statm: 7429 1627 289 184 0 2304 0

[startup+0.090115 s]
/proc/loadavg: 4.72 3.46 3.56 4/189 24441
/proc/meminfo: memFree=8708392/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=76900 CPUtime=0.08 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 13886 0 0 0 6 2 0 0 22 0 1 0 488117069 78745600 13820 33554432000 4194304 4947581 140733501782720 18446744073709551615 4283938 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 19225 13821 377 184 0 14100 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 76900

[startup+0.101113 s]
/proc/loadavg: 4.72 3.46 3.56 4/189 24441
/proc/meminfo: memFree=8708392/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=80996 CPUtime=0.09 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 14174 0 0 0 7 2 0 0 22 0 1 0 488117069 82939904 14109 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640557146 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 20249 14133 377 184 0 15124 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 80996

[startup+0.301078 s]
/proc/loadavg: 4.72 3.46 3.56 4/189 24441
/proc/meminfo: memFree=8708392/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=113892 CPUtime=0.29 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 22771 0 0 0 26 3 0 0 23 0 1 0 488117069 116625408 22705 33554432000 4194304 4947581 140733501782720 18446744073709551615 4799423 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 28473 22705 377 184 0 23348 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 113892

[startup+0.701004 s]
/proc/loadavg: 4.72 3.46 3.56 4/189 24441
/proc/meminfo: memFree=8708392/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=163172 CPUtime=0.69 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 34844 0 0 0 64 5 0 0 25 0 1 0 488117069 167088128 34778 33554432000 4194304 4947581 140733501782720 18446744073709551615 4799423 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 40793 34778 377 184 0 35668 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 163172

[startup+1.50085 s]
/proc/loadavg: 4.72 3.46 3.56 5/190 24442
/proc/meminfo: memFree=8507752/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=261860 CPUtime=1.49 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 58894 0 0 0 139 10 0 0 25 0 1 0 488117069 268144640 58828 33554432000 4194304 4947581 140733501782720 18446744073709551615 4798321 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 65465 58829 377 184 0 60340 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 261860

[startup+3.10057 s]
/proc/loadavg: 4.72 3.46 3.56 5/190 24442
/proc/meminfo: memFree=8248104/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=459620 CPUtime=3.09 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 106920 0 0 0 292 17 0 0 25 0 1 0 488117069 470650880 106854 33554432000 4194304 4947581 140733501782720 18446744073709551615 4716924 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 114905 106854 377 184 0 109780 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 459620

[startup+6.301 s]
/proc/loadavg: 4.83 3.50 3.57 5/190 24442
/proc/meminfo: memFree=7989904/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=459872 CPUtime=6.29 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 109579 0 0 0 610 19 0 0 25 0 1 0 488117069 470908928 109513 33554432000 4194304 4947581 140733501782720 18446744073709551615 4761024 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 114968 109513 385 184 0 109843 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 459872

[startup+12.7008 s]
/proc/loadavg: 4.92 3.54 3.58 5/190 24443
/proc/meminfo: memFree=6626920/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=1740384 CPUtime=12.69 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 418704 0 0 0 1215 54 0 0 25 0 1 0 488117069 1782153216 418146 33554432000 4194304 4947581 140733501782720 18446744073709551615 4826431 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 435096 418146 387 184 0 429971 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1740384

[startup+25.5005 s]
/proc/loadavg: 4.78 3.58 3.60 5/190 24443
/proc/meminfo: memFree=2264552/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=5795664 CPUtime=25.49 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 1361307 0 0 0 2391 158 0 0 25 0 1 0 488117069 5934759936 1358842 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640557008 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 1448916 1358842 421 184 0 1443791 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 5795664

[startup+51.1008 s]
/proc/loadavg: 4.57 3.63 3.61 5/190 24471
/proc/meminfo: memFree=6777636/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=7692640 CPUtime=51.09 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4202496 1757074 0 0 0 4906 203 0 0 25 0 1 0 488117069 7877263360 1683945 33554432000 4194304 4947581 140733501782720 18446744073709551615 4517354 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/24441/statm: 1923160 1683945 449 184 0 1918035 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 7692640

Solver just ended. Dumping a history of the last processes samples

[startup+63.9005 s]
/proc/loadavg: 4.53 3.66 3.62 4/190 24472
/proc/meminfo: memFree=2576120/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=7807712 CPUtime=62.73 cores=5,7
/proc/24441/stat : 24441 (synit_sat) D 24439 24441 23613 0 -1 4204032 1849419 0 2 0 5814 459 0 0 18 0 1 0 488117069 7995097088 1776291 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640245861 0 0 4096 24578 18446744071562154983 0 0 17 5 0 0 0
/proc/24441/statm: 1951928 1776291 488 184 0 1946803 0
Current children cumulated CPU time (s) 62.73
Current children cumulated vsize (KiB) 7807712

[startup+67.1069 s]
/proc/loadavg: 4.53 3.66 3.62 6/190 24472
/proc/meminfo: memFree=96884/32951124 swapFree=67111528/67111528
[pid=24441] ppid=24439 vsize=7807712 CPUtime=65.47 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4204032 1849419 0 2 0 5814 733 0 0 23 0 1 0 488117069 7995097088 1776291 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640245861 0 0 4096 24578 0 0 0 17 5 0 0 163
/proc/24441/statm: 1951928 1776291 488 184 0 1946803 0
Current children cumulated CPU time (s) 65.47
Current children cumulated vsize (KiB) 7807712

[startup+70.3003 s]
/proc/loadavg: 4.80 3.73 3.65 5/190 24472
/proc/meminfo: memFree=94872/32951124 swapFree=67111524/67111528
[pid=24441] ppid=24439 vsize=7807712 CPUtime=68.67 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4204032 1849419 0 2 0 5814 1053 0 0 25 0 1 0 488117069 7995097088 1776291 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640245861 0 0 4096 24578 0 0 0 17 5 0 0 163
/proc/24441/statm: 1951928 1776291 488 184 0 1946803 0
Current children cumulated CPU time (s) 68.67
Current children cumulated vsize (KiB) 7807712

[startup+71.1002 s]
/proc/loadavg: 4.80 3.73 3.65 5/190 24472
/proc/meminfo: memFree=94872/32951124 swapFree=67111524/67111528
[pid=24441] ppid=24439 vsize=7807712 CPUtime=69.46 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4204032 1849419 0 2 0 5814 1132 0 0 25 0 1 0 488117069 7995097088 1776291 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640245861 0 0 4096 24578 0 0 0 17 5 0 0 163
/proc/24441/statm: 1951928 1776291 488 184 0 1946803 0
Current children cumulated CPU time (s) 69.46
Current children cumulated vsize (KiB) 7807712

[startup+71.5071 s]
/proc/loadavg: 4.80 3.73 3.65 5/190 24472
/proc/meminfo: memFree=96676/32951124 swapFree=67111524/67111528
[pid=24441] ppid=24439 vsize=7807712 CPUtime=69.87 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4204032 1849419 0 2 0 5814 1173 0 0 25 0 1 0 488117069 7995097088 1776291 33554432000 4194304 4947581 140733501782720 18446744073709551615 253640245861 0 0 4096 24578 0 0 0 17 5 0 0 163
/proc/24441/statm: 1951928 1776291 488 184 0 1946803 0
Current children cumulated CPU time (s) 69.87
Current children cumulated vsize (KiB) 7807712

[startup+71.9011 s]
/proc/loadavg: 4.80 3.73 3.65 5/190 24472
/proc/meminfo: memFree=96676/32951124 swapFree=67111524/67111528
[pid=24441] ppid=24439 vsize=0 CPUtime=70.27 cores=5,7
/proc/24441/stat : 24441 (synit_sat) R 24439 24441 23613 0 -1 4204036 1849419 0 2 0 5814 1213 0 0 25 0 1 0 488117069 0 0 33554432000 0 0 0 0 0 0 0 4096 24578 18446744073709551615 0 0 17 5 0 0 163
/proc/24441/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 70.27
Current children cumulated vsize (KiB) 0

Child ended because it received signal 6 (SIGABRT)
Child dumped core
Real time (s): 71.9446
CPU time (s): 70.3143
CPU user time (s): 58.1412
CPU system time (s): 12.1731
CPU usage (%): 97.734
Max. virtual memory (cumulated for all children) (KiB): 7807712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 58.1412
system time used= 12.1731
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1849419
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 68

runsolver used 0.108983 second user time and 0.288956 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-25 22:59:27
IDJOB=3285828
IDBENCH=82404
IDSOLVER=1571
FILE ID=node106/3285828-1303765161
RUNJOBID= node106-1303765018-24342
PBS_JOBID= 13157143
Free space on /tmp= 71424 MiB

SOLVER NAME= synit_sat 2011-03-03
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= HOME/synit_sat BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285828-1303765161/watcher-3285828-1303765161 -o /tmp/evaluation-result-3285828-1303765161/solver-3285828-1303765161 -C 2400 -W 1300 -M 7680  HOME/synit_sat HOME/instance-3285828-1303765161.cnf 1983333902

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 6c2d25eda70423643946d76935ceb950
RANDOM SEED=1983333902

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8708672 kB
Buffers:       1973700 kB
Cached:       10893844 kB
SwapCached:          0 kB
Active:       14742152 kB
Inactive:      8901612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8708672 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          237752 kB
Writeback:           0 kB
AnonPages:    10775592 kB
Mapped:          17100 kB
Slab:           511024 kB
PageTables:      27476 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 12120340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 64280 MiB
End job on node106 at 2011-04-25 23:00:39