Trace number 4258571

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 1.1? (TO) 252.03 252.011

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-07-350-100.xml
MD5SUMcd1777af07bd314664d86e97c163b75e
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark22
Best CPU time to get the best result obtained on this benchmark1920.95
Satisfiable
(Un)Satisfiability was proved
Number of variables2451
Number of constraints29
Number of domains2
Minimum domain size2
Maximum domain size334
Distribution of domain sizes[{"size":2,"count":2450},{"size":334,"count":1}]
Minimum variable degree8
Maximum variable degree22
Distribution of variable degrees[{"degree":8,"count":2450},{"degree":22,"count":1}]
Minimum constraint arity350
Maximum constraint arity2450
Distribution of constraint arities[{"arity":350,"count":7},{"arity":701,"count":21},{"arity":2450,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":28}]
Optimization problemYES
Type of objectivemin VAR

Solver Data 

0.10/0.15	c best=?? lower=0 upper=333 
252.02/252.00	c
252.02/252.00	c This is cosoco 1.1 --  
252.02/252.00	c
252.02/252.00	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4258571-1502641205.xml 
252.02/252.00	c enable optimization
252.02/252.00	c ========================================[ Problem Statistics ]===========================================
252.02/252.00	c |                                                                                                       
252.02/252.00	c |  Parse time        :         0.15 s 
252.02/252.00	c |
252.02/252.00	c |               Variables: 2451
252.02/252.00	c |            Domain Sizes: 2..334
252.02/252.00	c |
252.02/252.00	c |             Constraints: 384
252.02/252.00	c |                   Arity: 1..701  -- Unary: 1
252.02/252.00	c | 
252.02/252.00	c |                   Types: 
252.02/252.00	c |                          Intension: 22
252.02/252.00	c |                          Lex: 355
252.02/252.00	c |                          Sum: 7
252.02/252.00	c |                          
252.02/252.00	c =========================================================================================================
252.02/252.00	
252.02/252.00	c *** INTERRUPTED ***
252.02/252.00	c restarts              : 0           
252.02/252.00	c conflicts             : 0            (0 /sec)
252.02/252.00	c decisions             : 1428         (6 /sec)
252.02/252.01	c propagations          : 1928        (8 /sec)
252.02/252.01	c root propagations     : 17          
252.02/252.01	c filter calls          : 16164          (64 /sec)
252.02/252.01	c useless filter calls  : 16157          (99 %)
252.02/252.01	c Memory used           : 138.42 MB
252.02/252.01	c CPU time              : 251.978 s
252.02/252.01	
252.02/252.01	c No Bound found!
252.02/252.01	
252.02/252.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13528 MiB free)
  memory of node 1: 16384 MiB (14330 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4258571-1502641205/watcher-4258571-1502641205 -o /tmp/evaluation-result-4258571-1502641205/solver-4258571-1502641205 -C 252 -W 252 -M 15500 --bin-var /tmp/runsolver-exch-node151-1502635273-10382 --watchdog 312 HOME/cosoco -lc -model -restarts HOME/instance-4258571-1502641205.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 282 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=13052, runsolver pid=13049

[startup+0.10015 s]*
/proc/loadavg: 2.00 1.99 2.03 3/188 13053
/proc/meminfo: memFree=28523544/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=31420 memory=8052 CPUtime=0.1 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 2166 0 0 0 10 0 0 0 20 0 1 0 97201388 32174080 1981 33554432000 4194304 5972556 140731048267648 140731048264296 140605015700640 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 7888 1981 805 435 0 1251 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31420 KiB
Current children cumulated memory: 8052 KiB

[startup+0.20955 s]*
/proc/loadavg: 2.00 1.99 2.03 3/188 13053
/proc/meminfo: memFree=28515732/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=38892 memory=15544 CPUtime=0.21 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 4049 0 0 0 21 0 0 0 20 0 1 0 97201388 39825408 3886 33554432000 4194304 5972556 140731048267648 140731048264296 4965737 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 9723 3886 845 435 0 3086 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 38892 KiB
Current children cumulated memory: 15544 KiB

[startup+0.309513 s]*
/proc/loadavg: 2.00 1.99 2.03 3/188 13053
/proc/meminfo: memFree=28515484/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=39156 memory=15808 CPUtime=0.31 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 4128 0 0 0 31 0 0 0 20 0 1 0 97201388 40095744 3952 33554432000 4194304 5972556 140731048267648 140731048264296 4962371 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 9789 3952 845 435 0 3152 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 39156 KiB
Current children cumulated memory: 15808 KiB

[startup+0.700275 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13053
/proc/meminfo: memFree=28514740/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=40344 memory=16864 CPUtime=0.69 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 4431 0 0 0 69 0 0 0 20 0 1 0 97201388 41312256 4216 33554432000 4194304 5972556 140731048267648 140731048264296 4962360 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 10086 4216 845 435 0 3449 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 40344 KiB
Current children cumulated memory: 16864 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13053
/proc/meminfo: memFree=28513164/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=44832 memory=21352 CPUtime=1.49 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 5553 0 0 0 149 0 0 0 20 0 1 0 97201388 45907968 5338 33554432000 4194304 5972556 140731048267648 140731048264504 140605006367717 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 11208 5338 845 435 0 4571 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 44832 KiB
Current children cumulated memory: 21352 KiB

[startup+3.1092 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13114
/proc/meminfo: memFree=28838808/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=53808 memory=30340 CPUtime=3.1 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 8524 0 0 0 309 1 0 0 20 0 1 0 97201388 55099392 7585 33554432000 4194304 5972556 140731048267648 140731048264504 140605006367717 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 13452 7585 845 435 0 6815 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 53808 KiB
Current children cumulated memory: 30340 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13114
/proc/meminfo: memFree=28823100/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=69780 memory=46476 CPUtime=6.29 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 13565 0 0 0 628 1 0 0 20 0 1 0 97201388 71454720 11619 33554432000 4194304 5972556 140731048267648 140731048264504 4965737 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 17445 11619 846 435 0 10808 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 69780 KiB
Current children cumulated memory: 46476 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13114
/proc/meminfo: memFree=28790044/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=105684 memory=82336 CPUtime=12.69 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 23070 0 0 0 1267 2 0 0 20 0 1 0 97201388 108220416 20584 33554432000 4194304 5972556 140731048267648 140731048264504 5070688 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 26421 20584 846 435 0 19784 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 105684 KiB
Current children cumulated memory: 82336 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 13114
/proc/meminfo: memFree=28755120/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=136836 memory=113616 CPUtime=25.48 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 49768 0 0 0 2544 4 0 0 20 0 1 0 97201388 140120064 28404 33554432000 4194304 5972556 140731048267648 140731048264504 5053055 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 34209 28404 849 435 0 27572 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 136836 KiB
Current children cumulated memory: 113616 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 13114
/proc/meminfo: memFree=28754948/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=136968 memory=113628 CPUtime=51.1 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 49816 0 0 0 5106 4 0 0 20 0 1 0 97201388 140255232 28407 33554432000 4194304 5972556 140731048267648 140731048264568 5071483 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 34242 28407 849 435 0 27605 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 136968 KiB
Current children cumulated memory: 113628 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 13115
/proc/meminfo: memFree=28754544/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=137364 memory=114052 CPUtime=102.29 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 49998 0 0 0 10225 4 0 0 20 0 1 0 97201388 140660736 28513 33554432000 4194304 5972556 140731048267648 140731048264568 4965412 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 34341 28513 849 435 0 27704 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 137364 KiB
Current children cumulated memory: 114052 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.00 2.03 3/187 13116
/proc/meminfo: memFree=28753800/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=138420 memory=115032 CPUtime=162.3 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 50595 0 0 0 16225 5 0 0 20 0 1 0 97201388 141742080 28758 33554432000 4194304 5972556 140731048267648 140731048264568 4965404 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 34605 28758 849 435 0 27968 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 138420 KiB
Current children cumulated memory: 115032 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.00 2.03 3/187 13117
/proc/meminfo: memFree=28751736/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=140272 memory=116944 CPUtime=222.31 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 51123 0 0 0 22226 5 0 0 20 0 1 0 97201388 143638528 29236 33554432000 4194304 5972556 140731048267648 140731048264568 5099648 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 35068 29236 849 435 0 28431 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 140272 KiB
Current children cumulated memory: 116944 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252 s]*
/proc/loadavg: 2.01 2.00 2.03 3/187 13118
/proc/meminfo: memFree=28750472/32770624 swapFree=67108860/67108860
[pid=13052] ppid=13049 vsize=141740 memory=118496 CPUtime=252.02 cores=0,2,4,6
/proc/13052/stat : 13052 (cosoco) R 13049 13052 4973 0 -1 4202496 51500 0 0 0 25197 5 0 0 20 0 1 0 97201388 145141760 29624 33554432000 4194304 5972556 140731048267648 140731048264568 4909627 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31387648 140731048273057 140731048273187 140731048273187 140731048275918 0
/proc/13052/statm: 35435 29624 849 435 0 28798 0
Current children cumulated CPU time: 252.02 s
Current children cumulated vsize: 141740 KiB
Current children cumulated memory: 118496 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.011 s]
# the end of solver process 13052 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=251.978 s, system=0.052005 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.011
CPU time (s): 252.03
CPU user time (s): 251.978
CPU system time (s): 0.052005
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 141740
Max. memory (cumulated for all children) (KiB): 118496

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 251.978
system time used= 0.052005
maximum resident set size= 118584
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51542
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21
involuntary context switches= 302


# summary of solver processes directly reported to runsolver:
#   pid: 13052
#   total CPU time (s): 252.03
#   total CPU user time (s): 251.978
#   total CPU system time (s): 0.052005

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.43707 second user time and 1.3976 second system time

The end

Launcher Data 

Begin job on node151 at 2017-08-13 18:05:46
IDJOB=4258571
IDBENCH=122949
IDSOLVER=2644
FILE ID=node151/4258571-1502641205
RUNJOBID= node151-1502635273-10382
PBS_JOBID= 20628306
Free space on /tmp= 61752 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-07-350-100.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4258571-1502641205/watcher-4258571-1502641205 -o /tmp/evaluation-result-4258571-1502641205/solver-4258571-1502641205 -C 252 -W 252 -M 15500 --bin-var /tmp/runsolver-exch-node151-1502635273-10382 --watchdog 312  HOME/cosoco -lc -model -restarts HOME/instance-4258571-1502641205.xml

TIME LIMIT= 252 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cd1777af07bd314664d86e97c163b75e
RANDOM SEED=255700

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28528024 kB
MemAvailable:   31653784 kB
Buffers:          244356 kB
Cached:          3172756 kB
SwapCached:            0 kB
Active:          1189896 kB
Inactive:        2618464 kB
Active(anon):     394104 kB
Inactive(anon):    25044 kB
Active(file):     795792 kB
Inactive(file):  2593420 kB
Unevictable:        7024 kB
Mlocked:            7024 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2344 kB
Writeback:             4 kB
AnonPages:        398220 kB
Mapped:            45684 kB
Shmem:             25224 kB
Slab:             131320 kB
SReclaimable:     104764 kB
SUnreclaim:        26556 kB
KernelStack:        3280 kB
PageTables:         5676 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     690380 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61752 MiB
End job on node151 at 2017-08-13 18:09:59