Trace number 4266747

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco-sat 1.12? (TO) 251.94099 252.01801

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-10-325-100.xml
MD5SUM34a68c11381dc26a6f51296df739d32e
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark43
Best CPU time to get the best result obtained on this benchmark1994.3199
Satisfiable
(Un)Satisfiability was proved
Number of variables3251
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size302
Distribution of domain sizes[{"size":2,"count":3250},{"size":302,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":3250},{"degree":46,"count":1}]
Minimum constraint arity325
Maximum constraint arity3250
Distribution of constraint arities[{"arity":325,"count":10},{"arity":651,"count":45},{"arity":3250,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data 

0.25/0.36	c SAT : Variables: 6802 -- Clauses: 51952
0.25/0.36	c best=?? lower=0 upper=301 
251.92/252.01	c
251.92/252.01	c This is cosoco 1.12 --  
251.92/252.01	c
251.92/252.01	c command line: cosoco -lc -model -restarts -sat HOME/instance-4266747-1502644540.xml 
251.92/252.01	c enable optimization
251.92/252.01	c ========================================[ Problem Statistics ]===========================================
251.92/252.01	c |                                                                                                       
251.92/252.01	c |  Parse time        :         0.29 s 
251.92/252.01	c |
251.92/252.01	c |               Variables: 3251
251.92/252.01	c |            Domain Sizes: 2..302
251.92/252.01	c |
251.92/252.01	c |             Constraints: 389
251.92/252.01	c |                   Arity: 1..651  -- Unary: 1
251.92/252.01	c | 
251.92/252.01	c |                   Types: 
251.92/252.01	c |                          Intension: 46
251.92/252.01	c |                          Lex: 333
251.92/252.01	c |                          Sum: 10
251.92/252.01	c |                          
251.92/252.01	c =========================================================================================================
251.92/252.01	
251.92/252.01	c *** INTERRUPTED ***
251.92/252.01	c restarts              : 0           
251.92/252.01	c conflicts             : 0            (0 /sec)
251.92/252.01	c decisions             : 969          (4 /sec)
251.92/252.01	c propagations          : 1369        (5 /sec)
251.92/252.01	c root propagations     : 24          
251.92/252.01	c filter calls          : 14002          (56 /sec)
251.92/252.01	c useless filter calls  : 13996          (99 %)
251.92/252.01	c
251.92/252.01	c clauses               : 51952
251.92/252.01	c SAT propagations      : 0
251.92/252.01	c SAT conflicts         : 0 (0 learnts)
251.92/252.01	c Memory used           : 231.16 MB
251.92/252.01	c CPU time              : 251.758 s
251.92/252.01	
251.92/252.01	c No Bound found!
251.92/252.01	
251.92/252.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15176 MiB free)
  memory of node 1: 16384 MiB (15629 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4266747-1502644540/watcher-4266747-1502644540 -o /tmp/evaluation-result-4266747-1502644540/solver-4266747-1502644540 -C 252 -W 252 -M 15500 --bin-var /tmp/runsolver-exch-node134-1502642157-20629 --watchdog 312 cosoco -lc -model -restarts -sat HOME/instance-4266747-1502644540.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 282 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=21545, runsolver pid=21542

[startup+0.100151 s]*
/proc/loadavg: 2.17 3.21 3.02 3/189 21546
/proc/meminfo: memFree=31543036/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=30040 memory=6412 CPUtime=0.04 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 1814 0 0 0 4 0 0 0 20 0 1 0 111960429 30760960 1603 18446744073709551615 4194304 5972588 140728001489264 140728001485912 140121312603109 0 0 1 0 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 7510 1603 805 435 0 873 0
Current children cumulated CPU time: 0.04 s
Current children cumulated vsize: 30040 KiB
Current children cumulated memory: 6412 KiB

[startup+0.209791 s]*
/proc/loadavg: 2.17 3.21 3.02 3/189 21546
/proc/meminfo: memFree=31539688/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=33468 memory=9828 CPUtime=0.15 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 2677 0 0 0 15 0 0 0 20 0 1 0 111960429 34271232 2457 18446744073709551615 4194304 5972588 140728001489264 140728001485912 140121312603109 0 0 1 0 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 8367 2457 805 435 0 1730 0
Current children cumulated CPU time: 0.15 s
Current children cumulated vsize: 33468 KiB
Current children cumulated memory: 9828 KiB

[startup+0.309625 s]*
/proc/loadavg: 2.17 3.21 3.02 3/189 21546
/proc/meminfo: memFree=31536712/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=36488 memory=12984 CPUtime=0.25 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 3428 0 0 0 25 0 0 0 20 0 1 0 111960429 37363712 3246 18446744073709551615 4194304 5972588 140728001489264 140728001485912 140121312603109 0 0 1 0 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 9122 3246 805 435 0 2485 0
Current children cumulated CPU time: 0.25 s
Current children cumulated vsize: 36488 KiB
Current children cumulated memory: 12984 KiB

[startup+0.700289 s]
/proc/loadavg: 2.17 3.21 3.02 3/190 21547
/proc/meminfo: memFree=31523520/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=52428 memory=26860 CPUtime=0.62 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 6377 0 0 0 62 0 0 0 20 0 1 0 111960429 53686272 6715 18446744073709551615 4194304 5972588 140728001489264 140728001486120 4965744 0 0 1 8405026 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 13107 6715 851 435 0 6470 0
Current children cumulated CPU time: 0.62 s
Current children cumulated vsize: 52428 KiB
Current children cumulated memory: 26860 KiB

[startup+1.50029 s]
/proc/loadavg: 2.17 3.21 3.02 3/190 21547
/proc/meminfo: memFree=31521660/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=56784 memory=31084 CPUtime=1.43 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 7478 0 0 0 142 1 0 0 20 0 1 0 111960429 58146816 7771 18446744073709551615 4194304 5972588 140728001489264 140728001486120 4965753 0 0 1 8405026 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 14196 7771 851 435 0 7559 0
Current children cumulated CPU time: 1.43 s
Current children cumulated vsize: 56784 KiB
Current children cumulated memory: 31084 KiB

[startup+3.10958 s]
/proc/loadavg: 2.17 3.21 3.02 3/190 21547
/proc/meminfo: memFree=31510088/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=65628 memory=39864 CPUtime=3.04 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 10332 0 0 0 303 1 0 0 20 0 1 0 111960429 67203072 9966 18446744073709551615 4194304 5972588 140728001489264 140728001486120 140121312603109 0 0 1 8405026 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 16407 9966 851 435 0 9770 0
Current children cumulated CPU time: 3.04 s
Current children cumulated vsize: 65628 KiB
Current children cumulated memory: 39864 KiB

[startup+6.30027 s]
/proc/loadavg: 2.15 3.19 3.02 3/190 21547
/proc/meminfo: memFree=31492408/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=84900 memory=59268 CPUtime=6.22 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 16100 0 0 0 621 1 0 0 20 0 1 0 111960429 86937600 14817 18446744073709551615 4194304 5972588 140728001489264 140728001486120 4965744 0 0 1 8405026 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 21225 14817 851 435 0 14588 0
Current children cumulated CPU time: 6.22 s
Current children cumulated vsize: 84900 KiB
Current children cumulated memory: 59268 KiB

[startup+12.7003 s]
/proc/loadavg: 2.14 3.17 3.01 3/190 21547
/proc/meminfo: memFree=31457260/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=121860 memory=96088 CPUtime=12.62 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 27401 0 0 0 1259 3 0 0 20 0 1 0 111960429 124784640 24022 18446744073709551615 4194304 5972588 140728001489264 140728001486120 140121312598846 0 0 1 8405026 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 30465 24022 852 435 0 23828 0
Current children cumulated CPU time: 12.62 s
Current children cumulated vsize: 121860 KiB
Current children cumulated memory: 96088 KiB

[startup+25.5003 s]
/proc/loadavg: 2.11 3.11 3.00 3/190 21547
/proc/meminfo: memFree=31382532/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=195516 memory=169900 CPUtime=25.42 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 48897 0 0 0 2535 7 0 0 20 0 1 0 111960429 200208384 42475 18446744073709551615 4194304 5972588 140728001489264 140728001486120 4965753 0 0 1 8405026 0 0 0 17 1 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 48879 42475 852 435 0 42242 0
Current children cumulated CPU time: 25.42 s
Current children cumulated vsize: 195516 KiB
Current children cumulated memory: 169900 KiB

[startup+51.1098 s]
/proc/loadavg: 2.07 3.02 2.97 3/190 21548
/proc/meminfo: memFree=31340448/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=234324 memory=208832 CPUtime=51.03 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 102254 0 0 0 5092 11 0 0 20 0 1 0 111960429 239947776 52208 18446744073709551615 4194304 5972588 140728001489264 140728001486120 4909657 0 0 1 8405026 0 0 0 17 5 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 58581 52208 855 435 0 51944 0
Current children cumulated CPU time: 51.03 s
Current children cumulated vsize: 234324 KiB
Current children cumulated memory: 208832 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.87 2.92 3/186 21549
/proc/meminfo: memFree=31344496/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=234588 memory=209068 CPUtime=102.22 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 112782 0 0 0 10211 11 0 0 20 0 1 0 111960429 240218112 52267 18446744073709551615 4194304 5972588 140728001489264 140728001486040 5071499 0 0 1 8405026 0 0 0 17 5 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 58647 52267 855 435 0 52010 0
Current children cumulated CPU time: 102.22 s
Current children cumulated vsize: 234588 KiB
Current children cumulated memory: 209068 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.71 2.86 3/186 21551
/proc/meminfo: memFree=31343948/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=235248 memory=209720 CPUtime=162.22 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 144454 0 0 0 16209 13 0 0 20 0 1 0 111960429 240893952 52430 18446744073709551615 4194304 5972588 140728001489264 140728001486040 4965404 0 0 1 8405026 0 0 0 17 5 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 58812 52430 855 435 0 52175 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 235248 KiB
Current children cumulated memory: 209720 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.58 2.81 3/186 21553
/proc/meminfo: memFree=31342132/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=235908 memory=210284 CPUtime=222.22 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 185652 0 0 0 22206 16 0 0 20 0 1 0 111960429 241569792 52571 18446744073709551615 4194304 5972588 140728001489264 140728001486184 5070711 0 0 1 8405026 0 0 0 17 5 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 58977 52571 855 435 0 52340 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 235908 KiB
Current children cumulated memory: 210284 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252 s]*
/proc/loadavg: 2.00 2.52 2.78 3/185 21616
/proc/meminfo: memFree=31593680/32770624 swapFree=67108764/67108860
[pid=21545] ppid=21542 vsize=236700 memory=211164 CPUtime=251.92 cores=1,3,5,7
/proc/21545/stat : 21545 (cosoco) R 21542 21545 4674 0 -1 4202496 192633 0 0 0 25175 17 0 0 20 0 1 0 111960429 242380800 52791 18446744073709551615 4194304 5972588 140728001489264 140728001486024 5070711 0 0 1 8405026 0 0 0 17 5 0 0 6 0 0 8070896 8075904 35749888 140728001495497 140728001495597 140728001495597 140728001499086 0
/proc/21545/statm: 59175 52791 855 435 0 52538 0
Current children cumulated CPU time: 251.92 s
Current children cumulated vsize: 236700 KiB
Current children cumulated memory: 211164 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+252.018 s]
# the end of solver process 21545 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=251.758 s, system=0.182997 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 252.018
CPU time (s): 251.941
CPU user time (s): 251.758
CPU system time (s): 0.182997
CPU usage (%): 99.9693
Max. virtual memory (cumulated for all children) (KiB): 236700
Max. memory (cumulated for all children) (KiB): 211164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 251.758
system time used= 0.182997
maximum resident set size= 211248
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 192678
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 540


# summary of solver processes directly reported to runsolver:
#   pid: 21545
#   total CPU time (s): 251.941
#   total CPU user time (s): 251.758
#   total CPU system time (s): 0.182997

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.989149 second user time and 1.87886 second system time

The end

Launcher Data 

Begin job on node134 at 2017-08-13 19:01:46
IDJOB=4266747
IDBENCH=122928
IDSOLVER=2656
FILE ID=node134/4266747-1502644540
RUNJOBID= node134-1502642157-20629
PBS_JOBID= 
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-10-325-100.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4266747-1502644540/watcher-4266747-1502644540 -o /tmp/evaluation-result-4266747-1502644540/solver-4266747-1502644540 -C 252 -W 252 -M 15500 --bin-var /tmp/runsolver-exch-node134-1502642157-20629 --watchdog 312  cosoco -lc -model -restarts -sat HOME/instance-4266747-1502644540.xml

TIME LIMIT= 252 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 34a68c11381dc26a6f51296df739d32e
RANDOM SEED=175521660

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31545928 kB
MemAvailable:   31665220 kB
Buffers:          216088 kB
Cached:           206368 kB
SwapCached:            4 kB
Active:           667392 kB
Inactive:         122072 kB
Active(anon):     311004 kB
Inactive(anon):    97600 kB
Active(file):     356388 kB
Inactive(file):    24472 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      67108860 kB
SwapFree:       67108764 kB
Dirty:              2504 kB
Writeback:             4 kB
AnonPages:        324520 kB
Mapped:            59060 kB
Shmem:             41564 kB
Slab:             135768 kB
SReclaimable:     108532 kB
SUnreclaim:        27236 kB
KernelStack:        3296 kB
PageTables:         5824 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     673184 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      354332 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      101760 kB
DirectMap2M:    33443840 kB

Free space on /tmp at the end= 62028 MiB
End job on node134 at 2017-08-13 19:05:58