Trace number 4266637

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco-sat 1.12? (TO) 240.487 240.494

General information on the benchmark

NameCutstock/Cutstock-zinc-s1/
Cutstock-t16-1.xml
MD5SUM36688640cc45f0157406ded158d596cc
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark1510
Best CPU time to get the best result obtained on this benchmark1975.21
Satisfiable
(Un)Satisfiability was proved
Number of variables31773
Number of constraints1535
Number of domains17
Minimum domain size2
Maximum domain size195
Distribution of domain sizes[{"size":2,"count":1513},{"size":4,"count":1513},{"size":25,"count":3026},{"size":44,"count":1513},{"size":45,"count":1513},{"size":73,"count":1513},{"size":78,"count":1513},{"size":87,"count":3026},{"size":102,"count":1513},{"size":107,"count":1513},{"size":130,"count":1513},{"size":131,"count":1513},{"size":132,"count":3026},{"size":139,"count":3026},{"size":170,"count":1513},{"size":175,"count":1513},{"size":195,"count":1513}]
Minimum variable degree3
Maximum variable degree3
Distribution of variable degrees[{"degree":3,"count":31773}]
Minimum constraint arity21
Maximum constraint arity30260
Distribution of constraint arities[{"arity":21,"count":1513},{"arity":1513,"count":21},{"arity":30260,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"ordered","count":1},{"type":"lex","count":1},{"type":"sum","count":1533}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

17.00/17.09	c SAT : Variables: 3059286 -- Clauses: 194235914
17.00/17.10	c best=?? lower=-1513 upper=0 
240.00/240.01	c
240.00/240.01	c This is cosoco 1.12 --  
240.00/240.01	c
240.00/240.01	c command line: cosoco -lc -model -restarts -sat HOME/instance-4266637-1502599423.xml 
240.00/240.01	c enable optimization
240.00/240.01	c ========================================[ Problem Statistics ]===========================================
240.00/240.01	c |                                                                                                       
240.00/240.01	c |  Parse time        :        14.89 s 
240.00/240.01	c |
240.00/240.01	c |               Variables: 31773
240.00/240.01	c |            Domain Sizes: 2..195
240.00/240.01	c |
240.00/240.01	c |             Constraints: 4558
240.00/240.01	c |                   Arity: 2..1513  -- Binary: 1512
240.00/240.01	c | 
240.00/240.01	c |                   Types: 
240.00/240.01	c |                          (X -Y <= k): 1512
240.00/240.01	c |                          Lex: 1512
240.00/240.01	c |                          Sum: 1534
240.00/240.01	c |                          
240.00/240.01	c =========================================================================================================
240.00/240.01	
240.00/240.01	c *** INTERRUPTED ***
240.00/240.01	c restarts              : 28          
240.00/240.01	c conflicts             : 261          (1 /sec)
240.00/240.01	c decisions             : 66021        (278 /sec)
240.00/240.01	c propagations          : 11696113    (49282 /sec)
240.00/240.01	c root propagations     : 2976071     
240.00/240.01	c filter calls          : 5346385        (22527 /sec)
240.00/240.01	c useless filter calls  : 3419372        (63 %)
240.00/240.01	c
240.00/240.01	c clauses               : 194236002
240.00/240.01	c SAT propagations      : 0
240.00/240.01	c SAT conflicts         : 0 (0 learnts)
240.00/240.01	c Memory used           : 10515.48 MB
240.00/240.01	c CPU time              : 237.333 s
240.00/240.01	
240.00/240.01	c No Bound found!
240.00/240.01	
240.00/240.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14050 MiB free)
  memory of node 1: 16384 MiB (15653 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4266637-1502599423/watcher-4266637-1502599423 -o /tmp/evaluation-result-4266637-1502599423/solver-4266637-1502599423 -C 264 -W 240 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502598081-28307 --watchdog 300 cosoco -lc -model -restarts -sat HOME/instance-4266637-1502599423.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 264 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 294 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 240 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=28660, runsolver pid=28657
Current StackSize limit: 8192 KiB


[startup+0.100115 s]*
/proc/loadavg: 2.00 1.79 1.60 3/187 28661
/proc/meminfo: memFree=30360416/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=38500 memory=14628 CPUtime=0.1 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 3853 0 0 0 10 0 0 0 20 0 1 0 93030593 39424000 3657 33554432000 4194304 5972588 140736156830704 140736156827352 139802912738277 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 9625 3657 711 435 0 2988 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38500 KiB
Current children cumulated memory: 14628 KiB

[startup+0.209661 s]*
/proc/loadavg: 2.00 1.79 1.60 3/187 28661
/proc/meminfo: memFree=30271296/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=68420 memory=44484 CPUtime=0.21 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 11354 0 0 0 20 1 0 0 20 0 1 0 93030593 70062080 11121 33554432000 4194304 5972588 140736156830704 140736156827352 5473283 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 17105 11121 743 435 0 10468 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 68420 KiB
Current children cumulated memory: 44484 KiB

[startup+0.309565 s]*
/proc/loadavg: 2.00 1.79 1.60 3/187 28661
/proc/meminfo: memFree=30218012/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=69376 memory=45540 CPUtime=0.31 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 11593 0 0 0 30 1 0 0 20 0 1 0 93030593 71041024 11385 33554432000 4194304 5972588 140736156830704 140736156827352 5635611 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 17344 11385 743 435 0 10707 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 69376 KiB
Current children cumulated memory: 45540 KiB

[startup+0.70036 s]
/proc/loadavg: 2.00 1.79 1.60 3/187 28661
/proc/meminfo: memFree=30116968/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=336300 memory=312444 CPUtime=0.69 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 78297 0 0 0 60 9 0 0 20 0 1 0 93030593 344371200 78045 33554432000 4194304 5972588 140736156830704 140736156827352 139802912734014 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 84075 78111 750 435 0 77438 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 336300 KiB
Current children cumulated memory: 312444 KiB

[startup+1.50036 s]
/proc/loadavg: 2.00 1.79 1.60 3/187 28661
/proc/meminfo: memFree=29237608/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=999264 memory=962740 CPUtime=1.49 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 208296 0 0 0 122 27 0 0 20 0 1 0 93030593 1023246336 240685 33554432000 4194304 5972588 140736156830704 140736156827352 139802912738277 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 249816 240685 784 435 0 243179 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 999264 KiB
Current children cumulated memory: 962740 KiB

[startup+3.10954 s]
/proc/loadavg: 2.00 1.79 1.60 3/187 28661
/proc/meminfo: memFree=28037072/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=2005656 memory=1845480 CPUtime=3.1 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 329280 0 0 0 263 47 0 0 20 0 1 0 93030593 2053791744 461370 33554432000 4194304 5972588 140736156830704 140736156827496 139802912738277 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 501414 461370 784 435 0 494777 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2005656 KiB
Current children cumulated memory: 1845480 KiB

[startup+6.30032 s]
/proc/loadavg: 2.00 1.80 1.60 3/187 28661
/proc/meminfo: memFree=26481564/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=4034052 memory=3486168 CPUtime=6.29 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 562315 0 0 0 539 90 0 0 20 0 1 0 93030593 4130869248 871542 33554432000 4194304 5972588 140736156830704 140736156827496 139802912744344 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 1008513 871542 784 435 0 1001876 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 4034052 KiB
Current children cumulated memory: 3486168 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.80 1.61 3/187 28661
/proc/meminfo: memFree=23466420/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=7055284 memory=6689752 CPUtime=12.69 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1012323 0 0 0 1102 167 0 0 20 0 1 0 93030593 7224610816 1672438 33554432000 4194304 5972588 140736156830704 140736156827496 139802912738277 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 1763821 1672438 784 435 0 1757184 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 7055284 KiB
Current children cumulated memory: 6689752 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 1.81 1.61 3/187 28661
/proc/meminfo: memFree=20659352/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=10364104 memory=9137836 CPUtime=25.49 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1428748 0 0 0 2318 231 0 0 20 0 1 0 93030593 10612842496 2284459 33554432000 4194304 5972588 140736156830704 140736156827304 5039159 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 2591026 2284459 802 435 0 2584389 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 10364104 KiB
Current children cumulated memory: 9137836 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 1.83 1.62 3/188 28669
/proc/meminfo: memFree=20325060/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=10702304 memory=9470664 CPUtime=51.1 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1554176 0 0 0 4866 244 0 0 20 0 1 0 93030593 10959159296 2367666 33554432000 4194304 5972588 140736156830704 140736156827464 5039164 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 2675576 2367666 802 435 0 2668939 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 10702304 KiB
Current children cumulated memory: 9470664 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.85 1.64 3/188 28670
/proc/meminfo: memFree=20262160/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=10766536 memory=9533808 CPUtime=102.28 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1654185 0 0 0 9976 252 0 0 20 0 1 0 93030593 11024932864 2383452 33554432000 4194304 5972588 140736156830704 140736156827464 5327767 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 2691634 2383452 802 435 0 2684997 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 10766536 KiB
Current children cumulated memory: 9533808 KiB

[startup+162.3 s]
/proc/loadavg: 1.92 1.85 1.65 3/188 28671
/proc/meminfo: memFree=20260380/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=10767848 memory=9535268 CPUtime=162.29 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1780043 0 0 0 15968 261 0 0 20 0 1 0 93030593 11026276352 2383817 33554432000 4194304 5972588 140736156830704 140736156827464 5139264 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 2691962 2383817 802 435 0 2685325 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 10767848 KiB
Current children cumulated memory: 9535268 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.88 1.68 3/188 28672
/proc/meminfo: memFree=20260256/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=10767848 memory=9535268 CPUtime=222.29 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1850311 0 0 0 21964 265 0 0 20 0 1 0 93030593 11026276352 2383817 33554432000 4194304 5972588 140736156830704 140736156827464 5039159 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 2691962 2383817 802 435 0 2685325 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 10767848 KiB
Current children cumulated memory: 9535268 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+240 s]*
/proc/loadavg: 1.98 1.88 1.68 3/188 28733
/proc/meminfo: memFree=22138644/32770624 swapFree=67108860/67108860
[pid=28660] ppid=28657 vsize=10767848 memory=9535268 CPUtime=240 cores=1,3,5,7
/proc/28660/stat : 28660 (cosoco) R 28657 28660 24168 0 -1 4202496 1874362 0 0 0 23733 267 0 0 20 0 1 0 93030593 11026276352 2383817 33554432000 4194304 5972588 140736156830704 140736156827464 5094144 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8070896 8075904 25952256 140736156832959 140736156833059 140736156833059 140736156835790 0
/proc/28660/statm: 2691962 2383817 802 435 0 2685325 0
Current children cumulated CPU time: 240 s
Current children cumulated vsize: 10767848 KiB
Current children cumulated memory: 9535268 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+240.494 s]
# the end of solver process 28660 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=237.333 s, system=3.15402 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+240.4 s]
/proc/loadavg: 1.98 1.88 1.68 3/188 28733
/proc/meminfo: memFree=23937304/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 1
Real time (s): 240.494
CPU time (s): 240.487
CPU user time (s): 237.333
CPU system time (s): 3.15402
CPU usage (%): 99.9971
Max. virtual memory (cumulated for all children) (KiB): 10767848
Max. memory (cumulated for all children) (KiB): 9535268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 237.333
system time used= 3.15402
maximum resident set size= 9535344
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1874409
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13
involuntary context switches= 127


# summary of solver processes directly reported to runsolver:
#   pid: 28660
#   total CPU time (s): 240.487
#   total CPU user time (s): 237.333
#   total CPU system time (s): 3.15402

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.966603 second user time and 1.80551 second system time

The end

Launcher Data 

Begin job on node103 at 2017-08-13 06:29:25
IDJOB=4266637
IDBENCH=124244
IDSOLVER=2656
FILE ID=node103/4266637-1502599423
RUNJOBID= node103-1502598081-28307
PBS_JOBID= 20628288
Free space on /tmp= 61792 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/Cutstock/Cutstock-zinc-s1/Cutstock-t16-1.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4266637-1502599423/watcher-4266637-1502599423 -o /tmp/evaluation-result-4266637-1502599423/solver-4266637-1502599423 -C 264 -W 240 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502598081-28307 --watchdog 300  cosoco -lc -model -restarts -sat HOME/instance-4266637-1502599423.xml

TIME LIMIT= 264 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 36688640cc45f0157406ded158d596cc
RANDOM SEED=867004991

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30427716 kB
MemAvailable:   30668132 kB
Buffers:           79720 kB
Cached:           455064 kB
SwapCached:            0 kB
Active:          1807708 kB
Inactive:         108452 kB
Active(anon):    1327744 kB
Inactive(anon):    81176 kB
Active(file):     479964 kB
Inactive(file):    27276 kB
Unevictable:        6344 kB
Mlocked:            6344 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              4844 kB
Writeback:             0 kB
AnonPages:       1336004 kB
Mapped:            44448 kB
Shmem:             25228 kB
Slab:             124052 kB
SReclaimable:      98020 kB
SUnreclaim:        26032 kB
KernelStack:        3360 kB
PageTables:         7620 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1782636 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    176128 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61788 MiB
End job on node103 at 2017-08-13 06:33:26