Trace number 4265675

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco-sat 1.12SAT (TO)170 2519.99 2520.01

General information on the benchmark

NameGolombRuler/GolombRuler-a3-s1/
GolombRuler-14-a3.xml
MD5SUMa5381fa3d98671549d41a8d043d26ba4
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark129
Best CPU time to get the best result obtained on this benchmark20028.4
Satisfiable
(Un)Satisfiability was proved
Number of variables210
Number of constraints94
Number of domains2
Minimum domain size500
Maximum domain size501
Distribution of domain sizes[{"size":500,"count":91},{"size":501,"count":14}]
Minimum variable degree0
Maximum variable degree15
Distribution of variable degrees[{"degree":0,"count":105},{"degree":2,"count":91},{"degree":14,"count":12},{"degree":15,"count":2}]
Minimum constraint arity1
Maximum constraint arity91
Distribution of constraint arities[{"arity":1,"count":1},{"arity":3,"count":91},{"arity":14,"count":1},{"arity":91,"count":1}]
Number of extensional constraints0
Number of intensional constraints92
Distribution of constraint types[{"type":"intension","count":92},{"type":"allDifferent","count":1},{"type":"ordered","count":1}]
Optimization problemYES
Type of objectivemin VAR

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

1.79/1.87	c SAT : Variables: 105014 -- Clauses: 26204710
1.79/1.87	c best=?? lower=0 upper=500 
201.86/201.91	c
201.86/201.91	c This is cosoco 1.12 --  
201.86/201.91	c
201.86/201.91	c command line: cosoco -lc -model -restarts -sat HOME/instance-4265675-1502575897.xml 
201.86/201.91	c enable optimization
201.86/201.91	c ========================================[ Problem Statistics ]===========================================
201.86/201.91	c |                                                                                                       
201.86/201.91	c |  Parse time        :         1.59 s 
201.86/201.91	c |
201.86/201.91	c |               Variables: 210
201.86/201.91	c |            Domain Sizes: 500..501
201.86/201.91	c |
201.86/201.91	c |             Constraints: 107
201.86/201.91	c |                   Arity: 1..91  -- Unary: 2  -- Binary: 13  -- Ternary: 91
201.86/201.91	c | 
201.86/201.91	c |                   Types: 
201.86/201.91	c |                          (X - Y < k): 13
201.86/201.91	c |                          All Different: 1
201.86/201.91	c |                          Intension: 93
201.86/201.91	c |                          
201.86/201.91	c =========================================================================================================
201.86/201.91	o 186
201.86/201.91	c    1 calls to solver: best=186 lower=0 upper=185 
205.07/205.11	o 182
208.46/208.53	o 171
208.46/208.53	c    3 calls to solver: best=171 lower=0 upper=170 
892.35/892.46	o 170
2519.97/2520.00	
2519.97/2520.00	c *** INTERRUPTED ***
2519.97/2520.00	c restarts              : 581         
2519.97/2520.00	c conflicts             : 2573895      (1022 /sec)
2519.97/2520.00	c decisions             : 3945741      (1566 /sec)
2519.97/2520.00	c propagations          : 6831711736  (2711401 /sec)
2519.97/2520.00	c root propagations     : 669         
2519.97/2520.00	c filter calls          : 129000319      (51198 /sec)
2519.97/2520.00	c useless filter calls  : 86600043       (67 %)
2519.97/2520.00	c
2519.97/2520.00	c clauses               : 26232027
2519.97/2520.00	c SAT propagations      : 79932
2519.97/2520.00	c SAT conflicts         : 30 (0 learnts)
2519.97/2520.00	c Memory used           : 1240.53 MB
2519.97/2520.00	c CPU time              : 2519.62 s
2519.97/2520.00	
2519.97/2520.00	c nb Solutions = 4
2519.97/2520.00	s SATISFIABLE
2519.97/2520.00	c Best value found: 170
2519.97/2520.00	
2519.97/2520.00	
2519.97/2520.00	v <instantiation type='solution' cost='170'>
2519.97/2520.00	v <list>x[0] x[10] x[11] x[12] x[13] x[1] x[2] x[3] x[4] x[5] x[6] x[7] x[8] x[9] y[0][0] y[0][10] y[0][11] y[0][12] y[0][13] y[0][1] y[0][2] y[0][3] y[0][4] y[0][5] y[0][6] y[0][7] y[0][8] y[0][9] y[10][0] y[10][10] y[10][11] y[10][12] y[10][13] y[10][1] y[10][2] y[10][3] y[10][4] y[10][5] y[10][6] y[10][7] y[10][8] y[10][9] y[11][0] y[11][10] y[11][11] y[11][12] y[11][13] y[11][1] y[11][2] y[11][3] y[11][4] y[11][5] y[11][6] y[11][7] y[11][8] y[11][9] y[12][0] y[12][10] y[12][11] y[12][12] y[12][13] y[12][1] y[12][2] y[12][3] y[12][4] y[12][5] y[12][6] y[12][7] y[12][8] y[12][9] y[13][0] y[13][10] y[13][11] y[13][12] y[13][13] y[13][1] y[13][2] y[13][3] y[13][4] y[13][5] y[13][6] y[13][7] y[13][8] y[13][9] y[1][0] y[1][10] y[1][11] y[1][12] y[1][13] y[1][1] y[1][2] y[1][3] y[1][4] y[1][5] y[1][6] y[1][7] y[1][8] y[1][9] y[2][0] y[2][10] y[2][11] y[2][12] y[2][13] y[2][1] y[2][2] y[2][3] y[2][4] y[2][5] y[2][6] y[2][7] y[2][8] y[2][9] y[3][0] y[3][10] y[3][11] y[3][12] y[3][13] y[3][1] y[3][2] y[3][3] y[3][4] y[3][5] y[3][6] y[3][7] y[3][8] y[3][9] y[4][0] y[4][10] y[4][11] y[4][12] y[4][13] y[4][1] y[4][2] y[4][3] y[4][4] y[4][5] y[4][6] y[4][7] y[4][8] y[4][9] y[5][0] y[5][10] y[5][11] y[5][12] y[5][13] y[5][1] y[5][2] y[5][3] y[5][4] y[5][5] y[5][6] y[5][7] y[5][8] y[5][9] y[6][0] y[6][10] y[6][11] y[6][12] y[6][13] y[6][1] y[6][2] y[6][3] y[6][4] y[6][5] y[6][6] y[6][7] y[6][8] y[6][9] y[7][0] y[7][10] y[7][11] y[7][12] y[7][13] y[7][1] y[7][2] y[7][3] y[7][4] y[7][5] y[7][6] y[7][7] y[7][8] y[7][9] y[8][0] y[8][10] y[8][11] y[8][12] y[8][13] y[8][1] y[8][2] y[8][3] y[8][4] y[8][5] y[8][6] y[8][7] y[8][8] y[8][9] y[9][0] y[9][10] y[9][11] y[9][12] y[9][13] y[9][1] y[9][2] y[9][3] y[9][4] y[9][5] y[9][6] y[9][7] y[9][8] y[9][9] </list>
2519.97/2520.01	v <values>0 100 130 159 170 2 7 15 21 24 25 52 68 88 * 100 130 159 170 2 7 15 21 24 25 52 68 88 * * 30 59 70 * * * * * * * * * * * * 29 40 * * * * * * * * * * * * * 11 * * * * * * * * * * * * * * * * * * * * * * * * 98 128 157 168 * 5 13 19 22 23 50 66 86 * 93 123 152 163 * * 8 14 17 18 45 61 81 * 85 115 144 155 * * * 6 9 10 37 53 73 * 79 109 138 149 * * * * 3 4 31 47 67 * 76 106 135 146 * * * * * 1 28 44 64 * 75 105 134 145 * * * * * * 27 43 63 * 48 78 107 118 * * * * * * * 16 36 * 32 62 91 102 * * * * * * * * 20 * 12 42 71 82 * * * * * * * * * </values>
2519.97/2520.01	v </instantiation>
2519.97/2520.01

Verifier Data 

OK	170

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14118 MiB free)
  memory of node 1: 16384 MiB (14872 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265675-1502575897/watcher-4265675-1502575897 -o /tmp/evaluation-result-4265675-1502575897/solver-4265675-1502575897 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502567255-24253 --watchdog 2580 cosoco -lc -model -restarts -sat HOME/instance-4265675-1502575897.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=25578, runsolver pid=25575

[startup+0.100171 s]*
/proc/loadavg: 2.04 2.09 2.05 3/187 25579
/proc/meminfo: memFree=29683176/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=34928 memory=7276 CPUtime=0.1 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 1976 0 0 0 10 0 0 0 20 0 1 0 90677994 35766272 1753 33554432000 4194304 5972588 140734120672720 140734120669368 5280335 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 8732 1753 815 435 0 2095 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 34928 KiB
Current children cumulated memory: 7276 KiB

[startup+0.209707 s]*
/proc/loadavg: 2.04 2.09 2.05 3/187 25579
/proc/meminfo: memFree=29621532/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=102732 memory=73828 CPUtime=0.21 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 14035 0 0 0 19 2 0 0 20 0 1 0 90677994 105197568 18457 33554432000 4194304 5972588 140734120672720 140734120669592 139973612694501 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 25683 18457 823 435 0 19046 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 102732 KiB
Current children cumulated memory: 73828 KiB

[startup+0.30987 s]*
/proc/loadavg: 2.04 2.09 2.05 3/187 25579
/proc/meminfo: memFree=29562176/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=156940 memory=132604 CPUtime=0.31 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 23644 0 0 0 27 4 0 0 20 0 1 0 90677994 160706560 33151 33554432000 4194304 5972588 140734120672720 140734120669592 5280404 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 39235 33151 823 435 0 32598 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 156940 KiB
Current children cumulated memory: 132604 KiB

[startup+0.700382 s]
/proc/loadavg: 2.04 2.09 2.05 3/187 25579
/proc/meminfo: memFree=29442528/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=463896 memory=360748 CPUtime=0.69 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 55094 0 0 0 59 10 0 0 20 0 1 0 90677994 475029504 90187 33554432000 4194304 5972588 140734120672720 140734120669592 139973612694501 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 116007 90187 823 435 0 109370 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 463896 KiB
Current children cumulated memory: 360748 KiB

[startup+1.50039 s]
/proc/loadavg: 2.04 2.09 2.05 3/187 25579
/proc/meminfo: memFree=29149196/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=891468 memory=834280 CPUtime=1.49 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 117305 0 0 0 127 22 0 0 20 0 1 0 90677994 912863232 208570 33554432000 4194304 5972588 140734120672720 140734120669592 139973612763691 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 222867 208570 823 435 0 216230 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 891468 KiB
Current children cumulated memory: 834280 KiB

[startup+3.10966 s]
/proc/loadavg: 1.96 2.07 2.05 3/187 25579
/proc/meminfo: memFree=28633180/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1267124 memory=1055168 CPUtime=3.1 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 147709 0 0 0 282 28 0 0 20 0 1 0 90677994 1297534976 263792 33554432000 4194304 5972588 140734120672720 140734120669592 4968734 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 316781 263792 839 435 0 310144 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 1267124 KiB
Current children cumulated memory: 1055168 KiB

[startup+6.30028 s]
/proc/loadavg: 1.96 2.07 2.05 3/187 25579
/proc/meminfo: memFree=28632916/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1267124 memory=1055184 CPUtime=6.29 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 150535 0 0 0 601 28 0 0 20 0 1 0 90677994 1297534976 263796 33554432000 4194304 5972588 140734120672720 140734120669368 4965472 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 316781 263796 839 435 0 310144 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 1267124 KiB
Current children cumulated memory: 1055184 KiB

[startup+12.7003 s]
/proc/loadavg: 1.96 2.07 2.05 3/187 25579
/proc/meminfo: memFree=28632916/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1267124 memory=1055192 CPUtime=12.69 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 157122 0 0 0 1240 29 0 0 20 0 1 0 90677994 1297534976 263798 33554432000 4194304 5972588 140734120672720 140734120669368 4968804 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 316781 263798 839 435 0 310144 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 1267124 KiB
Current children cumulated memory: 1055192 KiB

[startup+25.5003 s]
/proc/loadavg: 1.97 2.07 2.05 3/187 25579
/proc/meminfo: memFree=28632800/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1267124 memory=1055200 CPUtime=25.49 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 164667 0 0 0 2520 29 0 0 20 0 1 0 90677994 1297534976 263800 33554432000 4194304 5972588 140734120672720 140734120669368 4965552 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 316781 263800 839 435 0 310144 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 1267124 KiB
Current children cumulated memory: 1055200 KiB

[startup+51.1094 s]
/proc/loadavg: 1.98 2.06 2.05 3/187 25580
/proc/meminfo: memFree=28632596/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1267784 memory=1055860 CPUtime=51.1 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 174341 0 0 0 5081 29 0 0 20 0 1 0 90677994 1298210816 263965 33554432000 4194304 5972588 140734120672720 140734120669528 5053061 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 316946 263965 839 435 0 310309 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 1267784 KiB
Current children cumulated memory: 1055860 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.05 2.05 3/187 25581
/proc/meminfo: memFree=28631716/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1268336 memory=1056308 CPUtime=102.29 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 184980 0 0 0 10199 30 0 0 20 0 1 0 90677994 1298776064 264077 33554432000 4194304 5972588 140734120672720 140734120669432 5071767 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317084 264077 839 435 0 310447 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1268336 KiB
Current children cumulated memory: 1056308 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 25590
/proc/meminfo: memFree=28629832/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1268732 memory=1056796 CPUtime=162.27 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 191692 0 0 0 16196 31 0 0 20 0 1 0 90677994 1299181568 264199 33554432000 4194304 5972588 140734120672720 140734120669576 5071761 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317183 264199 839 435 0 310546 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 1268732 KiB
Current children cumulated memory: 1056796 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/189 25617
/proc/meminfo: memFree=28628724/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1268996 memory=1057076 CPUtime=222.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 202712 0 0 0 22195 31 0 0 20 0 1 0 90677994 1299451904 264269 33554432000 4194304 5972588 140734120672720 140734120659912 5071767 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317249 264269 840 435 0 310612 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 1268996 KiB
Current children cumulated memory: 1057076 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/189 25618
/proc/meminfo: memFree=28630304/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1269132 memory=1057172 CPUtime=282.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 208277 0 0 0 28194 32 0 0 20 0 1 0 90677994 1299591168 264293 33554432000 4194304 5972588 140734120672720 140734120669288 5071411 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317283 264293 840 435 0 310646 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 1269132 KiB
Current children cumulated memory: 1057172 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/189 25619
/proc/meminfo: memFree=28630164/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1269264 memory=1057340 CPUtime=342.25 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 218683 0 0 0 34193 32 0 0 20 0 1 0 90677994 1299726336 264335 33554432000 4194304 5972588 140734120672720 140734120669368 4968862 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317316 264335 840 435 0 310679 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 1269264 KiB
Current children cumulated memory: 1057340 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/189 25620
/proc/meminfo: memFree=28630516/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1269264 memory=1057404 CPUtime=402.25 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 222468 0 0 0 40193 32 0 0 20 0 1 0 90677994 1299726336 264351 33554432000 4194304 5972588 140734120672720 140734120669368 4962387 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317316 264351 840 435 0 310679 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 1269264 KiB
Current children cumulated memory: 1057404 KiB

[startup+462.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/189 25682
/proc/meminfo: memFree=28759368/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1269412 memory=1057436 CPUtime=462.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 229067 0 0 0 46193 33 0 0 20 0 1 0 90677994 1299877888 264359 33554432000 4194304 5972588 140734120672720 140734120669368 4965342 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317353 264359 840 435 0 310716 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 1269412 KiB
Current children cumulated memory: 1057436 KiB


################
# More data... #
################

/proc/25578/statm: 317539 265114 840 435 0 310902 0
Current children cumulated CPU time: 1722.26 s
Current children cumulated vsize: 1270156 KiB
Current children cumulated memory: 1060456 KiB

[startup+1782.3 s]
/proc/loadavg: 2.15 2.12 2.08 3/187 25722
/proc/meminfo: memFree=28753988/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270156 memory=1060456 CPUtime=1782.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 263254 0 0 0 178191 35 0 0 20 0 1 0 90677994 1300639744 265114 33554432000 4194304 5972588 140734120672720 140734120669368 4978317 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317539 265114 840 435 0 310902 0
Current children cumulated CPU time: 1782.26 s
Current children cumulated vsize: 1270156 KiB
Current children cumulated memory: 1060456 KiB

[startup+1842.3 s]
/proc/loadavg: 2.05 2.10 2.08 3/187 25724
/proc/meminfo: memFree=28753880/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270156 memory=1060456 CPUtime=1842.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 264218 0 0 0 184191 35 0 0 20 0 1 0 90677994 1300639744 265114 33554432000 4194304 5972588 140734120672720 140734120669368 5070704 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317539 265114 840 435 0 310902 0
Current children cumulated CPU time: 1842.26 s
Current children cumulated vsize: 1270156 KiB
Current children cumulated memory: 1060456 KiB

[startup+1902.3 s]
/proc/loadavg: 2.02 2.08 2.07 3/187 25725
/proc/meminfo: memFree=28753880/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270156 memory=1060456 CPUtime=1902.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 265065 0 0 0 190191 35 0 0 20 0 1 0 90677994 1300639744 265114 33554432000 4194304 5972588 140734120672720 140734120669368 4962405 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317539 265114 840 435 0 310902 0
Current children cumulated CPU time: 1902.26 s
Current children cumulated vsize: 1270156 KiB
Current children cumulated memory: 1060456 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/188 25734
/proc/meminfo: memFree=28752512/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270156 memory=1060468 CPUtime=1962.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 265898 0 0 0 196191 35 0 0 20 0 1 0 90677994 1300639744 265117 33554432000 4194304 5972588 140734120672720 140734120669368 4968801 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317539 265117 840 435 0 310902 0
Current children cumulated CPU time: 1962.26 s
Current children cumulated vsize: 1270156 KiB
Current children cumulated memory: 1060468 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/188 25735
/proc/meminfo: memFree=28753460/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270156 memory=1060468 CPUtime=2022.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 266750 0 0 0 202191 35 0 0 20 0 1 0 90677994 1300639744 265117 33554432000 4194304 5972588 140734120672720 140734120669368 4909660 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317539 265117 840 435 0 310902 0
Current children cumulated CPU time: 2022.26 s
Current children cumulated vsize: 1270156 KiB
Current children cumulated memory: 1060468 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 25736
/proc/meminfo: memFree=28753492/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060528 CPUtime=2082.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 267991 0 0 0 208191 35 0 0 20 0 1 0 90677994 1300783104 265132 33554432000 4194304 5972588 140734120672720 140734120669368 5099648 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265132 840 435 0 310937 0
Current children cumulated CPU time: 2082.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060528 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 25737
/proc/meminfo: memFree=28753244/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060532 CPUtime=2142.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 268914 0 0 0 214191 35 0 0 20 0 1 0 90677994 1300783104 265133 33554432000 4194304 5972588 140734120672720 140734120669368 4909679 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265133 840 435 0 310937 0
Current children cumulated CPU time: 2142.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060532 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 25738
/proc/meminfo: memFree=28753492/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060532 CPUtime=2202.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 269816 0 0 0 220191 35 0 0 20 0 1 0 90677994 1300783104 265133 33554432000 4194304 5972588 140734120672720 140734120669368 4968801 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265133 840 435 0 310937 0
Current children cumulated CPU time: 2202.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060532 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 25739
/proc/meminfo: memFree=28753704/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060532 CPUtime=2262.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 270693 0 0 0 226191 35 0 0 20 0 1 0 90677994 1300783104 265133 33554432000 4194304 5972588 140734120672720 140734120669368 5070704 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265133 840 435 0 310937 0
Current children cumulated CPU time: 2262.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060532 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 25740
/proc/meminfo: memFree=28753596/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060532 CPUtime=2322.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 271633 0 0 0 232191 35 0 0 20 0 1 0 90677994 1300783104 265133 33554432000 4194304 5972588 140734120672720 140734120669368 5099648 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265133 840 435 0 310937 0
Current children cumulated CPU time: 2322.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060532 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25741
/proc/meminfo: memFree=28753596/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060532 CPUtime=2382.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 272362 0 0 0 238191 35 0 0 20 0 1 0 90677994 1300783104 265133 33554432000 4194304 5972588 140734120672720 140734120669368 5099648 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265133 840 435 0 310937 0
Current children cumulated CPU time: 2382.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060532 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25742
/proc/meminfo: memFree=28753224/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060564 CPUtime=2442.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 273625 0 0 0 244191 35 0 0 20 0 1 0 90677994 1300783104 265141 33554432000 4194304 5972588 140734120672720 140734120669368 5071428 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265141 840 435 0 310937 0
Current children cumulated CPU time: 2442.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060564 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25743
/proc/meminfo: memFree=28753572/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060564 CPUtime=2502.26 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 274316 0 0 0 250191 35 0 0 20 0 1 0 90677994 1300783104 265141 33554432000 4194304 5972588 140734120672720 140734120669368 5070704 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265141 840 435 0 310937 0
Current children cumulated CPU time: 2502.26 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060564 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 25743
/proc/meminfo: memFree=28753576/32770624 swapFree=67108860/67108860
[pid=25578] ppid=25575 vsize=1270296 memory=1060564 CPUtime=2519.97 cores=1,3,5,7
/proc/25578/stat : 25578 (cosoco) R 25575 25578 24168 0 -1 4202496 274844 0 0 0 251962 35 0 0 20 0 1 0 90677994 1300783104 265141 33554432000 4194304 5972588 140734120672720 140734120669368 5094152 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 14311424 140734120674490 140734120674590 140734120674590 140734120677326 0
/proc/25578/statm: 317574 265141 840 435 0 310937 0
Current children cumulated CPU time: 2519.97 s
Current children cumulated vsize: 1270296 KiB
Current children cumulated memory: 1060564 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 25578 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.62 s, system=0.363 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.99
CPU user time (s): 2519.62
CPU system time (s): 0.363
CPU usage (%): 99.999
Max. virtual memory (cumulated for all children) (KiB): 1270296
Max. memory (cumulated for all children) (KiB): 1060564

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.62
system time used= 0.363
maximum resident set size= 1060636
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 274892
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 71
involuntary context switches= 827


# summary of solver processes directly reported to runsolver:
#   pid: 25578
#   total CPU time (s): 2519.99
#   total CPU user time (s): 2519.62
#   total CPU system time (s): 0.363

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.4038 second user time and 15.5277 second system time

The end

Launcher Data 

Begin job on node103 at 2017-08-12 23:57:19
IDJOB=4265675
IDBENCH=126210
IDSOLVER=2655
FILE ID=node103/4265675-1502575897
RUNJOBID= node103-1502567255-24253
PBS_JOBID= 20628288
Free space on /tmp= 61792 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/GolombRuler/GolombRuler-a3-s1/GolombRuler-14-a3.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265675-1502575897/watcher-4265675-1502575897 -o /tmp/evaluation-result-4265675-1502575897/solver-4265675-1502575897 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502567255-24253 --watchdog 2580  cosoco -lc -model -restarts -sat HOME/instance-4265675-1502575897.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a5381fa3d98671549d41a8d043d26ba4
RANDOM SEED=1002068873

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29687340 kB
MemAvailable:   31841416 kB
Buffers:          122676 kB
Cached:          2326832 kB
SwapCached:            0 kB
Active:           655564 kB
Inactive:        2005836 kB
Active(anon):     214296 kB
Inactive(anon):    25124 kB
Active(file):     441268 kB
Inactive(file):  1980712 kB
Unevictable:        6432 kB
Mlocked:            6432 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2332 kB
Writeback:             0 kB
AnonPages:        263080 kB
Mapped:            44136 kB
Shmem:             25228 kB
Slab:             120888 kB
SReclaimable:      95864 kB
SUnreclaim:        25024 kB
KernelStack:        3360 kB
PageTables:         5328 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     517952 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    202752 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61788 MiB
End job on node103 at 2017-08-13 00:39:19