Trace number 4265944

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco-sat 1.12SAT (TO)555 2519.9399 2520.01

General information on the benchmark

NameTravellingSalesman/TravellingSalesman-m1-n150/
TravellingSalesman-150-50-14.xml
MD5SUMb2c04361dada2322dcbf50e86c385888
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark531
Best CPU time to get the best result obtained on this benchmark2400.12
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints151
Number of domains2
Minimum domain size64
Maximum domain size150
Distribution of domain sizes[{"size":64,"count":150},{"size":150,"count":150}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":150},{"degree":3,"count":150}]
Minimum constraint arity3
Maximum constraint arity150
Distribution of constraint arities[{"arity":3,"count":150},{"arity":150,"count":1}]
Number of extensional constraints150
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":150},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.22/0.34	c SAT : Variables: 32100 -- Clauses: 1978950
0.22/0.34	c best=?? lower=-9600 upper=-150 
2.21/2.36	c
2.21/2.36	c This is cosoco 1.12 --  
2.21/2.36	c
2.21/2.36	c command line: cosoco -lc -model -restarts -sat HOME/instance-4265944-1502586231.xml 
2.21/2.36	c enable optimization
2.21/2.36	c ========================================[ Problem Statistics ]===========================================
2.21/2.36	c |                                                                                                       
2.21/2.36	c |  Parse time        :         0.23 s 
2.21/2.36	c |
2.21/2.36	c |               Variables: 300
2.21/2.36	c |            Domain Sizes: 64..150
2.21/2.36	c |
2.21/2.36	c |             Constraints: 152
2.21/2.36	c |                   Arity: 3..150  -- Ternary: 150
2.21/2.36	c | 
2.21/2.36	c |                   Types: 
2.21/2.36	c |                          All Different: 1
2.21/2.36	c |                          Extension: 150  (nb tuples: 22350..22350) -- (shared: 149)
2.21/2.36	c |                          Sum: 1
2.21/2.36	c |                          
2.21/2.36	c =========================================================================================================
2.21/2.36	o -2677
2.21/2.36	c    1 calls to solver: best=-2677 lower=-2676 upper=-150 
49.30/49.42	o -2607
53.60/53.74	o -2541
53.60/53.74	c    3 calls to solver: best=-2541 lower=-2540 upper=-150 
124.01/124.17	o -2540
178.50/178.65	o -2488
178.50/178.65	c    5 calls to solver: best=-2488 lower=-2487 upper=-150 
182.20/182.39	o -2432
216.49/216.61	o -2398
216.49/216.61	c    7 calls to solver: best=-2398 lower=-2397 upper=-150 
238.01/238.16	o -2329
412.70/412.88	o -750
412.70/412.88	c    9 calls to solver: best=-750 lower=-749 upper=-150 
413.10/413.26	o -636
413.50/413.64	o -634
413.50/413.64	c   11 calls to solver: best=-634 lower=-633 upper=-150 
415.91/416.08	o -633
416.50/416.67	o -632
416.50/416.67	c   13 calls to solver: best=-632 lower=-631 upper=-150 
416.91/417.03	o -630
417.20/417.39	o -628
417.20/417.39	c   15 calls to solver: best=-628 lower=-627 upper=-150 
418.10/418.20	o -627
418.40/418.53	o -617
418.40/418.53	c   17 calls to solver: best=-617 lower=-616 upper=-150 
418.70/418.87	o -616
419.10/419.21	o -614
419.10/419.21	c   19 calls to solver: best=-614 lower=-613 upper=-150 
420.20/420.31	o -596
421.01/421.11	o -595
421.01/421.11	c   21 calls to solver: best=-595 lower=-594 upper=-150 
421.40/421.57	o -594
421.80/421.95	o -585
421.80/421.95	c   23 calls to solver: best=-585 lower=-584 upper=-150 
422.30/422.47	o -584
422.80/422.92	o -572
422.80/422.92	c   25 calls to solver: best=-572 lower=-571 upper=-150 
430.20/430.38	o -569
444.10/444.20	o -565
444.10/444.20	c   27 calls to solver: best=-565 lower=-564 upper=-150 
444.40/444.59	o -564
476.00/476.16	o -563
476.00/476.16	c   29 calls to solver: best=-563 lower=-562 upper=-150 
664.60/664.74	o -562
669.10/669.21	o -561
669.10/669.21	c   31 calls to solver: best=-561 lower=-560 upper=-150 
677.30/677.44	o -560
681.10/681.25	o -559
681.10/681.25	c   33 calls to solver: best=-559 lower=-558 upper=-150 
796.30/796.46	o -558
809.50/809.68	o -557
809.50/809.68	c   35 calls to solver: best=-557 lower=-556 upper=-150 
819.80/819.92	o -555
832.80/832.96	conflict 297lvl : 268 bt268-19528:0(25041)X9772420
2519.94/2520.00	
2519.94/2520.00	c *** INTERRUPTED ***
2519.94/2520.00	c restarts              : 581         
2519.94/2520.00	c conflicts             : 2481443      (985 /sec)
2519.94/2520.00	c decisions             : 3819460      (1516 /sec)
2519.94/2520.00	c propagations          : 864590445   (343116 /sec)
2519.94/2520.00	c root propagations     : 21968       
2519.94/2520.00	c filter calls          : 66198914       (26271 /sec)
2519.94/2520.00	c useless filter calls  : 30838881       (46 %)
2519.94/2520.00	c
2519.94/2520.00	c clauses               : 1991197
2519.94/2520.00	c SAT propagations      : 5405
2519.94/2520.00	c SAT conflicts         : 0 (1 learnts)
2519.94/2520.00	c Memory used           : 156.57 MB
2519.94/2520.00	c CPU time              : 2519.82 s
2519.94/2520.00	
2519.94/2520.00	c nb Solutions = 36
2519.94/2520.00	s SATISFIABLE
2519.94/2520.00	c Best value found: -555
2519.94/2520.00	
2519.94/2520.00	
2519.94/2520.00	v <instantiation type='solution' cost='-555'>
2519.94/2520.00	v <list>c[0] c[100] c[101] c[102] c[103] c[104] c[105] c[106] c[107] c[108] c[109] c[10] c[110] c[111] c[112] c[113] c[114] c[115] c[116] c[117] c[118] c[119] c[11] c[120] c[121] c[122] c[123] c[124] c[125] c[126] c[127] c[128] c[129] c[12] c[130] c[131] c[132] c[133] c[134] c[135] c[136] c[137] c[138] c[139] c[13] c[140] c[141] c[142] c[143] c[144] c[145] c[146] c[147] c[148] c[149] c[14] c[15] c[16] c[17] c[18] c[19] c[1] c[20] c[21] c[22] c[23] c[24] c[25] c[26] c[27] c[28] c[29] c[2] c[30] c[31] c[32] c[33] c[34] c[35] c[36] c[37] c[38] c[39] c[3] c[40] c[41] c[42] c[43] c[44] c[45] c[46] c[47] c[48] c[49] c[4] c[50] c[51] c[52] c[53] c[54] c[55] c[56] c[57] c[58] c[59] c[5] c[60] c[61] c[62] c[63] c[64] c[65] c[66] c[67] c[68] c[69] c[6] c[70] c[71] c[72] c[73] c[74] c[75] c[76] c[77] c[78] c[79] c[7] c[80] c[81] c[82] c[83] c[84] c[85] c[86] c[87] c[88] c[89] c[8] c[90] c[91] c[92] c[93] c[94] c[95] c[96] c[97] c[98] c[99] c[9] d[0] d[100] d[101] d[102] d[103] d[104] d[105] d[106] d[107] d[108] d[109] d[10] d[110] d[111] d[112] d[113] d[114] d[115] d[116] d[117] d[118] d[119] d[11] d[120] d[121] d[122] d[123] d[124] d[125] d[126] d[127] d[128] d[129] d[12] d[130] d[131] d[132] d[133] d[134] d[135] d[136] d[137] d[138] d[139] d[13] d[140] d[141] d[142] d[143] d[144] d[145] d[146] d[147] d[148] d[149] d[14] d[15] d[16] d[17] d[18] d[19] d[1] d[20] d[21] d[22] d[23] d[24] d[25] d[26] d[27] d[28] d[29] d[2] d[30] d[31] d[32] d[33] d[34] d[35] d[36] d[37] d[38] d[39] d[3] d[40] d[41] d[42] d[43] d[44] d[45] d[46] d[47] d[48] d[49] d[4] d[50] d[51] d[52] d[53] d[54] d[55] d[56] d[57] d[58] d[59] d[5] d[60] d[61] d[62] d[63] d[64] d[65] d[66] d[67] d[68] d[69] d[6] d[70] d[71] d[72] d[73] d[74] d[75] d[76] d[77] d[78] d[79] d[7] d[80] d[81] d[82] d[83] d[84] d[85] d[86] d[87] d[88] d[89] d[8] d[90] d[91] d[92] d[93] d[94] d[95] d[96] d[97] d[98] d[99] d[9] </list>
2519.94/2520.00	v <values>98 122 133 129 140 127 145 144 147 126 102 105 100 99 49 42 41 35 30 31 24 16 104 27 38 36 28 20 8 3 7 2 1 107 9 11 13 25 32 39 43 51 60 59 112 56 58 73 71 68 67 79 86 96 95 117 116 124 134 139 148 103 146 141 138 137 136 128 110 106 109 108 111 115 114 135 132 131 123 119 113 101 94 120 97 90 84 78 74 63 52 61 50 47 149 44 37 34 33 26 21 4 0 5 14 143 17 18 22 19 10 6 12 15 23 29 142 40 46 45 53 65 69 76 87 82 81 130 75 80 64 57 54 48 55 62 66 70 125 72 77 85 91 88 83 89 92 93 118 121 4 22 2 9 6 8 4 1 9 9 6 2 9 20 3 3 2 1 1 2 2 4 1 3 1 3 3 4 1 7 3 3 27 1 3 1 3 3 3 1 4 3 2 2 2 1 4 4 1 3 4 2 4 2 3 1 3 2 4 6 2 3 4 3 1 1 3 5 2 3 3 2 3 1 5 2 1 2 3 2 4 5 3 13 3 4 4 1 3 3 4 3 2 3 6 4 2 6 2 2 5 1 5 4 1 2 1 2 1 3 3 2 1 2 4 4 7 4 1 4 4 1 2 4 5 1 3 3 2 5 13 2 3 5 2 2 4 1 2 1 3 2 4 2 7 8 5 10 2 5 </values>
2519.94/2520.00	v </instantiation>
2519.94/2520.00

Verifier Data 

OK	555

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14845 MiB free)
  memory of node 1: 16384 MiB (15564 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4265944-1502586231/watcher-4265944-1502586231 -o /tmp/evaluation-result-4265944-1502586231/solver-4265944-1502586231 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1502565138-11650 --watchdog 2580 cosoco -lc -model -restarts -sat HOME/instance-4265944-1502586231.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=16486, runsolver pid=16483


[startup+0.100642 s]*
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31139992/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=27880 memory=3856 CPUtime=0.02 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 1160 0 0 0 2 0 0 0 20 0 1 0 46963778 28549120 964 18446744073709551615 4194304 5972588 140727379041536 140727379038104 140368859417600 0 0 1 0 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 6970 964 720 435 0 333 0
Current children cumulated CPU time: 0.02 s
Current children cumulated vsize: 27880 KiB
Current children cumulated memory: 3856 KiB

[startup+0.209263 s]*
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31104488/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=70608 memory=43636 CPUtime=0.12 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 10871 0 0 0 11 1 0 0 20 0 1 0 46963778 72302592 10909 18446744073709551615 4194304 5972588 140727379041536 140727379038104 140368858975038 0 0 1 0 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 17652 10909 763 435 0 11015 0
Current children cumulated CPU time: 0.12 s
Current children cumulated vsize: 70608 KiB
Current children cumulated memory: 43636 KiB

[startup+0.309703 s]*
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31047432/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=129836 memory=100964 CPUtime=0.22 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 20572 0 0 0 20 2 0 0 20 0 1 0 46963778 132952064 25241 18446744073709551615 4194304 5972588 140727379041536 140727379038104 140368858979301 0 0 1 0 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 32459 25241 763 435 0 25822 0
Current children cumulated CPU time: 0.22 s
Current children cumulated vsize: 129836 KiB
Current children cumulated memory: 100964 KiB

[startup+0.700396 s]
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31029384/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=157616 memory=114252 CPUtime=0.61 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 22932 0 0 0 58 3 0 0 20 0 1 0 46963778 161398784 28563 18446744073709551615 4194304 5972588 140727379041536 140727379038104 4935463 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39404 28563 764 435 0 32767 0
Current children cumulated CPU time: 0.61 s
Current children cumulated vsize: 157616 KiB
Current children cumulated memory: 114252 KiB

[startup+1.50036 s]
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31029236/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=158036 memory=114780 CPUtime=1.41 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 23007 0 0 0 138 3 0 0 20 0 1 0 46963778 161828864 28695 18446744073709551615 4194304 5972588 140727379041536 140727379038104 4935490 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39509 28695 781 435 0 32872 0
Current children cumulated CPU time: 1.41 s
Current children cumulated vsize: 158036 KiB
Current children cumulated memory: 114780 KiB

[startup+3.10933 s]
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31028180/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=158908 memory=115728 CPUtime=3.01 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 31873 0 0 0 298 3 0 0 20 0 1 0 46963778 162721792 28932 18446744073709551615 4194304 5972588 140727379041536 140727379028728 4935428 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39727 28932 783 435 0 33090 0
Current children cumulated CPU time: 3.01 s
Current children cumulated vsize: 158908 KiB
Current children cumulated memory: 115728 KiB

[startup+6.30033 s]
/proc/loadavg: 2.04 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31027676/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159108 memory=115856 CPUtime=6.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 41870 0 0 0 617 4 0 0 20 0 1 0 46963778 162926592 28964 18446744073709551615 4194304 5972588 140727379041536 140727379038104 4935456 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39777 28964 783 435 0 33140 0
Current children cumulated CPU time: 6.21 s
Current children cumulated vsize: 159108 KiB
Current children cumulated memory: 115856 KiB

[startup+12.7003 s]
/proc/loadavg: 2.03 2.03 2.05 3/181 16487
/proc/meminfo: memFree=31027720/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159240 memory=116036 CPUtime=12.6 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 52469 0 0 0 1256 4 0 0 20 0 1 0 46963778 163061760 29009 18446744073709551615 4194304 5972588 140727379041536 140727379038024 4935428 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39810 29009 783 435 0 33173 0
Current children cumulated CPU time: 12.6 s
Current children cumulated vsize: 159240 KiB
Current children cumulated memory: 116036 KiB

[startup+25.5004 s]
/proc/loadavg: 2.03 2.02 2.05 3/181 16487
/proc/meminfo: memFree=31027600/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159240 memory=116172 CPUtime=25.4 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 72369 0 0 0 2535 5 0 0 20 0 1 0 46963778 163061760 29043 18446744073709551615 4194304 5972588 140727379041536 140727379038024 4935408 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39810 29043 783 435 0 33173 0
Current children cumulated CPU time: 25.4 s
Current children cumulated vsize: 159240 KiB
Current children cumulated memory: 116172 KiB

[startup+51.1097 s]
/proc/loadavg: 2.02 2.02 2.05 3/184 16501
/proc/meminfo: memFree=31023760/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159372 memory=116452 CPUtime=51.01 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 85404 0 0 0 5095 6 0 0 20 0 1 0 46963778 163196928 29113 18446744073709551615 4194304 5972588 140727379041536 140727379038984 4935502 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39843 29113 783 435 0 33206 0
Current children cumulated CPU time: 51.01 s
Current children cumulated vsize: 159372 KiB
Current children cumulated memory: 116452 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/184 16503
/proc/meminfo: memFree=31023268/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159504 memory=116672 CPUtime=102.2 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 100606 0 0 0 10213 7 0 0 20 0 1 0 46963778 163332096 29168 18446744073709551615 4194304 5972588 140727379041536 140727379038392 4935681 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39876 29168 783 435 0 33239 0
Current children cumulated CPU time: 102.2 s
Current children cumulated vsize: 159504 KiB
Current children cumulated memory: 116672 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 16505
/proc/meminfo: memFree=31026664/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159504 memory=117016 CPUtime=162.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 116502 0 0 0 16212 9 0 0 20 0 1 0 46963778 163332096 29254 18446744073709551615 4194304 5972588 140727379041536 140727379038984 4935446 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39876 29254 783 435 0 33239 0
Current children cumulated CPU time: 162.21 s
Current children cumulated vsize: 159504 KiB
Current children cumulated memory: 117016 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 16507
/proc/meminfo: memFree=31026128/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159504 memory=117424 CPUtime=222.19 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 132754 0 0 0 22210 9 0 0 20 0 1 0 46963778 163332096 29356 18446744073709551615 4194304 5972588 140727379041536 140727379028728 4975784 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39876 29356 783 435 0 33239 0
Current children cumulated CPU time: 222.19 s
Current children cumulated vsize: 159504 KiB
Current children cumulated memory: 117424 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 16509
/proc/meminfo: memFree=31023908/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159504 memory=119812 CPUtime=282.2 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 136671 0 0 0 28210 10 0 0 20 0 1 0 46963778 163332096 29953 18446744073709551615 4194304 5972588 140727379041536 140727379038984 4935490 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39876 29953 783 435 0 33239 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 159504 KiB
Current children cumulated memory: 119812 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/181 16512
/proc/meminfo: memFree=31023680/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159504 memory=119828 CPUtime=342.2 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 137756 0 0 0 34210 10 0 0 20 0 1 0 46963778 163332096 29957 18446744073709551615 4194304 5972588 140727379041536 140727379038984 4935408 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39876 29957 783 435 0 33239 0
Current children cumulated CPU time: 342.2 s
Current children cumulated vsize: 159504 KiB
Current children cumulated memory: 119828 KiB

[startup+402.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/181 16514
/proc/meminfo: memFree=31023928/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159636 memory=119860 CPUtime=402.2 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 138857 0 0 0 40210 10 0 0 20 0 1 0 46963778 163467264 29965 18446744073709551615 4194304 5972588 140727379041536 140727379038104 4935792 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39909 29965 783 435 0 33272 0
Current children cumulated CPU time: 402.2 s
Current children cumulated vsize: 159636 KiB
Current children cumulated memory: 119860 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/181 16516
/proc/meminfo: memFree=31021840/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=159928 memory=122124 CPUtime=462.2 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 140264 0 0 0 46210 10 0 0 20 0 1 0 46963778 163766272 30531 18446744073709551615 4194304 5972588 140727379041536 140727379038984 4935502 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 39982 30531 783 435 0 33345 0
Current children cumulated CPU time: 462.2 s
Current children cumulated vsize: 159928 KiB
Current children cumulated memory: 122124 KiB


################
# More data... #
################

/proc/16486/statm: 40048 31662 788 435 0 33411 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126648 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16696
/proc/meminfo: memFree=31188576/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126648 CPUtime=1782.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 155571 0 0 0 178210 11 0 0 20 0 1 0 46963778 164036608 31662 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935454 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31662 788 435 0 33411 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126648 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/185 16711
/proc/meminfo: memFree=31183880/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126652 CPUtime=1842.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 156736 0 0 0 184210 11 0 0 20 0 1 0 46963778 164036608 31663 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935463 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31663 788 435 0 33411 0
Current children cumulated CPU time: 1842.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126652 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/185 16713
/proc/meminfo: memFree=31184136/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126652 CPUtime=1902.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 157342 0 0 0 190210 11 0 0 20 0 1 0 46963778 164036608 31663 18446744073709551615 4194304 5972588 140727379041536 140727379038760 5046712 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31663 788 435 0 33411 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126652 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16715
/proc/meminfo: memFree=31187844/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126652 CPUtime=1962.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 157950 0 0 0 196210 11 0 0 20 0 1 0 46963778 164036608 31663 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935463 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31663 788 435 0 33411 0
Current children cumulated CPU time: 1962.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126652 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16717
/proc/meminfo: memFree=31187896/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126652 CPUtime=2022.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 158485 0 0 0 202210 11 0 0 20 0 1 0 46963778 164036608 31663 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935428 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31663 788 435 0 33411 0
Current children cumulated CPU time: 2022.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126652 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16719
/proc/meminfo: memFree=31188524/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2082.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 159030 0 0 0 208210 11 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935463 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2082.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16722
/proc/meminfo: memFree=31188664/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2142.21 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 159576 0 0 0 214210 11 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935463 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2142.21 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16724
/proc/meminfo: memFree=31189168/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2202.22 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 160084 0 0 0 220210 12 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935663 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2202.22 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16726
/proc/meminfo: memFree=31189044/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2262.22 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 160588 0 0 0 226210 12 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4971920 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16729
/proc/meminfo: memFree=31189008/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2322.23 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 161212 0 0 0 232211 12 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935463 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/182 16731
/proc/meminfo: memFree=31188760/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2382.23 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 161812 0 0 0 238211 12 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935454 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/185 16746
/proc/meminfo: memFree=31185972/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160192 memory=126656 CPUtime=2442.23 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 162478 0 0 0 244211 12 0 0 20 0 1 0 46963778 164036608 31664 18446744073709551615 4194304 5972588 140727379041536 140727379038760 4935454 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40048 31664 788 435 0 33411 0
Current children cumulated CPU time: 2442.23 s
Current children cumulated vsize: 160192 KiB
Current children cumulated memory: 126656 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/185 16748
/proc/meminfo: memFree=31185736/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160324 memory=126696 CPUtime=2502.23 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 163418 0 0 0 250211 12 0 0 20 0 1 0 46963778 164171776 31674 18446744073709551615 4194304 5972588 140727379041536 140727379038392 4934322 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40081 31674 788 435 0 33444 0
Current children cumulated CPU time: 2502.23 s
Current children cumulated vsize: 160324 KiB
Current children cumulated memory: 126696 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/185 16748
/proc/meminfo: memFree=31185608/32770624 swapFree=67108860/67108860
[pid=16486] ppid=16483 vsize=160324 memory=126696 CPUtime=2519.94 cores=1,3,5,7
/proc/16486/stat : 16486 (cosoco) R 16483 16486 11586 0 -1 4202496 163697 0 0 0 251982 12 0 0 20 0 1 0 46963778 164171776 31674 18446744073709551615 4194304 5972588 140727379041536 140727379038392 4978595 0 0 1 8405026 0 0 0 17 3 0 0 8 0 0 8070896 8075904 21897216 140727379046852 140727379046952 140727379046952 140727379050446 0
/proc/16486/statm: 40081 31674 788 435 0 33444 0
Current children cumulated CPU time: 2519.94 s
Current children cumulated vsize: 160324 KiB
Current children cumulated memory: 126696 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 16486 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.82 s, system=0.122001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.94
CPU user time (s): 2519.82
CPU system time (s): 0.122001
CPU usage (%): 99.9973
Max. virtual memory (cumulated for all children) (KiB): 160324
Max. memory (cumulated for all children) (KiB): 126696

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.82
system time used= 0.122001
maximum resident set size= 126776
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 163766
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 964


# summary of solver processes directly reported to runsolver:
#   pid: 16486
#   total CPU time (s): 2519.94
#   total CPU user time (s): 2519.82
#   total CPU system time (s): 0.122001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.95258 second user time and 16.5659 second system time

The end

Launcher Data 

Begin job on node124 at 2017-08-13 02:49:35
IDJOB=4265944
IDBENCH=135805
IDSOLVER=2655
FILE ID=node124/4265944-1502586231
RUNJOBID= node124-1502565138-11650
PBS_JOBID= 
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/TravellingSalesman/TravellingSalesman-m1-n150/TravellingSalesman-150-50-14.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4265944-1502586231/watcher-4265944-1502586231 -o /tmp/evaluation-result-4265944-1502586231/solver-4265944-1502586231 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1502565138-11650 --watchdog 2580  cosoco -lc -model -restarts -sat HOME/instance-4265944-1502586231.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b2c04361dada2322dcbf50e86c385888
RANDOM SEED=722306378

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31141372 kB
MemAvailable:   31664896 kB
Buffers:          245400 kB
Cached:           570728 kB
SwapCached:            0 kB
Active:           702768 kB
Inactive:         506644 kB
Active(anon):     393624 kB
Inactive(anon):    24960 kB
Active(file):     309144 kB
Inactive(file):   481684 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2576 kB
Writeback:             0 kB
AnonPages:        393288 kB
Mapped:            43104 kB
Shmem:             25320 kB
Slab:             122556 kB
SReclaimable:      97060 kB
SUnreclaim:        25496 kB
KernelStack:        3200 kB
PageTables:         5088 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     668708 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      354332 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    335872 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 62028 MiB
End job on node124 at 2017-08-13 03:31:35