Trace number 4408872

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0SAT (TO)151 2400.04 2399.7

General information on the benchmark

NameTravellingSalesman/TravellingSalesman-m1-n20/
TravellingSalesman-20-30-05.xml
MD5SUM6b55f0e9dc993e2546b868899e60f341
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark114
Best CPU time to get the best result obtained on this benchmark740.811
Satisfiable
(Un)Satisfiability was proved
Number of variables40
Number of constraints21
Number of domains2
Minimum domain size20
Maximum domain size32
Distribution of domain sizes[{"size":20,"count":20},{"size":32,"count":20}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":20},{"degree":3,"count":20}]
Minimum constraint arity3
Maximum constraint arity20
Distribution of constraint arities[{"arity":3,"count":20},{"arity":20,"count":1}]
Number of extensional constraints20
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":20},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c
0.00/0.00	c This is cosoco 2.00 --  
0.00/0.00	c
0.00/0.00	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408872-1569805397.xml 
0.00/0.00	c enable optimization
0.00/0.00	c ========================================[ Problem Statistics ]===========================================
0.00/0.00	c |                                                                                                       
0.00/0.00	c |  Parse time        :         0.00 s 
0.00/0.00	c |
0.00/0.00	c |               Variables: 40
0.00/0.00	c |            Domain Sizes: 20..32
0.00/0.00	c |
0.00/0.00	c |             Constraints: 22
0.00/0.00	c |                   Arity: 3..20  -- Ternary: 20
0.00/0.00	c | 
0.00/0.00	c |                   Types: 
0.00/0.00	c |                          All Different: 1
0.00/0.00	c |                          Extension: 20  (nb tuples: 380..380) -- (shared: 19)
0.00/0.00	c |                          Sum: 1
0.00/0.00	c |                          
0.00/0.00	c |               Objective: Minimize Sum
0.00/0.00	
0.00/0.00	c =========================================================================================================
0.00/0.00	o 221
0.00/0.00	c    1 calls to solver(id=0): best=221 lower=20 upper=220 
0.00/0.01	o 196
0.31/0.34	o 191
0.31/0.34	c    3 calls to solver(id=0): best=191 lower=20 upper=190 
0.41/0.47	o 186
0.60/0.69	o 183
0.60/0.69	c    5 calls to solver(id=0): best=183 lower=20 upper=182 
0.69/0.70	o 180
1.19/1.20	o 179
1.19/1.20	c    7 calls to solver(id=0): best=179 lower=20 upper=178 
3.59/3.65	o 175
23.40/23.43	o 173
23.40/23.43	c    9 calls to solver(id=0): best=173 lower=20 upper=172 
31.01/31.09	o 170
111.31/111.37	o 169
111.31/111.37	c   11 calls to solver(id=0): best=169 lower=20 upper=168 
111.31/111.39	o 168
118.21/118.29	o 167
118.21/118.29	c   13 calls to solver(id=0): best=167 lower=20 upper=166 
171.62/171.69	o 165
246.63/246.60	o 164
246.63/246.60	c   15 calls to solver(id=0): best=164 lower=20 upper=163 
252.63/252.62	o 163
651.88/651.87	o 161
651.88/651.87	c   17 calls to solver(id=0): best=161 lower=20 upper=160 
728.29/728.26	o 160
728.39/728.31	o 159
728.39/728.31	c   19 calls to solver(id=0): best=159 lower=20 upper=158 
728.39/728.32	o 155
2306.61/2306.33	o 154
2306.61/2306.33	c   21 calls to solver(id=0): best=154 lower=20 upper=153 
2363.43/2363.14	o 151
2400.03/2399.70	
2400.03/2399.70	c *** INTERRUPTED ***
2400.03/2399.70	c call to solver        : 22
2400.03/2399.70	c
2400.03/2399.70	c restarts              : 1483        
2400.03/2399.70	c conflicts             : 49351568     (20563 /sec)
2400.03/2399.70	c decisions             : 83280100     (34700 /sec)
2400.03/2399.70	c propagations          : 6247126385  (2602936 /sec)
2400.03/2399.70	c root propagations     : 888         
2400.03/2399.70	c filter calls          : 916748709      (381974 /sec)
2400.03/2399.70	c useless filter calls  : 437066136      (47 %)
2400.03/2399.70	c Memory used           : 26.73 MB
2400.03/2399.70	c Best bound time (wc)  : 2363.14 s
2400.03/2399.70	c CPU time              : 2400.03 s
2400.03/2399.70	c real time             : 2399.7 s
2400.03/2399.70	
2400.03/2399.70	c nb Solutions = 22
2400.03/2399.70	s SATISFIABLE
2400.03/2399.70	c Best value found: 151
2400.03/2399.70	
2400.03/2399.70	
2400.03/2399.70	v <instantiation type='solution' cost='151'>
2400.03/2399.70	v <list>c[0] c[10] c[11] c[12] c[13] c[14] c[15] c[16] c[17] c[18] c[19] c[1] c[2] c[3] c[4] c[5] c[6] c[7] c[8] c[9] d[0] d[10] d[11] d[12] d[13] d[14] d[15] d[16] d[17] d[18] d[19] d[1] d[2] d[3] d[4] d[5] d[6] d[7] d[8] d[9] </list>
2400.03/2399.70	v <values>3 1 4 7 10 12 14 13 11 9 8 18 19 17 16 15 6 2 0 5 25 7 5 2 4 6 1 7 3 1 12 16 8 13 7 13 2 11 4 4 </values>
2400.03/2399.70	v </instantiation>
2400.03/2399.70

Verifier Data 

OK	151

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15273 MiB free)
  memory of node 1: 16384 MiB (15527 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408872-1569805397/watcher-4408872-1569805397 -o /tmp/evaluation-result-4408872-1569805397/solver-4408872-1569805397 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node141-1569787350-25285 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408872-1569805397.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28819, runsolver pid=28816

[startup+0.100155 s]*
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31541064/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=3952 CPUtime=0.1 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1163 0 0 0 10 0 0 0 20 0 1 0 556477420 28020736 988 33554432000 4194304 6211132 140736943994384 140736943990920 5250319 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 988 858 493 0 146 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 3952 KiB

[startup+0.209426 s]*
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31540756/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=3952 CPUtime=0.21 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1163 0 0 0 21 0 0 0 20 0 1 0 556477420 28020736 988 33554432000 4194304 6211132 140736943994384 140736943990920 5193760 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 988 858 493 0 146 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 3952 KiB

[startup+0.309018 s]*
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31540756/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=3952 CPUtime=0.31 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1163 0 0 0 31 0 0 0 20 0 1 0 556477420 28020736 988 33554432000 4194304 6211132 140736943994384 140736943990920 5039022 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 988 858 493 0 146 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 3952 KiB

[startup+0.700278 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31540540/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=3952 CPUtime=0.69 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1163 0 0 0 69 0 0 0 20 0 1 0 556477420 28020736 988 33554432000 4194304 6211132 140736943994384 140736943992520 5250321 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 988 858 493 0 146 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 3952 KiB

[startup+1.50027 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31540084/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=3952 CPUtime=1.49 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1163 0 0 0 149 0 0 0 20 0 1 0 556477420 28020736 988 33554432000 4194304 6211132 140736943994384 140736943982264 5078771 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 988 858 493 0 146 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 3952 KiB

[startup+3.10902 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31540132/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=3.1 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1222 0 0 0 310 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943982264 5039026 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+6.30027 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31539372/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=6.29 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1294 0 0 0 629 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5082376 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+12.7003 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 28820
/proc/meminfo: memFree=31539568/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=12.69 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1403 0 0 0 1269 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5038944 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+25.5003 s]
/proc/loadavg: 2.09 2.03 2.05 3/200 28822
/proc/meminfo: memFree=31539008/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=25.5 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1485 0 0 0 2550 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5082803 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 25.5 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+51.1091 s]
/proc/loadavg: 2.06 2.03 2.05 3/200 28822
/proc/meminfo: memFree=31538916/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=51.11 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1544 0 0 0 5111 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5075208 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/200 28826
/proc/meminfo: memFree=31539652/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=102.31 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1603 0 0 0 10231 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5250321 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 102.31 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 28832
/proc/meminfo: memFree=31539128/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=162.31 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1676 0 0 0 16231 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943982264 5039141 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28836
/proc/meminfo: memFree=31539160/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=222.32 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1748 0 0 0 22232 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5083285 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 222.32 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28840
/proc/meminfo: memFree=31539004/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=282.33 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1749 0 0 0 28233 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5075838 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 282.33 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28846
/proc/meminfo: memFree=31539196/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=342.34 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1808 0 0 0 34234 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5186260 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 342.34 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28850
/proc/meminfo: memFree=31538708/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=402.35 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1808 0 0 0 40235 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5037868 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 402.35 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28859
/proc/meminfo: memFree=31538908/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=462.36 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 1867 0 0 0 46236 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5039132 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 462.36 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB


################
# More data... #
################

/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 1662.52 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+1722.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 29078
/proc/meminfo: memFree=31537168/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=1722.53 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2475 0 0 0 172253 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5079276 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 1722.53 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29084
/proc/meminfo: memFree=31538860/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=1782.54 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2531 0 0 0 178254 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5155943 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 1782.54 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 29089
/proc/meminfo: memFree=31538108/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=1842.55 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2531 0 0 0 184255 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5078712 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 1842.55 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+1902.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/199 29093
/proc/meminfo: memFree=31538124/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=1902.56 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2590 0 0 0 190256 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5037884 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 1902.56 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+1962.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/199 29099
/proc/meminfo: memFree=31538784/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=1962.56 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2590 0 0 0 196256 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5075192 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 1962.56 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 29103
/proc/meminfo: memFree=31538452/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2022.57 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2645 0 0 0 202257 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5039029 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2022.57 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29107
/proc/meminfo: memFree=31538140/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2082.58 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2649 0 0 0 208258 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5193728 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2082.58 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29113
/proc/meminfo: memFree=31537920/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2142.59 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2703 0 0 0 214259 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5076402 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2142.59 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29117
/proc/meminfo: memFree=31537828/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2202.6 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2703 0 0 0 220260 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5394535 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2202.6 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29128
/proc/meminfo: memFree=31538252/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2262.61 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2762 0 0 0 226261 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5039540 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2262.61 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29134
/proc/meminfo: memFree=31537928/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2322.61 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2776 0 0 0 232261 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943982264 5078953 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2322.61 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

[startup+2382.3 s]
/proc/loadavg: 2.16 2.05 2.06 3/199 29201
/proc/meminfo: memFree=31537792/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2382.62 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2848 0 0 0 238262 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5082376 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2382.62 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.7 s]
/proc/loadavg: 2.34 2.09 2.07 3/200 29204
/proc/meminfo: memFree=31538180/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2400.03 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2848 0 0 0 240003 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5081205 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.7 s]
# the end of solver process 28819 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.03 s, system=0.007 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.7 s]
/proc/loadavg: 2.34 2.09 2.07 3/200 29204
/proc/meminfo: memFree=31538180/32770624 swapFree=66937824/67108860
[pid=28819] ppid=28816 vsize=27364 memory=4004 CPUtime=2400.03 cores=1,3,5,7
/proc/28819/stat : 28819 (cosoco) R 28816 28819 25253 0 -1 4202496 2848 0 0 0 240003 0 0 0 20 0 1 0 556477420 28020736 1001 33554432000 4194304 6211132 140736943994384 140736943992520 5081205 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 22769664 140736944002059 140736944002161 140736944002161 140736944005070 0
/proc/28819/statm: 6841 1001 870 493 0 146 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 27364 KiB
Current children cumulated memory: 4004 KiB

Child status: 1
Real time (s): 2399.7
CPU time (s): 2400.04
CPU user time (s): 2400.03
CPU system time (s): 0.007
CPU usage (%): 100.014
Max. virtual memory (cumulated for all children) (KiB): 27364
Max. memory (cumulated for all children) (KiB): 4004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.03
system time used= 0.007
maximum resident set size= 4068
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2885
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 610


# summary of solver processes directly reported to runsolver:
#   pid: 28819
#   total CPU time (s): 2400.04
#   total CPU user time (s): 2400.03
#   total CPU system time (s): 0.007

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.16732 second user time and 14.5474 second system time

The end

Launcher Data 

Begin job on node141 at 2019-09-30 03:02:34
IDJOB=4408872
IDBENCH=135679
IDSOLVER=2875
FILE ID=node141/4408872-1569805397
RUNJOBID= node141-1569787350-25285
PBS_JOBID= 21705821
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/TravellingSalesman/TravellingSalesman-m1-n20/TravellingSalesman-20-30-05.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408872-1569805397/watcher-4408872-1569805397 -o /tmp/evaluation-result-4408872-1569805397/solver-4408872-1569805397 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node141-1569787350-25285 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408872-1569805397.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b55f0e9dc993e2546b868899e60f341
RANDOM SEED=122429216

node141.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31541064 kB
MemAvailable:   31823164 kB
Buffers:          194680 kB
Cached:           431248 kB
SwapCached:        62076 kB
Active:           343492 kB
Inactive:         350856 kB
Active(anon):      20332 kB
Inactive(anon):   126400 kB
Active(file):     323160 kB
Inactive(file):   224456 kB
Unevictable:      107692 kB
Mlocked:          107692 kB
SwapTotal:      67108860 kB
SwapFree:       66937824 kB
Dirty:              2736 kB
Writeback:             0 kB
AnonPages:        114892 kB
Mapped:            28552 kB
Shmem:             69560 kB
Slab:             130416 kB
SReclaimable:     100636 kB
SUnreclaim:        29780 kB
KernelStack:        3536 kB
PageTables:         5972 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     569932 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      128384 kB
DirectMap2M:    33417216 kB

Free space on /tmp at the end= 62024 MiB
End job on node141 at 2019-09-30 03:42:33