Trace number 4293991

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 1.12SAT (TO)55 2520.01 2519.7

General information on the benchmark

NameCrosswordDesign/
CrosswordDesign-07-4-rom_c18.xml
MD5SUMb03b025d4dc3e1307d2e111dd352b63c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark55
Best CPU time to get the best result obtained on this benchmark2520.01
Satisfiable
(Un)Satisfiability was proved
Number of variables217
Number of constraints56
Number of domains5
Minimum domain size2
Maximum domain size41345
Distribution of domain sizes[{"size":2,"count":14},{"size":8,"count":98},{"size":27,"count":49},{"size":41345,"count":56}]
Minimum variable degree1
Maximum variable degree8
Distribution of variable degrees[{"degree":1,"count":70},{"degree":2,"count":98},{"degree":8,"count":49}]
Minimum constraint arity10
Maximum constraint arity11
Distribution of constraint arities[{"arity":10,"count":14},{"arity":11,"count":42}]
Number of extensional constraints56
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":56}]
Optimization problemYES
Type of objectivemax SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

1.79/1.84	c best=?? lower=0 upper=392 
3.89/3.95	c
3.89/3.95	c This is cosoco 1.12 --  
3.89/3.95	c
3.89/3.95	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4293991-1532384695.xml 
3.89/3.95	c enable optimization
3.89/3.95	c ========================================[ Problem Statistics ]===========================================
3.89/3.95	c |                                                                                                       
3.89/3.95	c |  Parse time        :         1.82 s 
3.89/3.95	c |
3.89/3.95	c |               Variables: 217
3.89/3.95	c |            Domain Sizes: 2..41345
3.89/3.95	c |
3.89/3.95	c |             Constraints: 57
3.89/3.95	c |                   Arity: 10..56
3.89/3.95	c | 
3.89/3.95	c |                   Types: 
3.89/3.95	c |                          Extension: 56  (nb tuples: 27..64202) -- (shared: 48)
3.89/3.95	c |                          Sum: 1
3.89/3.95	c |                          
3.89/3.95	c |               Objective: Maximize Sum
3.89/3.95	
3.89/3.95	c =========================================================================================================
3.89/3.95	o 0
3.89/3.95	c    1 calls to solver: best=0 lower=1 upper=392 
5.10/5.12	o 4
7.00/7.09	o 6
7.00/7.09	c    3 calls to solver: best=6 lower=7 upper=392 
11.29/11.35	o 7
19.00/19.10	o 8
19.00/19.10	c    5 calls to solver: best=8 lower=9 upper=392 
19.69/19.70	o 9
20.29/20.30	o 10
20.29/20.30	c    7 calls to solver: best=10 lower=11 upper=392 
20.79/20.84	o 11
21.39/21.41	o 12
21.39/21.41	c    9 calls to solver: best=12 lower=13 upper=392 
21.89/21.95	o 13
22.49/22.50	o 14
22.49/22.50	c   11 calls to solver: best=14 lower=15 upper=392 
23.00/23.05	o 15
23.49/23.58	o 16
23.49/23.58	c   13 calls to solver: best=16 lower=17 upper=392 
24.69/24.73	o 17
25.29/25.32	o 18
25.29/25.32	c   15 calls to solver: best=18 lower=19 upper=392 
25.79/25.88	o 19
26.39/26.41	o 20
26.39/26.41	c   17 calls to solver: best=20 lower=21 upper=392 
26.89/26.90	o 21
27.29/27.39	o 22
27.29/27.39	c   19 calls to solver: best=22 lower=23 upper=392 
27.79/27.87	o 23
28.69/28.74	o 25
28.69/28.74	c   21 calls to solver: best=25 lower=26 upper=392 
29.79/29.88	o 26
30.89/30.98	o 27
30.89/30.98	c   23 calls to solver: best=27 lower=28 upper=392 
31.79/31.81	o 28
33.89/33.92	o 29
33.89/33.92	c   25 calls to solver: best=29 lower=30 upper=392 
34.49/34.58	o 31
35.59/35.60	o 32
35.59/35.60	c   27 calls to solver: best=32 lower=33 upper=392 
42.19/42.24	o 33
54.60/54.66	o 35
54.60/54.66	c   29 calls to solver: best=35 lower=36 upper=392 
90.90/90.97	o 36
107.50/107.59	o 37
107.50/107.59	c   31 calls to solver: best=37 lower=38 upper=392 
132.01/132.05	o 38
187.12/187.19	o 39
187.12/187.19	c   33 calls to solver: best=39 lower=40 upper=392 
188.91/188.93	o 41
281.32/281.35	o 42
281.32/281.35	c   35 calls to solver: best=42 lower=43 upper=392 
345.22/345.20	o 43
478.05/478.03	o 44
478.05/478.03	c   37 calls to solver: best=44 lower=45 upper=392 
480.64/480.68	o 47
508.24/508.26	o 50
508.24/508.26	c   39 calls to solver: best=50 lower=51 upper=392 
611.26/611.24	o 52
2230.16/2230.00	o 54
2230.16/2230.00	c   41 calls to solver: best=54 lower=55 upper=392 
2424.59/2424.33	o 55
2520.00/2519.70	
2520.00/2519.70	c *** INTERRUPTED ***
2520.00/2519.70	c restarts              : 52          
2520.00/2519.70	c conflicts             : 146778       (58 /sec)
2520.00/2519.70	c decisions             : 400543       (159 /sec)
2520.00/2519.70	c propagations          : 11641788842 (4619881 /sec)
2520.00/2519.70	c root propagations     : 1571976     
2520.00/2519.70	c filter calls          : 21574774       (8562 /sec)
2520.00/2519.70	c useless filter calls  : 13430670       (62 %)
2520.00/2519.70	c Memory used           : 84.96 MB
2520.00/2519.70	c CPU time              : 2519.93 s
2520.00/2519.70	
2520.00/2519.70	c nb Solutions = 42
2520.00/2519.70	s SATISFIABLE
2520.00/2519.70	c Best value found: 55
2520.00/2519.70	
2520.00/2519.70	
2520.00/2519.70	v <instantiation type='solution' cost='55'>
2520.00/2519.70	v <list>bc[0][0] bc[0][1] bc[0][2] bc[0][3] bc[1][0] bc[1][1] bc[1][2] bc[1][3] bc[2][0] bc[2][1] bc[2][2] bc[2][3] bc[3][0] bc[3][1] bc[3][2] bc[3][3] bc[4][0] bc[4][1] bc[4][2] bc[4][3] bc[5][0] bc[5][1] bc[5][2] bc[5][3] bc[6][0] bc[6][1] bc[6][2] bc[6][3] br[0][0] br[0][1] br[0][2] br[0][3] br[1][0] br[1][1] br[1][2] br[1][3] br[2][0] br[2][1] br[2][2] br[2][3] br[3][0] br[3][1] br[3][2] br[3][3] br[4][0] br[4][1] br[4][2] br[4][3] br[5][0] br[5][1] br[5][2] br[5][3] br[6][0] br[6][1] br[6][2] br[6][3] c[0][0] c[0][1] c[0][2] c[0][3] c[1][0] c[1][1] c[1][2] c[1][3] c[2][0] c[2][1] c[2][2] c[2][3] c[3][0] c[3][1] c[3][2] c[3][3] c[4][0] c[4][1] c[4][2] c[4][3] c[5][0] c[5][1] c[5][2] c[5][3] c[6][0] c[6][1] c[6][2] c[6][3] pc[0][0] pc[0][1] pc[0][2] pc[0][3] pc[1][0] pc[1][1] pc[1][2] pc[1][3] pc[2][0] pc[2][1] pc[2][2] pc[2][3] pc[3][0] pc[3][1] pc[3][2] pc[3][3] pc[4][0] pc[4][1] pc[4][2] pc[4][3] pc[5][0] pc[5][1] pc[5][2] pc[5][3] pc[6][0] pc[6][1] pc[6][2] pc[6][3] pr[0][0] pr[0][1] pr[0][2] pr[0][3] pr[1][0] pr[1][1] pr[1][2] pr[1][3] pr[2][0] pr[2][1] pr[2][2] pr[2][3] pr[3][0] pr[3][1] pr[3][2] pr[3][3] pr[4][0] pr[4][1] pr[4][2] pr[4][3] pr[5][0] pr[5][1] pr[5][2] pr[5][3] pr[6][0] pr[6][1] pr[6][2] pr[6][3] r[0][0] r[0][1] r[0][2] r[0][3] r[1][0] r[1][1] r[1][2] r[1][3] r[2][0] r[2][1] r[2][2] r[2][3] r[3][0] r[3][1] r[3][2] r[3][3] r[4][0] r[4][1] r[4][2] r[4][3] r[5][0] r[5][1] r[5][2] r[5][3] r[6][0] r[6][1] r[6][2] r[6][3] x[0][0] x[0][1] x[0][2] x[0][3] x[0][4] x[0][5] x[0][6] x[1][0] x[1][1] x[1][2] x[1][3] x[1][4] x[1][5] x[1][6] x[2][0] x[2][1] x[2][2] x[2][3] x[2][4] x[2][5] x[2][6] x[3][0] x[3][1] x[3][2] x[3][3] x[3][4] x[3][5] x[3][6] x[4][0] x[4][1] x[4][2] x[4][3] x[4][4] x[4][5] x[4][6] x[5][0] x[5][1] x[5][2] x[5][3] x[5][4] x[5][5] x[5][6] x[6][0] x[6][1] x[6][2] x[6][3] x[6][4] x[6][5] x[6][6] </list>
2520.00/2519.70	v <values>5 0 0 0 0 0 0 0 7 0 0 0 7 0 0 0 0 0 0 0 5 0 0 0 7 0 0 0 5 0 0 0 0 0 0 0 7 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 5 0 0 0 10036 11562 -1 -1 11562 23111 2780 -1 1397 -1 -1 -1 35070 -1 -1 -1 11562 17155 24451 -1 32554 -1 -1 -1 415 -1 -1 -1 0 6 -1 -1 0 2 5 -1 0 -1 -1 -1 0 -1 -1 -1 0 2 5 -1 1 -1 -1 -1 0 -1 -1 -1 0 6 -1 -1 0 2 5 -1 0 -1 -1 -1 0 -1 -1 -1 0 2 5 -1 1 -1 -1 -1 0 6 -1 -1 10036 0 -1 -1 11562 23111 32648 -1 1397 -1 -1 -1 35070 -1 -1 -1 11562 17155 37937 -1 284 -1 -1 -1 12489 23450 -1 -1 3 4 0 18 4 26 0 4 26 12 19 26 18 3 0 12 4 17 8 2 0 18 19 17 0 1 14 13 4 26 8 1 26 19 18 26 0 2 14 13 19 14 4 21 0 13 18 26 13 </values>
2520.00/2519.70	v </instantiation>
2520.00/2519.70

Verifier Data 

OK	55

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (4056 MiB free)
  memory of node 1: 16384 MiB (8040 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293991-1532384695/watcher-4293991-1532384695 -o /tmp/evaluation-result-4293991-1532384695/solver-4293991-1532384695 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1532371797-14425 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4293991-1532384695.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=16026, runsolver pid=16023

[startup+0.1002 s]*
/proc/loadavg: 2.25 2.14 2.09 3/188 16027
/proc/meminfo: memFree=12368620/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=46648 memory=22688 CPUtime=0.1 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 5886 0 0 0 10 0 0 0 20 0 1 0 56032708 47767552 5672 33554432000 4194304 6142532 140736384116240 140736384112872 140030349593573 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 11662 5672 783 476 0 4984 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 46648 KiB
Current children cumulated memory: 22688 KiB

[startup+0.209782 s]*
/proc/loadavg: 2.25 2.14 2.09 3/188 16027
/proc/meminfo: memFree=12367504/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=47560 memory=23392 CPUtime=0.2 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 6202 0 0 0 20 0 0 0 20 0 1 0 56032708 48701440 5848 33554432000 4194304 6142532 140736384116240 140736384112872 5802612 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 11890 5848 783 476 0 5212 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 47560 KiB
Current children cumulated memory: 23392 KiB

[startup+0.308929 s]*
/proc/loadavg: 2.25 2.14 2.09 3/188 16027
/proc/meminfo: memFree=12366760/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=48220 memory=24180 CPUtime=0.3 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 6401 0 0 0 30 0 0 0 20 0 1 0 56032708 49377280 6045 33554432000 4194304 6142532 140736384116240 140736384112872 5802612 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 12055 6045 783 476 0 5377 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 48220 KiB
Current children cumulated memory: 24180 KiB

[startup+0.700337 s]
/proc/loadavg: 2.25 2.14 2.09 3/188 16027
/proc/meminfo: memFree=12364900/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=51232 memory=27436 CPUtime=0.69 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 7357 0 0 0 68 1 0 0 20 0 1 0 56032708 52461568 6859 33554432000 4194304 6142532 140736384116240 140736384112888 140030349593573 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 12808 6859 783 476 0 6130 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 51232 KiB
Current children cumulated memory: 27436 KiB

[startup+1.50034 s]
/proc/loadavg: 2.25 2.14 2.09 3/188 16027
/proc/meminfo: memFree=12355404/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=58956 memory=35072 CPUtime=1.49 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 9891 0 0 0 148 1 0 0 20 0 1 0 56032708 60370944 8768 33554432000 4194304 6142532 140736384116240 140736384112888 140030350031872 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 14739 8768 792 476 0 8061 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 58956 KiB
Current children cumulated memory: 35072 KiB

[startup+3.10966 s]
/proc/loadavg: 2.25 2.14 2.09 3/188 16027
/proc/meminfo: memFree=12328412/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86860 memory=62932 CPUtime=3.1 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 27991 0 0 0 307 3 0 0 20 0 1 0 56032708 88944640 15733 33554432000 4194304 6142532 140736384116240 140736384112888 5017979 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21715 15733 842 476 0 15037 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 86860 KiB
Current children cumulated memory: 62932 KiB

[startup+6.30042 s]
/proc/loadavg: 2.23 2.14 2.08 3/188 16027
/proc/meminfo: memFree=12328424/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=62976 CPUtime=6.29 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 39214 0 0 0 626 3 0 0 20 0 1 0 56032708 89079808 15744 33554432000 4194304 6142532 140736384116240 140736384113768 5017740 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15744 844 476 0 15070 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 62976 KiB

[startup+12.7004 s]
/proc/loadavg: 2.21 2.14 2.08 3/187 16028
/proc/meminfo: memFree=12327804/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63012 CPUtime=12.69 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 50411 0 0 0 1266 3 0 0 20 0 1 0 56032708 89079808 15753 33554432000 4194304 6142532 140736384116240 140736384103512 5017767 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15753 844 476 0 15070 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63012 KiB

[startup+25.5004 s]
/proc/loadavg: 2.16 2.13 2.08 3/187 16028
/proc/meminfo: memFree=12327804/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63012 CPUtime=25.49 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 72799 0 0 0 2545 4 0 0 20 0 1 0 56032708 89079808 15753 33554432000 4194304 6142532 140736384116240 140736384113768 5017767 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15753 844 476 0 15070 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63012 KiB

[startup+51.1097 s]
/proc/loadavg: 2.11 2.12 2.08 3/187 16028
/proc/meminfo: memFree=12327804/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63012 CPUtime=51.11 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 83991 0 0 0 5106 5 0 0 20 0 1 0 56032708 89079808 15753 33554432000 4194304 6142532 140736384116240 140736384113768 5333269 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15753 844 476 0 15070 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63012 KiB

[startup+102.3 s]
/proc/loadavg: 2.05 2.10 2.08 3/187 16029
/proc/meminfo: memFree=12326904/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63020 CPUtime=102.29 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 95196 0 0 0 10224 5 0 0 20 0 1 0 56032708 89079808 15755 33554432000 4194304 6142532 140736384116240 140736384113768 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15755 844 476 0 15070 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63020 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.08 2.07 3/187 16030
/proc/meminfo: memFree=12326684/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63296 CPUtime=162.31 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 98708 0 0 0 16225 6 0 0 20 0 1 0 56032708 89079808 15824 33554432000 4194304 6142532 140736384116240 140736384113768 5017760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15824 844 476 0 15070 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63296 KiB

[startup+222.3 s]
/proc/loadavg: 2.16 2.10 2.07 3/187 16032
/proc/meminfo: memFree=12326228/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63296 CPUtime=222.31 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 99940 0 0 0 22225 6 0 0 20 0 1 0 56032708 89079808 15824 33554432000 4194304 6142532 140736384116240 140736384113768 5017782 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15824 844 476 0 15070 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63296 KiB

[startup+282.3 s]
/proc/loadavg: 2.52 2.23 2.12 3/187 16033
/proc/meminfo: memFree=12326424/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63296 CPUtime=282.32 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 99940 0 0 0 28226 6 0 0 20 0 1 0 56032708 89079808 15824 33554432000 4194304 6142532 140736384116240 140736384113768 5017799 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15824 844 476 0 15070 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63296 KiB

[startup+342.3 s]
/proc/loadavg: 2.25 2.21 2.12 3/188 16042
/proc/meminfo: memFree=12326056/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63316 CPUtime=342.32 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 101156 0 0 0 34226 6 0 0 20 0 1 0 56032708 89079808 15829 33554432000 4194304 6142532 140736384116240 140736384103512 5333269 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15829 844 476 0 15070 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63316 KiB

[startup+402.3 s]
/proc/loadavg: 2.09 2.17 2.12 3/188 16043
/proc/meminfo: memFree=12326032/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63316 CPUtime=402.33 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 101169 0 0 0 40227 6 0 0 20 0 1 0 56032708 89079808 15829 33554432000 4194304 6142532 140736384116240 140736384113768 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15829 844 476 0 15070 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63316 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 2.14 2.11 3/188 16044
/proc/meminfo: memFree=12326296/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63316 CPUtime=462.34 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 102155 0 0 0 46228 6 0 0 20 0 1 0 56032708 89079808 15829 33554432000 4194304 6142532 140736384116240 140736384113768 5333269 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15829 844 476 0 15070 0
Current children cumulated CPU time: 462.34 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63316 KiB


################
# More data... #
################

/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 1782.51 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16082
/proc/meminfo: memFree=12326624/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=1842.52 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 115667 0 0 0 184245 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 1842.52 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16083
/proc/meminfo: memFree=12326460/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=1902.52 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 116929 0 0 0 190245 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5017816 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 1902.52 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16084
/proc/meminfo: memFree=12326588/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=1962.53 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 116929 0 0 0 196246 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5017895 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 1962.53 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16086
/proc/meminfo: memFree=12326568/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=2022.54 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 118007 0 0 0 202247 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 2022.54 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16087
/proc/meminfo: memFree=12326420/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=2082.54 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 118155 0 0 0 208247 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5017816 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 2082.54 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16095
/proc/meminfo: memFree=12326544/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=2142.55 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 119193 0 0 0 214248 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5016509 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 2142.55 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16122
/proc/meminfo: memFree=12326256/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63336 CPUtime=2202.56 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 119193 0 0 0 220249 7 0 0 20 0 1 0 56032708 89079808 15834 33554432000 4194304 6142532 140736384116240 140736384113768 5017909 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15834 844 476 0 15070 0
Current children cumulated CPU time: 2202.56 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63336 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16123
/proc/meminfo: memFree=12326808/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2262.57 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 120423 0 0 0 226250 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384103512 5017767 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2262.57 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16248
/proc/meminfo: memFree=11804580/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2322.57 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 120424 0 0 0 232250 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384103512 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2322.57 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16249
/proc/meminfo: memFree=11804268/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2382.58 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 121552 0 0 0 238251 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384103512 5017767 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2382.58 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16250
/proc/meminfo: memFree=11803580/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2442.59 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 121652 0 0 0 244252 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384113768 5016455 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2442.59 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB

[startup+2502.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 16251
/proc/meminfo: memFree=11803756/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2502.6 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 122665 0 0 0 250253 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384113768 5333295 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2502.6 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.7 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 16251
/proc/meminfo: memFree=11803864/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2520 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 122802 0 0 0 251993 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384113768 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.7 s]
# the end of solver process 16026 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.93 s, system=0.08001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.7 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 16251
/proc/meminfo: memFree=11803864/32770624 swapFree=67108860/67108860
[pid=16026] ppid=16023 vsize=86992 memory=63340 CPUtime=2520 cores=0,2,4,6
/proc/16026/stat : 16026 (cosoco) R 16023 16026 14394 0 -1 4202496 122802 0 0 0 251993 7 0 0 20 0 1 0 56032708 89079808 15835 33554432000 4194304 6142532 140736384116240 140736384113768 5017759 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8243016 8247936 32399360 140736384119942 140736384120072 140736384120072 140736384122830 0
/proc/16026/statm: 21748 15835 844 476 0 15070 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 86992 KiB
Current children cumulated memory: 63340 KiB

Child status: 1
Real time (s): 2519.7
CPU time (s): 2520.01
CPU user time (s): 2519.93
CPU system time (s): 0.08001
CPU usage (%): 100.012
Max. virtual memory (cumulated for all children) (KiB): 86992
Max. memory (cumulated for all children) (KiB): 63340

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.93
system time used= 0.08001
maximum resident set size= 63412
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 122855
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 649


# summary of solver processes directly reported to runsolver:
#   pid: 16026
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2519.93
#   total CPU system time (s): 0.08001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.03 second user time and 18.3866 second system time

The end

Launcher Data 

Begin job on node104 at 2018-07-24 00:24:55
IDJOB=4293991
IDBENCH=141308
IDSOLVER=2752
FILE ID=node104/4293991-1532384695
RUNJOBID= node104-1532371797-14425
PBS_JOBID= 21021574
Free space on /tmp= 48944 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/CrosswordDesign/CrosswordDesign-07-4-rom_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293991-1532384695/watcher-4293991-1532384695 -o /tmp/evaluation-result-4293991-1532384695/solver-4293991-1532384695 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1532371797-14425 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4293991-1532384695.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b03b025d4dc3e1307d2e111dd352b63c
RANDOM SEED=40475501

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        12387520 kB
MemAvailable:   31768260 kB
Buffers:          268904 kB
Cached:         19080584 kB
SwapCached:            0 kB
Active:          2316224 kB
Inactive:       17257372 kB
Active(anon):     227008 kB
Inactive(anon):    17080 kB
Active(file):    2089216 kB
Inactive(file): 17240292 kB
Unevictable:        7180 kB
Mlocked:            7180 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              7744 kB
Writeback:             0 kB
AnonPages:        384868 kB
Mapped:            39384 kB
Shmem:             17036 kB
Slab:             507648 kB
SReclaimable:     479692 kB
SUnreclaim:        27956 kB
KernelStack:        3632 kB
PageTables:         5504 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     515120 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    323584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 48872 MiB
End job on node104 at 2018-07-24 01:06:55