Trace number 4389635

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.1 2519.9

General information on the benchmark

NameQuasiGroups/QuasiGroups-elt-qg3/
QuasiGroup-3-40.xml
MD5SUMe27695e2b8dc2930e1e97c4ddd0ab1f7
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3200
Number of constraints3122
Number of domains2
Minimum domain size40
Maximum domain size1600
Distribution of domain sizes[{"size":40,"count":1600},{"size":1600,"count":1560}]
Minimum variable degree0
Maximum variable degree1563
Distribution of variable degrees[{"degree":0,"count":40},{"degree":2,"count":1560},{"degree":1562,"count":40},{"degree":1563,"count":1560}]
Minimum constraint arity3
Maximum constraint arity1601
Distribution of constraint arities[{"arity":3,"count":1560},{"arity":40,"count":1},{"arity":1600,"count":1},{"arity":1601,"count":1560}]
Number of extensional constraints0
Number of intensional constraints1560
Distribution of constraint types[{"type":"intension","count":1560},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":1560}]
Optimization problemNO
Type of objective

Solver Data 

4.38/4.46	c root propagations     : 67280       
4.38/4.46	c restarts enabled, print stats at every restarts
4.38/4.46	c
4.38/4.46	c
4.38/4.46	c
4.38/4.46	c This is cosoco 2.00 --  
4.38/4.46	c
4.38/4.46	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389635-1568341912.xml 
4.38/4.46	c ========================================[ Problem Statistics ]===========================================
4.38/4.46	c |                                                                                                       
4.38/4.46	c |  Parse time        :         2.61 s 
4.38/4.46	c |
4.38/4.46	c |               Variables: 3200
4.38/4.46	c |            Domain Sizes: 40..1600
4.38/4.46	c |
4.38/4.46	c |             Constraints: 3240
4.38/4.46	c |                   Arity: 1..1601  -- Unary: 40  -- Ternary: 1560
4.38/4.46	c | 
4.38/4.46	c |                   Types: 
4.38/4.46	c |                          All Different: 80
4.38/4.46	c |                          Element Constant: 1560
4.38/4.46	c |                          Intension: 1560
4.38/4.46	c |                          Unary: 40
4.38/4.46	c |                          
4.38/4.46	c =========================================================================================================
4.38/4.46	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
4.38/4.46	c remove useless variable y[0][0]
4.38/4.46	c remove useless variable y[1][1]
4.38/4.46	c remove useless variable y[2][2]
4.38/4.46	c remove useless variable y[3][3]
4.38/4.46	c remove useless variable y[4][4]
4.38/4.46	c remove useless variable y[5][5]
4.38/4.46	c remove useless variable y[6][6]
4.38/4.46	c remove useless variable y[7][7]
4.38/4.46	c remove useless variable y[8][8]
4.38/4.46	c remove useless variable y[9][9]
4.38/4.46	c remove useless variable y[10][10]
4.38/4.46	c remove useless variable y[11][11]
4.38/4.46	c remove useless variable y[12][12]
4.38/4.46	c remove useless variable y[13][13]
4.38/4.46	c remove useless variable y[14][14]
4.38/4.46	c remove useless variable y[15][15]
4.38/4.46	c remove useless variable y[16][16]
4.38/4.46	c remove useless variable y[17][17]
4.38/4.46	c remove useless variable y[18][18]
4.38/4.46	c remove useless variable y[19][19]
4.38/4.46	c remove useless variable y[20][20]
4.38/4.46	c remove useless variable y[21][21]
4.38/4.46	c remove useless variable y[22][22]
4.38/4.46	c remove useless variable y[23][23]
4.38/4.46	c remove useless variable y[24][24]
4.38/4.46	c remove useless variable y[25][25]
4.38/4.46	c remove useless variable y[26][26]
4.38/4.46	c remove useless variable y[27][27]
4.38/4.46	c remove useless variable y[28][28]
4.38/4.46	c remove useless variable y[29][29]
4.38/4.46	c remove useless variable y[30][30]
4.38/4.46	c remove useless variable y[31][31]
4.38/4.46	c remove useless variable y[32][32]
4.38/4.46	c remove useless variable y[33][33]
4.38/4.46	c remove useless variable y[34][34]
4.38/4.46	c remove useless variable y[35][35]
4.38/4.46	c remove useless variable y[36][36]
4.38/4.46	c remove useless variable y[37][37]
4.38/4.46	c remove useless variable y[38][38]
4.38/4.46	c remove useless variable y[39][39]
31.59/31.69	c 101            427            1398487        1137597        1754           0              133   319   298
58.59/58.61	c 211            834            2577095        1934376        1754           0              126   286   246
85.49/85.59	c 332            1226           3760983        2719812        1754           0              174   269   264
121.69/121.70	c 465            1799           5462329        3558347        1754           0              140   430   404
177.39/177.48	c 611            2593           8112917        5114866        1754           0              9   531   448  
231.90/231.93	c 771            3340           10439886       6901629        1754           0              18   345   312 
268.01/268.07	c 947            3780           11968111       7866789        1754           0              44   254   223 
295.91/295.93	c 1140           4111           13039485       8275547        1754           0              67   131   128 
342.02/342.04	c 1352           4674           14985638       9663408        1754           0              27   301   264 
380.02/380.01	c 1585           5133           16514672       10718930       1754           0              19   218   206 
428.51/428.56	c 1841           5788           18647090       11984300       1754           0              23   389   325 
483.51/483.58	c 2122           6649           21178491       13334488       1754           0              27   573   459 
534.03/534.04	c 2431           7295           23335662       14385535       1754           0              37   327   310 
584.32/584.35	c 2770           7927           25408205       15363981       1754           0              37   261   251 
640.43/640.47	c 3142           8558           27630235       17258804       1754           0              16   226   209 
691.73/691.75	c 3551           9168           29627354       18431267       1754           0              17   184   181 
741.23/741.25	c 4000           9711           31373948       19014393       1754           0              53   80   79   
806.15/806.12	c 4493           10546          34125414       20054990       1754           0              20   294   288 
887.94/887.95	c 5035           11599          37851725       22267477       1754           0              25   421   391 
978.95/978.96	c 5631           12643          41925078       25750411       1754           0              28   396   361 
1065.46/1065.49	c 6286           13684          45554801       27935069       1754           0              32   306   293 
1161.36/1161.34	c 7006           14754          49239163       30681732       1754           0              25   243   227 
1286.58/1286.55	c 7798           16095          54642411       35904386       1754           0              30   393   348 
1390.10/1390.09	c 8669           17511          59643089       38157720       1754           0              36   500   477 
1514.70/1514.65	c 9627           18954          64860037       42210164       1754           0              39   339   318 
1802.73/1802.63	c 10680          21510          75999869       53917052       1754           0              48   230   223 
1949.54/1949.48	c 11838          23245          82349027       57680051       1754           0              32   377   367 
2140.85/2140.74	c 13111          25917          91515870       64961088       1754           0              33   482   463 
2438.29/2438.19	c 14511          29506          104297525      72413790       1754           0              36   390   369 
2520.09/2519.90	
2520.09/2519.90	c *** INTERRUPTED ***
2520.09/2519.90	c restarts              : 29          
2520.09/2519.90	c conflicts             : 15198        (6 /sec)
2520.09/2519.90	c decisions             : 30489        (12 /sec)
2520.09/2519.90	c propagations          : 73525889    (29178 /sec)
2520.09/2519.90	c root propagations     : 67280       
2520.09/2519.90	c filter calls          : 107512261      (42665 /sec)
2520.09/2519.90	c useless filter calls  : 82350885       (76 %)
2520.09/2519.90	c Memory used           : 252.48 MB
2520.09/2519.90	c CPU time              : 2519.89 s
2520.09/2519.90	c real time             : 2519.9 s
2520.09/2519.90	
2520.09/2519.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15340 MiB free)
  memory of node 1: 16384 MiB (15592 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389635-1568341912/watcher-4389635-1568341912 -o /tmp/evaluation-result-4389635-1568341912/solver-4389635-1568341912 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1568308483-14143 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389635-1568341912.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=20245, runsolver pid=20242

[startup+0.100172 s]*
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31641272/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=62356 memory=38784 CPUtime=0.1 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 9865 0 0 0 9 1 0 0 20 0 1 0 410449676 63852544 9696 33554432000 4194304 6210612 140724748713232 140724748707976 5001269 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 15622 9696 827 493 0 8927 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 62356 KiB
Current children cumulated memory: 38784 KiB

[startup+0.209575 s]*
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31625848/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=78648 memory=54888 CPUtime=0.2 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 13935 0 0 0 19 1 0 0 20 0 1 0 410449676 80535552 13722 33554432000 4194304 6210612 140724748713232 140724748707976 5002501 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 19662 13722 827 493 0 12967 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 78648 KiB
Current children cumulated memory: 54888 KiB

[startup+0.309532 s]*
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31610596/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=93400 memory=69672 CPUtime=0.3 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 17623 0 0 0 28 2 0 0 20 0 1 0 410449676 95641600 17418 33554432000 4194304 6210612 140724748713232 140724748707976 5002501 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 23350 17418 827 493 0 16655 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 93400 KiB
Current children cumulated memory: 69672 KiB

[startup+0.700298 s]
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31582448/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=143284 memory=119668 CPUtime=0.68 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 30093 0 0 0 65 3 0 0 20 0 1 0 410449676 146722816 29917 33554432000 4194304 6210612 140724748713232 140724748704456 5456957 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 35821 29917 837 493 0 29126 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 143284 KiB
Current children cumulated memory: 119668 KiB

[startup+1.50031 s]
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31518712/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=246464 memory=222404 CPUtime=1.49 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 55830 0 0 0 142 7 0 0 20 0 1 0 410449676 252379136 55601 33554432000 4194304 6210612 140724748713232 140724748709352 5100902 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 61616 55601 837 493 0 54921 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 246464 KiB
Current children cumulated memory: 222404 KiB

[startup+3.10976 s]
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31456264/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=246464 memory=222804 CPUtime=3.09 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 74600 0 0 0 301 8 0 0 20 0 1 0 410449676 252379136 55701 33554432000 4194304 6210612 140724748713232 140724748711496 5390303 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 61616 55701 872 493 0 54921 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 246464 KiB
Current children cumulated memory: 222804 KiB

[startup+6.30043 s]
/proc/loadavg: 2.10 2.04 2.05 3/199 20246
/proc/meminfo: memFree=31455872/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=246640 memory=222896 CPUtime=6.29 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 104366 0 0 0 619 10 0 0 20 0 1 0 410449676 252559360 55724 33554432000 4194304 6210612 140724748713232 140724748701256 5098856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 61660 55724 873 493 0 54965 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 246640 KiB
Current children cumulated memory: 222896 KiB

[startup+12.7004 s]
/proc/loadavg: 2.09 2.04 2.05 3/200 20249
/proc/meminfo: memFree=31455064/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=248604 memory=224704 CPUtime=12.68 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 130610 0 0 0 1258 10 0 0 20 0 1 0 410449676 254570496 56176 33554432000 4194304 6210612 140724748713232 140724748710520 5098837 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 62151 56176 874 493 0 55456 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 248604 KiB
Current children cumulated memory: 224704 KiB

[startup+25.5005 s]
/proc/loadavg: 2.07 2.04 2.05 3/199 20249
/proc/meminfo: memFree=31452864/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=250404 memory=226620 CPUtime=25.48 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 176159 0 0 0 2535 13 0 0 20 0 1 0 410449676 256413696 56655 33554432000 4194304 6210612 140724748713232 140724748710760 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 62601 56655 874 493 0 55906 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 250404 KiB
Current children cumulated memory: 226620 KiB

[startup+51.1098 s]
/proc/loadavg: 2.05 2.04 2.05 3/199 20249
/proc/meminfo: memFree=31451680/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=250800 memory=227148 CPUtime=51.1 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 213332 0 0 0 5094 16 0 0 20 0 1 0 410449676 256819200 56787 33554432000 4194304 6210612 140724748713232 140724748710520 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 62700 56787 875 493 0 56005 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 250800 KiB
Current children cumulated memory: 227148 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/201 20256
/proc/meminfo: memFree=31451680/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=251196 memory=227428 CPUtime=102.29 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 235823 0 0 0 10211 18 0 0 20 0 1 0 410449676 257224704 56857 33554432000 4194304 6210612 140724748713232 140724748710680 5098856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 62799 56857 875 493 0 56104 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 251196 KiB
Current children cumulated memory: 227428 KiB

[startup+162.3 s]
/proc/loadavg: 2.41 2.12 2.08 3/200 20260
/proc/meminfo: memFree=31446624/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=256824 memory=232252 CPUtime=162.29 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 247780 0 0 0 16211 18 0 0 20 0 1 0 410449676 262987776 58063 33554432000 4194304 6210612 140724748713232 140724748710520 5192880 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64206 58063 875 493 0 57511 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 256824 KiB
Current children cumulated memory: 232252 KiB

[startup+222.3 s]
/proc/loadavg: 2.33 2.17 2.10 3/200 20264
/proc/meminfo: memFree=31445388/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=257088 memory=233600 CPUtime=222.3 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 250448 0 0 0 22211 19 0 0 20 0 1 0 410449676 263258112 58400 33554432000 4194304 6210612 140724748713232 140724748711192 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64272 58400 875 493 0 57577 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233600 KiB

[startup+282.3 s]
/proc/loadavg: 2.12 2.14 2.09 3/201 20270
/proc/meminfo: memFree=31446092/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=257088 memory=233600 CPUtime=282.3 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 250448 0 0 0 28211 19 0 0 20 0 1 0 410449676 263258112 58400 33554432000 4194304 6210612 140724748713232 140724748711192 5192912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64272 58400 875 493 0 57577 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233600 KiB

[startup+342.3 s]
/proc/loadavg: 2.04 2.11 2.08 3/200 20274
/proc/meminfo: memFree=31445988/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=257088 memory=233600 CPUtime=342.31 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 251093 0 0 0 34212 19 0 0 20 0 1 0 410449676 263258112 58400 33554432000 4194304 6210612 140724748713232 140724748711192 5098814 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64272 58400 875 493 0 57577 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233600 KiB

[startup+402.3 s]
/proc/loadavg: 2.36 2.17 2.11 3/199 20278
/proc/meminfo: memFree=31446056/32770624 swapFree=66935628/67108860
[pid=20245] ppid=20242 vsize=257088 memory=233600 CPUtime=402.31 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 251113 0 0 0 40212 19 0 0 20 0 1 0 410449676 263258112 58400 33554432000 4194304 6210612 140724748713232 140724748711192 5098833 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64272 58400 875 493 0 57577 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233600 KiB

[startup+462.3 s]
/proc/loadavg: 2.28 2.20 2.12 3/200 20326
/proc/meminfo: memFree=31445240/32770624 swapFree=66935640/67108860
[pid=20245] ppid=20242 vsize=257088 memory=233652 CPUtime=462.31 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 251823 0 0 0 46212 19 0 0 20 0 1 0 410449676 263258112 58413 33554432000 4194304 6210612 140724748713232 140724748711192 5098829 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64272 58413 875 493 0 57577 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233652 KiB


################
# More data... #
################

/proc/20245/statm: 64602 58730 875 493 0 57907 0
Current children cumulated CPU time: 1782.43 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234920 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20458
/proc/meminfo: memFree=31442352/32770624 swapFree=66935660/67108860
[pid=20245] ppid=20242 vsize=258408 memory=234920 CPUtime=1842.43 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 259811 0 0 0 184223 20 0 0 20 0 1 0 410449676 264609792 58730 33554432000 4194304 6210612 140724748713232 140724748711192 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64602 58730 875 493 0 57907 0
Current children cumulated CPU time: 1842.43 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234920 KiB

[startup+1902.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/201 20486
/proc/meminfo: memFree=31442380/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258408 memory=234936 CPUtime=1902.44 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 259981 0 0 0 190224 20 0 0 20 0 1 0 410449676 264609792 58734 33554432000 4194304 6210612 140724748713232 140724748711192 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64602 58734 875 493 0 57907 0
Current children cumulated CPU time: 1902.44 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234936 KiB

[startup+1962.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 20490
/proc/meminfo: memFree=31442688/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258408 memory=234952 CPUtime=1962.44 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 260316 0 0 0 196224 20 0 0 20 0 1 0 410449676 264609792 58738 33554432000 4194304 6210612 140724748713232 140724748711192 5192912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64602 58738 875 493 0 57907 0
Current children cumulated CPU time: 1962.44 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234952 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 20555
/proc/meminfo: memFree=31442888/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258408 memory=234952 CPUtime=2022.45 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 260538 0 0 0 202225 20 0 0 20 0 1 0 410449676 264609792 58738 33554432000 4194304 6210612 140724748713232 140724748711192 5098833 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64602 58738 875 493 0 57907 0
Current children cumulated CPU time: 2022.45 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234952 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20561
/proc/meminfo: memFree=31441296/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235016 CPUtime=2082.45 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 260560 0 0 0 208225 20 0 0 20 0 1 0 410449676 264744960 58754 33554432000 4194304 6210612 140724748713232 140724748710520 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58754 875 493 0 57940 0
Current children cumulated CPU time: 2082.45 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235016 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20566
/proc/meminfo: memFree=31441552/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2142.45 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261100 0 0 0 214225 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5098833 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2142.45 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20570
/proc/meminfo: memFree=31441360/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2202.46 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261106 0 0 0 220226 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5098837 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2202.46 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20576
/proc/meminfo: memFree=31441612/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2262.46 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261272 0 0 0 226226 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5192894 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2262.46 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20580
/proc/meminfo: memFree=31441136/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2322.47 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261280 0 0 0 232227 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5098837 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2322.47 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20584
/proc/meminfo: memFree=31441088/32770624 swapFree=66935672/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2382.48 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261451 0 0 0 238228 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5192912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2382.48 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20598
/proc/meminfo: memFree=31441380/32770624 swapFree=66935676/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2442.48 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261804 0 0 0 244228 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5192880 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2442.48 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20602
/proc/meminfo: memFree=31441824/32770624 swapFree=66935676/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2502.49 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261995 0 0 0 250229 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2502.49 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20602
/proc/meminfo: memFree=31442288/32770624 swapFree=66935676/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2520.09 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261995 0 0 0 251989 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2520.09 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 20245 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.89 s, system=0.205017 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20602
/proc/meminfo: memFree=31442288/32770624 swapFree=66935676/67108860
[pid=20245] ppid=20242 vsize=258540 memory=235056 CPUtime=2520.09 cores=0,2,4,6
/proc/20245/stat : 20245 (cosoco) R 20242 20245 14112 0 -1 4202496 261995 0 0 0 251989 20 0 0 20 0 1 0 410449676 264744960 58764 33554432000 4194304 6210612 140724748713232 140724748711192 5098888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10022912 140724748715019 140724748715121 140724748715121 140724748718030 0
/proc/20245/statm: 64635 58764 875 493 0 57940 0
Current children cumulated CPU time: 2520.09 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 235056 KiB

Child status: 1
Real time (s): 2519.9
CPU time (s): 2520.1
CPU user time (s): 2519.89
CPU system time (s): 0.205017
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 258540
Max. memory (cumulated for all children) (KiB): 235056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.89
system time used= 0.205017
maximum resident set size= 235128
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 262040
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 29
involuntary context switches= 3915


# summary of solver processes directly reported to runsolver:
#   pid: 20245
#   total CPU time (s): 2520.1
#   total CPU user time (s): 2519.89
#   total CPU system time (s): 0.205017

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.083 second user time and 17.8167 second system time

The end

Launcher Data 

Begin job on node105 at 2019-09-13 03:30:18
IDJOB=4389635
IDBENCH=133801
IDSOLVER=2829
FILE ID=node105/4389635-1568341912
RUNJOBID= node105-1568308483-14143
PBS_JOBID= 21701128
Free space on /tmp= 54368 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/QuasiGroups/QuasiGroups-elt-qg3/QuasiGroup-3-40.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389635-1568341912/watcher-4389635-1568341912 -o /tmp/evaluation-result-4389635-1568341912/solver-4389635-1568341912 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1568308483-14143 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389635-1568341912.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e27695e2b8dc2930e1e97c4ddd0ab1f7
RANDOM SEED=1691873974

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31676036 kB
MemAvailable:   31855596 kB
Buffers:          129536 kB
Cached:           338308 kB
SwapCached:        68908 kB
Active:           228324 kB
Inactive:         311672 kB
Active(anon):      14244 kB
Inactive(anon):    89624 kB
Active(file):     214080 kB
Inactive(file):   222048 kB
Unevictable:      111240 kB
Mlocked:          111240 kB
SwapTotal:      67108860 kB
SwapFree:       66935628 kB
Dirty:              2812 kB
Writeback:             0 kB
AnonPages:        115892 kB
Mapped:            37020 kB
Shmem:             23324 kB
Slab:             147056 kB
SReclaimable:     118536 kB
SUnreclaim:        28520 kB
KernelStack:        3552 kB
PageTables:         5660 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     522112 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 54364 MiB
End job on node105 at 2019-09-13 04:12:18