Trace number 4396915

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.05 2520.01

General information on the benchmark

NameQuasiGroups/QuasiGroups-elt-qg3/
QuasiGroup-3-40.xml
MD5SUMe27695e2b8dc2930e1e97c4ddd0ab1f7
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3200
Number of constraints3122
Number of domains2
Minimum domain size40
Maximum domain size1600
Distribution of domain sizes[{"size":40,"count":1600},{"size":1600,"count":1560}]
Minimum variable degree0
Maximum variable degree1563
Distribution of variable degrees[{"degree":0,"count":40},{"degree":2,"count":1560},{"degree":1562,"count":40},{"degree":1563,"count":1560}]
Minimum constraint arity3
Maximum constraint arity1601
Distribution of constraint arities[{"arity":3,"count":1560},{"arity":40,"count":1},{"arity":1600,"count":1},{"arity":1601,"count":1560}]
Number of extensional constraints0
Number of intensional constraints1560
Distribution of constraint types[{"type":"intension","count":1560},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":1560}]
Optimization problemNO
Type of objective

Solver Data 

4.38/4.42	c root propagations     : 67280       
4.38/4.42	c restarts enabled, print stats at every restarts
4.38/4.42	c
4.38/4.42	c
4.38/4.42	c
4.38/4.42	c This is cosoco 2.00 --  
4.38/4.42	c
4.38/4.42	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396915-1568585726.xml 
4.38/4.42	c ========================================[ Problem Statistics ]===========================================
4.38/4.42	c |                                                                                                       
4.38/4.42	c |  Parse time        :         2.58 s 
4.38/4.42	c |
4.38/4.42	c |               Variables: 3200
4.38/4.42	c |            Domain Sizes: 40..1600
4.38/4.42	c |
4.38/4.42	c |             Constraints: 3240
4.38/4.42	c |                   Arity: 1..1601  -- Unary: 40  -- Ternary: 1560
4.38/4.42	c | 
4.38/4.42	c |                   Types: 
4.38/4.42	c |                          All Different: 80
4.38/4.42	c |                          Element Constant: 1560
4.38/4.42	c |                          Intension: 1560
4.38/4.42	c |                          Unary: 40
4.38/4.42	c |                          
4.38/4.42	c =========================================================================================================
4.38/4.42	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
4.38/4.42	c remove useless variable y[0][0]
4.38/4.42	c remove useless variable y[1][1]
4.38/4.42	c remove useless variable y[2][2]
4.38/4.42	c remove useless variable y[3][3]
4.38/4.42	c remove useless variable y[4][4]
4.38/4.42	c remove useless variable y[5][5]
4.38/4.42	c remove useless variable y[6][6]
4.38/4.42	c remove useless variable y[7][7]
4.38/4.42	c remove useless variable y[8][8]
4.38/4.42	c remove useless variable y[9][9]
4.38/4.42	c remove useless variable y[10][10]
4.38/4.42	c remove useless variable y[11][11]
4.38/4.42	c remove useless variable y[12][12]
4.38/4.42	c remove useless variable y[13][13]
4.38/4.42	c remove useless variable y[14][14]
4.38/4.42	c remove useless variable y[15][15]
4.38/4.42	c remove useless variable y[16][16]
4.38/4.42	c remove useless variable y[17][17]
4.38/4.42	c remove useless variable y[18][18]
4.38/4.42	c remove useless variable y[19][19]
4.38/4.42	c remove useless variable y[20][20]
4.38/4.42	c remove useless variable y[21][21]
4.38/4.42	c remove useless variable y[22][22]
4.38/4.42	c remove useless variable y[23][23]
4.38/4.42	c remove useless variable y[24][24]
4.38/4.42	c remove useless variable y[25][25]
4.38/4.42	c remove useless variable y[26][26]
4.38/4.42	c remove useless variable y[27][27]
4.38/4.42	c remove useless variable y[28][28]
4.38/4.42	c remove useless variable y[29][29]
4.38/4.42	c remove useless variable y[30][30]
4.38/4.42	c remove useless variable y[31][31]
4.38/4.42	c remove useless variable y[32][32]
4.38/4.42	c remove useless variable y[33][33]
4.38/4.42	c remove useless variable y[34][34]
4.38/4.42	c remove useless variable y[35][35]
4.38/4.42	c remove useless variable y[36][36]
4.38/4.42	c remove useless variable y[37][37]
4.38/4.42	c remove useless variable y[38][38]
4.38/4.42	c remove useless variable y[39][39]
31.58/31.64	c 101            427            1398487        1137597        1754           0              133   319   298
58.89/58.97	c 211            834            2577095        1934376        1754           0              126   286   246
86.49/86.56	c 332            1226           3760983        2719812        1754           0              174   269   264
123.49/123.53	c 465            1799           5462329        3558347        1754           0              140   430   404
180.69/180.79	c 611            2593           8112917        5114866        1754           0              9   531   448  
236.79/236.87	c 771            3340           10439886       6901629        1754           0              18   345   312 
273.99/274.09	c 947            3780           11968111       7866789        1754           0              44   254   223 
302.68/302.75	c 1140           4111           13039485       8275547        1754           0              67   131   128 
350.18/350.29	c 1352           4674           14985638       9663408        1754           0              27   301   264 
389.39/389.42	c 1585           5133           16514672       10718930       1754           0              19   218   206 
439.39/439.47	c 1841           5788           18647090       11984300       1754           0              23   389   325 
496.19/496.21	c 2122           6649           21178491       13334488       1754           0              27   573   459 
548.29/548.30	c 2431           7295           23335662       14385535       1754           0              37   327   310 
600.19/600.24	c 2770           7927           25408205       15363981       1754           0              37   261   251 
658.19/658.20	c 3142           8558           27630235       17258804       1754           0              16   226   209 
711.19/711.25	c 3551           9168           29627354       18431267       1754           0              17   184   181 
762.39/762.45	c 4000           9711           31373948       19014393       1754           0              53   80   79   
829.49/829.57	c 4493           10546          34125414       20054990       1754           0              20   294   288 
914.20/914.29	c 5035           11599          37851725       22267477       1754           0              25   421   391 
1008.60/1008.67	c 5631           12643          41925078       25750411       1754           0              28   396   361 
1098.70/1098.71	c 6286           13684          45554801       27935069       1754           0              32   306   293 
1198.50/1198.58	c 7006           14754          49239163       30681732       1754           0              25   243   227 
1329.01/1329.05	c 7798           16095          54642411       35904386       1754           0              30   393   348 
1436.80/1436.85	c 8669           17511          59643089       38157720       1754           0              36   500   477 
1567.21/1567.20	c 9627           18954          64860037       42210164       1754           0              39   339   318 
1869.12/1869.11	c 10680          21510          75999869       53917052       1754           0              48   230   223 
2022.92/2022.92	c 11838          23245          82349027       57680051       1754           0              32   377   367 
2222.63/2222.61	c 13111          25917          91515870       64961088       1754           0              33   482   463 
2520.04/2520.01	
2520.04/2520.01	c *** INTERRUPTED ***
2520.04/2520.01	c restarts              : 28          
2520.04/2520.01	c conflicts             : 14451        (6 /sec)
2520.04/2520.01	c decisions             : 29253        (12 /sec)
2520.04/2520.01	c propagations          : 72293300    (28690 /sec)
2520.04/2520.01	c root propagations     : 67280       
2520.04/2520.01	c filter calls          : 103689096      (41149 /sec)
2520.04/2520.01	c useless filter calls  : 79310350       (76 %)
2520.04/2520.01	c Memory used           : 252.48 MB
2520.04/2520.01	c CPU time              : 2519.82 s
2520.04/2520.01	c real time             : 2520.01 s
2520.04/2520.01	
2520.04/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13779 MiB free)
  memory of node 1: 16384 MiB (14185 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396915-1568585726/watcher-4396915-1568585726 -o /tmp/evaluation-result-4396915-1568585726/solver-4396915-1568585726 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568572744-4122 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396915-1568585726.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=6400, runsolver pid=6397

[startup+0.1006 s]*
/proc/loadavg: 1.94 2.07 2.07 3/200 6401
/proc/meminfo: memFree=28602688/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=61552 memory=37732 CPUtime=0.09 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 9653 0 0 0 9 0 0 0 20 0 1 0 434512699 63029248 9433 33554432000 4194304 6211092 140725217316288 140725217311032 5002869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 15388 9433 829 493 0 8693 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 61552 KiB
Current children cumulated memory: 37732 KiB

[startup+0.209996 s]*
/proc/loadavg: 1.94 2.07 2.07 3/200 6401
/proc/meminfo: memFree=28588580/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=76272 memory=52516 CPUtime=0.21 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 13351 0 0 0 20 1 0 0 20 0 1 0 434512699 78102528 13129 33554432000 4194304 6211092 140725217316288 140725217311032 140104995052517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 19068 13129 829 493 0 12373 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 76272 KiB
Current children cumulated memory: 52516 KiB

[startup+0.309637 s]*
/proc/loadavg: 1.94 2.07 2.07 3/200 6401
/proc/meminfo: memFree=28574816/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=89956 memory=66244 CPUtime=0.3 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 16741 0 0 0 29 1 0 0 20 0 1 0 434512699 92114944 16561 33554432000 4194304 6211092 140725217316288 140725217311032 5002869 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 22489 16561 829 493 0 15794 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 89956 KiB
Current children cumulated memory: 66244 KiB

[startup+0.70035 s]
/proc/loadavg: 1.94 2.07 2.07 3/200 6401
/proc/meminfo: memFree=28547288/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=139380 memory=115712 CPUtime=0.68 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 29108 0 0 0 65 3 0 0 20 0 1 0 434512699 142725120 28928 33554432000 4194304 6211092 140725217316288 140725217311032 140104995052517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 34845 28928 839 493 0 28150 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 139380 KiB
Current children cumulated memory: 115712 KiB

[startup+1.50038 s]
/proc/loadavg: 1.94 2.07 2.07 3/200 6401
/proc/meminfo: memFree=28480396/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=246464 memory=222412 CPUtime=1.49 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 55831 0 0 0 142 7 0 0 20 0 1 0 434512699 252379136 55603 33554432000 4194304 6211092 140725217316288 140725217307512 5101270 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 61616 55603 839 493 0 54921 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 246464 KiB
Current children cumulated memory: 222412 KiB

[startup+3.10964 s]
/proc/loadavg: 1.87 2.05 2.06 3/200 6401
/proc/meminfo: memFree=28417188/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=246464 memory=222820 CPUtime=3.1 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 69172 0 0 0 302 8 0 0 20 0 1 0 434512699 252379136 55705 33554432000 4194304 6211092 140725217316288 140725217307512 5390463 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 61616 55705 876 493 0 54921 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 246464 KiB
Current children cumulated memory: 222820 KiB

[startup+6.3004 s]
/proc/loadavg: 1.87 2.05 2.06 3/201 6403
/proc/meminfo: memFree=28416940/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=246640 memory=222916 CPUtime=6.29 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 107822 0 0 0 619 10 0 0 20 0 1 0 434512699 252559360 55729 33554432000 4194304 6211092 140725217316288 140725217304312 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 61660 55729 878 493 0 54965 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 246640 KiB
Current children cumulated memory: 222916 KiB

[startup+12.7004 s]
/proc/loadavg: 1.89 2.05 2.06 3/200 6403
/proc/meminfo: memFree=28416084/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=248604 memory=224728 CPUtime=12.68 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 134647 0 0 0 1257 11 0 0 20 0 1 0 434512699 254570496 56182 33554432000 4194304 6211092 140725217316288 140725217313880 5099274 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 62151 56182 879 493 0 55456 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 248604 KiB
Current children cumulated memory: 224728 KiB

[startup+25.5004 s]
/proc/loadavg: 1.90 2.05 2.06 3/199 6404
/proc/meminfo: memFree=28413620/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=250404 memory=226696 CPUtime=25.49 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 178883 0 0 0 2534 15 0 0 20 0 1 0 434512699 256413696 56674 33554432000 4194304 6211092 140725217316288 140725217313816 5099197 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 62601 56674 879 493 0 55906 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 250404 KiB
Current children cumulated memory: 226696 KiB

[startup+51.1097 s]
/proc/loadavg: 1.94 2.04 2.06 3/200 6406
/proc/meminfo: memFree=28412944/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=250800 memory=227164 CPUtime=51.1 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 217258 0 0 0 5092 18 0 0 20 0 1 0 434512699 256819200 56791 33554432000 4194304 6211092 140725217316288 140725217313576 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 62700 56791 879 493 0 56005 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 250800 KiB
Current children cumulated memory: 227164 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 2.04 2.05 3/199 6410
/proc/meminfo: memFree=28412156/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=251064 memory=227384 CPUtime=102.29 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 241182 0 0 0 10209 20 0 0 20 0 1 0 434512699 257089536 56846 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 62766 56846 879 493 0 56071 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 251064 KiB
Current children cumulated memory: 227384 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.03 2.05 3/199 6414
/proc/meminfo: memFree=28407736/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=256692 memory=232196 CPUtime=162.28 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 253987 0 0 0 16208 20 0 0 20 0 1 0 434512699 262852608 58049 33554432000 4194304 6211092 140725217316288 140725217313784 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64173 58049 879 493 0 57478 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 256692 KiB
Current children cumulated memory: 232196 KiB

[startup+222.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/199 6418
/proc/meminfo: memFree=28407124/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=257088 memory=233432 CPUtime=222.29 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 257688 0 0 0 22208 21 0 0 20 0 1 0 434512699 263258112 58358 33554432000 4194304 6211092 140725217316288 140725217314248 5099201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64272 58358 879 493 0 57577 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233432 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/199 6424
/proc/meminfo: memFree=28406824/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=257088 memory=233432 CPUtime=282.29 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 258750 0 0 0 28208 21 0 0 20 0 1 0 434512699 263258112 58358 33554432000 4194304 6211092 140725217316288 140725217314248 5099197 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64272 58358 879 493 0 57577 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233432 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/200 6436
/proc/meminfo: memFree=28406232/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=257088 memory=233432 CPUtime=342.28 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 259818 0 0 0 34207 21 0 0 20 0 1 0 434512699 263258112 58358 33554432000 4194304 6211092 140725217316288 140725217314248 5099205 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64272 58358 879 493 0 57577 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233432 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 6440
/proc/meminfo: memFree=28405936/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=257088 memory=233432 CPUtime=402.29 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 260903 0 0 0 40208 21 0 0 20 0 1 0 434512699 263258112 58358 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64272 58358 879 493 0 57577 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233432 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 6446
/proc/meminfo: memFree=28406016/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=257088 memory=233484 CPUtime=462.29 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 262020 0 0 0 46208 21 0 0 20 0 1 0 434512699 263258112 58371 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64272 58371 879 493 0 57577 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 257088 KiB
Current children cumulated memory: 233484 KiB


################
# More data... #
################

/proc/6400/statm: 64602 58688 879 493 0 57907 0
Current children cumulated CPU time: 1722.31 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234752 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/200 6626
/proc/meminfo: memFree=28405660/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258408 memory=234752 CPUtime=1782.31 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 279333 0 0 0 178209 22 0 0 20 0 1 0 434512699 264609792 58688 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64602 58688 879 493 0 57907 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234752 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 6630
/proc/meminfo: memFree=28406384/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258408 memory=234752 CPUtime=1842.31 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 279863 0 0 0 184209 22 0 0 20 0 1 0 434512699 264609792 58688 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64602 58688 879 493 0 57907 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234752 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 6636
/proc/meminfo: memFree=28406248/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258408 memory=234752 CPUtime=1902.32 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 280768 0 0 0 190209 23 0 0 20 0 1 0 434512699 264609792 58688 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64602 58688 879 493 0 57907 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234752 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 6640
/proc/meminfo: memFree=28406296/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258408 memory=234768 CPUtime=1962.32 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 281395 0 0 0 196209 23 0 0 20 0 1 0 434512699 264609792 58692 33554432000 4194304 6211092 140725217316288 140725217314248 5099152 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64602 58692 879 493 0 57907 0
Current children cumulated CPU time: 1962.32 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234768 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 6644
/proc/meminfo: memFree=28406136/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258408 memory=234784 CPUtime=2022.32 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 281930 0 0 0 202209 23 0 0 20 0 1 0 434512699 264609792 58696 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64602 58696 879 493 0 57907 0
Current children cumulated CPU time: 2022.32 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234784 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 6650
/proc/meminfo: memFree=28406496/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258408 memory=234796 CPUtime=2082.32 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 282962 0 0 0 208209 23 0 0 20 0 1 0 434512699 264609792 58699 33554432000 4194304 6211092 140725217316288 140725217314248 5099205 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64602 58699 879 493 0 57907 0
Current children cumulated CPU time: 2082.32 s
Current children cumulated vsize: 258408 KiB
Current children cumulated memory: 234796 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 6662
/proc/meminfo: memFree=28405248/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234872 CPUtime=2142.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 283517 0 0 0 214210 23 0 0 20 0 1 0 434512699 264744960 58718 33554432000 4194304 6211092 140725217316288 140725217313576 5193708 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58718 879 493 0 57940 0
Current children cumulated CPU time: 2142.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234872 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 6666
/proc/meminfo: memFree=28405480/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2202.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 284035 0 0 0 220210 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217313576 5193696 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2202.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB

[startup+2262.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/200 6672
/proc/meminfo: memFree=28404648/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2262.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 284980 0 0 0 226210 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 6676
/proc/meminfo: memFree=28404748/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2322.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 285484 0 0 0 232210 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2322.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 6680
/proc/meminfo: memFree=28405240/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2382.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 285953 0 0 0 238210 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217314248 5099107 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2382.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 6687
/proc/meminfo: memFree=28405964/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2442.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 286459 0 0 0 244210 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217314248 5099210 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2442.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 6691
/proc/meminfo: memFree=28407420/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2502.33 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 286973 0 0 0 250210 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217314248 5099201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2502.33 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 6692
/proc/meminfo: memFree=28407444/32770624 swapFree=66959728/67108860
[pid=6400] ppid=6397 vsize=258540 memory=234888 CPUtime=2520.04 cores=1,3,5,7
/proc/6400/stat : 6400 (cosoco) R 6397 6400 4090 0 -1 4202496 287407 0 0 0 251981 23 0 0 20 0 1 0 434512699 264744960 58722 33554432000 4194304 6211092 140725217316288 140725217314248 5099256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18939904 140725217317899 140725217318001 140725217318001 140725217320910 0
/proc/6400/statm: 64635 58722 879 493 0 57940 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 258540 KiB
Current children cumulated memory: 234888 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 6400 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.82 s, system=0.234004 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.05
CPU user time (s): 2519.82
CPU system time (s): 0.234004
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 258540
Max. memory (cumulated for all children) (KiB): 234888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.82
system time used= 0.234004
maximum resident set size= 234956
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 287457
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22
involuntary context switches= 810


# summary of solver processes directly reported to runsolver:
#   pid: 6400
#   total CPU time (s): 2520.05
#   total CPU user time (s): 2519.82
#   total CPU system time (s): 0.234004

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.8575 second user time and 14.1637 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-16 00:14:45
IDJOB=4396915
IDBENCH=133801
IDSOLVER=2848
FILE ID=node124/4396915-1568585726
RUNJOBID= node124-1568572744-4122
PBS_JOBID= 21703326
Free space on /tmp= 61808 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/QuasiGroups/QuasiGroups-elt-qg3/QuasiGroup-3-40.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396915-1568585726/watcher-4396915-1568585726 -o /tmp/evaluation-result-4396915-1568585726/solver-4396915-1568585726 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568572744-4122 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396915-1568585726.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e27695e2b8dc2930e1e97c4ddd0ab1f7
RANDOM SEED=1386010824

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28636172 kB
MemAvailable:   31835840 kB
Buffers:          210996 kB
Cached:          3276816 kB
SwapCached:        46376 kB
Active:          1006008 kB
Inactive:        2540740 kB
Active(anon):       9016 kB
Inactive(anon):    99220 kB
Active(file):     996992 kB
Inactive(file):  2441520 kB
Unevictable:      106524 kB
Mlocked:          106524 kB
SwapTotal:      67108860 kB
SwapFree:       66959728 kB
Dirty:              2908 kB
Writeback:             0 kB
AnonPages:        136812 kB
Mapped:            49008 kB
Shmem:             40944 kB
Slab:             183916 kB
SReclaimable:     153984 kB
SUnreclaim:        29932 kB
KernelStack:        3776 kB
PageTables:         5340 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     540520 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     88064 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61808 MiB
End job on node124 at 2019-09-16 00:56:45