Trace number 4389637

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.02 2520.01

General information on the benchmark

NameQuasiGroups/QuasiGroups-elt-qg7/
QuasiGroup-7-39.xml
MD5SUM5a6cd63004ce40fe2c4de94228743879
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3042
Number of constraints2966
Number of domains1
Minimum domain size39
Maximum domain size39
Distribution of domain sizes[{"size":39,"count":3003}]
Minimum variable degree0
Maximum variable degree79
Distribution of variable degrees[{"degree":0,"count":39},{"degree":2,"count":1482},{"degree":78,"count":39},{"degree":79,"count":1482}]
Minimum constraint arity39
Maximum constraint arity1521
Distribution of constraint arities[{"arity":39,"count":1},{"arity":41,"count":2964},{"arity":1521,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":2964}]
Optimization problemNO
Type of objective

Solver Data 

0.20/0.24	c root propagations     : 195         
0.20/0.24	c restarts enabled, print stats at every restarts
0.20/0.24	c
0.20/0.24	c
0.20/0.24	c
0.20/0.24	c This is cosoco 2.00 --  
0.20/0.24	c
0.20/0.24	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389637-1568341989.xml 
0.20/0.24	c ========================================[ Problem Statistics ]===========================================
0.20/0.24	c |                                                                                                       
0.20/0.24	c |  Parse time        :         0.19 s 
0.20/0.24	c |
0.20/0.24	c |               Variables: 3042
0.20/0.24	c |            Domain Sizes: 39..39
0.20/0.24	c |
0.20/0.24	c |             Constraints: 3081
0.20/0.24	c |                   Arity: 1..41  -- Unary: 39
0.20/0.24	c | 
0.20/0.24	c |                   Types: 
0.20/0.24	c |                          All Different: 78
0.20/0.24	c |                          Element Variable: 2964
0.20/0.24	c |                          Unary: 39
0.20/0.24	c |                          
0.20/0.24	c =========================================================================================================
0.20/0.24	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.20/0.24	c remove useless variable y[0][0]
0.20/0.24	c remove useless variable y[1][1]
0.20/0.24	c remove useless variable y[2][2]
0.20/0.24	c remove useless variable y[3][3]
0.20/0.24	c remove useless variable y[4][4]
0.20/0.24	c remove useless variable y[5][5]
0.20/0.24	c remove useless variable y[6][6]
0.20/0.24	c remove useless variable y[7][7]
0.20/0.24	c remove useless variable y[8][8]
0.20/0.24	c remove useless variable y[9][9]
0.20/0.24	c remove useless variable y[10][10]
0.20/0.24	c remove useless variable y[11][11]
0.20/0.24	c remove useless variable y[12][12]
0.20/0.24	c remove useless variable y[13][13]
0.20/0.24	c remove useless variable y[14][14]
0.20/0.24	c remove useless variable y[15][15]
0.20/0.24	c remove useless variable y[16][16]
0.20/0.24	c remove useless variable y[17][17]
0.20/0.24	c remove useless variable y[18][18]
0.20/0.24	c remove useless variable y[19][19]
0.20/0.24	c remove useless variable y[20][20]
0.20/0.24	c remove useless variable y[21][21]
0.20/0.24	c remove useless variable y[22][22]
0.20/0.24	c remove useless variable y[23][23]
0.20/0.24	c remove useless variable y[24][24]
0.20/0.24	c remove useless variable y[25][25]
0.20/0.24	c remove useless variable y[26][26]
0.20/0.24	c remove useless variable y[27][27]
0.20/0.24	c remove useless variable y[28][28]
0.20/0.24	c remove useless variable y[29][29]
0.20/0.24	c remove useless variable y[30][30]
0.20/0.24	c remove useless variable y[31][31]
0.20/0.24	c remove useless variable y[32][32]
0.20/0.24	c remove useless variable y[33][33]
0.20/0.24	c remove useless variable y[34][34]
0.20/0.24	c remove useless variable y[35][35]
0.20/0.24	c remove useless variable y[36][36]
0.20/0.24	c remove useless variable y[37][37]
0.20/0.24	c remove useless variable y[38][38]
0.40/0.45	c 101            585            206186         77231          189            0              268   326   305
0.50/0.59	c 211            902            341284         88986          189            0              83   119   116 
0.59/0.69	c 332            1203           453895         101495         189            0              152   163   160
0.78/0.80	c 465            1608           554378         113768         189            0              115   119   117
0.88/0.99	c 611            2070           744395         150031         189            0              101   233   224
1.09/1.14	c 771            2526           899527         178620         189            0              120   228   221
1.28/1.30	c 947            2961           1070385        209712         189            0              57   201   194 
1.38/1.48	c 1140           3445           1253834        245315         189            0              61   211   200 
1.68/1.70	c 1352           4032           1487155        299197         189            0              54   222   212 
1.88/1.97	c 1585           4718           1766146        359799         189            0              56   231   218 
2.18/2.24	c 1841           5361           2024454        423449         189            0              57   97   93   
2.38/2.44	c 2122           6003           2207451        445467         189            0              61   140   137 
2.68/2.75	c 2431           6831           2520892        506926         189            0              65   162   154 
3.09/3.12	c 2770           7909           2879397        602807         189            0              72   159   152 
3.78/3.81	c 3142           9435           3602742        758830         189            0              64   179   167 
4.29/4.36	c 3551           10897          4207090        876511         189            0              74   229   217 
4.89/4.99	c 4000           12450          4893297        995960         189            0              31   231   217 
5.39/5.45	c 4493           14012          5412591        1088415        189            0              28   285   270 
6.09/6.14	c 5035           15779          6151993        1460894        189            0              26   261   200 
6.59/6.69	c 5631           17484          6714319        1555260        189            0              25   303   291 
7.09/7.15	c 6286           19152          7179651        1641335        189            0              27   242   227 
7.79/7.80	c 7006           21566          7844821        1814039        189            0              30   326   312 
8.28/8.37	c 7798           23469          8417778        1957334        189            0              34   259   249 
9.18/9.22	c 8669           26606          9366910        2182473        189            0              38   244   238 
9.78/9.87	c 9627           28885          10066794       2363204        189            0              33   203   196 
10.68/10.80	c 10680          31819          11009005       2528210        189            0              32   263   255 
11.58/11.63	c 11838          34730          11883270       2729654        189            0              34   326   314 
12.38/12.45	c 13111          37519          12740516       3025698        189            0              36   329   318 
13.48/13.58	c 14511          40702          13938914       3231923        189            0              39   331   321 
14.88/14.98	c 16051          44658          15475563       3649304        189            0              40   338   326 
16.27/16.30	c 17745          48993          16906418       3949250        189            0              42   342   331 
17.77/17.81	c 19608          54238          18455868       4319908        189            0              43   280   272 
19.98/20.10	c 21657          60608          20848426       4919563        189            0              46   151   146 
21.77/21.83	c 23910          67099          22558920       5436169        189            0              47   131   129 
23.98/24.03	c 26388          73507          24982881       5970717        189            0              47   264   249 
26.17/26.26	c 29113          79924          27320283       6614925        189            0              54   146   140 
28.47/28.50	c 32110          89109          29838709       7179348        189            0              53   265   254 
29.87/30.00	c 35406          96574          31542151       7596659        189            0              54   272   254 
34.47/34.54	c 39031          108167         36486015       8391728        189            0              51   277   268 
42.17/42.27	c 43018          123115         44968384       10206963       189            0              53   293   279 
44.98/45.02	c 47403          128628         48180686       10908298       189            0              54   315   304 
48.27/48.32	c 52226          139969         51716644       11694516       189            0              47   279   271 
51.57/51.65	c 57531          153571         55231297       12582871       189            0              48   268   257 
54.37/54.42	c 63366          165770         58337724       14153479       189            0              49   212   205 
59.77/59.86	c 69784          183884         64104478       15435619       189            0              49   265   251 
65.08/65.11	c 76843          203840         69177908       17172278       189            0              50   157   156 
68.98/69.07	c 84607          223084         73763440       18828153       189            0              51   257   240 
75.37/75.42	c 93147          241294         81001281       21250772       189            0              49   259   249 
80.37/80.41	c 102541         266232         86695675       22718602       189            0              48   257   247 
89.37/89.44	c 112874         298281         96088144       25830172       189            0              46   183   173 
98.27/98.34	c 124240         332435         106070517      28286295       189            0              48   268   253 
111.37/111.44	c 136742         365853         119732116      30568592       189            0              47   266   264 
120.77/120.83	c 150494         404915         130366682      33808464       189            0              49   269   256 
136.87/136.99	c 165621         451309         147376551      37788311       189            0              47   289   275 
145.77/145.81	c 182260         495039         157198720      40411675       189            0              49   226   210 
158.47/158.53	c 200562         541860         171229935      44264712       189            0              44   225   214 
183.77/183.84	c 220694         590514         199463168      51863568       189            0              45   236   219 
202.37/202.44	c 242839         656359         219938472      57712303       189            0              39   235   214 
219.98/220.10	c 267198         724122         239989997      61260592       189            0              38   223   212 
239.77/239.89	c 293992         799289         260480199      66143643       189            0              28   285   271 
272.57/272.62	c 323465         865920         296603684      71367790       189            0              32   249   238 
302.27/302.31	c 355885         961808         327473845      77811062       189            0              30   294   278 
331.17/331.23	c 391547         1059043        358732052      85606503       189            0              34   288   271 
355.98/356.04	c 430775         1164652        382330407      94624222       189            0              44   178   176 
395.87/395.94	c 473925         1333814        424480617      107182386      189            0              50   250   202 
445.47/445.56	c 521390         1479749        477236139      123316355      189            0              53   286   270 
500.09/500.16	c 573601         1664512        536011936      136339998      189            0              57   583   326 
542.58/542.62	c 631033         1841248        583332349      151334071      189            0              58   290   269 
580.78/580.87	c 694208         1992921        626465500      169051143      189            0              48   270   256 
618.88/618.93	c 763700         2115131        671526492      186889939      189            0              50   267   251 
755.99/756.05	c 840141         2390053        818128682      208475048      189            0              46   299   278 
810.48/810.52	c 924226         2597644        870010933      227344759      189            0              47   155   154 
894.88/894.92	c 1016719        2892288        955340209      252625794      189            0              49   153   135 
976.18/976.24	c 1118461        3150974        1047278975     279679840      189            0              50   280   258 
1034.99/1035.08	c 1230377        3400626        1115322541     302690088      189            0              49   276   260 
1115.59/1115.60	c 1353484        3727035        1207918093     325931241      189            0              49   280   265 
1204.19/1204.24	c 1488901        4081249        1310313798     353143474      189            0              46   288   267 
1315.39/1315.45	c 1637859        4529625        1438395805     392046633      189            0              45   299   269 
1428.10/1428.18	c 1801712        4951884        1567723497     436891921      189            0              43   278   261 
1563.10/1563.14	c 1981950        5416852        1719714321     475000224      189            0              40   282   258 
1731.10/1731.18	c 2180211        6100287        1907557606     530881675      189            0              44   286   268 
1878.89/1878.90	c 2398298        6681573        2075976080     576659094      189            0              37   288   266 
2109.30/2109.36	c 2638193        7440788        2334777701     659435804      189            0              29   288   271 
2312.40/2312.45	c 2902077        8088721        2568259261     745924894      189            0              27   296   273 
2471.20/2471.24	c 3192349        8657975        2752781446     809044231      189            0              26   279   261 
2520.01/2520.01	
2520.01/2520.01	c *** INTERRUPTED ***
2520.01/2520.01	c restarts              : 85          
2520.01/2520.01	c conflicts             : 3267369      (1297 /sec)
2520.01/2520.01	c decisions             : 8819556      (3500 /sec)
2520.01/2520.01	c propagations          : 836165745   (331814 /sec)
2520.01/2520.01	c root propagations     : 195         
2520.01/2520.01	c filter calls          : 2809771118     (1114995 /sec)
2520.01/2520.01	c useless filter calls  : 2737270320     (97 %)
2520.01/2520.01	c Memory used           : 78.15 MB
2520.01/2520.01	c CPU time              : 2519.98 s
2520.01/2520.01	c real time             : 2520.01 s
2520.01/2520.01	
2520.01/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12572 MiB free)
  memory of node 1: 16384 MiB (15790 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389637-1568341989/watcher-4389637-1568341989 -o /tmp/evaluation-result-4389637-1568341989/solver-4389637-1568341989 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node123-1568311188-14001 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389637-1568341989.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=20471, runsolver pid=20468

[startup+0.100174 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=29022828/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=50476 memory=26908 CPUtime=0.1 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 6896 0 0 0 9 1 0 0 20 0 1 0 410463740 51687424 6727 33554432000 4194304 6210612 140732406366336 140732406362872 140344017598368 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 12619 6727 828 493 0 5924 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 50476 KiB
Current children cumulated memory: 26908 KiB

[startup+0.20977 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=28998732/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=72500 memory=49084 CPUtime=0.2 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 12442 0 0 0 19 1 0 0 20 0 1 0 410463740 74240000 12271 33554432000 4194304 6210612 140732406366336 140732406362872 5397066 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 18125 12271 857 493 0 11430 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 72500 KiB
Current children cumulated memory: 49084 KiB

[startup+0.30978 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=28998088/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=73028 memory=49612 CPUtime=0.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 12565 0 0 0 29 1 0 0 20 0 1 0 410463740 74780672 12403 33554432000 4194304 6210612 140732406366336 140732406354360 140344017550309 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 18257 12403 867 493 0 11562 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 73028 KiB
Current children cumulated memory: 49612 KiB

[startup+0.700337 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=28995856/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=75008 memory=51460 CPUtime=0.68 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 13049 0 0 0 67 1 0 0 20 0 1 0 410463740 76808192 12865 33554432000 4194304 6210612 140732406366336 140732406354360 5409284 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 18752 12865 867 493 0 12057 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 75008 KiB
Current children cumulated memory: 51460 KiB

[startup+1.50037 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=28995856/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=75140 memory=51724 CPUtime=1.48 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 13098 0 0 0 147 1 0 0 20 0 1 0 410463740 76943360 12931 33554432000 4194304 6210612 140732406366336 140732406364296 5397215 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 18785 12931 870 493 0 12090 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 75140 KiB
Current children cumulated memory: 51724 KiB

[startup+3.10952 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=28995068/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=75272 memory=51868 CPUtime=3.09 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 21760 0 0 0 308 1 0 0 20 0 1 0 410463740 77078528 12967 33554432000 4194304 6210612 140732406366336 140732406364296 5409264 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 18818 12967 870 493 0 12123 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 75272 KiB
Current children cumulated memory: 51868 KiB

[startup+6.30035 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20472
/proc/meminfo: memFree=28994556/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=75668 memory=52240 CPUtime=6.29 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 27688 0 0 0 627 2 0 0 20 0 1 0 410463740 77484032 13060 33554432000 4194304 6210612 140732406366336 140732406364296 5409264 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 18917 13060 870 493 0 12222 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 75668 KiB
Current children cumulated memory: 52240 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20474
/proc/meminfo: memFree=28992896/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=76460 memory=53024 CPUtime=12.68 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 33839 0 0 0 1266 2 0 0 20 0 1 0 410463740 78295040 13256 33554432000 4194304 6210612 140732406366336 140732406364296 5078980 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19115 13256 870 493 0 12420 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 76460 KiB
Current children cumulated memory: 53024 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20474
/proc/meminfo: memFree=28993068/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=76856 memory=53488 CPUtime=25.47 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 39652 0 0 0 2545 2 0 0 20 0 1 0 410463740 78700544 13372 33554432000 4194304 6210612 140732406366336 140732406364296 5102408 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19214 13372 870 493 0 12519 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 76856 KiB
Current children cumulated memory: 53488 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20475
/proc/meminfo: memFree=28993672/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77120 memory=53732 CPUtime=51.08 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 40428 0 0 0 5106 2 0 0 20 0 1 0 410463740 78970880 13433 33554432000 4194304 6210612 140732406366336 140732406364296 5102483 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19280 13433 870 493 0 12585 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 77120 KiB
Current children cumulated memory: 53732 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20480
/proc/meminfo: memFree=28993104/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77252 memory=53816 CPUtime=102.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 41159 0 0 0 10225 2 0 0 20 0 1 0 410463740 79106048 13454 33554432000 4194304 6210612 140732406366336 140732406364296 5102668 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19313 13454 870 493 0 12618 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 77252 KiB
Current children cumulated memory: 53816 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20484
/proc/meminfo: memFree=28993188/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77252 memory=53912 CPUtime=162.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 41889 0 0 0 16225 2 0 0 20 0 1 0 410463740 79106048 13478 33554432000 4194304 6210612 140732406366336 140732406364296 5075192 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19313 13478 870 493 0 12618 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 77252 KiB
Current children cumulated memory: 53912 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20488
/proc/meminfo: memFree=28993364/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77384 memory=53916 CPUtime=222.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 42130 0 0 0 22225 2 0 0 20 0 1 0 410463740 79241216 13479 33554432000 4194304 6210612 140732406366336 140732406364296 5102857 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19346 13479 870 493 0 12651 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 53916 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20492
/proc/meminfo: memFree=28993920/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77384 memory=53964 CPUtime=282.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 42390 0 0 0 28225 2 0 0 20 0 1 0 410463740 79241216 13491 33554432000 4194304 6210612 140732406366336 140732406364296 5192880 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19346 13491 870 493 0 12651 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 53964 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20498
/proc/meminfo: memFree=28993068/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77384 memory=53992 CPUtime=342.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 42654 0 0 0 34225 2 0 0 20 0 1 0 410463740 79241216 13498 33554432000 4194304 6210612 140732406366336 140732406364296 5102447 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19346 13498 870 493 0 12651 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 53992 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20502
/proc/meminfo: memFree=28993404/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77384 memory=54016 CPUtime=402.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 42909 0 0 0 40225 2 0 0 20 0 1 0 410463740 79241216 13504 33554432000 4194304 6210612 140732406366336 140732406364296 5102812 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19346 13504 870 493 0 12651 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 54016 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20515
/proc/meminfo: memFree=28992156/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=77516 memory=54064 CPUtime=462.27 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 43196 0 0 0 46225 2 0 0 20 0 1 0 410463740 79376384 13516 33554432000 4194304 6210612 140732406366336 140732406363800 5102815 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 19379 13516 870 493 0 12684 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 77516 KiB
Current children cumulated memory: 54064 KiB


################
# More data... #
################

/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 1722.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+1782.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/200 20718
/proc/meminfo: memFree=28979888/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=1782.29 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 51497 0 0 0 178226 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5102982 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 1782.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+1842.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/200 20722
/proc/meminfo: memFree=28980620/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=1842.29 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 51844 0 0 0 184226 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 1842.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/200 20726
/proc/meminfo: memFree=28980440/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=1902.29 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 52210 0 0 0 190226 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5102438 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 1902.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 20732
/proc/meminfo: memFree=28980600/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=1962.29 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 52537 0 0 0 196226 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5074907 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 1962.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 20736
/proc/meminfo: memFree=28980696/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2022.29 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 52856 0 0 0 202226 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5192880 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2022.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20742
/proc/meminfo: memFree=28980008/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2082.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 53191 0 0 0 208227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5102503 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2082.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20746
/proc/meminfo: memFree=28980228/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2142.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 53567 0 0 0 214227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5102350 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2142.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20750
/proc/meminfo: memFree=28980268/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2202.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 53908 0 0 0 220227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5409279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2202.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2262.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/202 20765
/proc/meminfo: memFree=28979500/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2262.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 54249 0 0 0 226227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5075176 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2262.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/201 20769
/proc/meminfo: memFree=28979916/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2322.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 54611 0 0 0 232227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5102857 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2322.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/201 20773
/proc/meminfo: memFree=28979744/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2382.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 54981 0 0 0 238227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5082446 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2382.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/202 20779
/proc/meminfo: memFree=28979004/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2442.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 55331 0 0 0 244227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5192880 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2442.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20783
/proc/meminfo: memFree=28979808/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2502.3 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 55702 0 0 0 250227 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5389778 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2502.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/201 20784
/proc/meminfo: memFree=28979936/32770624 swapFree=66999908/67108860
[pid=20471] ppid=20468 vsize=80024 memory=56592 CPUtime=2520.01 cores=1,3,5,7
/proc/20471/stat : 20471 (cosoco) R 20468 20471 13969 0 -1 4202496 55988 0 0 0 251998 3 0 0 20 0 1 0 410463740 81944576 14148 33554432000 4194304 6210612 140732406366336 140732406364296 5389876 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 24178688 140732406371339 140732406371441 140732406371441 140732406374350 0
/proc/20471/statm: 20006 14148 870 493 0 13311 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56592 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 20471 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.98 s, system=0.038 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.02
CPU user time (s): 2519.98
CPU system time (s): 0.038
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 80024
Max. memory (cumulated for all children) (KiB): 56592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.98
system time used= 0.038
maximum resident set size= 56660
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 56043
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39
involuntary context switches= 786


# summary of solver processes directly reported to runsolver:
#   pid: 20471
#   total CPU time (s): 2520.02
#   total CPU user time (s): 2519.98
#   total CPU system time (s): 0.038

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.32772 second user time and 17.8222 second system time

The end

Launcher Data 

Begin job on node123 at 2019-09-13 04:32:30
IDJOB=4389637
IDBENCH=133850
IDSOLVER=2829
FILE ID=node123/4389637-1568341989
RUNJOBID= node123-1568311188-14001
PBS_JOBID= 21701126
Free space on /tmp= 56796 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/QuasiGroups/QuasiGroups-elt-qg7/QuasiGroup-7-39.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389637-1568341989/watcher-4389637-1568341989 -o /tmp/evaluation-result-4389637-1568341989/solver-4389637-1568341989 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node123-1568311188-14001 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389637-1568341989.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5a6cd63004ce40fe2c4de94228743879
RANDOM SEED=1580828928

node123.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29043884 kB
MemAvailable:   31869124 kB
Buffers:          101804 kB
Cached:          2983312 kB
SwapCached:         7396 kB
Active:          1066596 kB
Inactive:        2031812 kB
Active(anon):       3484 kB
Inactive(anon):    51224 kB
Active(file):    1063112 kB
Inactive(file):  1980588 kB
Unevictable:      107524 kB
Mlocked:          107524 kB
SwapTotal:      67108860 kB
SwapFree:       66999908 kB
Dirty:              3124 kB
Writeback:             0 kB
AnonPages:        116416 kB
Mapped:            45524 kB
Shmem:             32672 kB
Slab:             223780 kB
SReclaimable:     194752 kB
SUnreclaim:        29028 kB
KernelStack:        3552 kB
PageTables:         5676 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     528276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 56792 MiB
End job on node123 at 2019-09-13 05:14:30