Trace number 4242253

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.05 2400.4

General information on the benchmark

NameQuasiGroups/QuasiGroups-elt-qg4/
QuasiGroup-4-24.xml
MD5SUMeed4597320c79808ee022b7591b3ea00
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1152
Number of constraints1106
Number of domains2
Minimum domain size24
Maximum domain size576
Distribution of domain sizes[{"size":24,"count":576},{"size":576,"count":552}]
Minimum variable degree0
Maximum variable degree555
Distribution of variable degrees[{"degree":0,"count":24},{"degree":2,"count":552},{"degree":554,"count":24},{"degree":555,"count":552}]
Minimum constraint arity3
Maximum constraint arity577
Distribution of constraint arities[{"arity":3,"count":552},{"arity":24,"count":1},{"arity":576,"count":1},{"arity":577,"count":552}]
Number of extensional constraints0
Number of intensional constraints552
Distribution of constraint types[{"type":"intension","count":552},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":552}]
Optimization problemNO
Type of objective

Solver Data 

0.89/0.92	c root propagations     : 15024       
0.89/0.92	c restarts enabled, print stats at every restarts
0.89/0.92	c
0.89/0.92	c
0.89/0.92	c
0.89/0.92	c This is cosoco 1.0 --  
0.89/0.92	c
0.89/0.92	c ========================================[ Problem Statistics ]===========================================
0.89/0.92	c |                                                                                                       
0.89/0.92	c |  Parse time        :         0.79 s 
0.89/0.92	c |
0.89/0.92	c |               Variables: 1152
0.89/0.92	c |            Domain Sizes: 24..576
0.89/0.92	c |
0.89/0.92	c |             Constraints: 1176
0.89/0.92	c |                   Arity: 1..577  -- Unary: 24  -- Ternary: 552
0.89/0.92	c | 
0.89/0.92	c |                   Types: 
0.89/0.92	c |                          All Different: 48
0.89/0.92	c |                          Element Constant: 552
0.89/0.92	c |                          Intension: 552
0.89/0.92	c |                          Unary: 24
0.89/0.92	c |                          
0.89/0.92	c =========================================================================================================
0.89/0.92	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.89/0.92	c remove useless variable y[0][0]
0.89/0.92	c remove useless variable y[1][1]
0.89/0.92	c remove useless variable y[2][2]
0.89/0.92	c remove useless variable y[3][3]
0.89/0.92	c remove useless variable y[4][4]
0.89/0.92	c remove useless variable y[5][5]
0.89/0.92	c remove useless variable y[6][6]
0.89/0.92	c remove useless variable y[7][7]
0.89/0.92	c remove useless variable y[8][8]
0.89/0.92	c remove useless variable y[9][9]
0.89/0.92	c remove useless variable y[10][10]
0.89/0.92	c remove useless variable y[11][11]
0.89/0.92	c remove useless variable y[12][12]
0.89/0.92	c remove useless variable y[13][13]
0.89/0.92	c remove useless variable y[14][14]
0.89/0.92	c remove useless variable y[15][15]
0.89/0.92	c remove useless variable y[16][16]
0.89/0.92	c remove useless variable y[17][17]
0.89/0.92	c remove useless variable y[18][18]
0.89/0.92	c remove useless variable y[19][19]
0.89/0.92	c remove useless variable y[20][20]
0.89/0.92	c remove useless variable y[21][21]
0.89/0.92	c remove useless variable y[22][22]
0.89/0.92	c remove useless variable y[23][23]
3.89/3.95	c 101            204            512853         507996         666            0              50   52   50   
5.18/5.28	c 211            499            790048         701380         666            0              3   184   153  
11.28/11.37	c 332            1180           2644741        1507265        666            0              9   226   207  
14.78/14.88	c 465            1699           3544264        2058073        666            0              79   164   139 
18.48/18.50	c 611            2681           5134714        2894136        666            0              107   300   286
27.28/27.38	c 771            2995           6946389        4808070        666            0              53   129   125 
32.77/32.87	c 947            3368           7935911        5809123        666            0              82   94   89   
37.17/37.28	c 1140           4130           9697364        6738691        666            0              27   262   231 
40.87/40.90	c 1352           4505           10426789       7663277        666            0              27   127   121 
48.87/48.97	c 1585           4946           12020708       9212872        666            0              30   136   131 
57.87/57.99	c 1841           5338           13691783       10931399       666            0              33   111   110 
63.67/63.77	c 2122           6249           16429167       12112634       666            0              32   262   242 
67.67/67.75	c 2431           7091           18017877       12877079       666            0              49   252   233 
85.96/86.04	c 2770           7598           21492973       15601516       666            0              57   120   117 
90.56/90.67	c 3142           9044           24399718       16564423       666            0              198   329   304
100.46/100.59	c 3551           9727           26746953       18302143       666            0              78   135   131 
107.66/107.76	c 4000           12287          36206317       21526359       666            0              150   426   400
116.26/116.32	c 4493           15179          48538624       25174939       666            0              171   433   414
125.66/125.72	c 5035           17912          62103767       29627982       666            0              167   450   424
137.05/137.11	c 5631           20778          75875134       34133638       666            0              74   423   401 
148.56/148.68	c 6286           24396          90950447       39317059       666            0              77   443   409 
160.56/160.61	c 7006           28438          106641161      44968063       666            0              80   431   397 
231.34/231.45	c 7798           29472          119987110      62274035       666            0              49   116   109 
243.64/243.72	c 8669           33965          136639779      67789870       666            0              55   450   418 
255.35/255.42	c 9627           35950          139293309      68949964       666            0              53   120   108 
270.84/270.93	c 10680          41505          156328613      75546205       666            0              76   427   385 
344.63/344.72	c 11838          42957          169397428      92625598       666            0              78   120   116 
425.02/425.15	c 13111          45580          185956165      109196348      666            0              97   136   132 
604.29/604.41	c 14511          47368          218392198      144866622      666            0              102   114   113
788.16/788.37	c 16051          49694          254639683      178003059      666            0              76   127   123 
809.96/810.18	c 17745          54773          270352473      183854486      666            0              97   321   284 
857.55/857.78	c 19608          56978          279440335      191390588      666            0              100   107   106
880.96/881.17	c 21657          62407          292310899      196013993      666            0              57   279   262 
944.54/944.75	c 23910          73021          307206357      208804583      666            0              104   123   115
972.63/972.85	c 26388          86488          344924752      220599646      666            0              109   418   384
1132.01/1132.30	c 29113          91518          379681812      251565739      666            0              77   141   139 
1235.21/1235.47	c 32110          102846         409122192      271502247      666            0              70   164   148 
1323.79/1324.08	c 35406          120125         437334141      281532946      666            0              100   168   160
1383.08/1383.30	c 39031          134506         470677175      295603034      666            0              166   325   251
1451.17/1451.40	c 43018          145391         491185532      308137988      666            0              109   191   153
1504.16/1504.41	c 47403          166464         543363497      325936539      666            0              198   379   338
1576.45/1576.79	c 52226          188481         641586371      364344153      666            0              76   433   398 
1645.74/1646.05	c 57531          208903         729912133      398132663      666            0              76   416   388 
1721.43/1721.76	c 63366          234759         829196618      431013906      666            0              129   411   379
1810.12/1810.43	c 69784          268534         972378221      477579774      666            0              87   444   416 
2345.24/2345.68	c 76843          278733         1087513523     566394319      666            0              93   130   125

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4242253-1500660184/watcher-4242253-1500660184 -o /tmp/evaluation-result-4242253-1500660184/solver-4242253-1500660184 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node147-1500648172-9852 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4242253-1500660184.xml 

pid=11523
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.06 2.03 2.05 2/244 11526
/proc/meminfo: memFree=32033620/32770624 swapFree=5824/191108
[pid=11526] ppid=11523 vsize=27388 CPUtime=0 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 1057 0 0 0 0 0 0 0 20 0 1 0 1283585 28045312 832 33554432000 4194304 5970956 140728576493856 140728576489192 5505621 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 6847 832 702 434 0 211 0

[startup+0.100152 s]
/proc/loadavg: 2.06 2.03 2.05 2/244 11526
/proc/meminfo: memFree=32033620/32770624 swapFree=5824/191108
[pid=11526] ppid=11523 vsize=38096 CPUtime=0.08 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 3746 0 0 0 8 0 0 0 20 0 1 0 1283585 39010304 3538 33554432000 4194304 5970956 140728576493856 140728576487992 139904553589733 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 9524 3538 729 434 0 2888 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 38096

[startup+0.200398 s]
/proc/loadavg: 2.06 2.03 2.05 2/244 11526
/proc/meminfo: memFree=32033620/32770624 swapFree=5824/191108
[pid=11526] ppid=11523 vsize=40992 CPUtime=0.18 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 4534 0 0 0 18 0 0 0 20 0 1 0 1283585 41975808 4370 33554432000 4194304 5970956 140728576493856 140728576487688 139904553589733 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 10248 4370 799 434 0 3612 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 40992

[startup+0.300269 s]
/proc/loadavg: 2.06 2.03 2.05 2/244 11526
/proc/meminfo: memFree=32033620/32770624 swapFree=5824/191108
[pid=11526] ppid=11523 vsize=42880 CPUtime=0.28 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 5011 0 0 0 28 0 0 0 20 0 1 0 1283585 43909120 4840 33554432000 4194304 5970956 140728576493856 140728576487288 5219464 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 10720 4840 799 434 0 4084 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 42880

[startup+0.700239 s]
/proc/loadavg: 2.06 2.03 2.05 2/244 11526
/proc/meminfo: memFree=32033620/32770624 swapFree=5824/191108
[pid=11526] ppid=11523 vsize=50496 CPUtime=0.68 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 6927 0 0 0 68 0 0 0 20 0 1 0 1283585 51707904 6746 33554432000 4194304 5970956 140728576493856 140728576487448 139904554333608 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 12624 6746 799 434 0 5988 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 50496

[startup+1.50025 s]
/proc/loadavg: 2.06 2.03 2.05 3/245 11527
/proc/meminfo: memFree=32005820/32770624 swapFree=5824/191164
[pid=11526] ppid=11523 vsize=54192 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 7868 0 0 0 148 1 0 0 20 0 1 0 1283585 55492608 7696 33554432000 4194304 5970956 140728576493856 140728576490840 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 13548 7696 838 434 0 6912 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 54192

[startup+3.10027 s]
/proc/loadavg: 2.14 2.05 2.05 3/245 11527
/proc/meminfo: memFree=32004936/32770624 swapFree=5824/191168
[pid=11526] ppid=11523 vsize=54192 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 8824 0 0 0 308 1 0 0 20 0 1 0 1283585 55492608 7731 33554432000 4194304 5970956 140728576493856 140728576490840 4994549 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 13548 7731 839 434 0 6912 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 54192

[startup+6.30027 s]
/proc/loadavg: 2.14 2.05 2.05 3/245 11527
/proc/meminfo: memFree=32004304/32770624 swapFree=5824/191168
[pid=11526] ppid=11523 vsize=55248 CPUtime=6.28 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 10917 0 0 0 627 1 0 0 20 0 1 0 1283585 56573952 7946 33554432000 4194304 5970956 140728576493856 140728576490760 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 13812 7946 840 434 0 7176 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 55248

[startup+12.7004 s]
/proc/loadavg: 2.20 2.06 2.06 3/245 11527
/proc/meminfo: memFree=32003136/32770624 swapFree=5824/191184
[pid=11526] ppid=11523 vsize=55776 CPUtime=12.68 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 12711 0 0 0 1267 1 0 0 20 0 1 0 1283585 57114624 8117 33554432000 4194304 5970956 140728576493856 140728576491192 5098928 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 13944 8117 840 434 0 7308 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 55776

[startup+25.5003 s]
/proc/loadavg: 2.17 2.06 2.06 3/245 11527
/proc/meminfo: memFree=32002860/32770624 swapFree=5824/191208
[pid=11526] ppid=11523 vsize=56444 CPUtime=25.48 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 13855 0 0 0 2547 1 0 0 20 0 1 0 1283585 57798656 8260 33554432000 4194304 5970956 140728576493856 140728576491192 4994549 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 14111 8260 840 434 0 7475 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 56444

[startup+51.1003 s]
/proc/loadavg: 2.11 2.05 2.06 3/245 11527
/proc/meminfo: memFree=32002660/32770624 swapFree=5824/191232
[pid=11526] ppid=11523 vsize=56840 CPUtime=51.07 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 14968 0 0 0 5106 1 0 0 20 0 1 0 1283585 58204160 8367 33554432000 4194304 5970956 140728576493856 140728576490920 4994568 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 14210 8367 840 434 0 7574 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 56840

[startup+102.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/245 11528
/proc/meminfo: memFree=32000640/32770624 swapFree=5824/191284
[pid=11526] ppid=11523 vsize=58028 CPUtime=102.27 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 16219 0 0 0 10226 1 0 0 20 0 1 0 1283585 59420672 8680 33554432000 4194304 5970956 140728576493856 140728576490552 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 14507 8680 840 434 0 7871 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 58028

[startup+162.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/244 11529
/proc/meminfo: memFree=31999088/32770624 swapFree=5824/191332
[pid=11526] ppid=11523 vsize=60092 CPUtime=162.25 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 17458 0 0 0 16224 1 0 0 20 0 1 0 1283585 61534208 9087 33554432000 4194304 5970956 140728576493856 140728576490920 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15023 9087 840 434 0 8387 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 60092

[startup+222.308 s]
/proc/loadavg: 2.01 2.03 2.05 3/244 11530
/proc/meminfo: memFree=31999456/32770624 swapFree=5824/191360
[pid=11526] ppid=11523 vsize=60092 CPUtime=222.25 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 17840 0 0 0 22224 1 0 0 20 0 1 0 1283585 61534208 9144 33554432000 4194304 5970956 140728576493856 140728576490920 4967842 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15023 9144 840 434 0 8387 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 60092

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/243 11531
/proc/meminfo: memFree=31999708/32770624 swapFree=5824/191424
[pid=11526] ppid=11523 vsize=60620 CPUtime=282.24 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 18801 0 0 0 28222 2 0 0 20 0 1 0 1283585 62074880 9286 33554432000 4194304 5970956 140728576493856 140728576491192 5098928 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15155 9286 840 434 0 8519 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 60620

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/243 11532
/proc/meminfo: memFree=31999000/32770624 swapFree=5824/191456
[pid=11526] ppid=11523 vsize=60620 CPUtime=342.23 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 19343 0 0 0 34221 2 0 0 20 0 1 0 1283585 62074880 9295 33554432000 4194304 5970956 140728576493856 140728576491192 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15155 9295 840 434 0 8519 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 60620

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11533
/proc/meminfo: memFree=31999696/32770624 swapFree=5824/191484
[pid=11526] ppid=11523 vsize=60752 CPUtime=402.22 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 19514 0 0 0 40220 2 0 0 20 0 1 0 1283585 62210048 9302 33554432000 4194304 5970956 140728576493856 140728576490920 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15188 9302 840 434 0 8552 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 60752

[startup+462.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/244 11542
/proc/meminfo: memFree=31999100/32770624 swapFree=5824/191540
[pid=11526] ppid=11523 vsize=60752 CPUtime=462.21 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 19684 0 0 0 46219 2 0 0 20 0 1 0 1283585 62210048 9305 33554432000 4194304 5970956 140728576493856 140728576491192 4994614 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15188 9305 840 434 0 8552 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 60752

[startup+522.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/244 11543
/proc/meminfo: memFree=31998608/32770624 swapFree=5824/191572
[pid=11526] ppid=11523 vsize=60752 CPUtime=522.2 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 19785 0 0 0 52218 2 0 0 20 0 1 0 1283585 62210048 9315 33554432000 4194304 5970956 140728576493856 140728576491192 4994549 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15188 9315 840 434 0 8552 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 60752

[startup+582.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/244 11544
/proc/meminfo: memFree=31999000/32770624 swapFree=5824/191604
[pid=11526] ppid=11523 vsize=60752 CPUtime=582.19 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 19882 0 0 0 58217 2 0 0 20 0 1 0 1283585 62210048 9315 33554432000 4194304 5970956 140728576493856 140728576491192 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15188 9315 840 434 0 8552 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 60752


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/243 11699
/proc/meminfo: memFree=31871404/32770624 swapFree=5824/192204
[pid=11526] ppid=11523 vsize=62336 CPUtime=1482.06 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 25246 0 0 0 148203 3 0 0 20 0 1 0 1283585 63832064 9683 33554432000 4194304 5970956 140728576493856 140728576490920 4961264 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15584 9683 840 434 0 8948 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 62336

[startup+1542.31 s]
/proc/loadavg: 2.02 2.02 2.05 3/243 11701
/proc/meminfo: memFree=31872372/32770624 swapFree=5824/192252
[pid=11526] ppid=11523 vsize=62600 CPUtime=1542.06 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 25935 0 0 0 154203 3 0 0 20 0 1 0 1283585 64102400 9757 33554432000 4194304 5970956 140728576493856 140728576490920 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15650 9757 840 434 0 9014 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 62600

[startup+1602.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/243 11702
/proc/meminfo: memFree=31872240/32770624 swapFree=5824/192280
[pid=11526] ppid=11523 vsize=62732 CPUtime=1602.05 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 26669 0 0 0 160202 3 0 0 20 0 1 0 1283585 64237568 9796 33554432000 4194304 5970956 140728576493856 140728576490920 5052132 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15683 9796 840 434 0 9047 0
Current children cumulated CPU time (s) 1602.05
Current children cumulated vsize (KiB) 62732

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11711
/proc/meminfo: memFree=31871692/32770624 swapFree=5824/192324
[pid=11526] ppid=11523 vsize=62864 CPUtime=1662.04 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 26934 0 0 0 166201 3 0 0 20 0 1 0 1283585 64372736 9835 33554432000 4194304 5970956 140728576493856 140728576490920 5098910 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15716 9835 840 434 0 9080 0
Current children cumulated CPU time (s) 1662.04
Current children cumulated vsize (KiB) 62864

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/244 11712
/proc/meminfo: memFree=31872048/32770624 swapFree=5824/192360
[pid=11526] ppid=11523 vsize=62996 CPUtime=1722.03 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 27218 0 0 0 172200 3 0 0 20 0 1 0 1283585 64507904 9875 33554432000 4194304 5970956 140728576493856 140728576491192 4994549 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15749 9875 840 434 0 9113 0
Current children cumulated CPU time (s) 1722.03
Current children cumulated vsize (KiB) 62996

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11713
/proc/meminfo: memFree=31871588/32770624 swapFree=5824/192388
[pid=11526] ppid=11523 vsize=63128 CPUtime=1782.02 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 27434 0 0 0 178199 3 0 0 20 0 1 0 1283585 64643072 9900 33554432000 4194304 5970956 140728576493856 140728576490920 4994545 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9900 840 434 0 9146 0
Current children cumulated CPU time (s) 1782.02
Current children cumulated vsize (KiB) 63128

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11714
/proc/meminfo: memFree=31871860/32770624 swapFree=5824/192416
[pid=11526] ppid=11523 vsize=63128 CPUtime=1842.01 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 27749 0 0 0 184198 3 0 0 20 0 1 0 1283585 64643072 9908 33554432000 4194304 5970956 140728576493856 140728576491192 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9908 840 434 0 9146 0
Current children cumulated CPU time (s) 1842.01
Current children cumulated vsize (KiB) 63128

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11715
/proc/meminfo: memFree=31872376/32770624 swapFree=5824/192444
[pid=11526] ppid=11523 vsize=63128 CPUtime=1902.01 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 27951 0 0 0 190198 3 0 0 20 0 1 0 1283585 64643072 9915 33554432000 4194304 5970956 140728576493856 140728576491192 4967886 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9915 840 434 0 9146 0
Current children cumulated CPU time (s) 1902.01
Current children cumulated vsize (KiB) 63128

[startup+1962.3 s]
/proc/loadavg: 2.11 2.04 2.05 3/243 11716
/proc/meminfo: memFree=31871584/32770624 swapFree=5824/192484
[pid=11526] ppid=11523 vsize=63128 CPUtime=1962 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 28157 0 0 0 196197 3 0 0 20 0 1 0 1283585 64643072 9917 33554432000 4194304 5970956 140728576493856 140728576491192 4994549 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9917 840 434 0 9146 0
Current children cumulated CPU time (s) 1962
Current children cumulated vsize (KiB) 63128

[startup+2022.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/243 11717
/proc/meminfo: memFree=31871964/32770624 swapFree=5824/192516
[pid=11526] ppid=11523 vsize=63128 CPUtime=2021.99 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 28344 0 0 0 202196 3 0 0 20 0 1 0 1283585 64643072 9924 33554432000 4194304 5970956 140728576493856 140728576491192 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9924 840 434 0 9146 0
Current children cumulated CPU time (s) 2021.99
Current children cumulated vsize (KiB) 63128

[startup+2082.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/243 11718
/proc/meminfo: memFree=31872004/32770624 swapFree=5824/192544
[pid=11526] ppid=11523 vsize=63128 CPUtime=2081.99 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 28498 0 0 0 208196 3 0 0 20 0 1 0 1283585 64643072 9925 33554432000 4194304 5970956 140728576493856 140728576491192 4994541 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9925 840 434 0 9146 0
Current children cumulated CPU time (s) 2081.99
Current children cumulated vsize (KiB) 63128

[startup+2142.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/243 11719
/proc/meminfo: memFree=31870700/32770624 swapFree=5824/192576
[pid=11526] ppid=11523 vsize=63128 CPUtime=2141.97 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 28738 0 0 0 214194 3 0 0 20 0 1 0 1283585 64643072 9925 33554432000 4194304 5970956 140728576493856 140728576491192 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9925 840 434 0 9146 0
Current children cumulated CPU time (s) 2141.97
Current children cumulated vsize (KiB) 63128

[startup+2202.31 s]
/proc/loadavg: 2.00 2.02 2.05 3/243 11720
/proc/meminfo: memFree=31870148/32770624 swapFree=5824/192580
[pid=11526] ppid=11523 vsize=63128 CPUtime=2201.97 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 28947 0 0 0 220194 3 0 0 20 0 1 0 1283585 64643072 9925 33554432000 4194304 5970956 140728576493856 140728576491192 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9925 840 434 0 9146 0
Current children cumulated CPU time (s) 2201.97
Current children cumulated vsize (KiB) 63128

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11729
/proc/meminfo: memFree=31870948/32770624 swapFree=5824/192620
[pid=11526] ppid=11523 vsize=63128 CPUtime=2261.95 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 29157 0 0 0 226192 3 0 0 20 0 1 0 1283585 64643072 9925 33554432000 4194304 5970956 140728576493856 140728576491192 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9925 840 434 0 9146 0
Current children cumulated CPU time (s) 2261.95
Current children cumulated vsize (KiB) 63128

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11730
/proc/meminfo: memFree=31869828/32770624 swapFree=5824/192652
[pid=11526] ppid=11523 vsize=63128 CPUtime=2321.94 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 29346 0 0 0 232191 3 0 0 20 0 1 0 1283585 64643072 9925 33554432000 4194304 5970956 140728576493856 140728576491192 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15782 9925 840 434 0 9146 0
Current children cumulated CPU time (s) 2321.94
Current children cumulated vsize (KiB) 63128

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/244 11731
/proc/meminfo: memFree=31869876/32770624 swapFree=5824/192692
[pid=11526] ppid=11523 vsize=63260 CPUtime=2381.94 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 29703 0 0 0 238191 3 0 0 20 0 1 0 1283585 64778240 9944 33554432000 4194304 5970956 140728576493856 140728576490920 4994554 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15815 9944 840 434 0 9179 0
Current children cumulated CPU time (s) 2381.94
Current children cumulated vsize (KiB) 63260



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11731
/proc/meminfo: memFree=31869876/32770624 swapFree=5824/192696
[pid=11526] ppid=11523 vsize=63392 CPUtime=2400.03 cores=1,3,5,7,9,11,13,15
/proc/11526/stat : 11526 (cosoco) R 11523 11526 9820 0 -1 4202496 29953 0 0 0 240000 3 0 0 20 0 1 0 1283585 64913408 9962 33554432000 4194304 5970956 140728576493856 140728576490920 4994596 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 31293440 140728576500929 140728576501059 140728576501059 140728576503758 0
/proc/11526/statm: 15848 9962 840 434 0 9212 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 63392

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 11526 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.4
CPU time (s): 2400.05
CPU user time (s): 2400.01
CPU system time (s): 0.036994
CPU usage (%): 99.9852
Max. virtual memory (cumulated for all children) (KiB): 63392

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.01
system time used= 0.036994
maximum resident set size= 39896
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29974
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22
involuntary context switches= 121304

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.11409 second user time and 10.708 second system time

The end

Launcher Data 

Begin job on node147 at 2017-07-21 20:03:04
IDJOB=4242253
IDBENCH=133755
IDSOLVER=2620
FILE ID=node147/4242253-1500660184
RUNJOBID= node147-1500648172-9852
PBS_JOBID= 20623274
Free space on /tmp= 61932 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/QuasiGroups/QuasiGroups-elt-qg4/QuasiGroup-4-24.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4242253-1500660184/watcher-4242253-1500660184 -o /tmp/evaluation-result-4242253-1500660184/solver-4242253-1500660184 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node147-1500648172-9852 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4242253-1500660184.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= eed4597320c79808ee022b7591b3ea00
RANDOM SEED=1447555516

node147.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2267.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        32033700 kB
MemAvailable:   32023808 kB
Buffers:           33456 kB
Cached:           266976 kB
SwapCached:            0 kB
Active:           160480 kB
Inactive:         199788 kB
Active(anon):      62700 kB
Inactive(anon):     8680 kB
Active(file):      97780 kB
Inactive(file):   191108 kB
Unevictable:        5824 kB
Mlocked:            5824 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2436 kB
Writeback:             0 kB
AnonPages:         67272 kB
Mapped:            30668 kB
Shmem:              8852 kB
Slab:              65736 kB
SReclaimable:      34108 kB
SUnreclaim:        31628 kB
KernelStack:        4224 kB
PageTables:         5200 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     328792 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61928 MiB
End job on node147 at 2017-07-21 20:43:04