Trace number 4294492

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2519.76 2520.01

General information on the benchmark

NameMisteryShopper/
MisteryShopper-10d_c18.xml
MD5SUMe96e067bea0f1885cdaca6b8f0c69217
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark31.0593
Satisfiable
(Un)Satisfiability was proved
Number of variables1440
Number of constraints865
Number of domains3
Minimum domain size6
Maximum domain size60
Distribution of domain sizes[{"size":6,"count":360},{"size":7,"count":360},{"size":60,"count":720}]
Minimum variable degree2
Maximum variable degree5
Distribution of variable degrees[{"degree":2,"count":720},{"degree":3,"count":360},{"degree":4,"count":324},{"degree":5,"count":36}]
Minimum constraint arity2
Maximum constraint arity360
Distribution of constraint arities[{"arity":2,"count":720},{"arity":6,"count":126},{"arity":60,"count":12},{"arity":120,"count":6},{"arity":360,"count":1}]
Number of extensional constraints720
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":720},{"type":"allDifferent","count":132},{"type":"ordered","count":6},{"type":"lex","count":1},{"type":"channel","count":6}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.03	c Create channel(X,Y) constraint using 60 element constraint 
0.00/0.03	c Create channel(X,Y) constraint using 60 element constraint 
0.00/0.03	c Create channel(X,Y) constraint using 60 element constraint 
0.00/0.03	c Create channel(X,Y) constraint using 60 element constraint 
0.00/0.04	c Create channel(X,Y) constraint using 60 element constraint 
0.00/0.04	c Create channel(X,Y) constraint using 60 element constraint 
0.00/0.04	c
0.00/0.04	c This is cosoco 1.12 --  
0.00/0.04	c
0.00/0.04	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4294492-1532470521.xml 
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.00/0.04	0
0.08/0.18	c root propagations     : 1615        
0.08/0.18	c restarts enabled, print stats at every restarts
0.08/0.18	c
0.08/0.18	c
0.08/0.18	c ========================================[ Problem Statistics ]===========================================
0.08/0.18	c |                                                                                                       
0.08/0.18	c |  Parse time        :         0.15 s 
0.08/0.18	c |
0.08/0.18	c |               Variables: 1440
0.08/0.18	c |            Domain Sizes: 6..60
0.08/0.18	c |
0.08/0.18	c |             Constraints: 1306
0.08/0.18	c |                   Arity: 2..120  -- Binary: 750
0.08/0.18	c | 
0.08/0.18	c |                   Types: 
0.08/0.18	c |                          (X - Y < k): 30
0.08/0.18	c |                          All Different: 132
0.08/0.18	c |                          Element Constant: 360
0.08/0.18	c |                          Extension: 720  (nb tuples: 60..60) -- (shared: 0)
0.08/0.18	c |                          Lex: 64
0.08/0.18	c |                          
0.08/0.18	c =========================================================================================================
0.08/0.18	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.18/0.26	c 101            598            117714         72293          241            0              22   340   320 
0.28/0.34	c 211            1441           237423         171305         241            0              7   684   354  
0.28/0.37	c 332            1619           262955         201624         241            0              7   58   29    
0.28/0.39	c 465            1788           289441         266620         295            0              1   37   23    
0.38/0.43	c 611            2050           326779         314886         295            0              1   117   42   
0.38/0.47	c 771            2478           388689         359492         295            0              11   237   118 
0.38/0.51	c 947            2974           444495         391006         295            0              11   267   185 
0.48/0.56	c 1140           3503           525896         441360         295            0              12   223   173 
0.48/0.59	c 1352           3931           577298         481293         295            0              14   178   146 
0.57/0.65	c 1585           4487           664580         589933         295            0              13   179   154 
0.66/0.70	c 1841           5100           740557         645950         297            0              1   219   178  
0.66/0.75	c 2122           5798           840100         732260         298            0              1   194   165  
0.66/0.79	c 2431           6262           890654         769585         299            0              1   68   61    
0.76/0.85	c 2770           7014           995474         865121         339            0              1   210   170  
0.86/0.95	c 3142           7987           1176339        998805         340            0              1   220   186  
0.97/1.08	c 3551           9021           1392881        1228922        340            0              9   224   196  
1.26/1.31	c 4000           10661          1768145        1470104        340            0              9   221   192  
1.26/1.39	c 4493           11755          1912984        1597592        341            0              1   229   199  
1.36/1.48	c 5035           12456          2020673        1827485        342            0              1   121   103  
1.56/1.65	c 5631           13839          2279883        2085344        342            0              8   215   188  
1.66/1.77	c 6286           15797          2509387        2250294        342            0              9   208   194  
1.76/1.87	c 7006           17623          2679534        2401644        343            0              1   225   207  
1.97/2.04	c 7798           20156          2962515        2522490        343            0              16   235   217 
2.07/2.18	c 8669           22653          3240214        2656675        343            0              16   190   180 
2.16/2.28	c 9627           24780          3402445        2735633        344            0              1   167   158  
2.46/2.53	c 10680          32265          3827601        2838763        345            0              1   191   176  
2.76/2.82	c 11838          35379          4234826        3071735        346            0              1   107   90   
3.16/3.21	c 13111          49240          4803427        3212546        347            0              1   238   213  
3.36/3.41	c 14511          52786          5073732        3323539        347            0              3   86   79    
3.56/3.62	c 16051          56041          5384641        3474068        347            0              1   575   501  
3.86/3.90	c 17745          59221          5881147        3913754        349            0              1   197   190  
4.07/4.14	c 19608          62523          6228473        4036786        349            0              12   175   104 
4.56/4.64	c 21657          68399          6961987        4637592        349            0              12   227   205 
4.86/4.95	c 23910          74986          7566237        4910775        350            0              1   204   198  
5.56/5.69	c 26388          86100          8403120        5487577        351            0              1   226   210  
5.97/6.09	c 29113          94569          9243864        5693848        351            0              7   213   203  
6.46/6.55	c 32110          99141          9824826        6028895        351            0              16   262   254 
6.86/6.94	c 35406          106198         10527011       6827086        351            0              1   226   209  
7.46/7.57	c 39031          113946         11414222       7229632        351            0              6   116   108  
8.16/8.22	c 43018          123913         12578348       8100436        351            0              1   221   212  
9.26/9.37	c 47403          137453         14271228       9783812        352            0              1   238   228  
10.76/10.86	c 52226          150873         16906970       11831192       352            0              13   539   526 
11.66/11.75	c 57531          166311         18506955       12996590       353            0              1   282   273  
12.76/12.86	c 63366          183245         20674003       14232717       354            0              1   492   465  
13.86/13.96	c 69784          199857         22934855       15285195       354            0              17   480   464 
15.76/15.82	c 76843          215934         25680649       16995506       354            0              20   722   691 
17.46/17.53	c 84607          231003         28052687       19828740       356            0              1   519   492  
18.65/18.71	c 93147          251426         30169612       20451116       356            0              19   362   342 
20.25/20.31	c 102541         273650         32536487       22326354       356            0              10   663   634 
21.65/21.72	c 112874         296036         35371719       23408316       356            0              8   583   567  
22.25/22.37	c 124240         310850         36983336       24066692       356            0              1   278   270  
24.06/24.14	c 136742         340942         40870093       26437780       356            0              8   247   240  
27.65/27.72	c 150494         376448         46514558       29817588       357            0              1   318   238  
29.75/29.80	c 165621         394516         49755789       31177117       357            0              14   210   207 
30.75/30.81	c 182260         417214         51291342       31840071       357            0              14   224   206 
36.96/37.10	c 200562         451084         59470069       40957018       357            0              15   170   164 
42.35/42.50	c 220694         496294         67978162       52935261       358            0              1   170   161  
47.55/47.66	c 242839         548226         77516149       67348347       359            0              1   121   114  
51.25/51.39	c 267198         602609         84756489       73685952       360            0              1   158   144  
53.45/53.56	c 293992         653069         87832754       77400827       360            0              28   169   165 
57.55/57.64	c 323465         731730         96443044       82944142       360            0              27   194   184 
62.45/62.51	c 355885         781926         104255162      89296048       361            0              1   163   158  
70.06/70.17	c 391547         888081         117135633      100416630      362            0              1   147   138  
76.54/76.62	c 430775         1001290        128590888      108974141      363            0              1   166   153  
84.64/84.76	c 473925         1106504        143217731      121766230      363            0              4   158   148  
93.44/93.59	c 521390         1230710        158780776      135954166      364            0              1   168   154  
103.14/103.23	c 573601         1380367        173829879      150458577      365            0              1   174   159  
112.64/112.79	c 631033         1524408        189766781      165960436      365            0              8   180   166  
125.34/125.42	c 694208         1701444        209912157      185634862      365            0              4   196   179  
140.64/140.70	c 763700         1826401        238387496      219547552      365            0              4   187   182  
150.14/150.27	c 840141         1966329        253127121      227263390      366            0              1   488   440  
174.34/174.41	c 924226         2273049        291680923      261046147      367            0              1   258   208  
186.14/186.26	c 1016719        2471732        310904715      266970724      367            0              3   180   146  
195.83/195.90	c 1118461        2684807        326214441      284549231      368            0              1   207   199  
217.83/218.00	c 1230377        3029596        362375924      310587221      369            0              1   199   181  
242.04/242.12	c 1353484        3370072        401141238      346382853      370            0              1   205   191  
265.53/265.67	c 1488901        3692147        442606993      379127229      371            0              1   208   192  
302.83/302.95	c 1637859        4079684        503946275      446726002      372            0              1   202   185  
330.62/330.73	c 1801712        4571301        548443081      490618599      373            0              1   196   188  
379.82/380.00	c 1981950        5327409        632111564      524338290      375            0              1   228   169  
398.72/398.86	c 2180211        5841075        665309109      538331536      377            0              1   261   250  
541.31/541.40	c 2398298        6517707        892343567      714256636      377            0              6   228   222  
570.60/570.70	c 2638193        6979236        941155335      742493681      377            0              17   184   168 
615.01/615.11	c 2902077        7646220        1017876057     789859821      379            0              1   187   177  
642.40/642.58	c 3192349        8275643        1067276323     806169385      379            0              4   212   205  
688.19/688.30	c 3511648        9115840        1152867601     851384022      379            0              5   194   186  
760.29/760.44	c 3862876        9794773        1259131255     907152054      379            0              5   146   140  
844.58/844.71	c 4249226        10986505       1405236958     1043073761     379            0              4   148   141  
902.98/903.15	c 4674211        11969409       1507605776     1119476949     379            0              5   176   164  
1004.67/1004.81	c 5141694        13752341       1703246762     1266499327     379            0              10   175   165 
1179.75/1179.92	c 5655925        15244618       2017492670     1585749309     380            0              1   186   165  
1267.64/1267.88	c 6221579        16775845       2177657714     1667042941     380            0              10   194   182 
1399.54/1399.71	c 6843798        18592771       2412303029     1794459292     381            0              1   194   183  
1561.13/1561.36	c 7528238        20412495       2695105329     1968087043     381            0              22   195   183 
1677.12/1677.39	c 8281122        22174999       2912327232     2136073944     381            0              26   177   171 
1834.00/1834.25	c 9109294        24647700       3187482437     2314378143     381            0              67   193   181 
1978.99/1979.22	c 10020283       27142754       3441457526     2489481330     381            0              69   201   186 
2184.37/2184.68	c 11022370       29581677       3841295350     2721278687     381            0              88   208   193 
2408.95/2409.24	c 12124665       32670913       4284987994     2969205771     381            0              56   202   191 
2519.75/2520.00	
2519.75/2520.00	c *** INTERRUPTED ***
2519.75/2520.00	c restarts              : 99          
2519.75/2520.00	c conflicts             : 12784126     (5074 /sec)
2519.75/2520.00	c decisions             : 34412670     (13657 /sec)
2519.75/2520.00	c propagations          : 3080609447  (1222591 /sec)
2519.75/2520.00	c root propagations     : 1615        
2519.75/2520.00	c filter calls          : 4495043164     (1783932 /sec)
2519.75/2520.00	c useless filter calls  : 3696710114     (82 %)
2519.75/2520.00	c Memory used           : 41.19 MB
2519.75/2520.00	c CPU time              : 2519.74 s
2519.75/2520.00	
2519.75/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (4867 MiB free)
  memory of node 1: 16384 MiB (10848 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4294492-1532470521/watcher-4294492-1532470521 -o /tmp/evaluation-result-4294492-1532470521/solver-4294492-1532470521 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1532470521-22596 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4294492-1532470521.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22624, runsolver pid=22618
Current StackSize limit: 8192 KiB


[startup+0.10009 s]*
/proc/loadavg: 1.08 1.00 1.02 3/185 22627
/proc/meminfo: memFree=16084292/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=34872 memory=11148 CPUtime=0.08 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 2993 0 0 0 8 0 0 0 20 0 1 0 64615420 35708928 2787 33554432000 4194304 6142532 140723733634960 140723733631448 140362690488224 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 8718 2787 813 476 0 2040 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 34872 KiB
Current children cumulated memory: 11148 KiB

[startup+0.209404 s]*
/proc/loadavg: 1.08 1.00 1.02 2/182 22635
/proc/meminfo: memFree=16082124/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=39068 memory=15636 CPUtime=0.18 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 4076 0 0 0 18 0 0 0 20 0 1 0 64615420 40005632 3909 33554432000 4194304 6142532 140723733634960 140723733631448 140362690440165 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 9767 3909 855 476 0 3089 0
Current children cumulated CPU time: 0.18 s
Current children cumulated vsize: 39068 KiB
Current children cumulated memory: 15636 KiB

[startup+0.31014 s]*
/proc/loadavg: 1.08 1.00 1.02 3/182 22635
/proc/meminfo: memFree=16079536/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=41252 memory=17748 CPUtime=0.28 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 4598 0 0 0 28 0 0 0 20 0 1 0 64615420 42242048 4437 33554432000 4194304 6142532 140723733634960 140723733631448 5175278 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10313 4437 856 476 0 3635 0
Current children cumulated CPU time: 0.28 s
Current children cumulated vsize: 41252 KiB
Current children cumulated memory: 17748 KiB

[startup+0.700235 s]
/proc/loadavg: 1.08 1.00 1.02 4/200 22656
/proc/meminfo: memFree=16056744/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=41252 memory=17748 CPUtime=0.66 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 4598 0 0 0 66 0 0 0 20 0 1 0 64615420 42242048 4437 33554432000 4194304 6142532 140723733634960 140723733632360 5347460 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10313 4437 856 476 0 3635 0
Current children cumulated CPU time: 0.66 s
Current children cumulated vsize: 41252 KiB
Current children cumulated memory: 17748 KiB

[startup+1.50023 s]
/proc/loadavg: 1.08 1.00 1.02 3/183 22671
/proc/meminfo: memFree=16075804/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=41252 memory=17748 CPUtime=1.46 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 4598 0 0 0 146 0 0 0 20 0 1 0 64615420 42242048 4437 33554432000 4194304 6142532 140723733634960 140723733632360 5079994 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10313 4437 856 476 0 3635 0
Current children cumulated CPU time: 1.46 s
Current children cumulated vsize: 41252 KiB
Current children cumulated memory: 17748 KiB

[startup+3.10887 s]
/proc/loadavg: 1.08 1.00 1.02 3/187 22691
/proc/meminfo: memFree=16073784/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=41252 memory=17768 CPUtime=3.07 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 7163 0 0 0 307 0 0 0 20 0 1 0 64615420 42242048 4442 33554432000 4194304 6142532 140723733634960 140723733632360 4995323 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10313 4442 856 476 0 3635 0
Current children cumulated CPU time: 3.07 s
Current children cumulated vsize: 41252 KiB
Current children cumulated memory: 17768 KiB

[startup+6.30022 s]
/proc/loadavg: 1.23 1.04 1.03 3/187 22691
/proc/meminfo: memFree=16073420/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=41648 memory=18244 CPUtime=6.26 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 10406 0 0 0 625 1 0 0 20 0 1 0 64615420 42647552 4561 33554432000 4194304 6142532 140723733634960 140723733632360 5061171 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10412 4561 856 476 0 3734 0
Current children cumulated CPU time: 6.26 s
Current children cumulated vsize: 41648 KiB
Current children cumulated memory: 18244 KiB

[startup+12.7002 s]
/proc/loadavg: 1.37 1.07 1.05 3/187 22691
/proc/meminfo: memFree=16073792/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=41780 memory=18316 CPUtime=12.66 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 13380 0 0 0 1265 1 0 0 20 0 1 0 64615420 42782720 4579 33554432000 4194304 6142532 140723733634960 140723733632360 5061110 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10445 4579 856 476 0 3767 0
Current children cumulated CPU time: 12.66 s
Current children cumulated vsize: 41780 KiB
Current children cumulated memory: 18316 KiB

[startup+25.5002 s]
/proc/loadavg: 1.62 1.13 1.07 3/187 22691
/proc/meminfo: memFree=16072652/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=25.45 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 16622 0 0 0 2544 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5061130 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 25.45 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+51.1089 s]
/proc/loadavg: 1.87 1.25 1.11 3/187 22691
/proc/meminfo: memFree=16074552/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=51.06 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 16813 0 0 0 5105 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5079981 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 51.06 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+102.3 s]
/proc/loadavg: 1.94 1.36 1.15 3/187 22692
/proc/meminfo: memFree=16075104/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=102.24 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 17002 0 0 0 10223 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5060745 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 102.24 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 1.48 1.21 3/187 22693
/proc/meminfo: memFree=16075160/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=162.24 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 17189 0 0 0 16223 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 4995371 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.57 1.26 3/187 22694
/proc/meminfo: memFree=16075184/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=222.23 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 17367 0 0 0 22222 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5058259 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+282.3 s]
/proc/loadavg: 1.96 1.64 1.30 3/188 22766
/proc/meminfo: memFree=16070532/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=282.23 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 17545 0 0 0 28222 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5175264 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 1.70 1.34 3/188 22767
/proc/meminfo: memFree=16071432/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=342.22 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 17719 0 0 0 34221 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5175070 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 342.22 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+402.3 s]
/proc/loadavg: 1.99 1.76 1.38 3/188 22768
/proc/meminfo: memFree=16071632/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=402.22 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 17902 0 0 0 40221 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5079985 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.80 1.42 3/188 22769
/proc/meminfo: memFree=16071212/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=462.21 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 18048 0 0 0 46220 1 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5175056 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB


################
# More data... #
################

/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 1722.11 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.86 3/187 22810
/proc/meminfo: memFree=16069244/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=1782.11 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 21594 0 0 0 178209 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5336576 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 1782.11 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 1.87 3/187 22811
/proc/meminfo: memFree=16068964/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=1842.1 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 21771 0 0 0 184208 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5055401 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 1842.1 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 1.87 3/187 22812
/proc/meminfo: memFree=16068676/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=1902.1 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 21911 0 0 0 190208 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5060763 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 1902.1 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 1.88 3/187 22813
/proc/meminfo: memFree=16068892/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=1962.09 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22053 0 0 0 196207 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5326540 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 1962.09 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/187 22814
/proc/meminfo: memFree=16069024/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2022.09 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22232 0 0 0 202207 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5060745 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2022.09 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/188 22823
/proc/meminfo: memFree=16068288/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2082.08 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22377 0 0 0 208206 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5080063 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2082.08 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/188 22824
/proc/meminfo: memFree=16069012/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2142.08 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22522 0 0 0 214206 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5080088 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2142.08 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/188 22825
/proc/meminfo: memFree=16069136/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2202.07 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22700 0 0 0 220205 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5061983 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2202.07 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/188 22826
/proc/meminfo: memFree=16068888/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2262.07 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22840 0 0 0 226205 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5054814 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2262.07 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 1.99 1.92 3/187 22827
/proc/meminfo: memFree=16070144/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2322.06 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 22981 0 0 0 232204 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5061940 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2322.06 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2382.3 s]
/proc/loadavg: 2.41 2.12 1.97 3/187 22830
/proc/meminfo: memFree=16069512/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2382.06 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 23122 0 0 0 238204 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5058268 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2382.06 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2442.3 s]
/proc/loadavg: 2.23 2.12 1.97 3/187 22831
/proc/meminfo: memFree=16069256/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2442.05 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 23299 0 0 0 244203 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5060790 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2442.05 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

[startup+2502.3 s]
/proc/loadavg: 2.22 2.13 1.98 3/187 22832
/proc/meminfo: memFree=16069024/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2502.05 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 23438 0 0 0 250203 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 4995353 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2502.05 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.17 2.12 1.98 3/187 22833
/proc/meminfo: memFree=16068900/32770624 swapFree=67108860/67108860
[pid=22624] ppid=22618 vsize=42176 memory=18780 CPUtime=2519.75 cores=0,2,4,6
/proc/22624/stat : 22624 (cosoco) R 22618 22624 22565 0 -1 4202496 23576 0 0 0 251973 2 0 0 20 0 1 0 64615420 43188224 4695 33554432000 4194304 6142532 140723733634960 140723733632360 5055525 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 9773056 140723733640326 140723733640456 140723733640456 140723733643214 0
/proc/22624/statm: 10544 4695 856 476 0 3866 0
Current children cumulated CPU time: 2519.75 s
Current children cumulated vsize: 42176 KiB
Current children cumulated memory: 18780 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 22624 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.74 s, system=0.021998 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.76
CPU user time (s): 2519.74
CPU system time (s): 0.021998
CPU usage (%): 99.9901
Max. virtual memory (cumulated for all children) (KiB): 42176
Max. memory (cumulated for all children) (KiB): 18780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.74
system time used= 0.021998
maximum resident set size= 18844
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23626
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 42
involuntary context switches= 3174


# summary of solver processes directly reported to runsolver:
#   pid: 22624
#   total CPU time (s): 2519.76
#   total CPU user time (s): 2519.74
#   total CPU system time (s): 0.021998

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.13666 second user time and 16.6133 second system time

The end

Launcher Data 

Begin job on node150 at 2018-07-25 00:15:21
IDJOB=4294492
IDBENCH=141389
IDSOLVER=2752
FILE ID=node150/4294492-1532470521
RUNJOBID= node150-1532470521-22596
PBS_JOBID= 21021585
Free space on /tmp= 53108 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/MisteryShopper/MisteryShopper-10d_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4294492-1532470521/watcher-4294492-1532470521 -o /tmp/evaluation-result-4294492-1532470521/solver-4294492-1532470521 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1532470521-22596 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4294492-1532470521.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e96e067bea0f1885cdaca6b8f0c69217
RANDOM SEED=1654944561

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        16093196 kB
MemAvailable:   31940060 kB
Buffers:          235156 kB
Cached:         15696600 kB
SwapCached:            0 kB
Active:          1569396 kB
Inactive:       14413808 kB
Active(anon):       9972 kB
Inactive(anon):    61412 kB
Active(file):    1559424 kB
Inactive(file): 14352396 kB
Unevictable:        7756 kB
Mlocked:            7756 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              5672 kB
Writeback:             0 kB
AnonPages:         59248 kB
Mapped:            38696 kB
Shmem:             17032 kB
Slab:             390276 kB
SReclaimable:     363504 kB
SUnreclaim:        26772 kB
KernelStack:        3168 kB
PageTables:         4780 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     318340 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 53100 MiB
End job on node150 at 2018-07-25 00:57:22