Trace number 4396837

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2519.95 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-02.xml
MD5SUM595b80e98a8312b53afa04c8c4859da3
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark10.2016
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.03	c root propagations     : 5017        
0.00/0.03	c restarts enabled, print stats at every restarts
0.00/0.03	c
0.00/0.03	c
0.00/0.03	c
0.00/0.03	c This is cosoco 2.00 --  
0.00/0.03	c
0.00/0.03	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396837-1568593513.xml 
0.00/0.03	c ========================================[ Problem Statistics ]===========================================
0.00/0.03	c |                                                                                                       
0.00/0.03	c |  Parse time        :         0.01 s 
0.00/0.03	c |
0.00/0.03	c |               Variables: 900
0.00/0.03	c |            Domain Sizes: 30..30
0.00/0.03	c |
0.00/0.03	c |             Constraints: 586
0.00/0.03	c |                   Arity: 1..30  -- Unary: 526
0.00/0.03	c | 
0.00/0.03	c |                   Types: 
0.00/0.03	c |                          All Different: 60
0.00/0.03	c |                          Unary: 526
0.00/0.03	c |                          
0.00/0.03	c =========================================================================================================
0.00/0.03	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            931            12281          39008          887            0              594   611   595
0.10/0.13	c 211            1887           23887          75859          887            0              100   676   616
0.10/0.20	c 332            3836           37320          126013         887            0              191   496   428
0.21/0.30	c 465            5602           56486          201685         887            0              318   626   563
0.31/0.38	c 611            6923           70887          258067         887            0              497   594   570
0.41/0.46	c 771            8340           86892          320351         887            0              411   581   539
0.51/0.58	c 947            10540          109505         421105         887            0              485   686   648
0.69/0.71	c 1140           12374          132612         523730         887            0              562   727   699
0.79/0.89	c 1352           14644          165115         674688         887            0              573   736   687
0.89/0.99	c 1585           16364          184010         749745         887            0              579   695   659
1.10/1.19	c 1841           18192          220482         935006         887            0              546   706   678
1.39/1.42	c 2122           20598          260655         1140074        887            0              556   714   673
1.59/1.67	c 2431           22660          305506         1376874        887            0              555   721   693
1.89/1.90	c 2770           25232          346531         1581317        887            0              565   723   663
2.19/2.28	c 3142           28053          414342         1899453        887            0              572   668   638
2.49/2.59	c 3551           30654          470329         2184672        887            0              576   705   676
2.89/2.95	c 4000           34149          534207         2512674        887            0              646   724   696
3.29/3.30	c 4493           37690          596549         2900118        887            0              679   730   705
3.79/3.83	c 5035           42200          690598         3396373        887            0              572   711   675
4.29/4.39	c 5631           45860          789024         3888603        887            0              582   692   656
4.79/4.86	c 6286           51155          874496         4309682        887            0              567   742   699
5.49/5.52	c 7006           56784          990422         4946105        887            0              568   708   679
5.89/5.93	c 7798           60814          1065537        5302562        887            0              570   704   675
6.49/6.55	c 8669           66815          1175390        5817628        887            0              564   709   674
7.59/7.63	c 9627           78393          1372329        6864893        887            0              566   756   705
8.29/8.37	c 10680          84498          1503307        7543430        887            0              568   714   681
9.00/9.03	c 11838          90889          1620420        8160511        887            0              557   705   666
9.69/9.75	c 13111          97501          1749910        8793731        887            0              555   714   681
10.69/10.78	c 14511          110029         1938477        9697081        887            0              556   754   699
11.69/11.74	c 16051          118216         2109872        10591100       887            0              559   716   683
12.49/12.59	c 17745          127083         2262934        11346607       887            0              572   711   670
14.00/14.01	c 19608          141442         2517698        12669750       887            0              602   746   694
15.69/15.70	c 21657          156273         2819790        14308154       887            0              591   742   703
17.29/17.31	c 23910          172434         3107369        15890953       887            0              613   721   688
19.19/19.24	c 26388          187285         3448326        17786326       887            0              641   733   701
21.19/21.21	c 29113          203208         3800170        19658543       887            0              646   721   690
23.79/23.84	c 32110          221879         4271301        22148801       887            0              641   726   685
26.29/26.33	c 35406          241263         4709228        24477867       887            0              584   722   690
30.59/30.61	c 39031          273605         5466653        28620735       887            0              609   733   691
33.59/33.66	c 43018          298739         6007340        31463228       887            0              575   733   686
37.79/37.87	c 47403          331218         6758004        35743786       887            0              594   749   704
41.59/41.62	c 52226          363425         7423832        39372266       887            0              627   720   678
46.49/46.56	c 57531          397597         8299773        43938376       887            0              584   730   691
49.99/50.05	c 63366          428511         8921247        47206944       887            0              573   744   703
55.69/55.78	c 69784          479400         9947207        52116021       887            0              587   742   691
61.89/61.99	c 76843          529591         11057110       57771277       887            0              577   736   699
68.09/68.15	c 84607          581307         12157592       63019399       887            0              586   713   670
74.18/74.22	c 93147          637048         13246526       68861800       887            0              640   750   704
81.99/82.10	c 102541         701911         14649882       76570741       887            0              552   753   706
89.99/90.06	c 112874         763445         16054342       83934037       887            0              642   746   697
96.28/96.36	c 124240         825487         17183015       89817168       887            0              625   732   695
108.58/108.69	c 136742         916165         19349456       102083568      887            0              654   751   707
120.09/120.18	c 150494         1003851        21375950       113478267      887            0              642   748   697
131.28/131.38	c 165621         1093911        23360492       124444017      887            0              625   735   693
144.38/144.43	c 182260         1209570        25709642       135542686      887            0              602   736   690
161.38/161.42	c 200562         1347523        28733276       151317059      887            0              578   747   696
180.28/180.32	c 220694         1510166        32105046       169281685      887            0              580   744   687
197.78/197.80	c 242839         1660075        35232308       186699788      887            0              578   752   699
221.58/221.66	c 267198         1870568        39498051       208245598      887            0              580   747   687
240.78/240.86	c 293992         2020441        42882256       226464675      887            0              608   745   682
263.58/263.60	c 323465         2208158        46945444       245956563      887            0              627   729   682
288.09/288.13	c 355885         2401932        51332228       268894910      887            0              585   752   694
310.78/310.83	c 391547         2585183        55427008       289517232      887            0              626   764   713
340.48/340.52	c 430775         2851453        60746148       316198939      887            0              553   758   699
374.98/375.10	c 473925         3114738        66860382       347424542      887            0              573   719   672
406.08/406.15	c 521390         3382092        72360077       377324425      887            0              569   719   679
441.67/441.76	c 573601         3688285        78679519       410646279      887            0              609   729   678
479.67/479.79	c 631033         4021677        85438720       448043514      887            0              588   748   704
525.37/525.45	c 694208         4348638        93559262       490259027      887            0              616   733   687
588.57/588.69	c 763700         4949108        104815545      549463728      887            0              606   748   698
644.47/644.56	c 840141         5387225        114781327      600604103      887            0              635   745   698
694.67/694.77	c 924226         5794271        123714470      647604134      887            0              582   746   697
763.57/763.62	c 1016719        6329535        135964854      713843752      887            0              642   748   697
838.76/838.82	c 1118461        6857351        149181828      787304717      887            0              629   728   689
930.76/930.80	c 1230377        7476472        165406111      876446930      887            0              625   736   690
1030.26/1030.32	c 1353484        8214826        182941295      966017439      887            0              567   734   686
1128.36/1128.46	c 1488901        9016254        200394972      1056271048     887            0              564   729   690
1252.06/1252.12	c 1637859        10069195       222364904      1176355447     887            0              582   765   711
1393.15/1393.29	c 1801712        11225398       247339044      1301881632     887            0              589   745   691
1532.75/1532.81	c 1981950        12343871       271984909      1434628416     887            0              587   744   695
1691.06/1691.11	c 2180211        13619932       299859979      1588536483     887            0              604   742   690
1867.65/1867.71	c 2398298        14806919       330867064      1755651397     887            0              589   736   688
2029.14/2029.26	c 2638193        16156996       359402879      1910966938     887            0              595   737   683
2210.14/2210.24	c 2902077        17738765       391496678      2076110330     887            0              587   731   675
2446.73/2446.86	c 3192349        19409843       433202915      2303928199     887            0              580   739   691
2519.94/2520.00	
2519.94/2520.00	c *** INTERRUPTED ***
2519.94/2520.00	c restarts              : 85          
2519.94/2520.00	c conflicts             : 3283453      (1303 /sec)
2519.94/2520.00	c decisions             : 19901512     (7898 /sec)
2519.94/2520.00	c propagations          : 2372745398  (941591 /sec)
2519.94/2520.00	c root propagations     : 5017        
2519.94/2520.00	c filter calls          : 446047502      (177008 /sec)
2519.94/2520.00	c useless filter calls  : 111161342      (24 %)
2519.94/2520.00	c Memory used           : 32.52 MB
2519.94/2520.00	c CPU time              : 2519.93 s
2519.94/2520.00	c real time             : 2520 s
2519.94/2520.00	
2519.94/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13689 MiB free)
  memory of node 1: 16384 MiB (13545 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396837-1568593513/watcher-4396837-1568593513 -o /tmp/evaluation-result-4396837-1568593513/solver-4396837-1568593513 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1568572745-9394 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396837-1568593513.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=14909, runsolver pid=14906
Current StackSize limit: 8192 KiB


[startup+0.100198 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27883500/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=32768 memory=9200 CPUtime=0.1 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 2497 0 0 0 10 0 0 0 20 0 1 0 435266202 33554432 2300 33554432000 4194304 6211092 140736419721376 140736419717912 139765677267941 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8192 2300 866 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.210167 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27883212/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=32900 memory=9200 CPUtime=0.21 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 2520 0 0 0 21 0 0 0 20 0 1 0 435266202 33689600 2300 33554432000 4194304 6211092 140736419721376 140736419717912 5075208 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8225 2300 866 493 0 1530 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9200 KiB

[startup+0.309439 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27883212/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33032 memory=9464 CPUtime=0.31 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 2555 0 0 0 31 0 0 0 20 0 1 0 435266202 33824768 2366 33554432000 4194304 6211092 140736419721376 140736419717912 5409465 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+0.700334 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27882840/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9728 CPUtime=0.69 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 2624 0 0 0 69 0 0 0 20 0 1 0 435266202 34099200 2432 33554432000 4194304 6211092 140736419721376 140736419718744 5081754 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2432 866 493 0 1630 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9728 KiB

[startup+1.50035 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27882280/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9728 CPUtime=1.49 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 2631 0 0 0 149 0 0 0 20 0 1 0 435266202 34099200 2432 33554432000 4194304 6211092 140736419721376 140736419718744 5078953 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2432 866 493 0 1630 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9728 KiB

[startup+3.10927 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27882032/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9876 CPUtime=3.1 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 4128 0 0 0 310 0 0 0 20 0 1 0 435266202 34099200 2469 33554432000 4194304 6211092 140736419721376 140736419719336 5082800 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2469 866 493 0 1630 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9876 KiB

[startup+6.30034 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14910
/proc/meminfo: memFree=27881904/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=6.29 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 5634 0 0 0 629 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5082449 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14911
/proc/meminfo: memFree=27882124/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=12.69 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 7135 0 0 0 1269 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5081703 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 14913
/proc/meminfo: memFree=27882580/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=25.49 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 10125 0 0 0 2549 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5393315 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 14914
/proc/meminfo: memFree=27881948/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=51.09 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 11630 0 0 0 5109 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5079276 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+102.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/200 14919
/proc/meminfo: memFree=27881072/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=102.28 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 13133 0 0 0 10228 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5076376 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 14925
/proc/meminfo: memFree=27879964/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=162.28 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 14621 0 0 0 16228 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5076013 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 14930
/proc/meminfo: memFree=27878832/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=222.28 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 15111 0 0 0 22228 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5074413 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14934
/proc/meminfo: memFree=27876812/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=282.28 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 15601 0 0 0 28228 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5079092 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 14949
/proc/meminfo: memFree=27876240/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=342.28 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 16091 0 0 0 34228 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5186312 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14953
/proc/meminfo: memFree=27874792/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=402.27 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 16581 0 0 0 40227 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5081767 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14957
/proc/meminfo: memFree=27875004/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=462.27 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 17071 0 0 0 46227 0 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5081375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB


################
# More data... #
################

/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/200 15077
/proc/meminfo: memFree=27866620/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=1782.25 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 25868 0 0 0 178224 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5193696 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+1842.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/199 15082
/proc/meminfo: memFree=27867604/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=1842.25 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 26139 0 0 0 184224 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5081706 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 1842.25 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+1902.3 s]
/proc/loadavg: 2.08 2.05 2.05 3/199 15086
/proc/meminfo: memFree=27866976/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=1902.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 26629 0 0 0 190223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5009195 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+1962.3 s]
/proc/loadavg: 2.10 2.07 2.05 3/199 15152
/proc/meminfo: memFree=26777848/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=1962.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 26900 0 0 0 196223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 1962.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2022.3 s]
/proc/loadavg: 2.11 2.07 2.05 3/200 15158
/proc/meminfo: memFree=26111612/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2022.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 27171 0 0 0 202223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5079378 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2022.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2082.3 s]
/proc/loadavg: 2.08 2.07 2.05 3/200 15162
/proc/meminfo: memFree=25512156/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2082.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 27662 0 0 0 208223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5075228 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.06 2.05 3/201 15176
/proc/meminfo: memFree=24843260/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2142.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 27934 0 0 0 214223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5186269 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/202 15202
/proc/meminfo: memFree=24824388/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2202.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 28206 0 0 0 220223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5082759 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/202 15206
/proc/meminfo: memFree=24797672/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2262.24 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 28690 0 0 0 226223 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5082435 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 15212
/proc/meminfo: memFree=24769656/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2322.23 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 28956 0 0 0 232222 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5079292 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 15216
/proc/meminfo: memFree=24719668/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2382.23 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 29222 0 0 0 238222 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5079049 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 15220
/proc/meminfo: memFree=24649316/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2442.23 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 29488 0 0 0 244222 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5074613 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2442.23 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

[startup+2502.3 s]
/proc/loadavg: 2.12 2.05 2.05 3/200 15226
/proc/meminfo: memFree=24594064/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2502.23 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 29978 0 0 0 250222 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5081676 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2502.23 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.08 2.05 2.05 3/200 15227
/proc/meminfo: memFree=24590892/32770624 swapFree=66939884/67108860
[pid=14909] ppid=14906 vsize=33300 memory=9880 CPUtime=2519.94 cores=0,2,4,6
/proc/14909/stat : 14909 (cosoco) R 14906 14909 9363 0 -1 4202496 30244 0 0 0 251993 1 0 0 20 0 1 0 435266202 34099200 2470 33554432000 4194304 6211092 140736419721376 140736419719336 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 18919424 140736419726347 140736419726449 140736419726449 140736419729358 0
/proc/14909/statm: 8325 2470 866 493 0 1630 0
Current children cumulated CPU time: 2519.94 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9880 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 14909 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.93 s, system=0.015999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.95
CPU user time (s): 2519.93
CPU system time (s): 0.015999
CPU usage (%): 99.9976
Max. virtual memory (cumulated for all children) (KiB): 33300
Max. memory (cumulated for all children) (KiB): 9880

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.93
system time used= 0.015999
maximum resident set size= 9944
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30297
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 3153


# summary of solver processes directly reported to runsolver:
#   pid: 14909
#   total CPU time (s): 2519.95
#   total CPU user time (s): 2519.93
#   total CPU system time (s): 0.015999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.233 second user time and 11.6033 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-16 02:24:33
IDJOB=4396837
IDBENCH=138963
IDSOLVER=2848
FILE ID=node119/4396837-1568593513
RUNJOBID= node119-1568572745-9394
PBS_JOBID= 21703330
Free space on /tmp= 61368 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-02.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396837-1568593513/watcher-4396837-1568593513 -o /tmp/evaluation-result-4396837-1568593513/solver-4396837-1568593513 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1568572745-9394 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396837-1568593513.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 595b80e98a8312b53afa04c8c4859da3
RANDOM SEED=169798679

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27888960 kB
MemAvailable:   31689316 kB
Buffers:          142784 kB
Cached:          3939032 kB
SwapCached:        61096 kB
Active:          2620916 kB
Inactive:        1659420 kB
Active(anon):     135112 kB
Inactive(anon):   113196 kB
Active(file):    2485804 kB
Inactive(file):  1546224 kB
Unevictable:      106936 kB
Mlocked:          106936 kB
SwapTotal:      67108860 kB
SwapFree:       66939884 kB
Dirty:              2696 kB
Writeback:             0 kB
AnonPages:        254744 kB
Mapped:            49432 kB
Shmem:             41008 kB
Slab:             197512 kB
SReclaimable:     168324 kB
SUnreclaim:        29188 kB
KernelStack:        3776 kB
PageTables:         6220 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     668116 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    200704 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 60796 MiB
End job on node119 at 2019-09-16 03:06:34