Trace number 4408104

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.04 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-19.xml
MD5SUM3875648f967e99deb98809a056dae84c
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark32.512
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4365        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408104-1569810134.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.10/0.11	c 101            1268           18842          68727          899            0              631   672   650
0.21/0.23	c 211            3658           42471          162968         899            0              318   686   540
0.21/0.30	c 332            4950           55424          217053         899            0              518   686   662
0.31/0.38	c 465            6249           70578          273751         899            0              518   653   627
0.31/0.41	c 611            7273           77068          299978         899            0              532   576   559
0.41/0.51	c 771            8825           94474          372871         899            0              545   698   667
0.60/0.68	c 947            10663          126003         519139         899            0              497   723   664
0.79/0.84	c 1140           12545          155031         658147         899            0              542   720   675
1.00/1.04	c 1352           14463          190610         817023         899            0              552   709   675
1.19/1.20	c 1585           16802          220887         951373         899            0              562   720   689
1.39/1.42	c 1841           18863          261123         1163216        899            0              651   721   685
1.59/1.69	c 2122           21551          309016         1389681        899            0              653   733   685
2.00/2.01	c 2431           24576          366627         1682848        899            0              629   722   697
2.10/2.19	c 2770           26698          399214         1859214        899            0              617   729   707
2.39/2.40	c 3142           29139          437082         2046072        899            0              636   733   704
2.59/2.68	c 3551           32088          487699         2316829        899            0              563   726   699
3.10/3.14	c 4000           35992          570615         2768022        899            0              552   738   695
3.49/3.56	c 4493           39401          646166         3164037        899            0              555   735   706
4.00/4.02	c 5035           43546          729087         3542455        899            0              557   724   687
4.49/4.53	c 5631           48318          821053         4006194        899            0              604   723   682
4.89/4.95	c 6286           52313          896829         4426107        899            0              596   729   690
5.49/5.58	c 7006           57002          1009522        4982234        899            0              584   718   683
6.10/6.15	c 7798           62265          1111611        5510913        899            0              605   712   683
6.79/6.81	c 8669           68726          1230908        6085415        899            0              590   703   663
7.39/7.42	c 9627           73018          1339038        6654534        899            0              592   707   684
8.19/8.29	c 10680          80834          1494774        7437555        899            0              601   718   674
9.39/9.41	c 11838          87828          1693831        8415284        899            0              573   717   667
10.10/10.14	c 13111          95604          1826418        9099950        899            0              581   736   700
10.89/10.97	c 14511          103579         1976026        9862542        899            0              569   728   678
12.10/12.19	c 16051          113834         2194960        10992600       899            0              568   716   672
13.49/13.54	c 17745          126285         2434914        12376872       899            0              557   750   700
15.59/15.62	c 19608          138856         2791710        14491007       899            0              565   728   667
16.79/16.82	c 21657          151196         3007660        15614328       899            0              564   746   702
18.99/19.02	c 23910          168160         3402392        17615939       899            0              664   746   701
21.10/21.14	c 26388          186235         3779782        19608208       899            0              661   731   694
23.49/23.53	c 29113          213933         4218701        21866792       899            0              633   766   722
25.99/26.01	c 32110          236068         4661702        24016251       899            0              626   742   692
28.59/28.61	c 35406          258109         5127690        26506163       899            0              651   733   697
31.49/31.55	c 39031          284664         5656990        29365567       899            0              661   769   712
34.49/34.55	c 43018          314104         6201985        32355955       899            0              595   763   710
38.19/38.20	c 47403          344969         6853775        35844990       899            0              585   756   711
42.19/42.26	c 52226          380621         7582966        39804163       899            0              617   753   715
46.99/47.10	c 57531          424043         8456106        44488567       899            0              606   762   713
52.49/52.55	c 63366          469960         9439381        49785363       899            0              599   757   716
57.29/57.38	c 69784          517568         10313059       54443026       899            0              584   757   715
61.39/61.47	c 76843          551512         11044185       58495690       899            0              623   735   701
67.10/67.13	c 84607          598009         12051152       64373876       899            0              588   721   686
72.39/72.40	c 93147          643961         12992871       69265967       899            0              564   734   690
78.49/78.52	c 102541         687585         14076814       75194570       899            0              590   734   689
85.69/85.78	c 112874         749082         15373748       82268652       899            0              619   735   699
91.99/92.04	c 124240         800247         16484794       88476108       899            0              623   723   689
103.29/103.33	c 136742         874121         18465405       99302642       899            0              655   736   699
111.49/111.53	c 150494         945897         19929043       107581442      899            0              625   736   693
121.10/121.16	c 165621         1022335        21638131       116536690      899            0              588   719   683
136.69/136.70	c 182260         1145091        24442570       130489567      899            0              588   740   698
149.10/149.11	c 200562         1259534        26672919       142483876      899            0              606   748   691
164.29/164.37	c 220694         1374567        29412012       157375306      899            0              580   726   682
182.10/182.19	c 242839         1486981        32559249       174885890      899            0              578   722   684
198.89/198.93	c 267198         1621089        35577017       191131162      899            0              576   715   673
219.59/219.66	c 293992         1815412        39319672       208870327      899            0              553   728   685
242.49/242.51	c 323465         2030770        43443313       227705217      899            0              555   717   657
266.29/266.32	c 355885         2221221        47739824       250075340      899            0              559   726   669
293.79/293.89	c 391547         2438669        52658053       275338389      899            0              557   738   691
330.89/330.93	c 430775         2733036        59255337       308148497      899            0              574   731   682
362.79/362.82	c 473925         2998333        65033457       337573389      899            0              584   743   685
396.69/396.74	c 521390         3301219        71143819       369747545      899            0              561   766   716
433.79/433.86	c 573601         3659326        77874821       406298712      899            0              580   779   724
485.19/485.20	c 631033         4092428        87063181       456372665      899            0              619   765   706
544.19/544.26	c 694208         4519252        97581697       509144385      899            0              552   752   703
596.59/596.68	c 763700         4906086        106928735      559914770      899            0              555   748   702
651.69/651.73	c 840141         5306176        116697010      612144197      899            0              549   726   688
725.79/725.86	c 924226         5847023        129986149      679228677      899            0              561   747   685
819.39/819.44	c 1016719        6499387        146632066      770507802      899            0              552   769   714
919.80/919.82	c 1118461        7296006        164526506      865702533      899            0              553   753   694
1030.30/1030.36	c 1230377        8133067        184149933      972511149      899            0              560   742   692
1131.50/1131.58	c 1353484        8954151        202248116      1071008168     899            0              600   747   694
1215.11/1215.16	c 1488901        9531655        217057375      1155962244     899            0              590   740   698
1339.60/1339.67	c 1637859        10457934       239031513      1278903227     899            0              619   761   698
1464.21/1464.25	c 1801712        11511366       261248036      1394072814     899            0              586   755   694
1602.51/1602.57	c 1981950        12664207       285922467      1527182790     899            0              580   745   697
1746.32/1746.35	c 2180211        13788836       311536855      1661455593     899            0              572   741   682
1917.92/1917.98	c 2398298        15174097       342372864      1822827172     899            0              580   754   695
2147.72/2147.74	c 2638193        16970255       383100176      2046171381     899            0              627   758   699
2382.82/2382.83	c 2902077        18752948       424876763      2279928465     899            0              641   749   696
2520.03/2520.00	
2520.03/2520.00	c *** INTERRUPTED ***
2520.03/2520.00	c restarts              : 84          
2520.03/2520.00	c conflicts             : 3066080      (1217 /sec)
2520.03/2520.00	c decisions             : 19911191     (7901 /sec)
2520.03/2520.00	c propagations          : 2410618154  (956583 /sec)
2520.03/2520.00	c root propagations     : 4365        
2520.03/2520.00	c filter calls          : 449220895      (178260 /sec)
2520.03/2520.00	c useless filter calls  : 114629041      (25 %)
2520.03/2520.00	c Memory used           : 32.39 MB
2520.03/2520.00	c CPU time              : 2520.03 s
2520.03/2520.00	c real time             : 2520 s
2520.03/2520.00	
2520.03/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14856 MiB free)
  memory of node 1: 16384 MiB (14633 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408104-1569810134/watcher-4408104-1569810134 -o /tmp/evaluation-result-4408104-1569810134/solver-4408104-1569810134 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30040 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408104-1569810134.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1843, runsolver pid=1840

[startup+0.100105 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 1844
/proc/meminfo: memFree=30192092/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=32372 memory=8932 CPUtime=0.1 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 2413 0 0 0 10 0 0 0 20 0 1 0 556928144 33148928 2233 33554432000 4194304 6211132 140730933274608 140730933271144 5076013 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8093 2233 864 493 0 1398 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32372 KiB
Current children cumulated memory: 8932 KiB

[startup+0.209653 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 1844
/proc/meminfo: memFree=30191720/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=32900 memory=9196 CPUtime=0.21 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 2525 0 0 0 21 0 0 0 20 0 1 0 556928144 33689600 2299 33554432000 4194304 6211132 140730933274608 140730933271144 5075124 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8225 2299 866 493 0 1530 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9196 KiB

[startup+0.308916 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 1844
/proc/meminfo: memFree=30191784/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=32900 memory=9460 CPUtime=0.31 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 2541 0 0 0 31 0 0 0 20 0 1 0 556928144 33689600 2365 33554432000 4194304 6211132 140730933274608 140730933272568 5081767 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8225 2365 866 493 0 1530 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9460 KiB

[startup+0.700232 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1844
/proc/meminfo: memFree=30191540/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33032 memory=9460 CPUtime=0.69 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 2563 0 0 0 69 0 0 0 20 0 1 0 556928144 33824768 2365 33554432000 4194304 6211132 140730933274608 140730933272568 5076336 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8258 2365 866 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+1.50022 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1844
/proc/meminfo: memFree=30191540/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33032 memory=9460 CPUtime=1.49 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 2570 0 0 0 149 0 0 0 20 0 1 0 556928144 33824768 2365 33554432000 4194304 6211132 140730933274608 140730933272568 5078762 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8258 2365 866 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+3.10894 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1845
/proc/meminfo: memFree=30191416/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9644 CPUtime=3.1 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 4032 0 0 0 310 0 0 0 20 0 1 0 556928144 33959936 2411 33554432000 4194304 6211132 140730933274608 140730933272200 5079295 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2411 866 493 0 1596 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9644 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1845
/proc/meminfo: memFree=30190032/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9716 CPUtime=6.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 5506 0 0 0 629 0 0 0 20 0 1 0 556928144 33959936 2429 33554432000 4194304 6211132 140730933274608 140730933272568 5393121 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2429 866 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9716 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1845
/proc/meminfo: memFree=30190620/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9736 CPUtime=12.69 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 6475 0 0 0 1269 0 0 0 20 0 1 0 556928144 33959936 2434 33554432000 4194304 6211132 140730933274608 140730933272568 5081349 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2434 866 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9736 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1845
/proc/meminfo: memFree=30190776/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9760 CPUtime=25.49 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 8404 0 0 0 2549 0 0 0 20 0 1 0 556928144 33959936 2440 33554432000 4194304 6211132 140730933274608 140730933272568 5079248 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2440 866 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9760 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1847
/proc/meminfo: memFree=30190840/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9780 CPUtime=51.1 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 9385 0 0 0 5110 0 0 0 20 0 1 0 556928144 33959936 2445 33554432000 4194304 6211132 140730933274608 140730933272568 5193728 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2445 866 493 0 1596 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9780 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1851
/proc/meminfo: memFree=30190236/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9792 CPUtime=102.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 10360 0 0 0 10229 0 0 0 20 0 1 0 556928144 33959936 2448 33554432000 4194304 6211132 140730933274608 140730933272568 5078762 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2448 866 493 0 1596 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1855
/proc/meminfo: memFree=30189572/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9796 CPUtime=162.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 11333 0 0 0 16229 0 0 0 20 0 1 0 556928144 33959936 2449 33554432000 4194304 6211132 140730933274608 140730933272568 5082800 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+222.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/199 1862
/proc/meminfo: memFree=30189908/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9796 CPUtime=222.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 11806 0 0 0 22229 0 0 0 20 0 1 0 556928144 33959936 2449 33554432000 4194304 6211132 140730933274608 140730933272568 5082358 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 1866
/proc/meminfo: memFree=30190172/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9800 CPUtime=282.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 12280 0 0 0 28229 0 0 0 20 0 1 0 556928144 33959936 2450 33554432000 4194304 6211132 140730933274608 140730933272568 5075597 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2450 866 493 0 1596 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9800 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 1870
/proc/meminfo: memFree=30190080/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9804 CPUtime=342.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 12754 0 0 0 34229 0 0 0 20 0 1 0 556928144 33959936 2451 33554432000 4194304 6211132 140730933274608 140730933272568 5186274 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2451 866 493 0 1596 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 1877
/proc/meminfo: memFree=30190328/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9804 CPUtime=402.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 13228 0 0 0 40229 0 0 0 20 0 1 0 556928144 33959936 2451 33554432000 4194304 6211132 140730933274608 140730933272568 5075234 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2451 866 493 0 1596 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/199 1881
/proc/meminfo: memFree=30189992/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9804 CPUtime=462.29 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 13702 0 0 0 46229 0 0 0 20 0 1 0 556928144 33959936 2451 33554432000 4194304 6211132 140730933274608 140730933272568 5078762 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2451 866 493 0 1596 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB


################
# More data... #
################

/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2007
/proc/meminfo: memFree=30188880/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=1782.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 22171 0 0 0 178231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5075208 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2013
/proc/meminfo: memFree=30188356/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=1842.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 22428 0 0 0 184231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5075448 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2019
/proc/meminfo: memFree=30187704/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=1902.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 22685 0 0 0 190231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5076389 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2023
/proc/meminfo: memFree=30188352/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=1962.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 23160 0 0 0 196231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5082423 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 1962.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2030
/proc/meminfo: memFree=30188320/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=2022.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 23413 0 0 0 202231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5083023 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 2022.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2034
/proc/meminfo: memFree=30188440/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=2082.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 23666 0 0 0 208231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5082367 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 2082.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2039
/proc/meminfo: memFree=30188672/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9808 CPUtime=2142.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 23919 0 0 0 214231 1 0 0 20 0 1 0 556928144 33959936 2452 33554432000 4194304 6211132 140730933274608 140730933272568 5075208 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2046
/proc/meminfo: memFree=30187944/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2202.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 24398 0 0 0 220231 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5082423 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2050
/proc/meminfo: memFree=30187700/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2262.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 24654 0 0 0 226231 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5081280 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2262.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2061
/proc/meminfo: memFree=30188176/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2322.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 24910 0 0 0 232231 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5081669 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2322.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB

[startup+2382.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/200 2090
/proc/meminfo: memFree=30187872/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2382.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 25166 0 0 0 238231 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5078748 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2382.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB

[startup+2442.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2094
/proc/meminfo: memFree=30188132/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2442.32 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 25641 0 0 0 244231 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5081431 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2442.32 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB

[startup+2502.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 2160
/proc/meminfo: memFree=29840220/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2502.33 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 25897 0 0 0 250232 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5081341 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2502.33 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.02 2.05 3/200 2162
/proc/meminfo: memFree=29653824/32770624 swapFree=66954180/67108860
[pid=1843] ppid=1840 vsize=33164 memory=9812 CPUtime=2520.03 cores=1,3,5,7
/proc/1843/stat : 1843 (cosoco) R 1840 1843 30008 0 -1 4202496 26153 0 0 0 252002 1 0 0 20 0 1 0 556928144 33959936 2453 33554432000 4194304 6211132 140730933274608 140730933272568 5081341 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8482816 140730933277707 140730933277809 140730933277809 140730933280718 0
/proc/1843/statm: 8291 2453 866 493 0 1596 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9812 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 1843 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.03 s, system=0.012 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.04
CPU user time (s): 2520.03
CPU system time (s): 0.012
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 33164
Max. memory (cumulated for all children) (KiB): 9812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.03
system time used= 0.012
maximum resident set size= 9876
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26206
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 651


# summary of solver processes directly reported to runsolver:
#   pid: 1843
#   total CPU time (s): 2520.04
#   total CPU user time (s): 2520.03
#   total CPU system time (s): 0.012

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.76534 second user time and 16.0458 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-30 04:21:33
IDJOB=4408104
IDBENCH=138957
IDSOLVER=2874
FILE ID=node119/4408104-1569810134
RUNJOBID= node119-1569787352-30040
PBS_JOBID= 21705833
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-19.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408104-1569810134/watcher-4408104-1569810134 -o /tmp/evaluation-result-4408104-1569810134/solver-4408104-1569810134 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30040 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408104-1569810134.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3875648f967e99deb98809a056dae84c
RANDOM SEED=1186421038

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30197220 kB
MemAvailable:   31822912 kB
Buffers:          217296 kB
Cached:          1746516 kB
SwapCached:        46700 kB
Active:          1081140 kB
Inactive:         940408 kB
Active(anon):      21832 kB
Inactive(anon):   117712 kB
Active(file):    1059308 kB
Inactive(file):   822696 kB
Unevictable:      107588 kB
Mlocked:          107588 kB
SwapTotal:      67108860 kB
SwapFree:       66954180 kB
Dirty:              2828 kB
Writeback:            52 kB
AnonPages:         67032 kB
Mapped:            28740 kB
Shmem:             73180 kB
Slab:             148988 kB
SReclaimable:     119048 kB
SUnreclaim:        29940 kB
KernelStack:        3776 kB
PageTables:         5028 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     575108 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     14336 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 62024 MiB
End job on node119 at 2019-09-30 05:03:33