Trace number 4408103

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.03 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-11.xml
MD5SUM593ac311ff8adf8f7756cc1eeec69a70
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark18.7897
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4768        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408103-1569810075.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            963            12084          34674          882            0              576   623   590
0.09/0.13	c 211            2059           24017          83448          882            0              417   649   624
0.20/0.28	c 332            3943           50252          195919         882            0              335   663   621
0.40/0.44	c 465            5511           80112          338350         882            0              609   682   653
0.50/0.60	c 611            7360           109453         461550         882            0              436   724   680
0.69/0.73	c 771            8706           132589         564820         882            0              575   669   647
0.89/0.92	c 947            11138          166626         731575         882            0              604   731   688
0.99/1.03	c 1140           13069          188120         827573         882            0              596   722   683
1.19/1.21	c 1352           14902          219665         991697         882            0              582   722   691
1.39/1.41	c 1585           17504          256019         1169949        882            0              662   725   691
1.59/1.67	c 1841           19592          301784         1381330        882            0              601   667   629
1.89/1.99	c 2122           22415          359980         1652813        882            0              542   705   664
1.99/2.09	c 2431           23933          376842         1731712        882            0              550   568   557
2.19/2.21	c 2770           25789          398073         1821852        882            0              539   677   547
2.29/2.30	c 3142           27655          415609         1897096        882            0              531   711   557
2.59/2.68	c 3551           31230          483411         2212039        882            0              529   725   674
2.89/2.97	c 4000           33646          535569         2470443        882            0              531   685   647
3.09/3.11	c 4493           36199          560654         2584820        882            0              533   638   606
3.69/3.78	c 5035           41391          679503         3197121        882            0              537   724   692
4.29/4.32	c 5631           45217          774880         3669764        882            0              551   707   678
4.79/4.89	c 6286           50058          876746         4169118        882            0              552   724   687
5.49/5.56	c 7006           55743          995278         4785993        882            0              556   721   690
6.09/6.19	c 7798           61825          1107194        5377528        882            0              563   723   690
6.69/6.72	c 8669           67244          1204452        5809598        882            0              566   709   663
7.29/7.31	c 9627           73042          1309352        6343588        882            0              598   700   666
8.09/8.15	c 10680          80729          1459362        7049569        882            0              630   727   671
8.78/8.89	c 11838          88105          1590484        7706169        882            0              568   713   678
9.68/9.78	c 13111          95638          1748515        8508041        882            0              570   694   656
10.99/11.09	c 14511          108704         1983590        9644389        882            0              564   733   678
12.58/12.67	c 16051          119439         2264842        11073414       882            0              559   723   691
13.99/14.05	c 17745          131601         2512082        12405412       882            0              628   719   692
15.59/15.63	c 19608          145730         2794203        13801931       882            0              658   728   690
17.10/17.12	c 21657          157888         3056500        15338363       882            0              589   714   685
18.79/18.84	c 23910          170767         3358736        16829392       882            0              571   712   676
20.89/20.96	c 26388          187487         3737944        18710256       882            0              605   708   667
23.00/23.06	c 29113          204906         4110391        20773378       882            0              626   706   673
25.79/25.86	c 32110          230917         4613458        23283179       882            0              655   748   705
28.59/28.62	c 35406          256806         5108298        25809658       882            0              592   741   698
31.59/31.69	c 39031          281044         5657387        28537263       882            0              607   719   677
35.79/35.86	c 43018          318956         6403814        32310256       882            0              649   737   691
40.49/40.52	c 47403          355035         7231696        36658900       882            0              639   724   682
44.29/44.34	c 52226          386509         7903262        40465714       882            0              623   728   696
49.29/49.39	c 57531          419773         8801745        45225717       882            0              623   723   688
53.59/53.66	c 63366          453755         9564335        49467573       882            0              666   739   699
58.49/58.59	c 69784          499253         10454429       54033488       882            0              598   743   701
66.39/66.48	c 76843          559290         11851280       61398097       882            0              604   735   678
73.89/73.95	c 84607          608805         13163654       68274488       882            0              632   724   686
80.59/80.69	c 93147          671694         14378464       74163201       882            0              599   726   678
90.19/90.20	c 102541         742039         16068138       83023775       882            0              633   742   694
100.00/100.00	c 112874         824943         17814778       92000669       882            0              631   737   690
108.00/108.06	c 124240         898037         19245225       99692334       882            0              648   742   693
118.19/118.25	c 136742         983146         21058781       109543508      882            0              601   748   691
128.39/128.45	c 150494         1059715        22853757       119088326      882            0              599   720   680
141.10/141.14	c 165621         1165302        25127314       130666317      882            0              556   745   692
153.90/153.98	c 182260         1280490        27412138       142413594      882            0              583   733   692
167.10/167.18	c 200562         1395591        29755116       154332411      882            0              577   733   683
183.20/183.20	c 220694         1510898        32566489       170533369      882            0              563   732   689
198.89/198.99	c 242839         1670492        35383077       183741627      882            0              568   704   662
225.10/225.14	c 267198         1863670        40017822       207998006      882            0              575   756   693
256.79/256.81	c 293992         2062562        45619051       235768402      882            0              607   734   692
284.49/284.58	c 323465         2258423        50551610       260306056      882            0              646   732   689
312.19/312.20	c 355885         2465173        55477948       284103561      882            0              608   732   677
338.39/338.45	c 391547         2685774        60164785       307409960      882            0              650   732   690
376.89/376.91	c 430775         2975390        66986118       341668654      882            0              605   736   683
414.49/414.52	c 473925         3248552        73651147       375616916      882            0              590   727   681
457.89/458.00	c 521390         3570125        81367465       415470612      882            0              638   725   681
494.49/494.50	c 573601         3946811        87951708       446546210      882            0              607   732   686
534.19/534.23	c 631033         4323345        95099159       482016120      882            0              638   723   684
573.29/573.35	c 694208         4702330        102130974      516695377      882            0              642   737   695
625.69/625.77	c 763700         5136937        111500515      567567034      882            0              595   748   698
686.49/686.56	c 840141         5620253        122306909      621912432      882            0              633   730   682
756.89/756.91	c 924226         6191872        134796202      685961124      882            0              628   740   683
820.39/820.46	c 1016719        6748447        146100333      748062609      882            0              608   730   685
906.00/906.02	c 1118461        7427284        161337824      831036559      882            0              554   744   695
974.19/974.22	c 1230377        8095061        173772930      895521344      882            0              602   752   702
1050.10/1050.19	c 1353484        8751058        187467121      966148141      882            0              630   732   682
1137.89/1137.95	c 1488901        9474723        203188911      1047554601     882            0              624   744   688
1239.10/1239.11	c 1637859        10271668       221269264      1138117490     882            0              586   730   683
1336.39/1336.43	c 1801712        11145984       238692752      1228633291     882            0              614   727   684
1482.89/1482.97	c 1981950        12303473       264899117      1370703814     882            0              603   753   700
1647.90/1647.98	c 2180211        13447304       294200204      1526734205     882            0              597   729   685
1836.50/1836.50	c 2398298        14789174       327587586      1705947240     882            0              603   739   686
2053.11/2053.19	c 2638193        16318653       366034749      1900772280     882            0              616   724   675
2294.61/2294.65	c 2902077        18126767       409204224      2121414661     882            0              611   732   678
2504.92/2504.92	c 3192349        19829604       446893867      2313917507     882            0              618   753   679
2520.03/2520.00	
2520.03/2520.00	c *** INTERRUPTED ***
2520.03/2520.00	c restarts              : 85          
2520.03/2520.00	c conflicts             : 3210044      (1274 /sec)
2520.03/2520.00	c decisions             : 19954390     (7918 /sec)
2520.03/2520.00	c propagations          : 2327556088  (923629 /sec)
2520.03/2520.00	c root propagations     : 4768        
2520.03/2520.00	c filter calls          : 449600539      (178412 /sec)
2520.03/2520.00	c useless filter calls  : 112504665      (25 %)
2520.03/2520.00	c Memory used           : 32.52 MB
2520.03/2520.00	c CPU time              : 2520.01 s
2520.03/2520.00	c real time             : 2520 s
2520.03/2520.00	
2520.03/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15147 MiB free)
  memory of node 1: 16384 MiB (13481 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408103-1569810075/watcher-4408103-1569810075 -o /tmp/evaluation-result-4408103-1569810075/solver-4408103-1569810075 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node125-1569787350-17998 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408103-1569810075.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22498, runsolver pid=22495
Current StackSize limit: 8192 KiB


[startup+0.100198 s]*
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29311300/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=32636 memory=9200 CPUtime=0.09 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 2480 0 0 0 9 0 0 0 20 0 1 0 557274202 33419264 2300 33554432000 4194304 6211132 140728455803712 140728455800248 5081382 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8159 2300 866 493 0 1464 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 32636 KiB
Current children cumulated memory: 9200 KiB

[startup+0.20977 s]*
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29310928/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33032 memory=9464 CPUtime=0.2 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 2556 0 0 0 20 0 0 0 20 0 1 0 557274202 33824768 2366 33554432000 4194304 6211132 140728455803712 140728455800248 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+0.309261 s]*
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29310928/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33032 memory=9464 CPUtime=0.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 2562 0 0 0 30 0 0 0 20 0 1 0 557274202 33824768 2366 33554432000 4194304 6211132 140728455803712 140728455800248 5078695 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+0.700343 s]
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29310928/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33032 memory=9464 CPUtime=0.69 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 2575 0 0 0 69 0 0 0 20 0 1 0 557274202 33824768 2366 33554432000 4194304 6211132 140728455803712 140728455801672 5082261 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+1.50033 s]
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29310428/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33032 memory=9464 CPUtime=1.49 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 2578 0 0 0 149 0 0 0 20 0 1 0 557274202 33824768 2366 33554432000 4194304 6211132 140728455803712 140728455801672 5076410 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+3.10929 s]
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29310484/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33032 memory=9680 CPUtime=3.09 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 4037 0 0 0 309 0 0 0 20 0 1 0 557274202 33824768 2420 33554432000 4194304 6211132 140728455803712 140728455801672 5081754 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8258 2420 866 493 0 1563 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9680 KiB

[startup+6.30033 s]
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29310204/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33164 memory=9700 CPUtime=6.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 5506 0 0 0 629 0 0 0 20 0 1 0 557274202 33959936 2425 33554432000 4194304 6211132 140728455803712 140728455801672 5082401 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8291 2425 866 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9700 KiB

[startup+12.7003 s]
/proc/loadavg: 2.02 2.01 2.05 3/200 22499
/proc/meminfo: memFree=29309692/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33164 memory=9744 CPUtime=12.68 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 6988 0 0 0 1268 0 0 0 20 0 1 0 557274202 33959936 2436 33554432000 4194304 6211132 140728455803712 140728455801672 5075761 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8291 2436 866 493 0 1596 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9744 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.01 2.05 3/200 22501
/proc/meminfo: memFree=29308672/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33164 memory=9768 CPUtime=25.49 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 9941 0 0 0 2548 1 0 0 20 0 1 0 557274202 33959936 2442 33554432000 4194304 6211132 140728455803712 140728455801672 5081706 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8291 2442 866 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+51.1092 s]
/proc/loadavg: 2.01 2.01 2.05 3/200 22502
/proc/meminfo: memFree=29308328/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33164 memory=9776 CPUtime=51.1 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 11421 0 0 0 5109 1 0 0 20 0 1 0 557274202 33959936 2444 33554432000 4194304 6211132 140728455803712 140728455801672 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8291 2444 866 493 0 1596 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9776 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22506
/proc/meminfo: memFree=29307936/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33164 memory=9784 CPUtime=102.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 12916 0 0 0 10228 1 0 0 20 0 1 0 557274202 33959936 2446 33554432000 4194304 6211132 140728455803712 140728455801672 5074537 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22512
/proc/meminfo: memFree=29306468/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33164 memory=9808 CPUtime=162.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 14406 0 0 0 16229 1 0 0 20 0 1 0 557274202 33959936 2452 33554432000 4194304 6211132 140728455803712 140728455801672 5082405 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22516
/proc/meminfo: memFree=29305492/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9812 CPUtime=222.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 15899 0 0 0 22228 1 0 0 20 0 1 0 557274202 34095104 2453 33554432000 4194304 6211132 140728455803712 140728455801304 5079440 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2453 866 493 0 1629 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22521
/proc/meminfo: memFree=29305340/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9820 CPUtime=282.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 17384 0 0 0 28228 1 0 0 20 0 1 0 557274202 34095104 2455 33554432000 4194304 6211132 140728455803712 140728455801672 5078894 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2455 866 493 0 1629 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9820 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22527
/proc/meminfo: memFree=29304492/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9820 CPUtime=342.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 18879 0 0 0 34228 1 0 0 20 0 1 0 557274202 34095104 2455 33554432000 4194304 6211132 140728455803712 140728455801672 5074392 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2455 866 493 0 1629 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9820 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22531
/proc/meminfo: memFree=29303796/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9824 CPUtime=402.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 20369 0 0 0 40228 1 0 0 20 0 1 0 557274202 34095104 2456 33554432000 4194304 6211132 140728455803712 140728455801672 5081301 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22536
/proc/meminfo: memFree=29303228/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9828 CPUtime=462.29 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 21854 0 0 0 46228 1 0 0 20 0 1 0 557274202 34095104 2457 33554432000 4194304 6211132 140728455803712 140728455801672 5079348 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB


################
# More data... #
################

/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 1722.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22662
/proc/meminfo: memFree=29297140/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=1782.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 37021 0 0 0 178229 1 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5078953 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 1782.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22666
/proc/meminfo: memFree=29296844/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=1842.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 37520 0 0 0 184229 1 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5081367 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 1842.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+1902.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/199 22670
/proc/meminfo: memFree=29297260/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=1902.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 37773 0 0 0 190229 1 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5193728 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 1902.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+1962.3 s]
/proc/loadavg: 2.12 2.05 2.05 3/199 22676
/proc/meminfo: memFree=29297056/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=1962.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 38029 0 0 0 196229 1 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5074575 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 1962.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.06 2.05 3/199 22680
/proc/meminfo: memFree=29296448/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2022.3 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 38287 0 0 0 202229 1 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5079072 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2022.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2082.3 s]
/proc/loadavg: 2.09 2.06 2.05 3/199 22746
/proc/meminfo: memFree=30871448/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2082.31 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 38789 0 0 0 208229 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5074621 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.05 2.05 3/199 22752
/proc/meminfo: memFree=30241308/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2142.31 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 39033 0 0 0 214229 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5079258 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2142.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/199 22756
/proc/meminfo: memFree=29612556/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2202.31 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 39301 0 0 0 220229 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5076301 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2202.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 22761
/proc/meminfo: memFree=28981608/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2262.31 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 39550 0 0 0 226229 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2262.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2322.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/199 22767
/proc/meminfo: memFree=28352420/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2322.31 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 40048 0 0 0 232229 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5082827 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2322.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2382.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 22779
/proc/meminfo: memFree=27721640/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2382.32 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 40305 0 0 0 238230 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5081371 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2382.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/201 22806
/proc/meminfo: memFree=27092492/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2442.32 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 40561 0 0 0 244230 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5078953 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2442.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 22812
/proc/meminfo: memFree=26461308/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2502.32 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 40825 0 0 0 250230 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5074940 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2502.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.02 2.05 3/201 22813
/proc/meminfo: memFree=26272524/32770624 swapFree=66975648/67108860
[pid=22498] ppid=22495 vsize=33296 memory=9832 CPUtime=2520.03 cores=0,2,4,6
/proc/22498/stat : 22498 (cosoco) R 22495 22498 17967 0 -1 4202496 41301 0 0 0 252001 2 0 0 20 0 1 0 557274202 34095104 2458 33554432000 4194304 6211132 140728455803712 140728455801672 5082385 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22941696 140728455808011 140728455808113 140728455808113 140728455811022 0
/proc/22498/statm: 8324 2458 866 493 0 1629 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9832 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 22498 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.01 s, system=0.021 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.03
CPU user time (s): 2520.01
CPU system time (s): 0.021
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.01
system time used= 0.021
maximum resident set size= 9896
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 41353
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 3152


# summary of solver processes directly reported to runsolver:
#   pid: 22498
#   total CPU time (s): 2520.03
#   total CPU user time (s): 2520.01
#   total CPU system time (s): 0.021

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.18783 second user time and 16.4961 second system time

The end

Launcher Data 

Begin job on node125 at 2019-09-30 04:20:31
IDJOB=4408103
IDBENCH=138937
IDSOLVER=2874
FILE ID=node125/4408103-1569810075
RUNJOBID= node125-1569787350-17998
PBS_JOBID= 21705828
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408103-1569810075/watcher-4408103-1569810075 -o /tmp/evaluation-result-4408103-1569810075/solver-4408103-1569810075 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node125-1569787350-17998 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408103-1569810075.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 593ac311ff8adf8f7756cc1eeec69a70
RANDOM SEED=2110093914

node125.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29317404 kB
MemAvailable:   29699364 kB
Buffers:          202840 kB
Cached:           517340 kB
SwapCached:        29880 kB
Active:          2544476 kB
Inactive:         356796 kB
Active(anon):    2163980 kB
Inactive(anon):    97756 kB
Active(file):     380496 kB
Inactive(file):   259040 kB
Unevictable:      107476 kB
Mlocked:          107476 kB
SwapTotal:      67108860 kB
SwapFree:       66975648 kB
Dirty:              2768 kB
Writeback:             0 kB
AnonPages:       2268408 kB
Mapped:            28520 kB
Shmem:             72028 kB
Slab:             145660 kB
SReclaimable:     116516 kB
SUnreclaim:        29144 kB
KernelStack:        3776 kB
PageTables:         9948 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2714852 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    796672 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 62024 MiB
End job on node125 at 2019-09-30 05:02:32