Trace number 4268060

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.01 2519.7

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gs/
qwh-o035-h405.xml
MD5SUM3223705abdf773009dcd28d689e47bd8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark12.0507
Satisfiable
(Un)Satisfiability was proved
Number of variables1225
Number of constraints2
Number of domains1
Minimum domain size35
Maximum domain size35
Distribution of domain sizes[{"size":35,"count":1225}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":405},{"degree":2,"count":820}]
Minimum constraint arity820
Maximum constraint arity1225
Distribution of constraint arities[{"arity":820,"count":1},{"arity":1225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.04	c root propagations     : 9644        
0.00/0.04	c restarts enabled, print stats at every restarts
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c This is cosoco 1.12 --  
0.00/0.04	c
0.00/0.04	c command line: cosoco -lc -model -restarts HOME/instance-4268060-1502585061.xml 
0.00/0.04	c ========================================[ Problem Statistics ]===========================================
0.00/0.04	c |                                                                                                       
0.00/0.04	c |  Parse time        :         0.01 s 
0.00/0.04	c |
0.00/0.04	c |               Variables: 1225
0.00/0.04	c |            Domain Sizes: 35..35
0.00/0.04	c |
0.00/0.04	c |             Constraints: 890
0.00/0.04	c |                   Arity: 1..35  -- Unary: 820
0.00/0.04	c | 
0.00/0.04	c |                   Types: 
0.00/0.04	c |                          All Different: 70
0.00/0.04	c |                          Unary: 820
0.00/0.04	c |                          
0.00/0.04	c =========================================================================================================
0.00/0.04	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.09/0.15	c 101            1472           23326          94326          1221           0              926   982   954
0.20/0.25	c 211            3916           40430          154029         1221           0              514   897   762
0.30/0.38	c 332            5975           62853          263451         1221           0              603   892   840
0.40/0.48	c 465            7485           78852          340701         1221           0              770   896   857
0.50/0.57	c 611            9214           93705          404542         1221           0              777   854   811
0.69/0.74	c 771            11080          120730         540330         1221           0              758   937   896
0.79/0.82	c 947            12799          134560         600671         1221           0              817   958   916
0.89/0.97	c 1140           15242          159513         725439         1221           0              757   987   953
1.09/1.12	c 1352           17484          183827         832375         1221           0              822   943   910
1.29/1.31	c 1585           19513          215562         986976         1221           0              816   959   925
1.49/1.55	c 1841           22151          253509         1191121        1221           0              827   1007   955
1.69/1.76	c 2122           24237          286585         1382879        1221           0              869   962   928
1.89/1.97	c 2431           26485          319165         1564950        1221           0              806   985   944
2.19/2.29	c 2770           29794          370137         1837814        1221           0              814   963   927
2.58/2.60	c 3142           32209          419758         2086321        1221           0              820   960   936
2.88/2.97	c 3551           35300          478625         2413924        1221           0              823   957   924
3.28/3.35	c 4000           38467          538184         2727228        1221           0              824   971   931
3.78/3.87	c 4493           42918          621298         3153236        1221           0              828   967   931
4.09/4.11	c 5035           45744          660808         3348405        1221           0              827   1000   969
4.48/4.52	c 5631           49272          723700         3703622        1221           0              801   982   954
4.99/5.03	c 6286           54410          805083         4140473        1221           0              810   1002   962
5.58/5.67	c 7006           58331          903415         4797004        1221           0              836   989   958
6.18/6.23	c 7798           63407          993394         5277817        1221           0              883   992   955
6.58/6.65	c 8669           68852          1062529        5649461        1221           0              875   1007   947
7.28/7.31	c 9627           75157          1169979        6213364        1221           0              883   1011   959
7.88/7.98	c 10680          81549          1276857        6821797        1221           0              895   1002   961
8.88/8.97	c 11838          88536          1435659        7720445        1221           0              875   1018   980
9.68/9.70	c 13111          95816          1553563        8366167        1221           0              868   997   942
10.58/10.68	c 14511          103502         1711019        9250487        1221           0              868   1042   999
11.68/11.71	c 16051          112370         1874576        10116345       1221           0              866   992   952
12.58/12.67	c 17745          122732         2030894        10891484       1221           0              838   1024   961
14.18/14.26	c 19608          136712         2285294        12346049       1221           0              860   1013   969
15.99/16.06	c 21657          149148         2570748        13988021       1221           0              852   1011   949
17.48/17.53	c 23910          165440         2809935        15133666       1221           0              835   1019   950
19.38/19.42	c 26388          183461         3117281        16783328       1221           0              1   1029   988 
22.28/22.33	c 29113          201339         3577737        19395514       1221           0              857   1014   971
24.48/24.55	c 32110          220681         3933271        21410041       1221           0              859   1018   976
26.99/27.09	c 35406          245660         4346316        23417736       1221           0              866   1012   960
29.88/29.98	c 39031          265502         4802612        26094709       1221           0              875   1032   977
32.68/32.77	c 43018          284868         5246445        28887531       1221           0              939   1042   1008
36.48/36.51	c 47403          315557         5848786        32308022       1221           0              887   1039   975
40.09/40.14	c 52226          341794         6430991        35414063       1221           0              885   1002   950
43.38/43.43	c 57531          366541         6953898        38395061       1221           0              884   1028   978
47.58/47.68	c 63366          407371         7636330        41928099       1221           0              911   1026   969
52.38/52.44	c 69784          438052         8388453        46264444       1221           0              897   999   952
57.28/57.31	c 76843          473439         9167812        50702581       1221           0              894   999   947
62.99/63.10	c 84607          522690         10090964       55999273       1221           0              878   1012   952
68.18/68.24	c 93147          563263         10906370       60999686       1221           0              928   1033   985
75.38/75.44	c 102541         608486         12048104       67450536       1221           0              901   1009   964
81.89/81.95	c 112874         656555         13079001       73696227       1221           0              861   1007   959
90.59/90.64	c 124240         727378         14487859       81237708       1221           0              846   1013   964
99.59/99.68	c 136742         795397         15931063       89837966       1221           0              856   1032   978
107.89/107.99	c 150494         873191         17277838       97003958       1221           0              845   1015   952
118.69/118.74	c 165621         979108         19027935       106145647      1221           0              862   1003   943
130.89/130.92	c 182260         1072271        20997747       117035444      1221           0              812   1022   974
148.50/148.56	c 200562         1206153        23814975       132753909      1221           0              859   1039   964
163.01/163.05	c 220694         1326605        26163042       145724679      1221           0              869   1027   961
184.60/184.60	c 242839         1487273        29631329       165385840      1221           0              877   1014   946
200.11/200.17	c 267198         1617334        32143913       179672263      1221           0              858   1039   946
219.91/219.92	c 293992         1802042        35326413       196670783      1221           0              842   1004   932
236.61/236.64	c 323465         1978730        38053157       212314427      1221           0              823   1041   986
257.51/257.56	c 355885         2156191        41441612       231144007      1221           0              833   1048   979
281.51/281.58	c 391547         2334743        45299485       253088152      1221           0              840   1002   941
306.22/306.21	c 430775         2517667        49255806       275108371      1221           0              816   1031   976
337.82/337.82	c 473925         2765269        54344604       302285236      1221           0              854   1006   928
373.23/373.20	c 521390         3092845        60054120       333097428      1221           0              839   1027   935
411.73/411.78	c 573601         3437540        66350358       367363061      1221           0              839   1058   963
444.74/444.73	c 631033         3773639        71708491       395253899      1221           0              833   984   911
488.24/488.22	c 694208         4114023        78678058       433418242      1221           0              809   1009   942
530.95/530.99	c 763700         4475763        85554896       472506505      1221           0              809   1031   974
582.55/582.59	c 840141         4917525        93861026       518575625      1221           0              818   1024   943
642.36/642.36	c 924226         5352621        103401679      574751161      1221           0              830   1026   972
704.97/704.91	c 1016719        5833102        113432936      630750518      1221           0              837   1027   962
772.68/772.67	c 1118461        6308877        124316608      692961656      1221           0              849   1018   963
857.10/857.01	c 1230377        6946952        137864058      768325885      1221           0              848   1019   956
956.21/956.19	c 1353484        7713395        153829719      854288971      1221           0              841   1014   952
1067.31/1067.20	c 1488901        8513714        171551195      951982755      1221           0              857   1020   968
1156.23/1156.14	c 1637859        9113052        185795889      1033673544     1221           0              834   1025   973
1271.64/1271.53	c 1801712        10480812       204817628      1131053789     1221           0              840   1020   943
1403.66/1403.50	c 1981950        11625427       226051948      1245241732     1221           0              859   1014   948
1567.88/1567.78	c 2180211        12937123       252439280      1400459461     1221           0              845   1058   978
1714.20/1714.04	c 2398298        14089279       275942609      1538220963     1221           0              838   1043   981
1885.33/1885.16	c 2638193        15332577       303380103      1698226013     1221           0              855   1051   975
2082.84/2082.66	c 2902077        16773297       335100629      1878444922     1221           0              855   1023   960
2346.68/2346.44	c 3192349        18431918       377215113      2115988929     1221           0              859   1027   968
2520.00/2519.70	
2520.00/2519.70	c *** INTERRUPTED ***
2520.00/2519.70	c restarts              : 85          
2520.00/2519.70	c conflicts             : 3438858      (1365 /sec)
2520.00/2519.70	c decisions             : 19814834     (7863 /sec)
2520.00/2519.70	c propagations          : 2278597184  (904207 /sec)
2520.00/2519.70	c root propagations     : 9644        
2520.00/2519.70	c filter calls          : 404921757      (160684 /sec)
2520.00/2519.70	c useless filter calls  : 109057095      (26 %)
2520.00/2519.70	c Memory used           : 37.50 MB
2520.00/2519.70	c CPU time              : 2520 s
2520.00/2519.70	
2520.00/2519.70	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11745 MiB free)
  memory of node 1: 16384 MiB (14932 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4268060-1502585061/watcher-4268060-1502585061 -o /tmp/evaluation-result-4268060-1502585061/solver-4268060-1502585061 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1502571587-3599 --watchdog 2580 cosoco -lc -model -restarts HOME/instance-4268060-1502585061.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=4825, runsolver pid=4822
Current StackSize limit: 8192 KiB


[startup+0.100747 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27309480/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=36680 memory=13096 CPUtime=0.09 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 3439 0 0 0 9 0 0 0 20 0 1 0 91587270 37560320 3274 33554432000 4194304 5972588 140720698740192 140720698736856 4978757 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9170 3274 772 435 0 2533 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 36680 KiB
Current children cumulated memory: 13096 KiB

[startup+0.209658 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27308752/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=37736 memory=13888 CPUtime=0.2 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 3694 0 0 0 20 0 0 0 20 0 1 0 91587270 38641664 3472 33554432000 4194304 5972588 140720698740192 140720698736856 4978757 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9434 3472 774 435 0 2797 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 37736 KiB
Current children cumulated memory: 13888 KiB

[startup+0.309024 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27308380/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=37736 memory=14152 CPUtime=0.3 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 3722 0 0 0 30 0 0 0 20 0 1 0 91587270 38641664 3538 33554432000 4194304 5972588 140720698740192 140720698736856 4970903 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9434 3538 774 435 0 2797 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 37736 KiB
Current children cumulated memory: 14152 KiB

[startup+0.700227 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27308380/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38000 memory=14416 CPUtime=0.69 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 3779 0 0 0 69 0 0 0 20 0 1 0 91587270 38912000 3604 33554432000 4194304 5972588 140720698740192 140720698736856 4975216 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9500 3604 774 435 0 2863 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38000 KiB
Current children cumulated memory: 14416 KiB

[startup+1.50023 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307760/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38264 memory=14416 CPUtime=1.49 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 3832 0 0 0 149 0 0 0 20 0 1 0 91587270 39182336 3604 33554432000 4194304 5972588 140720698740192 140720698737496 4978123 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9566 3604 774 435 0 2929 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 38264 KiB
Current children cumulated memory: 14416 KiB

[startup+3.10898 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307884/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38264 memory=14692 CPUtime=3.09 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 6406 0 0 0 309 0 0 0 20 0 1 0 91587270 39182336 3673 33554432000 4194304 5972588 140720698740192 140720698737496 4978757 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9566 3673 774 435 0 2929 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 38264 KiB
Current children cumulated memory: 14692 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307256/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38264 memory=14720 CPUtime=6.28 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 9026 0 0 0 628 0 0 0 20 0 1 0 91587270 39182336 3680 33554432000 4194304 5972588 140720698740192 140720698737496 5328510 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9566 3680 774 435 0 2929 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 38264 KiB
Current children cumulated memory: 14720 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307508/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38264 memory=14748 CPUtime=12.68 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 9273 0 0 0 1268 0 0 0 20 0 1 0 91587270 39182336 3687 33554432000 4194304 5972588 140720698740192 140720698737496 4972071 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9566 3687 774 435 0 2929 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 38264 KiB
Current children cumulated memory: 14748 KiB

[startup+25.5002 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307632/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14784 CPUtime=25.48 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 9756 0 0 0 2548 0 0 0 20 0 1 0 91587270 39317504 3696 33554432000 4194304 5972588 140720698740192 140720698737496 4977653 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3696 774 435 0 2962 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14784 KiB

[startup+51.1089 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307756/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14788 CPUtime=51.09 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10016 0 0 0 5109 0 0 0 20 0 1 0 91587270 39317504 3697 33554432000 4194304 5972588 140720698740192 140720698737496 4975305 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3697 774 435 0 2962 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14788 KiB

[startup+102.3 s]
/proc/loadavg: 1.95 2.00 2.04 3/188 4827
/proc/meminfo: memFree=27307528/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14792 CPUtime=102.29 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10264 0 0 0 10228 1 0 0 20 0 1 0 91587270 39317504 3698 33554432000 4194304 5972588 140720698740192 140720698737496 4979139 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3698 774 435 0 2962 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14792 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/188 4828
/proc/meminfo: memFree=27307696/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14800 CPUtime=162.3 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10503 0 0 0 16229 1 0 0 20 0 1 0 91587270 39317504 3700 33554432000 4194304 5972588 140720698740192 140720698737496 4972116 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3700 774 435 0 2962 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14800 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/188 4829
/proc/meminfo: memFree=27307696/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14800 CPUtime=222.31 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10751 0 0 0 22230 1 0 0 20 0 1 0 91587270 39317504 3700 33554432000 4194304 5972588 140720698740192 140720698737496 4978779 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3700 774 435 0 2962 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14800 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 4891
/proc/meminfo: memFree=26359588/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14800 CPUtime=282.31 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10753 0 0 0 28230 1 0 0 20 0 1 0 91587270 39317504 3700 33554432000 4194304 5972588 140720698740192 140720698737496 5099630 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3700 774 435 0 2962 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14800 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4892
/proc/meminfo: memFree=24472204/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14804 CPUtime=342.32 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10992 0 0 0 34231 1 0 0 20 0 1 0 91587270 39317504 3701 33554432000 4194304 5972588 140720698740192 140720698737496 4978110 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3701 774 435 0 2962 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14804 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4893
/proc/meminfo: memFree=24471844/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14804 CPUtime=402.33 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 10995 0 0 0 40232 1 0 0 20 0 1 0 91587270 39317504 3701 33554432000 4194304 5972588 140720698740192 140720698737496 4977727 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3701 774 435 0 2962 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14804 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4894
/proc/meminfo: memFree=24471320/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14808 CPUtime=462.34 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 11234 0 0 0 46233 1 0 0 20 0 1 0 91587270 39317504 3702 33554432000 4194304 5972588 140720698740192 140720698737496 4972741 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3702 774 435 0 2962 0
Current children cumulated CPU time: 462.34 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14808 KiB


################
# More data... #
################

/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 1782.51 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4942
/proc/meminfo: memFree=24462032/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=1842.51 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 13788 0 0 0 184250 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4975428 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 1842.51 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4965
/proc/meminfo: memFree=24460996/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=1902.52 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14037 0 0 0 190251 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4978576 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 1902.52 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4966
/proc/meminfo: memFree=24460256/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=1962.53 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14038 0 0 0 196252 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4970781 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 1962.53 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4967
/proc/meminfo: memFree=24458900/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2022.54 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14085 0 0 0 202253 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4972357 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2022.54 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4968
/proc/meminfo: memFree=24458528/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2082.54 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14087 0 0 0 208253 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4972625 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2082.54 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4969
/proc/meminfo: memFree=24458592/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2142.55 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14343 0 0 0 214254 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4978779 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2142.55 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4970
/proc/meminfo: memFree=24459412/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2202.56 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14343 0 0 0 220255 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4975613 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2202.56 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4970
/proc/meminfo: memFree=24459280/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2262.57 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14395 0 0 0 226256 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4978839 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2262.57 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4971
/proc/meminfo: memFree=24459684/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2322.57 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14395 0 0 0 232256 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4972728 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2322.57 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4972
/proc/meminfo: memFree=24459280/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2382.58 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14648 0 0 0 238257 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4971009 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2382.58 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4978
/proc/meminfo: memFree=24458444/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2442.59 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14648 0 0 0 244258 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4970932 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2442.59 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4979
/proc/meminfo: memFree=24458756/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2502.6 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14686 0 0 0 250259 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4979175 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2502.6 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4980
/proc/meminfo: memFree=24458396/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2520 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14686 0 0 0 251999 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4970781 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.7 s]
# the end of solver process 4825 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.012001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4980
/proc/meminfo: memFree=24458396/32770624 swapFree=67108860/67108860
[pid=4825] ppid=4822 vsize=38396 memory=14832 CPUtime=2520 cores=0,2,4,6
/proc/4825/stat : 4825 (cosoco) R 4822 4825 3568 0 -1 4202496 14686 0 0 0 251999 1 0 0 20 0 1 0 91587270 39317504 3708 33554432000 4194304 5972588 140720698740192 140720698737496 4970781 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 16506880 140720698741951 140720698742046 140720698742046 140720698744782 0
/proc/4825/statm: 9599 3708 774 435 0 2962 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 38396 KiB
Current children cumulated memory: 14832 KiB

Child status: 1
Real time (s): 2519.7
CPU time (s): 2520.01
CPU user time (s): 2520
CPU system time (s): 0.012001
CPU usage (%): 100.012
Max. virtual memory (cumulated for all children) (KiB): 38396
Max. memory (cumulated for all children) (KiB): 14832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.012001
maximum resident set size= 14908
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14739
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 781


# summary of solver processes directly reported to runsolver:
#   pid: 4825
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.012001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.41887 second user time and 15.7657 second system time

The end

Launcher Data 

Begin job on node150 at 2017-08-13 02:30:03
IDJOB=4268060
IDBENCH=139130
IDSOLVER=2658
FILE ID=node150/4268060-1502585061
RUNJOBID= node150-1502571587-3599
PBS_JOBID= 20628290
Free space on /tmp= 61636 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gs/qwh-o035-h405.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4268060-1502585061/watcher-4268060-1502585061 -o /tmp/evaluation-result-4268060-1502585061/solver-4268060-1502585061 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1502571587-3599 --watchdog 2580  cosoco -lc -model -restarts HOME/instance-4268060-1502585061.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3223705abdf773009dcd28d689e47bd8
RANDOM SEED=525196963

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27319068 kB
MemAvailable:   31984496 kB
Buffers:          215860 kB
Cached:          4738620 kB
SwapCached:            0 kB
Active:           653632 kB
Inactive:        4360932 kB
Active(anon):      62836 kB
Inactive(anon):    25068 kB
Active(file):     590796 kB
Inactive(file):  4335864 kB
Unevictable:        6228 kB
Mlocked:            6228 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2356 kB
Writeback:             0 kB
AnonPages:         66344 kB
Mapped:            44872 kB
Shmem:             25224 kB
Slab:             135692 kB
SReclaimable:     109204 kB
SUnreclaim:        26488 kB
KernelStack:        3344 kB
PageTables:         4896 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     357292 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61632 MiB
End job on node150 at 2017-08-13 03:12:03