Trace number 4408076

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.06 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-01.xml
MD5SUMdebd4f53dd650fe0aa41c33fe17bde33
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark11.8697
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4542        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408076-1569810877.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.00 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 585
0.00/0.02	c |                   Arity: 1..30  -- Unary: 525
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 525
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.06	c 101            947            10926          30122          892            0              556   657   638
0.10/0.14	c 211            2145           25140          86452          892            0              192   699   646
0.21/0.24	c 332            3585           43726          168328         892            0              596   704   667
0.21/0.30	c 465            4957           55773          202721         892            0              521   646   611
0.41/0.42	c 611            6097           77905          300325         892            0              578   675   657
0.51/0.56	c 771            7701           103586         412294         892            0              567   703   669
0.60/0.64	c 947            9005           117800         468451         892            0              603   674   641
0.79/0.85	c 1140           10849          154797         659561         892            0              581   686   663
0.89/0.99	c 1352           12543          181119         777010         892            0              579   703   668
1.10/1.14	c 1585           14498          207679         896549         892            0              607   707   667
1.29/1.33	c 1841           16650          241501         1055144        892            0              566   705   670
1.39/1.46	c 2122           18545          266652         1167999        892            0              561   720   657
1.49/1.52	c 2431           20346          278787         1200595        892            0              561   599   581
1.59/1.60	c 2770           22216          293515         1256477        892            0              550   638   619
1.59/1.67	c 3142           23739          307487         1307934        892            0              535   579   563
1.69/1.75	c 3551           25460          322833         1357364        892            0              530   552   536
1.79/1.86	c 4000           27288          342846         1429838        892            0              513   537   528
1.89/1.96	c 4493           31295          365195         1491929        892            0              395   510   469
2.00/2.04	c 5035           33207          379688         1538342        892            0              447   478   455
2.39/2.46	c 5631           37743          455667         1902088        892            0              366   706   588
2.89/2.98	c 6286           42751          550218         2358072        892            0              454   706   669
3.49/3.53	c 7006           47847          648827         2848278        892            0              503   720   676
4.10/4.11	c 7798           52771          753100         3348696        892            0              519   702   676
4.69/4.79	c 8669           58109          875415         3926963        892            0              525   700   672
5.49/5.50	c 9627           65194          1001966        4590175        892            0              531   728   689
6.39/6.49	c 10680          71198          1178763        5487985        892            0              532   714   677
7.19/7.26	c 11838          78040          1317822        6242984        892            0              534   719   693
8.09/8.14	c 13111          86188          1477033        7103696        892            0              535   755   711
9.09/9.18	c 14511          96386          1665935        7999458        892            0              534   716   675
10.09/10.13	c 16051          106088         1835767        8916443        892            0              536   714   675
10.89/10.99	c 17745          113594         1991561        9666715        892            0              534   693   663
12.39/12.41	c 19608          123389         2246286        10992989       892            0              534   717   678
14.39/14.41	c 21657          142327         2606676        12714867       892            0              533   726   686
15.99/16.03	c 23910          159739         2901354        14068285       892            0              537   703   666
18.89/19.00	c 26388          186670         3431043        16834740       892            0              536   742   702
21.49/21.51	c 29113          203458         3876910        19287133       892            0              549   744   707
23.49/23.58	c 32110          216450         4245452        21441336       892            0              550   717   694
25.69/25.75	c 35406          233715         4637389        23530467       892            0              562   753   704
27.69/27.78	c 39031          259449         5008850        25239522       892            0              540   740   676
30.19/30.24	c 43018          280743         5444970        27665350       892            0              592   738   699
33.39/33.43	c 47403          306331         6019227        30687453       892            0              596   722   689
37.39/37.47	c 52226          334458         6738717        34627554       892            0              622   729   684
40.99/41.08	c 57531          363775         7389524        38039763       892            0              612   741   704
45.49/45.52	c 63366          404221         8189278        42472656       892            0              656   764   717
50.79/50.90	c 69784          442901         9145089        47729379       892            0              642   729   685
55.69/55.71	c 76843          479561         9999845        52382748       892            0              612   731   680
61.69/61.74	c 84607          533037         11094480       58067040       892            0              623   743   694
68.59/68.60	c 93147          588790         12321299       64921042       892            0              631   765   721
75.10/75.14	c 102541         643258         13497791       71402359       892            0              646   743   699
82.69/82.79	c 112874         709875         14875756       79249216       892            0              574   744   702
91.10/91.18	c 124240         776241         16379852       87963806       892            0              570   732   698
98.59/98.67	c 136742         852742         17739650       95186755       892            0              639   756   692
107.00/107.10	c 150494         932129         19274085       103434653      892            0              597   734   689
118.49/118.54	c 165621         1025543        21334932       114611555      892            0              554   752   705
131.69/131.73	c 182260         1162471        23720401       126778164      892            0              599   757   703
148.00/148.08	c 200562         1285079        26641398       142905195      892            0              545   752   694
162.59/162.65	c 220694         1416455        29288320       157204404      892            0              564   730   685
176.79/176.82	c 242839         1536496        31836884       171943129      892            0              540   722   672
195.69/195.74	c 267198         1695002        35254538       189597819      892            0              542   737   689
217.10/217.12	c 293992         1858740        39100878       209942386      892            0              546   753   701
237.10/237.13	c 323465         2028391        42745997       230797199      892            0              537   771   723
259.19/259.29	c 355885         2228752        46761669       253652402      892            0              537   766   711
280.49/280.53	c 391547         2400698        50550267       276115504      892            0              539   734   696
312.89/312.93	c 430775         2641191        56365841       305873829      892            0              541   736   684
346.89/346.93	c 473925         2903373        62448439       340288799      892            0              539   764   717
378.69/378.75	c 521390         3187912        68198414       372979638      892            0              539   750   709
415.10/415.16	c 573601         3511932        74799240       409333786      892            0              538   738   695
458.89/458.97	c 631033         3803275        82615972       455966197      892            0              540   731   690
496.10/496.13	c 694208         4079129        89206762       495232954      892            0              541   732   686
551.40/551.49	c 763700         4488191        99150618       546069115      892            0              540   718   676
616.11/616.12	c 840141         4934055        110652525      606699959      892            0              549   729   684
673.60/673.67	c 924226         5388219        120928101      664125076      892            0              552   743   685
730.50/730.50	c 1016719        5936184        131141574      720169459      892            0              553   735   681
788.11/788.14	c 1118461        6486625        141547906      780209555      892            0              548   757   705
869.80/869.87	c 1230377        7106985        156119202      859646790      892            0              544   743   691
948.71/948.77	c 1353484        7747891        170249932      934388885      892            0              540   748   685
1043.71/1043.78	c 1488901        8601494        187471051      1021859142     892            0              540   745   696
1132.21/1132.29	c 1637859        9397727        203475599      1108946175     892            0              536   749   697
1242.41/1242.45	c 1801712        10459693       223374581      1210710988     892            0              537   757   690
1330.21/1330.22	c 1981950        11308673       239338541      1295374904     892            0              531   767   711
1469.22/1469.28	c 2180211        12494634       264432427      1415304763     892            0              529   733   684
1629.62/1629.66	c 2398298        13875810       293182519      1560630222     892            0              529   749   691
1762.43/1762.45	c 2638193        15045761       317255002      1678552061     892            0              529   740   678
1991.64/1991.66	c 2902077        16772679       358531268      1894622570     892            0              529   748   688
2143.84/2143.80	c 3192349        18396764       386264559      2030738500     892            0              529   753   686
2441.05/2441.10	c 3511648        20591037       439312601      2304133149     892            0              529   745   695
2520.06/2520.00	
2520.06/2520.00	c *** INTERRUPTED ***
2520.06/2520.00	c restarts              : 86          
2520.06/2520.00	c conflicts             : 3621244      (1437 /sec)
2520.06/2520.00	c decisions             : 21224323     (8422 /sec)
2520.06/2520.00	c propagations          : 2373945063  (942022 /sec)
2520.06/2520.00	c root propagations     : 4542        
2520.06/2520.00	c filter calls          : 453486423      (179951 /sec)
2520.06/2520.00	c useless filter calls  : 118446573      (26 %)
2520.06/2520.00	c Memory used           : 32.52 MB
2520.06/2520.00	c CPU time              : 2520.05 s
2520.06/2520.00	c real time             : 2520 s
2520.06/2520.00	
2520.06/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14679 MiB free)
  memory of node 1: 16384 MiB (13083 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408076-1569810877/watcher-4408076-1569810877 -o /tmp/evaluation-result-4408076-1569810877/solver-4408076-1569810877 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1569787351-1203 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408076-1569810877.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=5456, runsolver pid=5453
Current StackSize limit: 8192 KiB


[startup+0.100153 s]*
/proc/loadavg: 1.92 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28423704/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=32768 memory=9196 CPUtime=0.1 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 2510 0 0 0 10 0 0 0 20 0 1 0 557358973 33554432 2299 33554432000 4194304 6211132 140734145628688 140734145625224 5079440 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8192 2299 866 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9196 KiB

[startup+0.209545 s]*
/proc/loadavg: 1.92 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28423332/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=32900 memory=9460 CPUtime=0.21 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 2536 0 0 0 21 0 0 0 20 0 1 0 557358973 33689600 2365 33554432000 4194304 6211132 140734145628688 140734145625224 5082818 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8225 2365 866 493 0 1530 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9460 KiB

[startup+0.308883 s]*
/proc/loadavg: 1.92 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28423332/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=32900 memory=9460 CPUtime=0.31 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 2542 0 0 0 31 0 0 0 20 0 1 0 557358973 33689600 2365 33554432000 4194304 6211132 140734145628688 140734145625224 5079295 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8225 2365 866 493 0 1530 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9460 KiB

[startup+0.700273 s]
/proc/loadavg: 1.92 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28423332/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33032 memory=9460 CPUtime=0.69 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 2560 0 0 0 69 0 0 0 20 0 1 0 557358973 33824768 2365 33554432000 4194304 6211132 140734145628688 140734145625224 5081744 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8258 2365 866 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+1.50027 s]
/proc/loadavg: 1.92 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28423208/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33032 memory=9460 CPUtime=1.49 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 2570 0 0 0 149 0 0 0 20 0 1 0 557358973 33824768 2365 33554432000 4194304 6211132 140734145628688 140734145626648 5078752 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8258 2365 866 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+3.109 s]
/proc/loadavg: 1.92 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28422512/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9696 CPUtime=3.1 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 4048 0 0 0 310 0 0 0 20 0 1 0 557358973 33959936 2424 33554432000 4194304 6211132 140734145628688 140734145626648 5076376 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2424 866 493 0 1596 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9696 KiB

[startup+6.30027 s]
/proc/loadavg: 1.93 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28422528/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9724 CPUtime=6.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 4511 0 0 0 629 0 0 0 20 0 1 0 557358973 33959936 2431 33554432000 4194304 6211132 140734145628688 140734145626648 5075672 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2431 866 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9724 KiB

[startup+12.7003 s]
/proc/loadavg: 1.93 2.00 2.04 3/199 5457
/proc/meminfo: memFree=28422776/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9744 CPUtime=12.69 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 4988 0 0 0 1269 0 0 0 20 0 1 0 557358973 33959936 2436 33554432000 4194304 6211132 140734145628688 140734145626648 5082449 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2436 866 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9744 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.00 2.04 4/199 5458
/proc/meminfo: memFree=28423408/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9792 CPUtime=25.49 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 5942 0 0 0 2549 0 0 0 20 0 1 0 557358973 33959936 2448 33554432000 4194304 6211132 140734145628688 140734145626648 5074419 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2448 866 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+51.109 s]
/proc/loadavg: 1.97 2.00 2.04 3/199 5460
/proc/meminfo: memFree=28422680/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9792 CPUtime=51.1 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 6419 0 0 0 5110 0 0 0 20 0 1 0 557358973 33959936 2448 33554432000 4194304 6211132 140734145628688 140734145626648 5082762 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2448 866 493 0 1596 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/199 5464
/proc/meminfo: memFree=28422736/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9796 CPUtime=102.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 6899 0 0 0 10229 0 0 0 20 0 1 0 557358973 33959936 2449 33554432000 4194304 6211132 140734145628688 140734145626648 5076402 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/200 5470
/proc/meminfo: memFree=28422384/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9796 CPUtime=162.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 7376 0 0 0 16229 0 0 0 20 0 1 0 557358973 33959936 2449 33554432000 4194304 6211132 140734145628688 140734145626648 5078748 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 5474
/proc/meminfo: memFree=28422040/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9796 CPUtime=222.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 7852 0 0 0 22229 0 0 0 20 0 1 0 557358973 33959936 2449 33554432000 4194304 6211132 140734145628688 140734145626648 5075735 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 5478
/proc/meminfo: memFree=28422200/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9800 CPUtime=282.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 8330 0 0 0 28229 0 0 0 20 0 1 0 557358973 33959936 2450 33554432000 4194304 6211132 140734145628688 140734145626648 5076376 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2450 866 493 0 1596 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9800 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 5484
/proc/meminfo: memFree=28422256/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9800 CPUtime=342.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 8808 0 0 0 34229 0 0 0 20 0 1 0 557358973 33959936 2450 33554432000 4194304 6211132 140734145628688 140734145626648 5079360 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2450 866 493 0 1596 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9800 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 5495
/proc/meminfo: memFree=28421544/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9800 CPUtime=402.29 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 9284 0 0 0 40229 0 0 0 20 0 1 0 557358973 33959936 2450 33554432000 4194304 6211132 140734145628688 140734145626648 5082401 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2450 866 493 0 1596 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9800 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 5499
/proc/meminfo: memFree=28421756/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33164 memory=9800 CPUtime=462.3 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 9761 0 0 0 46230 0 0 0 20 0 1 0 557358973 33959936 2450 33554432000 4194304 6211132 140734145628688 140734145626648 5075231 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8291 2450 866 493 0 1596 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9800 KiB


################
# More data... #
################

/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 1722.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+1782.3 s]
/proc/loadavg: 2.07 2.11 2.09 3/202 5666
/proc/meminfo: memFree=28420128/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=1782.33 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 18725 0 0 0 178232 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5193760 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 1782.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+1842.3 s]
/proc/loadavg: 2.03 2.09 2.08 3/201 5670
/proc/meminfo: memFree=28420080/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=1842.33 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 18971 0 0 0 184232 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5075269 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.07 2.08 3/200 5674
/proc/meminfo: memFree=28420260/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=1902.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 19218 0 0 0 190233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5193760 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 1902.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 5680
/proc/meminfo: memFree=28420152/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=1962.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 19467 0 0 0 196233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5076389 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 1962.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.05 2.07 3/199 5744
/proc/meminfo: memFree=28421516/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2022.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 19949 0 0 0 202233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5076464 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2022.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/201 5750
/proc/meminfo: memFree=28420792/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2082.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 20187 0 0 0 208233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5397251 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2082.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/202 5756
/proc/meminfo: memFree=28420964/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2142.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 20428 0 0 0 214233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5193728 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2142.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2202.3 s]
/proc/loadavg: 2.22 2.08 2.06 3/201 5767
/proc/meminfo: memFree=28420300/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2202.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 20902 0 0 0 220233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5078748 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2202.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2262.3 s]
/proc/loadavg: 2.42 2.18 2.10 3/201 5771
/proc/meminfo: memFree=28420448/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2262.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 21134 0 0 0 226233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5075777 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2262.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2322.3 s]
/proc/loadavg: 2.15 2.15 2.10 3/202 5777
/proc/meminfo: memFree=28419816/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2322.34 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 21364 0 0 0 232233 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5079348 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2322.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2382.3 s]
/proc/loadavg: 2.06 2.12 2.09 3/199 5781
/proc/meminfo: memFree=28420000/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2382.35 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 21597 0 0 0 238234 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5082431 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2382.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2442.3 s]
/proc/loadavg: 2.02 2.10 2.08 3/199 5785
/proc/meminfo: memFree=28419940/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2442.35 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 22080 0 0 0 244234 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5075735 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2442.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

[startup+2502.3 s]
/proc/loadavg: 2.01 2.08 2.08 3/200 5791
/proc/meminfo: memFree=28420200/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2502.35 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 22334 0 0 0 250234 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5079276 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2502.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.08 2.08 3/199 5792
/proc/meminfo: memFree=28419844/32770624 swapFree=66956692/67108860
[pid=5456] ppid=5453 vsize=33296 memory=9824 CPUtime=2520.06 cores=1,3,5,7
/proc/5456/stat : 5456 (cosoco) R 5453 5456 1161 0 -1 4202496 22570 0 0 0 252005 1 0 0 20 0 1 0 557358973 34095104 2456 33554432000 4194304 6211132 140734145628688 140734145626648 5081687 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 20385792 140734145631243 140734145631345 140734145631345 140734145634254 0
/proc/5456/statm: 8324 2456 866 493 0 1629 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9824 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 5456 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.05 s, system=0.01 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.06
CPU user time (s): 2520.05
CPU system time (s): 0.01
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.05
system time used= 0.01
maximum resident set size= 9888
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22622
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 658


# summary of solver processes directly reported to runsolver:
#   pid: 5456
#   total CPU time (s): 2520.06
#   total CPU user time (s): 2520.05
#   total CPU system time (s): 0.01

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.69269 second user time and 16.052 second system time

The end

Launcher Data 

Begin job on node151 at 2019-09-30 04:33:56
IDJOB=4408076
IDBENCH=138967
IDSOLVER=2874
FILE ID=node151/4408076-1569810877
RUNJOBID= node151-1569787351-1203
PBS_JOBID= 21705814
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-01.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408076-1569810877/watcher-4408076-1569810877 -o /tmp/evaluation-result-4408076-1569810877/solver-4408076-1569810877 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1569787351-1203 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408076-1569810877.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= debd4f53dd650fe0aa41c33fe17bde33
RANDOM SEED=1186475149

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28429548 kB
MemAvailable:   31820364 kB
Buffers:          174852 kB
Cached:          3551744 kB
SwapCached:        50572 kB
Active:          1884184 kB
Inactive:        1904080 kB
Active(anon):      29544 kB
Inactive(anon):   111600 kB
Active(file):    1854640 kB
Inactive(file):  1792480 kB
Unevictable:      108344 kB
Mlocked:          108344 kB
SwapTotal:      67108860 kB
SwapFree:       66956692 kB
Dirty:              2792 kB
Writeback:             0 kB
AnonPages:        120220 kB
Mapped:            28164 kB
Shmem:             70732 kB
Slab:             148040 kB
SReclaimable:     119064 kB
SUnreclaim:        28976 kB
KernelStack:        3504 kB
PageTables:         5472 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     575152 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     73728 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 62024 MiB
End job on node151 at 2019-09-30 05:15:56