Trace number 4396791

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.08 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-05.xml
MD5SUM28a405c699ff9e569ded15e71872b7af
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark10.4884
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4481        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396791-1568593470.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            889            11662          36363          897            0              579   609   598
0.10/0.12	c 211            1994           22630          80874          897            0              589   661   622
0.10/0.17	c 332            3150           32100          114622         897            0              180   375   344
0.21/0.22	c 465            4697           43034          146105         897            0              279   517   493
0.21/0.31	c 611            6357           59368          220018         897            0              380   668   612
0.41/0.43	c 771            7775           82521          330732         897            0              569   688   659
0.51/0.58	c 947            9569           108682         461120         897            0              526   686   645
0.69/0.70	c 1140           11237          131409         583012         897            0              586   666   637
0.79/0.87	c 1352           13235          161528         724196         897            0              585   713   680
1.10/1.13	c 1585           16209          209579         964320         897            0              577   734   702
1.39/1.47	c 1841           19950          271580         1308052        897            0              586   742   704
1.59/1.69	c 2122           22309          310160         1512212        897            0              606   745   719
1.89/1.94	c 2431           25062          355891         1767028        897            0              617   727   700
2.19/2.25	c 2770           27576          410963         2053935        897            0              552   720   690
2.39/2.46	c 3142           30197          450420         2230919        897            0              573   690   657
2.59/2.68	c 3551           32623          489278         2443978        897            0              549   711   688
2.89/2.97	c 4000           35706          542653         2739099        897            0              557   731   693
3.29/3.33	c 4493           38932          607159         3098462        897            0              571   721   697
3.69/3.78	c 5035           43697          688163         3521998        897            0              572   750   709
4.19/4.24	c 5631           47785          770955         3979554        897            0              568   724   692
4.69/4.75	c 6286           52643          862245         4487601        897            0              603   722   691
5.29/5.35	c 7006           58291          969654         5049332        897            0              561   721   690
6.00/6.07	c 7798           64528          1097886        5755576        897            0              580   737   697
6.59/6.62	c 8669           70253          1197100        6226494        897            0              568   689   655
7.19/7.25	c 9627           76420          1313062        6831359        897            0              546   720   693
7.89/7.94	c 10680          82643          1437443        7439511        897            0              550   706   675
8.79/8.87	c 11838          90078          1605892        8303662        897            0              554   713   688
9.49/9.59	c 13111          96457          1736074        8981758        897            0              559   710   676
10.59/10.68	c 14511          106985         1935256        9969573        897            0              569   730   685
12.19/12.24	c 16051          119047         2215066        11388130       897            0              590   730   689
13.00/13.09	c 17745          125836         2366550        12272679       897            0              577   699   681
14.29/14.30	c 19608          135673         2583139        13389321       897            0              585   710   674
16.10/16.18	c 21657          150043         2921679        15144129       897            0              603   714   686
17.89/17.91	c 23910          163821         3231979        16829127       897            0              609   705   674
19.79/19.87	c 26388          180398         3584614        18704745       897            0              644   746   699
21.79/21.87	c 29113          194581         3942158        20445880       897            0              613   710   678
24.49/24.56	c 32110          214098         4423405        23004930       897            0              602   712   684
26.89/26.96	c 35406          231592         4856586        25383945       897            0              615   732   699
29.79/29.85	c 39031          254698         5381703        28094341       897            0              581   743   700
33.10/33.11	c 43018          279439         5970397        31203792       897            0              591   738   686
36.39/36.45	c 47403          307667         6570438        34459388       897            0              658   731   693
40.29/40.39	c 52226          340524         7279578        38580610       897            0              639   745   708
44.10/44.15	c 57531          373290         7957393        42385074       897            0              649   746   708
48.69/48.72	c 63366          413761         8779727        46787472       897            0              658   748   700
53.00/53.02	c 69784          455002         9557631        50890735       897            0              637   735   687
58.59/58.62	c 76843          495764         10549401       56519396       897            0              613   735   687
64.19/64.25	c 84607          547119         11568453       62325828       897            0              605   753   702
71.29/71.37	c 93147          600416         12834927       70016029       897            0              619   741   710
78.69/78.76	c 102541         667305         14165189       77048378       897            0              642   730   686
84.89/85.00	c 112874         726188         15301501       82775508       897            0              617   725   685
92.39/92.49	c 124240         793152         16653804       90101883       897            0              629   725   687
102.19/102.23	c 136742         873440         18413144       99496076       897            0              636   731   687
113.89/113.93	c 150494         971164         20533758       110692831      897            0              608   754   710
124.89/124.95	c 165621         1057802        22528334       121457383      897            0              595   737   691
139.10/139.16	c 182260         1166153        25080470       135875946      897            0              660   739   698
152.49/152.51	c 200562         1291865        27505148       148692591      897            0              580   744   690
170.10/170.14	c 220694         1430175        30663052       166509280      897            0              620   745   696
188.29/188.30	c 242839         1583409        33930471       184783118      897            0              603   750   702
206.29/206.32	c 267198         1734529        37167641       203039540      897            0              655   744   700
226.49/226.55	c 293992         1887550        40794372       223133553      897            0              639   742   696
250.10/250.12	c 323465         2086900        45068182       245937348      897            0              604   753   698
276.60/276.66	c 355885         2317402        49886246       272929230      897            0              626   766   717
301.60/301.61	c 391547         2540730        54424550       297518271      897            0              591   749   707
329.50/329.56	c 430775         2793211        59484078       325227097      897            0              619   738   697
362.60/362.61	c 473925         3038652        65436308       357880699      897            0              588   750   705
395.00/395.04	c 521390         3316751        71285173       391477947      897            0              586   768   719
438.30/438.30	c 573601         3636122        79047148       433425147      897            0              591   734   689
487.01/487.05	c 631033         4035265        87857667       480619014      897            0              584   745   695
539.60/539.68	c 694208         4459481        97314729       527294233      897            0              632   723   677
589.40/589.42	c 763700         4826611        106267424      571313753      897            0              590   729   675
646.11/646.14	c 840141         5267118        116488605      622539556      897            0              597   721   666
704.91/704.91	c 924226         5716375        127022406      676936735      897            0              574   734   681
786.31/786.38	c 1016719        6313483        141619626      753721025      897            0              604   732   685
877.21/877.27	c 1118461        6948086        157890663      836924779      897            0              604   718   675
976.92/976.91	c 1230377        7701029        175801135      928451505      897            0              581   746   693
1078.13/1078.12	c 1353484        8462360        194076420      1021391353     897            0              594   736   689
1219.63/1219.63	c 1488901        9450854        219290864      1157510502     897            0              633   745   697
1373.04/1373.01	c 1637859        10556012       246861654      1303281263     897            0              584   758   691
1493.73/1493.78	c 1801712        11519142       268562585      1418808996     897            0              577   750   691
1634.93/1634.98	c 1981950        12504751       293749695      1554188816     897            0              590   726   675
1793.44/1793.43	c 2180211        13701292       322220352      1710769467     897            0              616   750   691
1939.44/1939.46	c 2398298        14863173       348492000      1854265143     897            0              608   742   691
2139.45/2139.43	c 2638193        16231795       384296759      2049611261     897            0              636   735   687
2383.16/2383.17	c 2902077        17965912       427907090      2284586905     897            0              630   731   680
2520.07/2520.00	
2520.07/2520.00	c *** INTERRUPTED ***
2520.07/2520.00	c restarts              : 84          
2520.07/2520.00	c conflicts             : 3067831      (1217 /sec)
2520.07/2520.00	c decisions             : 18956759     (7522 /sec)
2520.07/2520.00	c propagations          : 2419256218  (959999 /sec)
2520.07/2520.00	c root propagations     : 4481        
2520.07/2520.00	c filter calls          : 452249709      (179460 /sec)
2520.07/2520.00	c useless filter calls  : 112916098      (24 %)
2520.07/2520.00	c Memory used           : 32.52 MB
2520.07/2520.00	c CPU time              : 2520.06 s
2520.07/2520.00	c real time             : 2520 s
2520.07/2520.00	
2520.07/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14723 MiB free)
  memory of node 1: 16384 MiB (15374 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396791-1568593470/watcher-4396791-1568593470 -o /tmp/evaluation-result-4396791-1568593470/solver-4396791-1568593470 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1568572744-4609 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396791-1568593470.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=8298, runsolver pid=8295

[startup+0.100162 s]*
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30815240/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=32768 memory=9200 CPUtime=0.1 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 2497 0 0 0 10 0 0 0 20 0 1 0 435618446 33554432 2300 33554432000 4194304 6211092 140724501458432 140724501454968 140383786011621 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8192 2300 866 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.209671 s]*
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30815240/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=32768 memory=9200 CPUtime=0.21 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 2500 0 0 0 21 0 0 0 20 0 1 0 435618446 33554432 2300 33554432000 4194304 6211092 140724501458432 140724501454968 5082762 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8192 2300 866 493 0 1497 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.309045 s]*
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30814336/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33032 memory=9464 CPUtime=0.31 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 2574 0 0 0 31 0 0 0 20 0 1 0 435618446 33824768 2366 33554432000 4194304 6211092 140724501458432 140724501456392 5076270 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+0.70028 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30814448/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9728 CPUtime=0.69 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 2604 0 0 0 69 0 0 0 20 0 1 0 435618446 33959936 2432 33554432000 4194304 6211092 140724501458432 140724501456392 5081371 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2432 866 493 0 1596 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9728 KiB

[startup+1.50032 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30814448/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9728 CPUtime=1.49 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 2608 0 0 0 149 0 0 0 20 0 1 0 435618446 33959936 2432 33554432000 4194304 6211092 140724501458432 140724501456392 5392642 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2432 866 493 0 1596 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9728 KiB

[startup+3.10908 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30814324/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9792 CPUtime=3.1 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 4089 0 0 0 310 0 0 0 20 0 1 0 435618446 33959936 2448 33554432000 4194304 6211092 140724501458432 140724501456392 5081280 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2448 866 493 0 1596 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+6.30029 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30813860/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9852 CPUtime=6.29 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 5577 0 0 0 629 0 0 0 20 0 1 0 435618446 33959936 2463 33554432000 4194304 6211092 140724501458432 140724501456392 5075871 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2463 866 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9852 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 8299
/proc/meminfo: memFree=30813796/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9856 CPUtime=12.69 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 6595 0 0 0 1269 0 0 0 20 0 1 0 435618446 33959936 2464 33554432000 4194304 6211092 140724501458432 140724501456392 5078791 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2464 866 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9856 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8299
/proc/meminfo: memFree=30814724/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9868 CPUtime=25.49 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 8121 0 0 0 2549 0 0 0 20 0 1 0 435618446 33959936 2467 33554432000 4194304 6211092 140724501458432 140724501456392 5082419 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2467 866 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9868 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8302
/proc/meminfo: memFree=30814264/32770624 swapFree=66937100/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9868 CPUtime=51.1 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 8640 0 0 0 5110 0 0 0 20 0 1 0 435618446 33959936 2467 33554432000 4194304 6211092 140724501458432 140724501456392 5193703 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2467 866 493 0 1596 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9868 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8308
/proc/meminfo: memFree=30814388/32770624 swapFree=66937104/67108860
[pid=8298] ppid=8295 vsize=33164 memory=9868 CPUtime=102.29 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 9152 0 0 0 10229 0 0 0 20 0 1 0 435618446 33959936 2467 33554432000 4194304 6211092 140724501458432 140724501456392 5078953 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8291 2467 866 493 0 1596 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9868 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8312
/proc/meminfo: memFree=30813428/32770624 swapFree=66937104/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9868 CPUtime=162.29 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 9663 0 0 0 16229 0 0 0 20 0 1 0 435618446 34095104 2467 33554432000 4194304 6211092 140724501458432 140724501456024 5081349 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2467 866 493 0 1629 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9868 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8318
/proc/meminfo: memFree=30803332/32770624 swapFree=66937104/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9872 CPUtime=222.29 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 10169 0 0 0 22229 0 0 0 20 0 1 0 435618446 34095104 2468 33554432000 4194304 6211092 140724501458432 140724501456392 5082431 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2468 866 493 0 1629 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9872 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8323
/proc/meminfo: memFree=30801828/32770624 swapFree=66937104/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9876 CPUtime=282.3 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 10680 0 0 0 28230 0 0 0 20 0 1 0 435618446 34095104 2469 33554432000 4194304 6211092 140724501458432 140724501456392 5081337 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2469 866 493 0 1629 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9876 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8327
/proc/meminfo: memFree=30802224/32770624 swapFree=66937104/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9880 CPUtime=342.3 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 11189 0 0 0 34230 0 0 0 20 0 1 0 435618446 34095104 2470 33554432000 4194304 6211092 140724501458432 140724501456392 5078951 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2470 866 493 0 1629 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9880 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8340
/proc/meminfo: memFree=30801836/32770624 swapFree=66937108/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9880 CPUtime=402.3 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 11700 0 0 0 40230 0 0 0 20 0 1 0 435618446 34095104 2470 33554432000 4194304 6211092 140724501458432 140724501456392 5075188 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2470 866 493 0 1629 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9880 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8344
/proc/meminfo: memFree=30802336/32770624 swapFree=66937108/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=462.3 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 12209 0 0 0 46230 0 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5082405 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB


################
# More data... #
################

/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 1722.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 8650
/proc/meminfo: memFree=30752248/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=1782.34 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 20238 0 0 0 178233 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5075597 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 1782.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 8656
/proc/meminfo: memFree=30752532/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=1842.34 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 20749 0 0 0 184233 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5079432 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 1842.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 8661
/proc/meminfo: memFree=30753464/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=1902.34 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 20988 0 0 0 190233 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5078923 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 1902.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 8665
/proc/meminfo: memFree=30752980/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=1962.34 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 21495 0 0 0 196233 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5207504 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 1962.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 8671
/proc/meminfo: memFree=30740048/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2022.34 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 21733 0 0 0 202233 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5079246 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2022.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2082.3 s]
/proc/loadavg: 2.45 2.12 2.08 3/199 8676
/proc/meminfo: memFree=30740924/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2082.35 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 21974 0 0 0 208234 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5186269 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2082.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2142.3 s]
/proc/loadavg: 2.16 2.10 2.07 3/199 8680
/proc/meminfo: memFree=30740940/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2142.35 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 22483 0 0 0 214234 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5380267 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2142.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2202.3 s]
/proc/loadavg: 2.06 2.08 2.07 3/200 8694
/proc/meminfo: memFree=30740620/32770624 swapFree=66937112/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2202.35 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 22725 0 0 0 220234 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5081439 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2202.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2262.3 s]
/proc/loadavg: 2.02 2.07 2.06 3/201 8720
/proc/meminfo: memFree=30739780/32770624 swapFree=66937116/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2262.35 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 22968 0 0 0 226234 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5079348 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2262.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/201 8724
/proc/meminfo: memFree=30739892/32770624 swapFree=66937116/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2322.35 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 23214 0 0 0 232234 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5082818 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2322.35 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 8730
/proc/meminfo: memFree=30739608/32770624 swapFree=66937116/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2382.36 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 23461 0 0 0 238235 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5075221 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2382.36 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 8734
/proc/meminfo: memFree=30739940/32770624 swapFree=66937116/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2442.36 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 23971 0 0 0 244235 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5409461 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2442.36 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 8738
/proc/meminfo: memFree=30740720/32770624 swapFree=66937116/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2502.36 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 24204 0 0 0 250235 1 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5193728 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2502.36 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 8740
/proc/meminfo: memFree=30740572/32770624 swapFree=66937116/67108860
[pid=8298] ppid=8295 vsize=33296 memory=9888 CPUtime=2520.07 cores=1,3,5,7
/proc/8298/stat : 8298 (cosoco) R 8295 8298 4577 0 -1 4202496 24438 0 0 0 252005 2 0 0 20 0 1 0 435618446 34095104 2472 33554432000 4194304 6211092 140724501458432 140724501456392 5082762 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8372224 140724501464075 140724501464177 140724501464177 140724501467086 0
/proc/8298/statm: 8324 2472 866 493 0 1629 0
Current children cumulated CPU time: 2520.07 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9888 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 8298 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.06 s, system=0.021 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.08
CPU user time (s): 2520.06
CPU system time (s): 0.021
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.06
system time used= 0.021
maximum resident set size= 9952
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24488
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 682


# summary of solver processes directly reported to runsolver:
#   pid: 8298
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2520.06
#   total CPU system time (s): 0.021

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.05283 second user time and 15.9288 second system time

The end

Launcher Data 

Begin job on node151 at 2019-09-16 02:23:51
IDJOB=4396791
IDBENCH=138945
IDSOLVER=2848
FILE ID=node151/4396791-1568593470
RUNJOBID= node151-1568572744-4609
PBS_JOBID= 21703306
Free space on /tmp= 59304 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-05.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396791-1568593470/watcher-4396791-1568593470 -o /tmp/evaluation-result-4396791-1568593470/solver-4396791-1568593470 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1568572744-4609 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396791-1568593470.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 28a405c699ff9e569ded15e71872b7af
RANDOM SEED=1803023390

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30820136 kB
MemAvailable:   31748340 kB
Buffers:          211008 kB
Cached:          1016644 kB
SwapCached:        69764 kB
Active:           757160 kB
Inactive:         638484 kB
Active(anon):     104068 kB
Inactive(anon):   107324 kB
Active(file):     653092 kB
Inactive(file):   531160 kB
Unevictable:      109164 kB
Mlocked:          109164 kB
SwapTotal:      67108860 kB
SwapFree:       66937100 kB
Dirty:              2772 kB
Writeback:             0 kB
AnonPages:        208212 kB
Mapped:            43644 kB
Shmem:             34484 kB
Slab:             148400 kB
SReclaimable:     119576 kB
SUnreclaim:        28824 kB
KernelStack:        3488 kB
PageTables:         6152 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     631640 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    159744 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 59304 MiB
End job on node151 at 2019-09-16 03:05:51