Trace number 4389511

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.05 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-05.xml
MD5SUM28a405c699ff9e569ded15e71872b7af
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark10.4884
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.02	c root propagations     : 4481        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389511-1568358390.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            889            11662          36363          897            0              579   609   598
0.10/0.12	c 211            1994           22630          80874          897            0              589   661   622
0.10/0.17	c 332            3150           32100          114622         897            0              180   375   344
0.21/0.22	c 465            4697           43034          146105         897            0              279   517   493
0.21/0.31	c 611            6357           59368          220018         897            0              380   668   612
0.41/0.44	c 771            7775           82521          330732         897            0              569   688   659
0.51/0.58	c 947            9569           108682         461120         897            0              526   686   645
0.69/0.71	c 1140           11237          131409         583012         897            0              586   666   637
0.79/0.87	c 1352           13235          161528         724196         897            0              585   713   680
1.10/1.14	c 1585           16209          209579         964320         897            0              577   734   702
1.39/1.48	c 1841           19950          271580         1308052        897            0              586   742   704
1.59/1.69	c 2122           22309          310160         1512212        897            0              606   745   719
1.89/1.95	c 2431           25062          355891         1767028        897            0              617   727   700
2.19/2.26	c 2770           27576          410963         2053935        897            0              552   720   690
2.39/2.48	c 3142           30197          450420         2230919        897            0              573   690   657
2.59/2.69	c 3551           32623          489278         2443978        897            0              549   711   688
2.89/2.99	c 4000           35706          542653         2739099        897            0              557   731   693
3.29/3.35	c 4493           38932          607159         3098462        897            0              571   721   697
3.69/3.80	c 5035           43697          688163         3521998        897            0              572   750   709
4.19/4.26	c 5631           47785          770955         3979554        897            0              568   724   692
4.69/4.77	c 6286           52643          862245         4487601        897            0              603   722   691
5.29/5.37	c 7006           58291          969654         5049332        897            0              561   721   690
6.00/6.09	c 7798           64528          1097886        5755576        897            0              580   737   697
6.59/6.65	c 8669           70253          1197100        6226494        897            0              568   689   655
7.19/7.29	c 9627           76420          1313062        6831359        897            0              546   720   693
7.89/7.99	c 10680          82643          1437443        7439511        897            0              550   706   675
8.89/8.94	c 11838          90078          1605892        8303662        897            0              554   713   688
9.59/9.66	c 13111          96457          1736074        8981758        897            0              559   710   676
10.69/10.77	c 14511          106985         1935256        9969573        897            0              569   730   685
12.29/12.35	c 16051          119047         2215066        11388130       897            0              590   730   689
13.19/13.21	c 17745          125836         2366550        12272679       897            0              577   699   681
14.39/14.44	c 19608          135673         2583139        13389321       897            0              585   710   674
16.29/16.34	c 21657          150043         2921679        15144129       897            0              603   714   686
18.00/18.09	c 23910          163821         3231979        16829127       897            0              609   705   674
20.00/20.08	c 26388          180398         3584614        18704745       897            0              644   746   699
22.00/22.10	c 29113          194581         3942158        20445880       897            0              613   710   678
24.79/24.83	c 32110          214098         4423405        23004930       897            0              602   712   684
27.19/27.25	c 35406          231592         4856586        25383945       897            0              615   732   699
30.10/30.19	c 39031          254698         5381703        28094341       897            0              581   743   700
33.49/33.50	c 43018          279439         5970397        31203792       897            0              591   738   686
36.79/36.88	c 47403          307667         6570438        34459388       897            0              658   731   693
40.79/40.88	c 52226          340524         7279578        38580610       897            0              639   745   708
44.59/44.69	c 57531          373290         7957393        42385074       897            0              649   746   708
49.29/49.33	c 63366          413761         8779727        46787472       897            0              658   748   700
53.59/53.69	c 69784          455002         9557631        50890735       897            0              637   735   687
59.29/59.35	c 76843          495764         10549401       56519396       897            0              613   735   687
65.00/65.06	c 84607          547119         11568453       62325828       897            0              605   753   702
72.19/72.28	c 93147          600416         12834927       70016029       897            0              619   741   710
79.69/79.78	c 102541         667305         14165189       77048378       897            0              642   730   686
86.10/86.11	c 112874         726188         15301501       82775508       897            0              617   725   685
93.69/93.73	c 124240         793152         16653804       90101883       897            0              629   725   687
103.59/103.62	c 136742         873440         18413144       99496076       897            0              636   731   687
115.39/115.49	c 150494         971164         20533758       110692831      897            0              608   754   710
126.59/126.68	c 165621         1057802        22528334       121457383      897            0              595   737   691
141.00/141.09	c 182260         1166153        25080470       135875946      897            0              660   739   698
154.59/154.63	c 200562         1291865        27505148       148692591      897            0              580   744   690
172.49/172.51	c 220694         1430175        30663052       166509280      897            0              620   745   696
190.89/190.97	c 242839         1583409        33930471       184783118      897            0              603   750   702
209.19/209.28	c 267198         1734529        37167641       203039540      897            0              655   744   700
229.79/229.83	c 293992         1887550        40794372       223133553      897            0              639   742   696
253.69/253.76	c 323465         2086900        45068182       245937348      897            0              604   753   698
280.69/280.72	c 355885         2317402        49886246       272929230      897            0              626   766   717
306.00/306.04	c 391547         2540730        54424550       297518271      897            0              591   749   707
334.39/334.40	c 430775         2793211        59484078       325227097      897            0              619   738   697
367.89/367.96	c 473925         3038652        65436308       357880699      897            0              588   750   705
400.80/400.87	c 521390         3316751        71285173       391477947      897            0              586   768   719
444.70/444.78	c 573601         3636122        79047148       433425147      897            0              591   734   689
494.20/494.25	c 631033         4035265        87857667       480619014      897            0              584   745   695
547.70/547.76	c 694208         4459481        97314729       527294233      897            0              632   723   677
598.20/598.26	c 763700         4826611        106267424      571313753      897            0              590   729   675
655.70/655.79	c 840141         5267118        116488605      622539556      897            0              597   721   666
715.40/715.43	c 924226         5716375        127022406      676936735      897            0              574   734   681
798.01/798.06	c 1016719        6313483        141619626      753721025      897            0              604   732   685
890.21/890.28	c 1118461        6948086        157890663      836924779      897            0              604   718   675
991.41/991.40	c 1230377        7701029        175801135      928451505      897            0              581   746   693
1094.12/1094.18	c 1353484        8462360        194076420      1021391353     897            0              594   736   689
1237.71/1237.71	c 1488901        9450854        219290864      1157510502     897            0              633   745   697
1393.02/1393.03	c 1637859        10556012       246861654      1303281263     897            0              584   758   691
1515.31/1515.36	c 1801712        11519142       268562585      1418808996     897            0              577   750   691
1658.62/1658.60	c 1981950        12504751       293749695      1554188816     897            0              590   726   675
1818.92/1819.00	c 2180211        13701292       322220352      1710769467     897            0              616   750   691
1966.72/1966.74	c 2398298        14863173       348492000      1854265143     897            0              608   742   691
2168.92/2168.94	c 2638193        16231795       384296759      2049611261     897            0              636   735   687
2415.63/2415.62	c 2902077        17965912       427907090      2284586905     897            0              630   731   680
2520.04/2520.00	
2520.04/2520.00	c *** INTERRUPTED ***
2520.04/2520.00	c restarts              : 84          
2520.04/2520.00	c conflicts             : 3030375      (1203 /sec)
2520.04/2520.00	c decisions             : 18724003     (7430 /sec)
2520.04/2520.00	c propagations          : 2386318695  (946940 /sec)
2520.04/2520.00	c root propagations     : 4481        
2520.04/2520.00	c filter calls          : 446223779      (177071 /sec)
2520.04/2520.00	c useless filter calls  : 111475894      (24 %)
2520.04/2520.00	c Memory used           : 32.52 MB
2520.04/2520.00	c CPU time              : 2520.03 s
2520.04/2520.00	c real time             : 2520 s
2520.04/2520.00	
2520.04/2520.00	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11096 MiB free)
  memory of node 1: 16384 MiB (12171 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389511-1568358390/watcher-4389511-1568358390 -o /tmp/evaluation-result-4389511-1568358390/solver-4389511-1568358390 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568358213-18954 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389511-1568358390.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=19055, runsolver pid=19052

[startup+0.100152 s]*
/proc/loadavg: 2.19 3.77 4.16 3/201 19056
/proc/meminfo: memFree=23821336/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=32768 memory=9200 CPUtime=0.1 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 2492 0 0 0 10 0 0 0 20 0 1 0 411779186 33554432 2300 33554432000 4194304 6210612 140726315461824 140726315458360 5082087 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8192 2300 862 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.209566 s]*
/proc/loadavg: 2.19 3.77 4.16 3/201 19056
/proc/meminfo: memFree=23821336/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=32768 memory=9200 CPUtime=0.21 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 2495 0 0 0 21 0 0 0 20 0 1 0 411779186 33554432 2300 33554432000 4194304 6210612 140726315461824 140726315458360 5082025 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8192 2300 862 493 0 1497 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.308954 s]*
/proc/loadavg: 2.19 3.77 4.16 3/201 19056
/proc/meminfo: memFree=23820964/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33032 memory=9464 CPUtime=0.31 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 2569 0 0 0 31 0 0 0 20 0 1 0 411779186 33824768 2366 33554432000 4194304 6210612 140726315461824 140726315459784 5078397 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+0.700269 s]
/proc/loadavg: 2.19 3.77 4.16 3/201 19056
/proc/meminfo: memFree=23820964/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9728 CPUtime=0.69 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 2599 0 0 0 69 0 0 0 20 0 1 0 411779186 33959936 2432 33554432000 4194304 6210612 140726315461824 140726315459784 5078394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2432 862 493 0 1596 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9728 KiB

[startup+1.50027 s]
/proc/loadavg: 2.19 3.77 4.16 3/201 19056
/proc/meminfo: memFree=23820608/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9728 CPUtime=1.49 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 2603 0 0 0 149 0 0 0 20 0 1 0 411779186 33959936 2432 33554432000 4194304 6210612 140726315461824 140726315459784 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2432 862 493 0 1596 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9728 KiB

[startup+3.109 s]
/proc/loadavg: 2.17 3.74 4.15 3/201 19056
/proc/meminfo: memFree=23820556/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9772 CPUtime=3.1 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 4084 0 0 0 310 0 0 0 20 0 1 0 411779186 33959936 2443 33554432000 4194304 6210612 140726315461824 140726315459784 5185931 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2443 862 493 0 1596 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9772 KiB

[startup+6.30026 s]
/proc/loadavg: 2.17 3.74 4.15 3/201 19056
/proc/meminfo: memFree=23817088/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9784 CPUtime=6.29 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 5571 0 0 0 629 0 0 0 20 0 1 0 411779186 33959936 2446 33554432000 4194304 6210612 140726315461824 140726315459784 5079072 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2446 862 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+12.7003 s]
/proc/loadavg: 2.14 3.68 4.13 3/200 19057
/proc/meminfo: memFree=23816304/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9784 CPUtime=12.69 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 7055 0 0 0 1269 0 0 0 20 0 1 0 411779186 33959936 2446 33554432000 4194304 6210612 140726315461824 140726315459784 5081319 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2446 862 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+25.5003 s]
/proc/loadavg: 2.12 3.62 4.10 3/200 19057
/proc/meminfo: memFree=23812008/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9796 CPUtime=25.49 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 10018 0 0 0 2549 0 0 0 20 0 1 0 411779186 33959936 2449 33554432000 4194304 6210612 140726315461824 140726315459784 5080973 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2449 862 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+51.109 s]
/proc/loadavg: 2.08 3.49 4.05 3/200 19059
/proc/meminfo: memFree=23807644/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9796 CPUtime=51.1 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 11512 0 0 0 5110 0 0 0 20 0 1 0 411779186 33959936 2449 33554432000 4194304 6210612 140726315461824 140726315459784 5078397 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2449 862 493 0 1596 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 3.24 3.93 3/200 19063
/proc/meminfo: memFree=23761112/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33164 memory=9796 CPUtime=102.29 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 12999 0 0 0 10229 0 0 0 20 0 1 0 411779186 33959936 2449 33554432000 4194304 6210612 140726315461824 140726315459784 5185871 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8291 2449 862 493 0 1596 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 3.02 3.81 3/200 19067
/proc/meminfo: memFree=23734392/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9796 CPUtime=162.29 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 14483 0 0 0 16229 0 0 0 20 0 1 0 411779186 34095104 2449 33554432000 4194304 6210612 140726315461824 140726315459416 5074866 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2449 862 493 0 1629 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9796 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.83 3.70 3/199 19073
/proc/meminfo: memFree=23727876/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9800 CPUtime=222.29 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 15960 0 0 0 22229 0 0 0 20 0 1 0 411779186 34095104 2450 33554432000 4194304 6210612 140726315461824 140726315459784 5074335 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2450 862 493 0 1629 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9800 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.68 3.59 3/199 19084
/proc/meminfo: memFree=23725400/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9808 CPUtime=282.29 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 17445 0 0 0 28229 0 0 0 20 0 1 0 411779186 34095104 2452 33554432000 4194304 6210612 140726315461824 140726315459784 5380107 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.56 3.49 3/199 19089
/proc/meminfo: memFree=23722844/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9808 CPUtime=342.29 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 18927 0 0 0 34229 0 0 0 20 0 1 0 411779186 34095104 2452 33554432000 4194304 6210612 140726315461824 140726315459784 5082063 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.45 3.40 3/199 19095
/proc/meminfo: memFree=23721232/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9808 CPUtime=402.3 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 20409 0 0 0 40229 1 0 0 20 0 1 0 411779186 34095104 2452 33554432000 4194304 6210612 140726315461824 140726315459784 5080912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.37 3.31 3/199 19099
/proc/meminfo: memFree=23721136/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=462.3 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 21889 0 0 0 46229 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5079072 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB


################
# More data... #
################

/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 2.34 3/199 19220
/proc/meminfo: memFree=23712360/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=1782.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 39312 0 0 0 178231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5409316 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.32 3/199 19226
/proc/meminfo: memFree=23712808/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=1842.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 39787 0 0 0 184231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5192894 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.30 3/199 19230
/proc/meminfo: memFree=23711856/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=1902.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 40052 0 0 0 190231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5078394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.28 3/199 19234
/proc/meminfo: memFree=23712124/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=1962.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 40316 0 0 0 196231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5080756 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 1962.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.27 3/199 19240
/proc/meminfo: memFree=23711160/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2022.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 40791 0 0 0 202231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5074924 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2022.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.25 3/200 19252
/proc/meminfo: memFree=23711692/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2082.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 41056 0 0 0 208231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5078899 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2082.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.23 3/200 19256
/proc/meminfo: memFree=23710872/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2142.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 41321 0 0 0 214231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5074917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.22 3/200 19262
/proc/meminfo: memFree=23711056/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2202.32 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 41796 0 0 0 220231 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5082394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.21 3/200 19266
/proc/meminfo: memFree=23710368/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2262.33 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 42061 0 0 0 226232 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5081112 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.20 3/200 19270
/proc/meminfo: memFree=23710616/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2322.33 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 42326 0 0 0 232232 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5076008 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2322.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2382.3 s]
/proc/loadavg: 2.16 2.05 2.19 3/199 19276
/proc/meminfo: memFree=23709848/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2382.33 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 42591 0 0 0 238232 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5079039 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2382.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2442.3 s]
/proc/loadavg: 1.70 1.96 2.16 2/192 19325
/proc/meminfo: memFree=25876864/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2442.33 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 43066 0 0 0 244232 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5076069 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2442.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+2502.3 s]
/proc/loadavg: 1.26 1.78 2.08 2/192 19329
/proc/meminfo: memFree=25876940/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2502.33 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 43334 0 0 0 250232 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5076031 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2502.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.18 1.73 2.06 2/192 19332
/proc/meminfo: memFree=25876640/32770624 swapFree=66959224/67108860
[pid=19055] ppid=19052 vsize=33296 memory=9816 CPUtime=2520.04 cores=1,3,5,7
/proc/19055/stat : 19055 (cosoco) R 19052 19055 18922 0 -1 4202496 43600 0 0 0 252003 1 0 0 20 0 1 0 411779186 34095104 2454 33554432000 4194304 6210612 140726315461824 140726315459784 5075696 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 29483008 140726315467787 140726315467889 140726315467889 140726315470798 0
/proc/19055/statm: 8324 2454 862 493 0 1629 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 19055 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.03 s, system=0.018 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.05
CPU user time (s): 2520.03
CPU system time (s): 0.018
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.03
system time used= 0.018
maximum resident set size= 9884
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 43655
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 680


# summary of solver processes directly reported to runsolver:
#   pid: 19055
#   total CPU time (s): 2520.05
#   total CPU user time (s): 2520.03
#   total CPU system time (s): 0.018

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.3352 second user time and 16.1736 second system time

The end

Launcher Data

Begin job on node124 at 2019-09-13 09:05:50
IDJOB=4389511
IDBENCH=138945
IDSOLVER=2829
FILE ID=node124/4389511-1568358390
RUNJOBID= node124-1568358213-18954
PBS_JOBID= 21701196
Free space on /tmp= 55364 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-05.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389511-1568358390/watcher-4389511-1568358390 -o /tmp/evaluation-result-4389511-1568358390/solver-4389511-1568358390 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568358213-18954 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389511-1568358390.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 28a405c699ff9e569ded15e71872b7af
RANDOM SEED=1238810763

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23826360 kB
MemAvailable:   29762396 kB
Buffers:          155356 kB
Cached:          6025580 kB
SwapCached:        45888 kB
Active:          3050640 kB
Inactive:        5231980 kB
Active(anon):    2054980 kB
Inactive(anon):    87940 kB
Active(file):     995660 kB
Inactive(file):  5144040 kB
Unevictable:      108748 kB
Mlocked:          108748 kB
SwapTotal:      67108860 kB
SwapFree:       66959224 kB
Dirty:              2500 kB
Writeback:             8 kB
AnonPages:       2165684 kB
Mapped:            45144 kB
Shmem:             32744 kB
Slab:             253228 kB
SReclaimable:     224344 kB
SUnreclaim:        28884 kB
KernelStack:        3584 kB
PageTables:         9348 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2578712 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    299008 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 55364 MiB
End job on node124 at 2019-09-13 09:47:50