Trace number 4408051

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.04 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-05.xml
MD5SUM28a405c699ff9e569ded15e71872b7af
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark10.4884
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.02	c root propagations     : 4481        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408051-1569810082.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            889            11662          36363          897            0              579   609   598
0.10/0.13	c 211            1994           22630          80874          897            0              589   661   622
0.10/0.17	c 332            3150           32100          114622         897            0              180   375   344
0.21/0.23	c 465            4697           43034          146105         897            0              279   517   493
0.31/0.31	c 611            6357           59368          220018         897            0              380   668   612
0.40/0.44	c 771            7775           82521          330732         897            0              569   688   659
0.50/0.59	c 947            9569           108682         461120         897            0              526   686   645
0.69/0.72	c 1140           11237          131409         583012         897            0              586   666   637
0.79/0.88	c 1352           13235          161528         724196         897            0              585   713   680
1.10/1.15	c 1585           16209          209579         964320         897            0              577   734   702
1.39/1.49	c 1841           19950          271580         1308052        897            0              586   742   704
1.69/1.71	c 2122           22309          310160         1512212        897            0              606   745   719
1.89/1.96	c 2431           25062          355891         1767028        897            0              617   727   700
2.19/2.27	c 2770           27576          410963         2053935        897            0              552   720   690
2.39/2.49	c 3142           30197          450420         2230919        897            0              573   690   657
2.69/2.71	c 3551           32623          489278         2443978        897            0              549   711   688
2.88/3.00	c 4000           35706          542653         2739099        897            0              557   731   693
3.28/3.37	c 4493           38932          607159         3098462        897            0              571   721   697
3.79/3.82	c 5035           43697          688163         3521998        897            0              572   750   709
4.19/4.28	c 5631           47785          770955         3979554        897            0              568   724   692
4.78/4.80	c 6286           52643          862245         4487601        897            0              603   722   691
5.38/5.40	c 7006           58291          969654         5049332        897            0              561   721   690
6.09/6.13	c 7798           64528          1097886        5755576        897            0              580   737   697
6.58/6.68	c 8669           70253          1197100        6226494        897            0              568   689   655
7.28/7.33	c 9627           76420          1313062        6831359        897            0              546   720   693
7.99/8.03	c 10680          82643          1437443        7439511        897            0              550   706   675
8.88/8.98	c 11838          90078          1605892        8303662        897            0              554   713   688
9.68/9.71	c 13111          96457          1736074        8981758        897            0              559   710   676
10.78/10.83	c 14511          106985         1935256        9969573        897            0              569   730   685
12.38/12.41	c 16051          119047         2215066        11388130       897            0              590   730   689
13.18/13.28	c 17745          125836         2366550        12272679       897            0              577   699   681
14.48/14.51	c 19608          135673         2583139        13389321       897            0              585   710   674
16.38/16.42	c 21657          150043         2921679        15144129       897            0              603   714   686
18.10/18.18	c 23910          163821         3231979        16829127       897            0              609   705   674
20.10/20.18	c 26388          180398         3584614        18704745       897            0              644   746   699
22.19/22.21	c 29113          194581         3942158        20445880       897            0              613   710   678
24.89/24.96	c 32110          214098         4423405        23004930       897            0              602   712   684
27.29/27.39	c 35406          231592         4856586        25383945       897            0              615   732   699
30.29/30.35	c 39031          254698         5381703        28094341       897            0              581   743   700
33.59/33.67	c 43018          279439         5970397        31203792       897            0              591   738   686
36.99/37.06	c 47403          307667         6570438        34459388       897            0              658   731   693
40.99/41.09	c 52226          340524         7279578        38580610       897            0              639   745   708
44.88/44.92	c 57531          373290         7957393        42385074       897            0              649   746   708
49.48/49.59	c 63366          413761         8779727        46787472       897            0              658   748   700
53.87/53.99	c 69784          455002         9557631        50890735       897            0              637   735   687
59.57/59.67	c 76843          495764         10549401       56519396       897            0              613   735   687
65.27/65.37	c 84607          547119         11568453       62325828       897            0              605   753   702
72.47/72.53	c 93147          600416         12834927       70016029       897            0              619   741   710
79.87/79.96	c 102541         667305         14165189       77048378       897            0              642   730   686
86.17/86.23	c 112874         726188         15301501       82775508       897            0              617   725   685
93.67/93.78	c 124240         793152         16653804       90101883       897            0              629   725   687
103.47/103.57	c 136742         873440         18413144       99496076       897            0              636   731   687
115.27/115.31	c 150494         971164         20533758       110692831      897            0              608   754   710
126.27/126.39	c 165621         1057802        22528334       121457383      897            0              595   737   691
140.57/140.67	c 182260         1166153        25080470       135875946      897            0              660   739   698
153.98/154.08	c 200562         1291865        27505148       148692591      897            0              580   744   690
171.77/171.81	c 220694         1430175        30663052       166509280      897            0              620   745   696
189.98/190.08	c 242839         1583409        33930471       184783118      897            0              603   750   702
208.17/208.23	c 267198         1734529        37167641       203039540      897            0              655   744   700
228.47/228.59	c 293992         1887550        40794372       223133553      897            0              639   742   696
252.28/252.31	c 323465         2086900        45068182       245937348      897            0              604   753   698
278.99/279.04	c 355885         2317402        49886246       272929230      897            0              626   766   717
304.09/304.17	c 391547         2540730        54424550       297518271      897            0              591   749   707
332.18/332.26	c 430775         2793211        59484078       325227097      897            0              619   738   697
365.48/365.54	c 473925         3038652        65436308       357880699      897            0              588   750   705
398.09/398.18	c 521390         3316751        71285173       391477947      897            0              586   768   719
441.58/441.68	c 573601         3636122        79047148       433425147      897            0              591   734   689
490.68/490.72	c 631033         4035265        87857667       480619014      897            0              584   745   695
543.58/543.69	c 694208         4459481        97314729       527294233      897            0              632   723   677
593.68/593.73	c 763700         4826611        106267424      571313753      897            0              590   729   675
650.69/650.72	c 840141         5267118        116488605      622539556      897            0              597   721   666
709.79/709.84	c 924226         5716375        127022406      676936735      897            0              574   734   681
791.69/791.77	c 1016719        6313483        141619626      753721025      897            0              604   732   685
883.19/883.26	c 1118461        6948086        157890663      836924779      897            0              604   718   675
983.49/983.50	c 1230377        7701029        175801135      928451505      897            0              581   746   693
1085.29/1085.35	c 1353484        8462360        194076420      1021391353     897            0              594   736   689
1227.89/1227.90	c 1488901        9450854        219290864      1157510502     897            0              633   745   697
1382.00/1382.07	c 1637859        10556012       246861654      1303281263     897            0              584   758   691
1503.41/1503.49	c 1801712        11519142       268562585      1418808996     897            0              577   750   691
1645.61/1645.62	c 1981950        12504751       293749695      1554188816     897            0              590   726   675
1804.91/1804.95	c 2180211        13701292       322220352      1710769467     897            0              616   750   691
1951.71/1951.75	c 2398298        14863173       348492000      1854265143     897            0              608   742   691
2152.62/2152.64	c 2638193        16231795       384296759      2049611261     897            0              636   735   687
2397.72/2397.79	c 2902077        17965912       427907090      2284586905     897            0              630   731   680
2520.03/2520.00	
2520.03/2520.00	c *** INTERRUPTED ***
2520.03/2520.00	c restarts              : 84          
2520.03/2520.00	c conflicts             : 3050802      (1211 /sec)
2520.03/2520.00	c decisions             : 18852247     (7481 /sec)
2520.03/2520.00	c propagations          : 2404271105  (954074 /sec)
2520.03/2520.00	c root propagations     : 4481        
2520.03/2520.00	c filter calls          : 449508239      (178376 /sec)
2520.03/2520.00	c useless filter calls  : 112267252      (24 %)
2520.03/2520.00	c Memory used           : 32.52 MB
2520.03/2520.00	c CPU time              : 2520 s
2520.03/2520.00	c real time             : 2520 s
2520.03/2520.00	
2520.03/2520.00	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14862 MiB free)
  memory of node 1: 16384 MiB (14419 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408051-1569810082/watcher-4408051-1569810082 -o /tmp/evaluation-result-4408051-1569810082/solver-4408051-1569810082 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30039 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408051-1569810082.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=1780, runsolver pid=1777
Current StackSize limit: 8192 KiB


[startup+0.100124 s]*
/proc/loadavg: 2.00 2.01 2.05 3/201 1781
/proc/meminfo: memFree=29979228/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=32768 memory=9232 CPUtime=0.1 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 2494 0 0 0 10 0 0 0 20 0 1 0 556922935 33554432 2308 33554432000 4194304 6211132 140730284538752 140730284535288 5081341 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8192 2308 866 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9232 KiB

[startup+0.209649 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29978856/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=32768 memory=9232 CPUtime=0.21 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 2497 0 0 0 21 0 0 0 20 0 1 0 556922935 33554432 2308 33554432000 4194304 6211132 140730284538752 140730284535288 5078762 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8192 2308 866 493 0 1497 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9232 KiB

[startup+0.308999 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29978112/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33032 memory=9496 CPUtime=0.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 2572 0 0 0 31 0 0 0 20 0 1 0 556922935 33824768 2374 33554432000 4194304 6211132 140730284538752 140730284535288 5081280 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8258 2374 866 493 0 1563 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9496 KiB

[startup+0.700227 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29977236/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9496 CPUtime=0.69 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 2602 0 0 0 69 0 0 0 20 0 1 0 556922935 33959936 2374 33554432000 4194304 6211132 140730284538752 140730284536344 5075581 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2374 866 493 0 1596 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9496 KiB

[startup+1.50023 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29975748/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9760 CPUtime=1.49 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 2606 0 0 0 149 0 0 0 20 0 1 0 556922935 33959936 2440 33554432000 4194304 6211132 140730284538752 140730284536344 5409485 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2440 866 493 0 1596 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9760 KiB

[startup+3.10907 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29968968/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9784 CPUtime=3.09 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 4087 0 0 0 309 0 0 0 20 0 1 0 556922935 33959936 2446 33554432000 4194304 6211132 140730284538752 140730284536712 5193728 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29959916/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9796 CPUtime=6.28 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 5574 0 0 0 628 0 0 0 20 0 1 0 556922935 33959936 2449 33554432000 4194304 6211132 140730284538752 140730284536712 5081294 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29940984/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9796 CPUtime=12.68 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 7058 0 0 0 1268 0 0 0 20 0 1 0 556922935 33959936 2449 33554432000 4194304 6211132 140730284538752 140730284536712 5081322 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2449 866 493 0 1596 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9796 KiB

[startup+25.5002 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1781
/proc/meminfo: memFree=29901760/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9808 CPUtime=25.49 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 10021 0 0 0 2548 1 0 0 20 0 1 0 556922935 33959936 2452 33554432000 4194304 6211132 140730284538752 140730284536712 5076480 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+51.1092 s]
/proc/loadavg: 2.00 2.01 2.05 5/213 1812
/proc/meminfo: memFree=30007424/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9808 CPUtime=51.09 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 11515 0 0 0 5108 1 0 0 20 0 1 0 556922935 33959936 2452 33554432000 4194304 6211132 140730284538752 140730284536712 5075678 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1847
/proc/meminfo: memFree=30190840/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33164 memory=9808 CPUtime=102.27 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 11993 0 0 0 10226 1 0 0 20 0 1 0 556922935 33959936 2452 33554432000 4194304 6211132 140730284538752 140730284536712 5075694 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8291 2452 866 493 0 1596 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9808 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1851
/proc/meminfo: memFree=30190420/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9808 CPUtime=162.27 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 12467 0 0 0 16226 1 0 0 20 0 1 0 556922935 34095104 2452 33554432000 4194304 6211132 140730284538752 140730284536344 5078762 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2452 866 493 0 1629 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1857
/proc/meminfo: memFree=30189288/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9812 CPUtime=222.27 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 12936 0 0 0 22226 1 0 0 20 0 1 0 556922935 34095104 2453 33554432000 4194304 6211132 140730284538752 140730284536712 5083248 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2453 866 493 0 1629 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+282.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/199 1862
/proc/meminfo: memFree=30190032/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9816 CPUtime=282.28 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 13411 0 0 0 28226 2 0 0 20 0 1 0 556922935 34095104 2454 33554432000 4194304 6211132 140730284538752 140730284536712 5074990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2454 866 493 0 1629 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9816 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 1866
/proc/meminfo: memFree=30190164/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9820 CPUtime=342.28 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 13884 0 0 0 34226 2 0 0 20 0 1 0 556922935 34095104 2455 33554432000 4194304 6211132 140730284538752 140730284536712 5081220 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2455 866 493 0 1629 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9820 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 1872
/proc/meminfo: memFree=30189892/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9820 CPUtime=402.28 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 14359 0 0 0 40226 2 0 0 20 0 1 0 556922935 34095104 2455 33554432000 4194304 6211132 140730284538752 140730284536712 5076399 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2455 866 493 0 1629 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9820 KiB

[startup+462.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/199 1877
/proc/meminfo: memFree=30190544/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=462.28 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 14832 0 0 0 46226 2 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5076389 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB


################
# More data... #
################

/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 1722.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2003
/proc/meminfo: memFree=30188900/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=1782.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 22591 0 0 0 178228 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5082827 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2009
/proc/meminfo: memFree=30188028/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=1842.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 23065 0 0 0 184228 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5079246 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2013
/proc/meminfo: memFree=30188356/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=1902.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 23279 0 0 0 190228 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5079264 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 1902.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2019
/proc/meminfo: memFree=30187860/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=1962.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 23748 0 0 0 196228 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5074683 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 1962.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2025
/proc/meminfo: memFree=30188008/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2022.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 23956 0 0 0 202228 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5074626 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2022.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2030
/proc/meminfo: memFree=30188320/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2082.31 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 24166 0 0 0 208228 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5075851 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2034
/proc/meminfo: memFree=30188156/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2142.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 24372 0 0 0 214229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5082468 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2041
/proc/meminfo: memFree=30187560/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2202.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 24849 0 0 0 220229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5082416 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2046
/proc/meminfo: memFree=30187944/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2262.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 25060 0 0 0 226229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5076405 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2262.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2050
/proc/meminfo: memFree=30187700/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2322.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 25270 0 0 0 232229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5078940 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2322.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2063
/proc/meminfo: memFree=30187748/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2382.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 25482 0 0 0 238229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5186278 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2382.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2442.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/200 2090
/proc/meminfo: memFree=30187880/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2442.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 25956 0 0 0 244229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5079295 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2442.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

[startup+2502.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2094
/proc/meminfo: memFree=30188256/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2502.32 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 26160 0 0 0 250229 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5075168 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2502.32 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.02 2.05 3/201 2097
/proc/meminfo: memFree=30188424/32770624 swapFree=66954180/67108860
[pid=1780] ppid=1777 vsize=33296 memory=9828 CPUtime=2520.03 cores=0,2,4,6
/proc/1780/stat : 1780 (cosoco) R 1777 1780 30008 0 -1 4202496 26359 0 0 0 252000 3 0 0 20 0 1 0 556922935 34095104 2457 33554432000 4194304 6211132 140730284538752 140730284536712 5081363 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 24854528 140730284545035 140730284545137 140730284545137 140730284548046 0
/proc/1780/statm: 8324 2457 866 493 0 1629 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9828 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 1780 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.036 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.04
CPU user time (s): 2520
CPU system time (s): 0.036
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.036
maximum resident set size= 9892
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26411
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 1913


# summary of solver processes directly reported to runsolver:
#   pid: 1780
#   total CPU time (s): 2520.04
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.036

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.686 second user time and 16.6498 second system time

The end

Launcher Data

Begin job on node119 at 2019-09-30 04:20:41
IDJOB=4408051
IDBENCH=138945
IDSOLVER=2874
FILE ID=node119/4408051-1569810082
RUNJOBID= node119-1569787352-30039
PBS_JOBID= 21705833
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-05.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408051-1569810082/watcher-4408051-1569810082 -o /tmp/evaluation-result-4408051-1569810082/solver-4408051-1569810082 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30039 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408051-1569810082.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 28a405c699ff9e569ded15e71872b7af
RANDOM SEED=1186421038

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29984380 kB
MemAvailable:   31610924 kB
Buffers:          217188 kB
Cached:          1747884 kB
SwapCached:        46700 kB
Active:          1294068 kB
Inactive:         940272 kB
Active(anon):     233760 kB
Inactive(anon):   117712 kB
Active(file):    1060308 kB
Inactive(file):   822560 kB
Unevictable:      107588 kB
Mlocked:          107588 kB
SwapTotal:      67108860 kB
SwapFree:       66954180 kB
Dirty:              2876 kB
Writeback:             0 kB
AnonPages:        332652 kB
Mapped:            28196 kB
Shmem:             73180 kB
Slab:             147872 kB
SReclaimable:     119020 kB
SUnreclaim:        28852 kB
KernelStack:        3616 kB
PageTables:         5904 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     784968 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     81920 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 62024 MiB
End job on node119 at 2019-09-30 05:02:41