Trace number 4396929

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2519.82 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gs/
qwh-o100-h10000.xml
MD5SUM2d32aa9e5f9738deac3ebf02ed7c37b3
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark67.7052
Satisfiable
(Un)Satisfiability was proved
Number of variables10000
Number of constraints1
Number of domains1
Minimum domain size100
Maximum domain size100
Distribution of domain sizes[{"size":100,"count":10000}]
Minimum variable degree1
Maximum variable degree1
Distribution of variable degrees[{"degree":1,"count":10000}]
Minimum constraint arity10000
Maximum constraint arity10000
Distribution of constraint arities[{"arity":10000,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.20/0.27	c root propagations     : 0           
0.20/0.27	c restarts enabled, print stats at every restarts
0.20/0.27	c
0.20/0.27	c
0.20/0.27	c
0.20/0.27	c This is cosoco 2.00 --  
0.20/0.27	c
0.20/0.27	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396929-1568593814.xml 
0.20/0.27	c ========================================[ Problem Statistics ]===========================================
0.20/0.27	c |                                                                                                       
0.20/0.27	c |  Parse time        :         0.05 s 
0.20/0.27	c |
0.20/0.27	c |               Variables: 10000
0.20/0.27	c |            Domain Sizes: 100..100
0.20/0.27	c |
0.20/0.27	c |             Constraints: 200
0.20/0.27	c |                   Arity: 100..100
0.20/0.27	c | 
0.20/0.27	c |                   Types: 
0.20/0.27	c |                          All Different: 200
0.20/0.27	c |                          
0.20/0.27	c =========================================================================================================
0.20/0.27	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
1.69/1.79	c 101            7057           91560          400629         0              0              2607   6875   6757
3.09/3.14	c 211            12399          171849         718296         0              0              993   5104   4799
4.78/4.89	c 332            18864          278034         1117539        0              0              5   6233   5626
6.78/6.82	c 465            25140          395833         1530565        0              0              6   6042   4747
8.10/8.11	c 611            28861          478482         1780509        0              0              7   3444   3242
9.99/10.06	c 771            34670          602138         2187301        0              0              12   5474   4796
11.78/11.85	c 947            39851          717349         2536429        0              0              19   4877   3673
13.28/13.30	c 1140           43901          814160         2813435        0              0              23   3732   3310
14.99/15.01	c 1352           48806          926885         3089449        0              0              29   4523   3235
16.48/16.57	c 1585           53344          1030960        3355814        0              0              30   4147   3287
17.78/17.89	c 1841           57136          1120085        3565359        0              0              32   3356   2864
19.58/19.64	c 2122           62229          1236104        3882516        0              0              40   4600   3475
21.38/21.48	c 2431           67534          1357587        4221698        0              0              49   4755   3669
23.18/23.23	c 2770           72751          1472612        4536761        0              0              63   4565   3657
25.09/25.17	c 3142           78716          1598055        4915387        0              0              90   5369   3916
26.88/26.98	c 3551           84272          1714448        5239450        0              0              42   4824   3912
28.88/28.94	c 4000           90234          1839863        5606956        0              0              33   5227   3747
30.78/30.83	c 4493           96063          1960332        5978811        0              0              22   5028   3992
32.48/32.52	c 5035           101153         2069728        6300438        0              0              28   4171   3617
34.57/34.61	c 5631           107965         2203246        6671626        0              0              32   5839   4147
36.28/36.32	c 6286           113521         2311221        6980818        0              0              48   4374   3747
38.48/38.58	c 7006           120655         2454343        7494754        0              0              32   5968   4647
40.48/40.50	c 7798           127244         2576367        7838315        0              0              37   5098   4160
42.18/42.26	c 8669           133049         2688629        8188784        0              0              36   4176   3747
44.48/44.52	c 9627           140469         2830442        8790694        0              0              24   5578   4662
46.57/46.65	c 10680          147623         2962801        9201916        0              0              29   5184   4423
48.78/48.87	c 11838          155013         3100736        9715879        0              0              35   5307   4186
51.09/51.12	c 13111          162396         3238109        10202451       0              0              36   5044   4112
53.58/53.62	c 14511          170869         3391863        10849079       0              0              31   5901   4828
55.48/55.51	c 16051          177570         3509366        11298840       0              0              27   3849   3519
57.78/57.86	c 17745          186390         3653274        11848957       0              0              26   5581   4546
60.38/60.48	c 19608          196729         3810961        12446497       0              0              32   6030   5122
63.09/63.19	c 21657          205931         3975017        13216231       0              0              42   5511   4943
65.98/66.05	c 23910          216624         4146935        14005865       0              0              58   6343   4788
68.78/68.88	c 26388          227218         4318916        15002315       0              0              9   6029   5176
71.77/71.88	c 29113          238357         4499153        15870701       0              0              10   6096   4629
74.77/74.88	c 32110          249848         4679692        16788632       0              0              4   5711   5235
78.08/78.19	c 35406          262368         4878059        17753599       0              0              4   5713   5083
81.78/81.80	c 39031          275823         5090006        19084508       0              0              5   6522   5047
85.77/85.85	c 43018          289791         5321792        20581938       0              0              7   6038   5526
89.57/89.63	c 47403          304889         5541896        21893797       0              0              6   6096   5050
93.27/93.31	c 52226          319374         5755070        23395783       0              0              20   5030   4757
97.16/97.25	c 57531          333912         5983572        24777105       0              0              30   4744   4522
103.07/103.16	c 63366          349735         6328515        27877340       0              0              21   4956   4709
107.47/107.52	c 69784          368178         6590055        29657834       0              0              20   6038   4871
112.45/112.58	c 76843          386122         6894472        31974434       0              0              24   4962   4746
117.66/117.74	c 84607          406958         7213864        35348136       0              0              34   5397   5187
123.96/124.05	c 93147          430510         7599923        38785466       0              0              19   6768   6237
129.75/129.86	c 102541         453657         7952670        41810397       0              0              12   6351   6099
138.25/138.39	c 112874         483001         8468941        46836980       0              0              13   6752   6398
145.95/146.09	c 124240         512876         8931444        51020193       0              0              27   6655   6292
152.96/153.06	c 136742         543492         9357913        54881243       0              0              34   5729   5551
163.75/163.84	c 150494         581832         9998051        59776403       0              0              13   6813   6377
173.65/173.79	c 165621         618661         10596617       65101823       0              0              16   5248   5140
185.95/186.01	c 182260         658285         11333677       72373571       0              0              17   5972   5766
196.34/196.42	c 200562         701358         11956857       77343194       0              0              19   4962   4875
207.64/207.79	c 220694         749653         12625533       83629101       0              0              23   5720   5608
221.05/221.16	c 242839         799222         13406058       91773643       0              0              16   6104   5926
237.53/237.69	c 267198         855972         14360636       100914981      0              0              21   7307   6572
249.73/249.85	c 293992         917115         15101110       106686195      0              0              28   5166   5084
264.94/265.10	c 323465         977337         16021626       116535738      0              0              20   6117   5843
283.42/283.59	c 355885         1049403        17089191       129313448      0              0              24   6167   6075
298.62/298.74	c 391547         1122353        17982025       138867923      0              0              12   5240   5182
315.82/315.93	c 430775         1202966        19020381       149509069      0              0              20   5279   5178
332.51/332.68	c 473925         1300313        20047358       156909728      0              0              21   3959   3932
355.71/355.80	c 521390         1402566        21355907       173541674      0              0              33   5970   5910
389.02/389.12	c 573601         1512050        23266404       196321660      0              0              30   6093   6021
418.50/418.66	c 631033         1623026        24962099       215905377      0              0              41   6285   6108
449.80/449.98	c 694208         1752875        26776454       237510098      0              0              42   5779   5714
492.19/492.32	c 763700         1901669        29170669       264559263      0              0              14   7088   5972
536.28/536.40	c 840141         2064357        31617711       299695528      0              0              22   7142   6694
582.57/582.72	c 924226         2247217        34336761       326323733      0              0              26   6635   6586
631.36/631.58	c 1016719        2444577        37151062       358142671      0              0              12   6773   6574
674.56/674.78	c 1118461        2656327        39734182       388563247      0              0              13   5786   5755
745.05/745.20	c 1230377        2900052        43609105       436172325      0              0              18   7711   7071
845.44/845.63	c 1353484        3213370        48950989       519431422      0              0              19   7234   7153
915.24/915.45	c 1488901        3467737        52910044       561979750      0              0              10   6342   6304
988.44/988.64	c 1637859        3776424        57189366       605371687      0              0              15   6405   6364
1068.34/1068.51	c 1801712        4124931        61665924       662881992      0              0              18   6645   6411
1160.33/1160.58	c 1981950        4599765        66916740       723631875      0              0              34   7267   7201
1311.63/1311.86	c 2180211        5015174        75276761       844503555      0              0              38   6937   6907
1426.94/1427.12	c 2398298        5497542        81722685       928733104      0              0              14   6489   5919
1536.33/1536.59	c 2638193        6020620        87961645       993579350      0              0              15   5801   5782
1677.62/1677.84	c 2902077        6588761        95917749       1084315098     0              0              17   6161   6144
1882.02/1882.29	c 3192349        7175030        107316766      1202462298     0              0              28   6401   6352
2023.01/2023.29	c 3511648        7768831        115518382      1291302069     0              0              14   6102   6088
2229.51/2229.73	c 3862876        8596414        127039355      1424196300     0              0              19   7146   -5699
2406.40/2406.63	c 4249226        9369127        137312432      1589773885     0              0              17   5968   -5161
2519.81/2520.00	
2519.81/2520.00	c *** INTERRUPTED ***
2519.81/2520.00	c restarts              : 88          
2519.81/2520.00	c conflicts             : 4454780      (1768 /sec)
2519.81/2520.00	c decisions             : 9809546      (3894 /sec)
2519.81/2520.00	c propagations          : 1659490884  (658674 /sec)
2519.81/2520.00	c root propagations     : 0           
2519.81/2520.00	c filter calls          : 143944687      (57134 /sec)
2519.81/2520.00	c useless filter calls  : 54314477       (37 %)
2519.81/2520.00	c Memory used           : 419.79 MB
2519.81/2520.00	c CPU time              : 2519.44 s
2519.81/2520.00	c real time             : 2520 s
2519.81/2520.00	
2519.81/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9871 MiB free)
  memory of node 1: 16384 MiB (15147 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396929-1568593814/watcher-4396929-1568593814 -o /tmp/evaluation-result-4396929-1568593814/solver-4396929-1568593814 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568572746-32297 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396929-1568593814.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=3835, runsolver pid=3832
Current StackSize limit: 8192 KiB


[startup+0.100631 s]*
/proc/loadavg: 2.01 2.06 2.06 3/199 3836
/proc/meminfo: memFree=25595552/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=50848 memory=27388 CPUtime=0.09 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 7013 0 0 0 8 1 0 0 20 0 1 0 435620106 52068352 6847 33554432000 4194304 6211092 140722354980496 140722354978760 5397235 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 12712 6847 849 493 0 6017 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 50848 KiB
Current children cumulated memory: 27388 KiB

[startup+0.209748 s]*
/proc/loadavg: 2.01 2.06 2.06 3/199 3836
/proc/meminfo: memFree=25595180/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=50848 memory=27388 CPUtime=0.2 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 7013 0 0 0 19 1 0 0 20 0 1 0 435620106 52068352 6847 33554432000 4194304 6211092 140722354980496 140722354978760 5397226 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 12712 6847 849 493 0 6017 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 50848 KiB
Current children cumulated memory: 27388 KiB

[startup+0.309051 s]*
/proc/loadavg: 2.01 2.06 2.06 3/199 3836
/proc/meminfo: memFree=25595180/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=50848 memory=27388 CPUtime=0.3 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 7021 0 0 0 29 1 0 0 20 0 1 0 435620106 52068352 6847 33554432000 4194304 6211092 140722354980496 140722354978760 5078923 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 12712 6847 849 493 0 6017 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 50848 KiB
Current children cumulated memory: 27388 KiB

[startup+0.700399 s]
/proc/loadavg: 2.01 2.06 2.06 3/199 3836
/proc/meminfo: memFree=25594452/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=56832 memory=33056 CPUtime=0.68 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 8483 0 0 0 67 1 0 0 20 0 1 0 435620106 58195968 8264 33554432000 4194304 6211092 140722354980496 140722354977944 5078762 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 14208 8264 857 493 0 7513 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 56832 KiB
Current children cumulated memory: 33056 KiB

[startup+1.50038 s]
/proc/loadavg: 2.01 2.06 2.06 3/199 3836
/proc/meminfo: memFree=25567556/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=145128 memory=116520 CPUtime=1.48 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 29351 0 0 0 144 4 0 0 20 0 1 0 435620106 148611072 29130 33554432000 4194304 6211092 140722354980496 140722354977944 5185143 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 36282 29130 857 493 0 29587 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 145128 KiB
Current children cumulated memory: 116520 KiB

[startup+3.10948 s]
/proc/loadavg: 2.01 2.06 2.06 3/199 3836
/proc/meminfo: memFree=25432196/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=230000 memory=194648 CPUtime=3.09 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 65658 0 0 0 302 7 0 0 20 0 1 0 435620106 235520000 48662 33554432000 4194304 6211092 140722354980496 140722354977784 5074626 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 57500 48662 859 493 0 50805 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 230000 KiB
Current children cumulated memory: 194648 KiB

[startup+6.30037 s]
/proc/loadavg: 2.09 2.07 2.06 3/199 3836
/proc/meminfo: memFree=25381792/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=283016 memory=245380 CPUtime=6.28 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 105645 0 0 0 618 10 0 0 20 0 1 0 435620106 289808384 61345 33554432000 4194304 6211092 140722354980496 140722354977784 5186224 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 70754 61345 859 493 0 64059 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 283016 KiB
Current children cumulated memory: 245380 KiB

[startup+12.7004 s]
/proc/loadavg: 2.16 2.09 2.07 3/199 3836
/proc/meminfo: memFree=25332068/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=330464 memory=289812 CPUtime=12.68 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 153869 0 0 0 1255 13 0 0 20 0 1 0 435620106 338395136 72453 33554432000 4194304 6211092 140722354980496 140722354978456 5409453 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 82616 72453 859 493 0 75921 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 330464 KiB
Current children cumulated memory: 289812 KiB

[startup+25.5004 s]
/proc/loadavg: 2.29 2.12 2.08 3/200 3846
/proc/meminfo: memFree=25323816/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=340220 memory=299196 CPUtime=25.48 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 195674 0 0 0 2532 16 0 0 20 0 1 0 435620106 348385280 74799 33554432000 4194304 6211092 140722354980496 140722354977784 5393040 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 85055 74799 859 493 0 78360 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 340220 KiB
Current children cumulated memory: 299196 KiB

[startup+51.1095 s]
/proc/loadavg: 2.55 2.20 2.11 3/199 3846
/proc/meminfo: memFree=25306884/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=355516 memory=314644 CPUtime=51.09 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 256831 0 0 0 5089 20 0 0 20 0 1 0 435620106 364048384 78661 33554432000 4194304 6211092 140722354980496 140722354978456 5076121 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 88879 78661 859 493 0 82184 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 355516 KiB
Current children cumulated memory: 314644 KiB

[startup+102.3 s]
/proc/loadavg: 2.32 2.20 2.11 3/199 3850
/proc/meminfo: memFree=25284992/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=376692 memory=335348 CPUtime=102.26 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 325876 0 0 0 10201 25 0 0 20 0 1 0 435620106 385732608 83837 33554432000 4194304 6211092 140722354980496 140722354978456 5380256 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 94173 83837 859 493 0 87478 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 376692 KiB
Current children cumulated memory: 335348 KiB

[startup+162.3 s]
/proc/loadavg: 2.12 2.16 2.11 3/199 3856
/proc/meminfo: memFree=25271044/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=391252 memory=350548 CPUtime=162.25 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 381640 0 0 0 16195 30 0 0 20 0 1 0 435620106 400642048 87637 33554432000 4194304 6211092 140722354980496 140722354977784 5392708 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 97813 87637 859 493 0 91118 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 391252 KiB
Current children cumulated memory: 350548 KiB

[startup+222.3 s]
/proc/loadavg: 2.08 2.15 2.11 3/199 3861
/proc/meminfo: memFree=25264564/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=391396 memory=357540 CPUtime=222.24 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 408342 0 0 0 22192 32 0 0 20 0 1 0 435620106 400789504 89385 33554432000 4194304 6211092 140722354980496 140722354978456 5186224 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 97849 89385 859 493 0 91154 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 391396 KiB
Current children cumulated memory: 357540 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.12 2.10 3/199 3865
/proc/meminfo: memFree=25251500/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=402108 memory=369992 CPUtime=282.22 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 425818 0 0 0 28189 33 0 0 20 0 1 0 435620106 411758592 92498 33554432000 4194304 6211092 140722354980496 140722354977784 5082411 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 100527 92498 859 493 0 93832 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 402108 KiB
Current children cumulated memory: 369992 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.10 2.09 3/199 3871
/proc/meminfo: memFree=25242908/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=402108 memory=378088 CPUtime=342.21 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 430079 0 0 0 34188 33 0 0 20 0 1 0 435620106 411758592 94522 33554432000 4194304 6211092 140722354980496 140722354978456 5078752 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 100527 94522 859 493 0 93832 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 402108 KiB
Current children cumulated memory: 378088 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.08 2.09 3/199 3875
/proc/meminfo: memFree=25242768/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=402668 memory=378468 CPUtime=402.21 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 431729 0 0 0 40187 34 0 0 20 0 1 0 435620106 412332032 94617 33554432000 4194304 6211092 140722354980496 140722354977784 5074642 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 100667 94617 859 493 0 93972 0
Current children cumulated CPU time: 402.21 s
Current children cumulated vsize: 402668 KiB
Current children cumulated memory: 378468 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.07 2.08 3/199 3879
/proc/meminfo: memFree=25242144/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=402668 memory=378576 CPUtime=462.2 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 433168 0 0 0 46186 34 0 0 20 0 1 0 435620106 412332032 94644 33554432000 4194304 6211092 140722354980496 140722354978456 5075228 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 100667 94644 859 493 0 93972 0
Current children cumulated CPU time: 462.2 s
Current children cumulated vsize: 402668 KiB
Current children cumulated memory: 378576 KiB


################
# More data... #
################

/proc/3835/statm: 107193 101283 859 493 0 100498 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 405132 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 4061
/proc/meminfo: memFree=24791040/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428772 memory=405132 CPUtime=1782.12 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 457000 0 0 0 178175 37 0 0 20 0 1 0 435620106 439062528 101283 33554432000 4194304 6211092 140722354980496 140722354977784 5082431 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107193 101283 859 493 0 100498 0
Current children cumulated CPU time: 1782.12 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 405132 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 4072
/proc/meminfo: memFree=24773336/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428772 memory=405136 CPUtime=1842.12 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 457164 0 0 0 184175 37 0 0 20 0 1 0 435620106 439062528 101284 33554432000 4194304 6211092 140722354980496 140722354977784 5074665 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107193 101284 859 493 0 100498 0
Current children cumulated CPU time: 1842.12 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 405136 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 4098
/proc/meminfo: memFree=24769316/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428772 memory=405136 CPUtime=1902.12 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 457843 0 0 0 190175 37 0 0 20 0 1 0 435620106 439062528 101284 33554432000 4194304 6211092 140722354980496 140722354978456 5075496 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107193 101284 859 493 0 100498 0
Current children cumulated CPU time: 1902.12 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 405136 KiB

[startup+1962.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/200 4104
/proc/meminfo: memFree=24760628/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428772 memory=405136 CPUtime=1962.12 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 457931 0 0 0 196175 37 0 0 20 0 1 0 435620106 439062528 101284 33554432000 4194304 6211092 140722354980496 140722354978456 5074863 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107193 101284 859 493 0 100498 0
Current children cumulated CPU time: 1962.12 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 405136 KiB

[startup+2022.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/200 4108
/proc/meminfo: memFree=24757028/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428772 memory=405136 CPUtime=2022.12 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 458019 0 0 0 202175 37 0 0 20 0 1 0 435620106 439062528 101284 33554432000 4194304 6211092 140722354980496 140722354978456 5076389 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107193 101284 859 493 0 100498 0
Current children cumulated CPU time: 2022.12 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 405136 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 4112
/proc/meminfo: memFree=24757088/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428916 memory=405160 CPUtime=2082.11 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 458736 0 0 0 208174 37 0 0 20 0 1 0 435620106 439209984 101290 33554432000 4194304 6211092 140722354980496 140722354977784 5409461 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107229 101290 859 493 0 100534 0
Current children cumulated CPU time: 2082.11 s
Current children cumulated vsize: 428916 KiB
Current children cumulated memory: 405160 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 4118
/proc/meminfo: memFree=24753688/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428916 memory=405224 CPUtime=2142.11 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 458796 0 0 0 214174 37 0 0 20 0 1 0 435620106 439209984 101306 33554432000 4194304 6211092 140722354980496 140722354977784 5081205 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107229 101306 859 493 0 100534 0
Current children cumulated CPU time: 2142.11 s
Current children cumulated vsize: 428916 KiB
Current children cumulated memory: 405224 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 4122
/proc/meminfo: memFree=24749648/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=428916 memory=405224 CPUtime=2202.11 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 458855 0 0 0 220174 37 0 0 20 0 1 0 435620106 439209984 101306 33554432000 4194304 6211092 140722354980496 140722354977784 5075188 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107229 101306 859 493 0 100534 0
Current children cumulated CPU time: 2202.11 s
Current children cumulated vsize: 428916 KiB
Current children cumulated memory: 405224 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 4126
/proc/meminfo: memFree=24746484/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=429856 memory=406020 CPUtime=2262.11 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 459824 0 0 0 226174 37 0 0 20 0 1 0 435620106 440172544 101505 33554432000 4194304 6211092 140722354980496 140722354978456 5079248 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107464 101505 859 493 0 100769 0
Current children cumulated CPU time: 2262.11 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 406020 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 4132
/proc/meminfo: memFree=24745852/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=429856 memory=406020 CPUtime=2322.1 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 459890 0 0 0 232173 37 0 0 20 0 1 0 435620106 440172544 101505 33554432000 4194304 6211092 140722354980496 140722354978456 5081349 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107464 101505 859 493 0 100769 0
Current children cumulated CPU time: 2322.1 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 406020 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 4136
/proc/meminfo: memFree=24745912/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=429856 memory=406020 CPUtime=2382.1 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 459934 0 0 0 238173 37 0 0 20 0 1 0 435620106 440172544 101505 33554432000 4194304 6211092 140722354980496 140722354978456 5074833 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107464 101505 859 493 0 100769 0
Current children cumulated CPU time: 2382.1 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 406020 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 4146
/proc/meminfo: memFree=24745836/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=429856 memory=406020 CPUtime=2442.1 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 460655 0 0 0 244173 37 0 0 20 0 1 0 435620106 440172544 101505 33554432000 4194304 6211092 140722354980496 140722354978456 5076376 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107464 101505 859 493 0 100769 0
Current children cumulated CPU time: 2442.1 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 406020 KiB

[startup+2502.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/201 4152
/proc/meminfo: memFree=24745748/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=429856 memory=406020 CPUtime=2502.1 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 460698 0 0 0 250173 37 0 0 20 0 1 0 435620106 440172544 101505 33554432000 4194304 6211092 140722354980496 140722354978456 5079273 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107464 101505 859 493 0 100769 0
Current children cumulated CPU time: 2502.1 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 406020 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.03 2.03 2.05 3/201 4152
/proc/meminfo: memFree=24745540/32770624 swapFree=66941248/67108860
[pid=3835] ppid=3832 vsize=429856 memory=406020 CPUtime=2519.81 cores=1,3,5,7
/proc/3835/stat : 3835 (cosoco) R 3832 3835 32265 0 -1 4202496 460733 0 0 0 251944 37 0 0 20 0 1 0 435620106 440172544 101505 33554432000 4194304 6211092 140722354980496 140722354978456 5079232 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 32354304 140722354983947 140722354984049 140722354984049 140722354986958 0
/proc/3835/statm: 107464 101505 859 493 0 100769 0
Current children cumulated CPU time: 2519.81 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 406020 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 3835 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.44 s, system=0.380974 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.82
CPU user time (s): 2519.44
CPU system time (s): 0.380974
CPU usage (%): 99.9926
Max. virtual memory (cumulated for all children) (KiB): 429856
Max. memory (cumulated for all children) (KiB): 406020

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.44
system time used= 0.380974
maximum resident set size= 406084
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 460784
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 44
involuntary context switches= 1174


# summary of solver processes directly reported to runsolver:
#   pid: 3835
#   total CPU time (s): 2519.82
#   total CPU user time (s): 2519.44
#   total CPU system time (s): 0.380974

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.44378 second user time and 15.996 second system time

The end

Launcher Data 

Begin job on node149 at 2019-09-16 02:29:36
IDJOB=4396929
IDBENCH=139122
IDSOLVER=2848
FILE ID=node149/4396929-1568593814
RUNJOBID= node149-1568572746-32297
PBS_JOBID= 21703308
Free space on /tmp= 61420 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gs/qwh-o100-h10000.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396929-1568593814/watcher-4396929-1568593814 -o /tmp/evaluation-result-4396929-1568593814/solver-4396929-1568593814 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568572746-32297 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396929-1568593814.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2d32aa9e5f9738deac3ebf02ed7c37b3
RANDOM SEED=917710739

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25618992 kB
MemAvailable:   31707656 kB
Buffers:          214116 kB
Cached:          6175276 kB
SwapCached:        61248 kB
Active:          2643904 kB
Inactive:        3941636 kB
Active(anon):     163708 kB
Inactive(anon):    80904 kB
Active(file):    2480196 kB
Inactive(file):  3860732 kB
Unevictable:      111216 kB
Mlocked:          111216 kB
SwapTotal:      67108860 kB
SwapFree:       66941248 kB
Dirty:              2792 kB
Writeback:             0 kB
AnonPages:        251612 kB
Mapped:            48656 kB
Shmem:             39848 kB
Slab:             156516 kB
SReclaimable:     127140 kB
SUnreclaim:        29376 kB
KernelStack:        3760 kB
PageTables:         5460 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     670240 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    202752 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      144768 kB
DirectMap2M:    33400832 kB

Free space on /tmp at the end= 61348 MiB
End job on node149 at 2019-09-16 03:11:37