Trace number 4389649

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.07 2519.9

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gs/
qwh-o100-h10000.xml
MD5SUM2d32aa9e5f9738deac3ebf02ed7c37b3
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark67.7052
Satisfiable
(Un)Satisfiability was proved
Number of variables10000
Number of constraints1
Number of domains1
Minimum domain size100
Maximum domain size100
Distribution of domain sizes[{"size":100,"count":10000}]
Minimum variable degree1
Maximum variable degree1
Distribution of variable degrees[{"degree":1,"count":10000}]
Minimum constraint arity10000
Maximum constraint arity10000
Distribution of constraint arities[{"arity":10000,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.21/0.27	c root propagations     : 0           
0.21/0.27	c restarts enabled, print stats at every restarts
0.21/0.27	c
0.21/0.27	c
0.21/0.27	c
0.21/0.27	c This is cosoco 2.00 --  
0.21/0.27	c
0.21/0.27	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389649-1568358554.xml 
0.21/0.27	c ========================================[ Problem Statistics ]===========================================
0.21/0.27	c |                                                                                                       
0.21/0.27	c |  Parse time        :         0.05 s 
0.21/0.27	c |
0.21/0.27	c |               Variables: 10000
0.21/0.27	c |            Domain Sizes: 100..100
0.21/0.27	c |
0.21/0.27	c |             Constraints: 200
0.21/0.27	c |                   Arity: 100..100
0.21/0.27	c | 
0.21/0.27	c |                   Types: 
0.21/0.27	c |                          All Different: 200
0.21/0.27	c |                          
0.21/0.27	c =========================================================================================================
0.21/0.27	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
1.79/1.80	c 101            7057           91560          400629         0              0              2607   6875   6757
3.10/3.19	c 211            12399          171849         718296         0              0              993   5104   4799
5.00/5.02	c 332            18864          278034         1117539        0              0              5   6233   5626
6.89/6.99	c 465            25140          395833         1530565        0              0              6   6042   4747
8.19/8.27	c 611            28861          478482         1780509        0              0              7   3444   3242
10.19/10.24	c 771            34670          602138         2187301        0              0              12   5474   4796
12.00/12.02	c 947            39851          717349         2536429        0              0              19   4877   3673
13.39/13.48	c 1140           43901          814160         2813435        0              0              23   3732   3310
15.10/15.19	c 1352           48806          926885         3089449        0              0              29   4523   3235
16.68/16.75	c 1585           53344          1030960        3355814        0              0              30   4147   3287
17.88/17.95	c 1841           57136          1120085        3565359        0              0              32   3356   2864
19.48/19.52	c 2122           62229          1236104        3882516        0              0              40   4600   3475
21.18/21.21	c 2431           67534          1357587        4221698        0              0              49   4755   3669
22.78/22.80	c 2770           72751          1472612        4536761        0              0              63   4565   3657
24.48/24.55	c 3142           78716          1598055        4915387        0              0              90   5369   3916
26.09/26.18	c 3551           84272          1714448        5239450        0              0              42   4824   3912
27.88/27.95	c 4000           90234          1839863        5606956        0              0              33   5227   3747
29.58/29.64	c 4493           96063          1960332        5978811        0              0              22   5028   3992
31.09/31.14	c 5035           101153         2069728        6300438        0              0              28   4171   3617
32.98/33.01	c 5631           107965         2203246        6671626        0              0              32   5839   4147
34.48/34.54	c 6286           113521         2311221        6980818        0              0              48   4374   3747
36.48/36.58	c 7006           120655         2454343        7494754        0              0              32   5968   4647
38.27/38.30	c 7798           127244         2576367        7838315        0              0              37   5098   4160
39.77/39.87	c 8669           133049         2688629        8188784        0              0              36   4176   3747
45.27/45.35	c 9627           140469         2830442        8790694        0              0              24   5578   4662
45.27/45.35	c 10680          147623         2962801        9201916        0              0              29   5184   4423
45.78/45.83	c 11838          155013         3100736        9715879        0              0              35   5307   4186
47.78/47.87	c 13111          162396         3238109        10202451       0              0              36   5044   4112
50.09/50.17	c 14511          170869         3391863        10849079       0              0              31   5901   4828
51.78/51.89	c 16051          177570         3509366        11298840       0              0              27   3849   3519
53.98/54.04	c 17745          186390         3653274        11848957       0              0              26   5581   4546
56.47/56.57	c 19608          196729         3810961        12446497       0              0              32   6030   5122
59.17/59.26	c 21657          205931         3975017        13216231       0              0              42   5511   4943
61.88/61.91	c 23910          216624         4146935        14005865       0              0              58   6343   4788
64.47/64.56	c 26388          227218         4318916        15002315       0              0              9   6029   5176
67.27/67.32	c 29113          238357         4499153        15870701       0              0              10   6096   4629
70.08/70.12	c 32110          249848         4679692        16788632       0              0              4   5711   5235
73.17/73.20	c 35406          262368         4878059        17753599       0              0              4   5713   5083
76.47/76.56	c 39031          275823         5090006        19084508       0              0              5   6522   5047
80.27/80.33	c 43018          289791         5321792        20581938       0              0              7   6038   5526
83.77/83.82	c 47403          304889         5541896        21893797       0              0              6   6096   5050
87.17/87.21	c 52226          319374         5755070        23395783       0              0              20   5030   4757
90.77/90.85	c 57531          333912         5983572        24777105       0              0              30   4744   4522
96.37/96.44	c 63366          349735         6328515        27877340       0              0              21   4956   4709
100.57/100.65	c 69784          368178         6590055        29657834       0              0              20   6038   4871
105.47/105.59	c 76843          386122         6894472        31974434       0              0              24   4962   4746
110.76/110.86	c 84607          406958         7213864        35348136       0              0              34   5397   5187
117.15/117.28	c 93147          430510         7599923        38785466       0              0              19   6768   6237
123.07/123.16	c 102541         453657         7952670        41810397       0              0              12   6351   6099
131.76/131.82	c 112874         483001         8468941        46836980       0              0              13   6752   6398
139.56/139.64	c 124240         512876         8931444        51020193       0              0              27   6655   6292
146.46/146.57	c 136742         543492         9357913        54881243       0              0              34   5729   5551
157.35/157.44	c 150494         581832         9998051        59776403       0              0              13   6813   6377
167.36/167.47	c 165621         618661         10596617       65101823       0              0              16   5248   5140
179.76/179.82	c 182260         658285         11333677       72373571       0              0              17   5972   5766
190.26/190.32	c 200562         701358         11956857       77343194       0              0              19   4962   4875
201.77/201.80	c 220694         749653         12625533       83629101       0              0              23   5720   5608
215.16/215.26	c 242839         799222         13406058       91773643       0              0              16   6104   5926
231.76/231.89	c 267198         855972         14360636       100914981      0              0              21   7307   6572
244.07/244.14	c 293992         917115         15101110       106686195      0              0              28   5166   5084
259.47/259.50	c 323465         977337         16021626       116535738      0              0              20   6117   5843
278.08/278.14	c 355885         1049403        17089191       129313448      0              0              24   6167   6075
293.37/293.41	c 391547         1122353        17982025       138867923      0              0              12   5240   5182
310.67/310.77	c 430775         1202966        19020381       149509069      0              0              20   5279   5178
327.47/327.54	c 473925         1300313        20047358       156909728      0              0              21   3959   3932
350.77/350.88	c 521390         1402566        21355907       173541674      0              0              33   5970   5910
384.48/384.58	c 573601         1512050        23266404       196321660      0              0              30   6093   6021
414.38/414.40	c 631033         1623026        24962099       215905377      0              0              41   6285   6108
445.88/445.99	c 694208         1752875        26776454       237510098      0              0              42   5779   5714
488.58/488.60	c 763700         1901669        29170669       264559263      0              0              14   7088   5972
532.89/532.98	c 840141         2064357        31617711       299695528      0              0              22   7142   6694
579.59/579.67	c 924226         2247217        34336761       326323733      0              0              26   6635   6586
628.89/628.92	c 1016719        2444577        37151062       358142671      0              0              12   6773   6574
672.60/672.63	c 1118461        2656327        39734182       388563247      0              0              13   5786   5755
743.51/743.54	c 1230377        2900052        43609105       436172325      0              0              18   7711   7071
844.51/844.54	c 1353484        3213370        48950989       519431422      0              0              19   7234   7153
914.92/914.91	c 1488901        3467737        52910044       561979750      0              0              10   6342   6304
988.53/988.58	c 1637859        3776424        57189366       605371687      0              0              15   6405   6364
1068.83/1068.84	c 1801712        4124931        61665924       662881992      0              0              18   6645   6411
1161.54/1161.50	c 1981950        4599765        66916740       723631875      0              0              34   7267   7201
1313.95/1313.94	c 2180211        5015174        75276761       844503555      0              0              38   6937   6907
1430.17/1430.14	c 2398298        5497542        81722685       928733104      0              0              14   6489   5919
1540.47/1540.45	c 2638193        6020620        87961645       993579350      0              0              15   5801   5782
1682.59/1682.56	c 2902077        6588761        95917749       1084315098     0              0              17   6161   6144
1887.80/1887.72	c 3192349        7175030        107316766      1202462298     0              0              28   6401   6352
2029.82/2029.74	c 3511648        7768831        115518382      1291302069     0              0              14   6102   6088
2237.83/2237.70	c 3862876        8596414        127039355      1424196300     0              0              19   7146   -5699
2415.95/2415.81	c 4249226        9369127        137312432      1589773885     0              0              17   5968   -5161
2520.05/2519.90	
2520.05/2519.90	c *** INTERRUPTED ***
2520.05/2519.90	c restarts              : 88          
2520.05/2519.90	c conflicts             : 4436565      (1761 /sec)
2520.05/2519.90	c decisions             : 9770776      (3878 /sec)
2520.05/2519.90	c propagations          : 1653600712  (656256 /sec)
2520.05/2519.90	c root propagations     : 0           
2520.05/2519.90	c filter calls          : 143357611      (56894 /sec)
2520.05/2519.90	c useless filter calls  : 54117135       (37 %)
2520.05/2519.90	c Memory used           : 419.79 MB
2520.05/2519.90	c CPU time              : 2519.75 s
2520.05/2519.90	c real time             : 2519.9 s
2520.05/2519.90	
2520.05/2519.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15312 MiB free)
  memory of node 1: 16384 MiB (15614 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389649-1568358554/watcher-4389649-1568358554 -o /tmp/evaluation-result-4389649-1568358554/solver-4389649-1568358554 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node133-1568358515-4203 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389649-1568358554.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=4228, runsolver pid=4224

[startup+0.100201 s]*
/proc/loadavg: 0.94 1.44 1.81 3/204 4234
/proc/meminfo: memFree=31540752/32770624 swapFree=67003480/67108860
[pid=4228] ppid=4224 vsize=50848 memory=27248 CPUtime=0.1 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 7011 0 0 0 10 0 0 0 20 0 1 0 412095065 52068352 6812 33554432000 4194304 6210612 140737475079584 140737475075528 5397066 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 12712 6812 822 493 0 6017 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 50848 KiB
Current children cumulated memory: 27248 KiB

[startup+0.210367 s]*
/proc/loadavg: 0.94 1.44 1.81 3/204 4234
/proc/meminfo: memFree=31362380/32770624 swapFree=67003480/67108860
[pid=4228] ppid=4224 vsize=50848 memory=27248 CPUtime=0.21 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 7011 0 0 0 21 0 0 0 20 0 1 0 412095065 52068352 6812 33554432000 4194304 6210612 140737475079584 140737475075528 5397066 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 12712 6812 822 493 0 6017 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 50848 KiB
Current children cumulated memory: 27248 KiB

[startup+0.30967 s]*
/proc/loadavg: 0.94 1.44 1.81 3/204 4234
/proc/meminfo: memFree=31199444/32770624 swapFree=67003480/67108860
[pid=4228] ppid=4224 vsize=50848 memory=27248 CPUtime=0.3 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 7018 0 0 0 30 0 0 0 20 0 1 0 412095065 52068352 6812 33554432000 4194304 6210612 140737475079584 140737475075528 5079064 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 12712 6812 822 493 0 6017 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 50848 KiB
Current children cumulated memory: 27248 KiB

[startup+0.700431 s]
/proc/loadavg: 0.94 1.44 1.81 3/204 4234
/proc/meminfo: memFree=30869604/32770624 swapFree=67003480/67108860
[pid=4228] ppid=4224 vsize=56832 memory=33044 CPUtime=0.69 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 8480 0 0 0 68 1 0 0 20 0 1 0 412095065 58195968 8261 33554432000 4194304 6210612 140737475079584 140737475075528 5074032 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 14208 8261 853 493 0 7513 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 56832 KiB
Current children cumulated memory: 33044 KiB

[startup+1.50042 s]
/proc/loadavg: 0.94 1.44 1.81 3/204 4234
/proc/meminfo: memFree=30032480/32770624 swapFree=67003480/67108860
[pid=4228] ppid=4224 vsize=144972 memory=116508 CPUtime=1.49 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 29312 0 0 0 146 3 0 0 20 0 1 0 412095065 148451328 29127 33554432000 4194304 6210612 140737475079584 140737475077176 139707190070144 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 36243 29127 853 493 0 29548 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 144972 KiB
Current children cumulated memory: 116508 KiB

[startup+3.10992 s]
/proc/loadavg: 0.94 1.44 1.81 2/204 4235
/proc/meminfo: memFree=29077492/32770624 swapFree=67003492/67108860
[pid=4228] ppid=4224 vsize=229860 memory=194552 CPUtime=3.1 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 65674 0 0 0 304 6 0 0 20 0 1 0 412095065 235376640 48638 33554432000 4194304 6210612 140737475079584 140737475077176 5184775 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 57465 48638 856 493 0 50770 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 229860 KiB
Current children cumulated memory: 194552 KiB

[startup+6.3003 s]
/proc/loadavg: 1.10 1.47 1.81 2/204 4235
/proc/meminfo: memFree=28354596/32770624 swapFree=67003492/67108860
[pid=4228] ppid=4224 vsize=277956 memory=240460 CPUtime=6.29 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 103663 0 0 0 620 9 0 0 20 0 1 0 412095065 284626944 60115 33554432000 4194304 6210612 140737475079584 140737475077544 5075200 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 69489 60115 856 493 0 62794 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 277956 KiB
Current children cumulated memory: 240460 KiB

[startup+12.7003 s]
/proc/loadavg: 1.34 1.51 1.83 2/205 4236
/proc/meminfo: memFree=27339740/32770624 swapFree=67003492/67108860
[pid=4228] ppid=4224 vsize=330464 memory=289804 CPUtime=12.69 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 152721 0 0 0 1256 13 0 0 20 0 1 0 412095065 338395136 72451 33554432000 4194304 6210612 140737475079584 140737475077544 5076037 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 82616 72451 856 493 0 75921 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 330464 KiB
Current children cumulated memory: 289804 KiB

[startup+25.5003 s]
/proc/loadavg: 1.93 1.63 1.86 2/205 4236
/proc/meminfo: memFree=25769848/32770624 swapFree=67003492/67108860
[pid=4228] ppid=4224 vsize=340220 memory=299192 CPUtime=25.48 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 193347 0 0 0 2533 15 0 0 20 0 1 0 412095065 348385280 74798 33554432000 4194304 6210612 140737475079584 140737475077544 5079064 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 85055 74798 856 493 0 78360 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 340220 KiB
Current children cumulated memory: 299192 KiB

[startup+51.1098 s]
/proc/loadavg: 3.11 1.94 1.95 2/205 4239
/proc/meminfo: memFree=25775584/32770624 swapFree=67003492/67108860
[pid=4228] ppid=4224 vsize=357752 memory=316796 CPUtime=51.09 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 247281 0 0 0 5091 18 0 0 20 0 1 0 412095065 366338048 79199 33554432000 4194304 6210612 140737475079584 140737475077544 5078572 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 89438 79199 856 493 0 82743 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 357752 KiB
Current children cumulated memory: 316796 KiB

[startup+102.3 s]
/proc/loadavg: 3.65 2.24 2.06 2/205 4313
/proc/meminfo: memFree=25895432/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=378052 memory=341152 CPUtime=102.27 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 297821 0 0 0 10205 22 0 0 20 0 1 0 412095065 387125248 85288 33554432000 4194304 6210612 140737475079584 140737475077544 5380107 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 94513 85288 856 493 0 87818 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 378052 KiB
Current children cumulated memory: 341152 KiB

[startup+162.3 s]
/proc/loadavg: 4.09 2.61 2.19 2/205 4381
/proc/meminfo: memFree=24235976/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=391252 memory=358924 CPUtime=162.26 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 327686 0 0 0 16199 27 0 0 20 0 1 0 412095065 400642048 89731 33554432000 4194304 6210612 140737475079584 140737475077544 5081399 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 97813 89731 856 493 0 91118 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 391252 KiB
Current children cumulated memory: 358924 KiB

[startup+222.3 s]
/proc/loadavg: 3.02 2.61 2.22 3/205 4451
/proc/meminfo: memFree=30875688/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=391532 memory=364772 CPUtime=222.26 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 335052 0 0 0 22199 27 0 0 20 0 1 0 412095065 400928768 91193 33554432000 4194304 6210612 140737475079584 140737475076872 5409293 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 97883 91193 856 493 0 91188 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 391532 KiB
Current children cumulated memory: 364772 KiB

[startup+282.3 s]
/proc/loadavg: 2.37 2.50 2.21 3/205 4457
/proc/meminfo: memFree=30244780/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=402108 memory=377276 CPUtime=282.27 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 340352 0 0 0 28199 28 0 0 20 0 1 0 412095065 411758592 94319 33554432000 4194304 6210612 140737475079584 140737475077544 5082021 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 100527 94319 856 493 0 93832 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 402108 KiB
Current children cumulated memory: 377276 KiB

[startup+342.3 s]
/proc/loadavg: 2.14 2.41 2.20 3/205 4462
/proc/meminfo: memFree=29625172/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=402108 memory=377312 CPUtime=342.27 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 341615 0 0 0 34199 28 0 0 20 0 1 0 412095065 411758592 94328 33554432000 4194304 6210612 140737475079584 140737475077544 5192880 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 100527 94328 856 493 0 93832 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 402108 KiB
Current children cumulated memory: 377312 KiB

[startup+402.3 s]
/proc/loadavg: 2.10 2.35 2.19 3/205 4466
/proc/meminfo: memFree=29003928/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=402668 memory=377676 CPUtime=402.28 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 343409 0 0 0 40200 28 0 0 20 0 1 0 412095065 412332032 94419 33554432000 4194304 6210612 140737475079584 140737475076872 5082059 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 100667 94419 856 493 0 93972 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 402668 KiB
Current children cumulated memory: 377676 KiB

[startup+462.3 s]
/proc/loadavg: 2.04 2.29 2.18 3/205 4472
/proc/meminfo: memFree=28381796/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=406648 memory=380884 CPUtime=462.28 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 345796 0 0 0 46200 28 0 0 20 0 1 0 412095065 416407552 95221 33554432000 4194304 6210612 140737475079584 140737475076872 5074335 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 101662 95221 856 493 0 94967 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 406648 KiB
Current children cumulated memory: 380884 KiB


################
# More data... #
################

/proc/4228/statm: 107193 99818 856 493 0 100498 0
Current children cumulated CPU time: 1722.39 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 399272 KiB

[startup+1782.3 s]
/proc/loadavg: 2.41 2.18 2.10 3/204 4665
/proc/meminfo: memFree=31239632/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428772 memory=399272 CPUtime=1782.4 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 387181 0 0 0 178209 31 0 0 20 0 1 0 412095065 439062528 99818 33554432000 4194304 6210612 140737475079584 140737475076872 5078380 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107193 99818 856 493 0 100498 0
Current children cumulated CPU time: 1782.4 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 399272 KiB

[startup+1842.3 s]
/proc/loadavg: 2.15 2.15 2.10 3/204 4669
/proc/meminfo: memFree=31239272/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428772 memory=399272 CPUtime=1842.4 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 387281 0 0 0 184209 31 0 0 20 0 1 0 412095065 439062528 99818 33554432000 4194304 6210612 140737475079584 140737475076872 5075988 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107193 99818 856 493 0 100498 0
Current children cumulated CPU time: 1842.4 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 399272 KiB

[startup+1902.3 s]
/proc/loadavg: 2.24 2.17 2.11 3/204 4683
/proc/meminfo: memFree=31239788/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428772 memory=399272 CPUtime=1902.41 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 389718 0 0 0 190210 31 0 0 20 0 1 0 412095065 439062528 99818 33554432000 4194304 6210612 140737475079584 140737475077544 5078999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107193 99818 856 493 0 100498 0
Current children cumulated CPU time: 1902.41 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 399272 KiB

[startup+1962.3 s]
/proc/loadavg: 2.09 2.14 2.10 3/204 4687
/proc/meminfo: memFree=31240012/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428772 memory=399272 CPUtime=1962.41 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 389815 0 0 0 196210 31 0 0 20 0 1 0 412095065 439062528 99818 33554432000 4194304 6210612 140737475079584 140737475077544 5075837 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107193 99818 856 493 0 100498 0
Current children cumulated CPU time: 1962.41 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 399272 KiB

[startup+2022.3 s]
/proc/loadavg: 2.03 2.11 2.10 3/204 4691
/proc/meminfo: memFree=31240192/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428772 memory=399364 CPUtime=2022.41 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 389869 0 0 0 202210 31 0 0 20 0 1 0 412095065 439062528 99841 33554432000 4194304 6210612 140737475079584 140737475077544 5080999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107193 99841 856 493 0 100498 0
Current children cumulated CPU time: 2022.41 s
Current children cumulated vsize: 428772 KiB
Current children cumulated memory: 399364 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.09 2.09 3/203 4697
/proc/meminfo: memFree=31233468/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428916 memory=405092 CPUtime=2082.42 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 392139 0 0 0 208211 31 0 0 20 0 1 0 412095065 439209984 101273 33554432000 4194304 6210612 140737475079584 140737475076872 5074035 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107229 101273 856 493 0 100534 0
Current children cumulated CPU time: 2082.42 s
Current children cumulated vsize: 428916 KiB
Current children cumulated memory: 405092 KiB

[startup+2142.3 s]
/proc/loadavg: 2.09 2.10 2.10 3/203 4701
/proc/meminfo: memFree=31233872/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428916 memory=405116 CPUtime=2142.42 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 392176 0 0 0 214211 31 0 0 20 0 1 0 412095065 439209984 101279 33554432000 4194304 6210612 140737475079584 140737475076872 5074720 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107229 101279 856 493 0 100534 0
Current children cumulated CPU time: 2142.42 s
Current children cumulated vsize: 428916 KiB
Current children cumulated memory: 405116 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.09 2.09 3/203 4706
/proc/meminfo: memFree=31233444/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=428916 memory=405116 CPUtime=2202.43 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 392193 0 0 0 220212 31 0 0 20 0 1 0 412095065 439209984 101279 33554432000 4194304 6210612 140737475079584 140737475076872 5074907 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107229 101279 856 493 0 100534 0
Current children cumulated CPU time: 2202.43 s
Current children cumulated vsize: 428916 KiB
Current children cumulated memory: 405116 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.07 2.08 3/204 4713
/proc/meminfo: memFree=31233288/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=429856 memory=405904 CPUtime=2262.43 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 393336 0 0 0 226212 31 0 0 20 0 1 0 412095065 440172544 101476 33554432000 4194304 6210612 140737475079584 140737475077544 5079064 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107464 101476 856 493 0 100769 0
Current children cumulated CPU time: 2262.43 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 405904 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.06 2.08 3/204 4717
/proc/meminfo: memFree=31233268/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=429856 memory=405904 CPUtime=2322.44 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 393378 0 0 0 232213 31 0 0 20 0 1 0 412095065 440172544 101476 33554432000 4194304 6210612 140737475079584 140737475077544 5409289 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107464 101476 856 493 0 100769 0
Current children cumulated CPU time: 2322.44 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 405904 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.05 2.07 3/204 4721
/proc/meminfo: memFree=31233580/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=429856 memory=405904 CPUtime=2382.44 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 393390 0 0 0 238213 31 0 0 20 0 1 0 412095065 440172544 101476 33554432000 4194304 6210612 140737475079584 140737475077544 5082029 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107464 101476 856 493 0 100769 0
Current children cumulated CPU time: 2382.44 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 405904 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.04 2.07 3/204 4727
/proc/meminfo: memFree=31233404/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=429856 memory=405904 CPUtime=2442.45 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 394112 0 0 0 244214 31 0 0 20 0 1 0 412095065 440172544 101476 33554432000 4194304 6210612 140737475079584 140737475077544 5074245 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107464 101476 856 493 0 100769 0
Current children cumulated CPU time: 2442.45 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 405904 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.06 3/203 4738
/proc/meminfo: memFree=31232856/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=429856 memory=405904 CPUtime=2502.45 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 394119 0 0 0 250214 31 0 0 20 0 1 0 412095065 440172544 101476 33554432000 4194304 6210612 140737475079584 140737475077544 5409293 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107464 101476 856 493 0 100769 0
Current children cumulated CPU time: 2502.45 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 405904 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.03 2.06 3/203 4741
/proc/meminfo: memFree=31232812/32770624 swapFree=67003968/67108860
[pid=4228] ppid=4224 vsize=429856 memory=405904 CPUtime=2520.05 cores=0,2,4,6
/proc/4228/stat : 4228 (cosoco) R 4224 4228 4172 0 -1 4202496 394144 0 0 0 251974 31 0 0 20 0 1 0 412095065 440172544 101476 33554432000 4194304 6210612 140737475079584 140737475077544 5074032 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12111872 140737475085323 140737475085425 140737475085425 140737475088334 0
/proc/4228/statm: 107464 101476 856 493 0 100769 0
Current children cumulated CPU time: 2520.05 s
Current children cumulated vsize: 429856 KiB
Current children cumulated memory: 405904 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 4228 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.75 s, system=0.318022 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2519.9
CPU time (s): 2520.07
CPU user time (s): 2519.75
CPU system time (s): 0.318022
CPU usage (%): 100.007
Max. virtual memory (cumulated for all children) (KiB): 429856
Max. memory (cumulated for all children) (KiB): 405904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.75
system time used= 0.318022
maximum resident set size= 405972
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 394197
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 45
involuntary context switches= 998


# summary of solver processes directly reported to runsolver:
#   pid: 4228
#   total CPU time (s): 2520.07
#   total CPU user time (s): 2519.75
#   total CPU system time (s): 0.318022

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.63677 second user time and 16.9299 second system time

The end

Launcher Data 

Begin job on node133 at 2019-09-13 09:08:35
IDJOB=4389649
IDBENCH=139122
IDSOLVER=2829
FILE ID=node133/4389649-1568358554
RUNJOBID= node133-1568358515-4203
PBS_JOBID= 21701200
Free space on /tmp= 55116 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gs/qwh-o100-h10000.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389649-1568358554/watcher-4389649-1568358554 -o /tmp/evaluation-result-4389649-1568358554/solver-4389649-1568358554 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node133-1568358515-4203 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389649-1568358554.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2d32aa9e5f9738deac3ebf02ed7c37b3
RANDOM SEED=402450306

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31670560 kB
MemAvailable:   31901300 kB
Buffers:          145296 kB
Cached:           369688 kB
SwapCached:         3468 kB
Active:           263208 kB
Inactive:         254856 kB
Active(anon):      27232 kB
Inactive(anon):    15984 kB
Active(file):     235976 kB
Inactive(file):   238872 kB
Unevictable:      111500 kB
Mlocked:          111500 kB
SwapTotal:      67108860 kB
SwapFree:       67003480 kB
Dirty:              5808 kB
Writeback:             0 kB
AnonPages:        164980 kB
Mapped:            43124 kB
Shmem:             31340 kB
Slab:             171924 kB
SReclaimable:     143456 kB
SUnreclaim:        28468 kB
KernelStack:        3728 kB
PageTables:         5548 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     501340 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    122880 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 55108 MiB
End job on node133 at 2019-09-13 09:50:35