Trace number 4243129

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.08 2400.31

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-15.xml
MD5SUMfdd30079817c8a7e676a6353b2e6ebba
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark7.1181402
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.04	c root propagations     : 4928        
0.00/0.04	c restarts enabled, print stats at every restarts
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c This is cosoco 1.0 --  
0.00/0.04	c
0.00/0.04	c ========================================[ Problem Statistics ]===========================================
0.00/0.04	c |                                                                                                       
0.00/0.04	c |  Parse time        :         0.01 s 
0.00/0.04	c |
0.00/0.04	c |               Variables: 900
0.00/0.04	c |            Domain Sizes: 30..30
0.00/0.04	c |
0.00/0.04	c |             Constraints: 586
0.00/0.04	c |                   Arity: 1..30  -- Unary: 526
0.00/0.04	c | 
0.00/0.04	c |                   Types: 
0.00/0.04	c |                          All Different: 60
0.00/0.04	c |                          Unary: 526
0.00/0.04	c |                          
0.00/0.04	c =========================================================================================================
0.00/0.04	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.09/0.14	c 101            1132           16913          50412          890            0              623   660   633
0.19/0.20	c 211            2752           28623          91567          890            0              321   412   382
0.29/0.33	c 332            5787           53801          175501         890            0              315   666   606
0.29/0.39	c 465            7076           66320          226641         890            0              547   670   635
0.39/0.45	c 611            8460           77514          274159         890            0              510   560   547
0.49/0.53	c 771            9871           92302          338562         890            0              429   654   618
0.59/0.62	c 947            11421          108929         405749         890            0              472   699   657
0.69/0.72	c 1140           12764          126800         481937         890            0              493   702   660
0.79/0.84	c 1352           14469          149589         574857         890            0              499   700   659
0.89/0.92	c 1585           15908          165659         644183         890            0              516   668   617
0.89/0.99	c 1841           17428          177756         699209         890            0              517   619   584
1.10/1.12	c 2122           19226          201936         800467         890            0              521   668   632
1.29/1.30	c 2431           21422          235798         959971         890            0              502   708   672
1.49/1.53	c 2770           24148          278403         1135002        890            0              522   731   677
1.79/1.80	c 3142           26901          326675         1377425        890            0              526   730   692
2.09/2.10	c 3551           29081          380442         1649377        890            0              538   704   684
2.49/2.50	c 4000           31993          451139         2000086        890            0              539   717   686
2.79/2.85	c 4493           35692          515405         2320303        890            0              529   727   694
3.09/3.15	c 5035           38516          570809         2589929        890            0              539   713   680
3.49/3.55	c 5631           42630          642832         2911129        890            0              544   710   676
3.89/3.95	c 6286           47037          715107         3267707        890            0              549   708   662
4.40/4.48	c 7006           51189          808954         3763218        890            0              561   732   694
4.99/5.08	c 7798           55676          917033         4327501        890            0              584   718   684
5.50/5.52	c 8669           60148          996364         4725436        890            0              588   691   669
5.89/5.98	c 9627           66144          1080057        5075771        890            0              567   705   626
6.49/6.60	c 10680          73767          1193311        5604228        890            0              559   730   686
7.09/7.18	c 11838          80549          1298514        6137776        890            0              566   716   684
7.80/7.86	c 13111          86841          1420110        6723514        890            0              584   714   689
8.69/8.70	c 14511          94719          1572517        7470770        890            0              612   723   690
9.39/9.42	c 16051          103825         1705565        8156609        890            0              669   734   699
10.39/10.45	c 17745          112595         1890831        9081209        890            0              646   711   685
11.29/11.33	c 19608          122893         2051095        9819595        890            0              595   691   661
12.59/12.61	c 21657          133233         2280286        11022413       890            0              586   707   678
14.09/14.17	c 23910          143169         2557096        12560492       890            0              645   708   677
15.49/15.55	c 26388          158125         2808450        13734095       890            0              584   715   676
16.89/16.91	c 29113          171752         3055767        15060842       890            0              540   754   718
18.49/18.56	c 32110          187148         3352850        16561710       890            0              589   718   686
20.49/20.55	c 35406          204227         3711869        18504626       890            0              564   739   700
22.39/22.45	c 39031          222822         4055209        20265312       890            0              562   738   694
24.09/24.18	c 43018          238572         4363927        22094245       890            0              619   699   674
26.39/26.44	c 47403          257080         4764505        24290506       890            0              553   718   684
29.29/29.36	c 52226          284894         5292859        27118751       890            0              592   759   713
32.39/32.43	c 57531          309945         5844123        29915740       890            0              573   723   681
35.19/35.28	c 63366          341978         6360445        32527862       890            0              559   732   673
38.68/38.70	c 69784          372044         6982121        35627949       890            0              613   738   692
42.28/42.34	c 76843          412572         7642784        38838835       890            0              622   730   676
47.48/47.51	c 84607          453917         8570677        43953012       890            0              586   742   702
51.69/51.75	c 93147          501804         9344965        47714772       890            0              542   745   695
56.38/56.41	c 102541         551116         10186103       52119261       890            0              578   747   700
62.58/62.65	c 112874         606731         11313521       57785504       890            0              640   726   681
68.68/68.71	c 124240         663581         12408631       63662305       890            0              642   750   700
75.38/75.46	c 136742         726490         13629819       70118748       890            0              591   731   692
82.88/82.93	c 150494         797237         14977106       77260243       890            0              637   734   690
90.08/90.11	c 165621         868756         16292802       84243443       890            0              581   740   706
99.28/99.32	c 182260         946457         17952220       92780803       890            0              585   720   685
109.07/109.14	c 200562         1058955        19749041       101617090      890            0              614   747   703
121.67/121.73	c 220694         1165851        22012281       113828766      890            0              582   761   714
134.57/134.62	c 242839         1293674        24350773       125984809      890            0              567   754   699
149.47/149.53	c 267198         1425669        27081037       139433284      890            0              603   743   700
166.08/166.18	c 293992         1561090        30055111       156431275      890            0              590   757   705
184.17/184.22	c 323465         1688888        33288990       172698007      890            0              629   722   681
200.47/200.52	c 355885         1843100        36222647       188024625      890            0              612   723   672
219.66/219.77	c 391547         2002973        39665828       207650504      890            0              643   732   688
243.07/243.12	c 430775         2183858        43852569       229661973      890            0              588   742   695
262.06/262.15	c 473925         2356958        47305382       248953089      890            0              570   740   699
289.76/289.86	c 521390         2558479        52289603       275502745      890            0              642   741   695
321.65/321.71	c 573601         2805178        58007502       305113392      890            0              600   744   692
353.85/353.90	c 631033         3099684        63882374       335641369      890            0              541   753   710
383.75/383.86	c 694208         3438133        69351167       363478119      890            0              595   746   700
423.14/423.23	c 763700         3833461        76538272       398740973      890            0              583   757   689
457.84/457.98	c 840141         4171833        82761807       435054012      890            0              598   729   683
515.54/515.61	c 924226         4592941        93000192       489745965      890            0              593   749   685
570.03/570.19	c 1016719        5071446        102828137      538704860      890            0              603   753   689
623.83/623.97	c 1118461        5652976        112550366      589738248      890            0              561   760   703
678.12/678.22	c 1230377        6189304        122300441      643807029      890            0              591   751   700
754.31/754.46	c 1353484        6838111        136120223      717839787      890            0              636   755   695
825.91/826.08	c 1488901        7561114        149053691      781731325      890            0              606   749   693
912.90/913.01	c 1637859        8293966        164684988      868165456      890            0              591   746   692
998.89/999.00	c 1801712        9126126        180319571      945951894      890            0              580   751   698
1098.18/1098.33	c 1981950        10078738       198398413      1037891686     890            0              583   750   684
1189.17/1189.32	c 2180211        11068536       214852364      1122532748     890            0              559   748   678
1287.56/1287.78	c 2398298        12139140       232875721      1211937830     890            0              592   765   710
1427.85/1428.05	c 2638193        13280682       258040619      1346099627     890            0              585   756   704
1584.94/1585.18	c 2902077        14861499       286810510      1492280655     890            0              639   762   712
1706.03/1706.26	c 3192349        16082532       308858541      1613384706     890            0              561   752   696
1863.01/1863.21	c 3511648        17627949       337293023      1759610570     890            0              583   759   695
2046.90/2047.13	c 3862876        19246407       370464455      1940767511     890            0              590   749   697
2238.47/2238.70	c 4249226        21134531       405044345      2129935082     890            0              568   771   703

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4243129-1500670962/watcher-4243129-1500670962 -o /tmp/evaluation-result-4243129-1500670962/solver-4243129-1500670962 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node147-1500648172-9852 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4243129-1500670962.xml 

pid=13270
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.95 2.00 2.04 4/245 13273
/proc/meminfo: memFree=32017552/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=28044 CPUtime=0.01 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 1241 0 0 0 1 0 0 0 20 0 1 0 2361370 28717056 1065 33554432000 4194304 5970956 140731005581184 140731005577832 5451784 0 0 4096 0 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 7011 1065 715 434 0 375 0

[startup+0.100147 s]
/proc/loadavg: 1.95 2.00 2.04 4/245 13273
/proc/meminfo: memFree=32017552/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=32004 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 2252 0 0 0 9 0 0 0 20 0 1 0 2361370 32772096 2055 33554432000 4194304 5970956 140731005581184 140731005577880 140276818926565 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8001 2055 767 434 0 1365 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 32004

[startup+0.200418 s]
/proc/loadavg: 1.95 2.00 2.04 4/245 13273
/proc/meminfo: memFree=32017552/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=32136 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 2297 0 0 0 19 0 0 0 20 0 1 0 2361370 32907264 2121 33554432000 4194304 5970956 140731005581184 140731005578520 4977773 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8034 2121 767 434 0 1398 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 32136

[startup+0.300224 s]
/proc/loadavg: 1.95 2.00 2.04 4/245 13273
/proc/meminfo: memFree=32017552/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=32664 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 2437 0 0 0 29 0 0 0 20 0 1 0 2361370 33447936 2253 33554432000 4194304 5970956 140731005581184 140731005578152 5098933 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8166 2253 770 434 0 1530 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 32664

[startup+0.70021 s]
/proc/loadavg: 1.95 2.00 2.04 4/245 13273
/proc/meminfo: memFree=32017552/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=32948 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 2489 0 0 0 69 0 0 0 20 0 1 0 2361370 33738752 2319 33554432000 4194304 5970956 140731005581184 140731005577960 4974629 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2319 770 434 0 1601 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 32948

[startup+1.5002 s]
/proc/loadavg: 1.95 2.00 2.04 4/246 13274
/proc/meminfo: memFree=32011276/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=32948 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 2492 0 0 0 149 0 0 0 20 0 1 0 2361370 33738752 2319 33554432000 4194304 5970956 140731005581184 140731005578520 5098910 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2319 770 434 0 1601 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 32948

[startup+3.10022 s]
/proc/loadavg: 1.95 2.00 2.04 4/246 13274
/proc/meminfo: memFree=32010484/32770624 swapFree=5824/199992
[pid=13273] ppid=13270 vsize=32948 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 3956 0 0 0 309 0 0 0 20 0 1 0 2361370 33738752 2334 33554432000 4194304 5970956 140731005581184 140731005578520 4971772 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2334 770 434 0 1601 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 32948

[startup+6.30022 s]
/proc/loadavg: 1.95 2.00 2.04 4/246 13274
/proc/meminfo: memFree=32010336/32770624 swapFree=5824/200020
[pid=13273] ppid=13270 vsize=32948 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 5447 0 0 0 629 0 0 0 20 0 1 0 2361370 33738752 2343 33554432000 4194304 5970956 140731005581184 140731005578520 4976725 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2343 770 434 0 1601 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 32948

[startup+12.7002 s]
/proc/loadavg: 1.96 2.00 2.04 4/246 13274
/proc/meminfo: memFree=32010104/32770624 swapFree=5824/200036
[pid=13273] ppid=13270 vsize=32948 CPUtime=12.69 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 6934 0 0 0 1269 0 0 0 20 0 1 0 2361370 33738752 2347 33554432000 4194304 5970956 140731005581184 140731005578520 4969779 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2347 770 434 0 1601 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 32948

[startup+25.5003 s]
/proc/loadavg: 1.97 2.00 2.04 4/246 13274
/proc/meminfo: memFree=32010448/32770624 swapFree=5824/200052
[pid=13273] ppid=13270 vsize=32948 CPUtime=25.49 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 9908 0 0 0 2549 0 0 0 20 0 1 0 2361370 33738752 2357 33554432000 4194304 5970956 140731005581184 140731005578520 4974138 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2357 770 434 0 1601 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 32948

[startup+51.1003 s]
/proc/loadavg: 2.05 2.01 2.05 4/246 13274
/proc/meminfo: memFree=32010116/32770624 swapFree=5824/200076
[pid=13273] ppid=13270 vsize=32948 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 11405 0 0 0 5108 0 0 0 20 0 1 0 2361370 33738752 2358 33554432000 4194304 5970956 140731005581184 140731005578520 4978138 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2358 770 434 0 1601 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 32948

[startup+102.3 s]
/proc/loadavg: 2.15 2.05 2.05 4/246 13275
/proc/meminfo: memFree=32010344/32770624 swapFree=5824/200152
[pid=13273] ppid=13270 vsize=32948 CPUtime=102.28 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 11888 0 0 0 10228 0 0 0 20 0 1 0 2361370 33738752 2359 33554432000 4194304 5970956 140731005581184 140731005578520 4970568 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8237 2359 770 434 0 1601 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 32948

[startup+162.3 s]
/proc/loadavg: 2.06 2.04 2.05 4/244 13276
/proc/meminfo: memFree=32010236/32770624 swapFree=5824/200232
[pid=13273] ppid=13270 vsize=33080 CPUtime=162.27 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 12376 0 0 0 16227 0 0 0 20 0 1 0 2361370 33873920 2363 33554432000 4194304 5970956 140731005581184 140731005578152 4974138 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2363 770 434 0 1634 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 33080

[startup+222.307 s]
/proc/loadavg: 2.02 2.03 2.05 4/243 13277
/proc/meminfo: memFree=32010424/32770624 swapFree=5824/200288
[pid=13273] ppid=13270 vsize=33080 CPUtime=222.27 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 12861 0 0 0 22227 0 0 0 20 0 1 0 2361370 33873920 2365 33554432000 4194304 5970956 140731005581184 140731005578520 4971813 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2365 770 434 0 1634 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 33080

[startup+282.3 s]
/proc/loadavg: 2.01 2.03 2.05 4/243 13278
/proc/meminfo: memFree=32009804/32770624 swapFree=5824/200348
[pid=13273] ppid=13270 vsize=33080 CPUtime=282.26 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 13344 0 0 0 28226 0 0 0 20 0 1 0 2361370 33873920 2365 33554432000 4194304 5970956 140731005581184 140731005578520 5093230 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2365 770 434 0 1634 0
Current children cumulated CPU time (s) 282.26
Current children cumulated vsize (KiB) 33080

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 4/243 13279
/proc/meminfo: memFree=32009716/32770624 swapFree=5824/200396
[pid=13273] ppid=13270 vsize=33080 CPUtime=342.25 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 13828 0 0 0 34225 0 0 0 20 0 1 0 2361370 33873920 2365 33554432000 4194304 5970956 140731005581184 140731005578520 4969771 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2365 770 434 0 1634 0
Current children cumulated CPU time (s) 342.25
Current children cumulated vsize (KiB) 33080

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 4/242 13280
/proc/meminfo: memFree=32010964/32770624 swapFree=5824/200440
[pid=13273] ppid=13270 vsize=33080 CPUtime=402.25 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 14314 0 0 0 40225 0 0 0 20 0 1 0 2361370 33873920 2366 33554432000 4194304 5970956 140731005581184 140731005578520 4974750 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2366 770 434 0 1634 0
Current children cumulated CPU time (s) 402.25
Current children cumulated vsize (KiB) 33080

[startup+462.3 s]
/proc/loadavg: 2.12 2.04 2.05 4/243 13289
/proc/meminfo: memFree=32008896/32770624 swapFree=5824/200516
[pid=13273] ppid=13270 vsize=33080 CPUtime=462.24 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 14799 0 0 0 46224 0 0 0 20 0 1 0 2361370 33873920 2366 33554432000 4194304 5970956 140731005581184 140731005578520 4974116 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2366 770 434 0 1634 0
Current children cumulated CPU time (s) 462.24
Current children cumulated vsize (KiB) 33080

[startup+522.3 s]
/proc/loadavg: 2.04 2.04 2.05 4/243 13290
/proc/meminfo: memFree=32009224/32770624 swapFree=5824/200552
[pid=13273] ppid=13270 vsize=33080 CPUtime=522.24 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 15284 0 0 0 52224 0 0 0 20 0 1 0 2361370 33873920 2367 33554432000 4194304 5970956 140731005581184 140731005578520 4976713 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2367 770 434 0 1634 0
Current children cumulated CPU time (s) 522.24
Current children cumulated vsize (KiB) 33080

[startup+582.3 s]
/proc/loadavg: 2.02 2.03 2.05 4/243 13291
/proc/meminfo: memFree=32008828/32770624 swapFree=5824/200608
[pid=13273] ppid=13270 vsize=33080 CPUtime=582.23 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 15768 0 0 0 58223 0 0 0 20 0 1 0 2361370 33873920 2368 33554432000 4194304 5970956 140731005581184 140731005578520 4970544 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2368 770 434 0 1634 0
Current children cumulated CPU time (s) 582.23
Current children cumulated vsize (KiB) 33080


################
# More data... #
################


[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13316
/proc/meminfo: memFree=32005896/32770624 swapFree=5824/201296
[pid=13273] ppid=13270 vsize=33080 CPUtime=1542.14 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 22420 0 0 0 154214 0 0 0 20 0 1 0 2361370 33873920 2368 33554432000 4194304 5970956 140731005581184 140731005578520 4974704 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2368 770 434 0 1634 0
Current children cumulated CPU time (s) 1542.14
Current children cumulated vsize (KiB) 33080

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13317
/proc/meminfo: memFree=32006064/32770624 swapFree=5824/201336
[pid=13273] ppid=13270 vsize=33080 CPUtime=1602.13 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 22906 0 0 0 160213 0 0 0 20 0 1 0 2361370 33873920 2368 33554432000 4194304 5970956 140731005581184 140731005578520 4978203 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2368 770 434 0 1634 0
Current children cumulated CPU time (s) 1602.13
Current children cumulated vsize (KiB) 33080

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13325
/proc/meminfo: memFree=32005432/32770624 swapFree=5824/201388
[pid=13273] ppid=13270 vsize=33080 CPUtime=1662.13 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 23211 0 0 0 166213 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4970002 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 1662.13
Current children cumulated vsize (KiB) 33080

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13326
/proc/meminfo: memFree=32004868/32770624 swapFree=5824/201424
[pid=13273] ppid=13270 vsize=33080 CPUtime=1722.12 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 23695 0 0 0 172212 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4976570 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 1722.12
Current children cumulated vsize (KiB) 33080

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13327
/proc/meminfo: memFree=32005496/32770624 swapFree=5824/201464
[pid=13273] ppid=13270 vsize=33080 CPUtime=1782.11 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 23992 0 0 0 178211 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4974704 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 1782.11
Current children cumulated vsize (KiB) 33080

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13328
/proc/meminfo: memFree=32005308/32770624 swapFree=5824/201500
[pid=13273] ppid=13270 vsize=33080 CPUtime=1842.11 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 24291 0 0 0 184211 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4978463 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 1842.11
Current children cumulated vsize (KiB) 33080

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13329
/proc/meminfo: memFree=32005328/32770624 swapFree=5824/201540
[pid=13273] ppid=13270 vsize=33080 CPUtime=1902.1 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 24776 0 0 0 190210 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4978194 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 1902.1
Current children cumulated vsize (KiB) 33080

[startup+1962.3 s]
/proc/loadavg: 2.08 2.03 2.05 4/243 13330
/proc/meminfo: memFree=32004772/32770624 swapFree=5824/201580
[pid=13273] ppid=13270 vsize=33080 CPUtime=1962.1 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 25074 0 0 0 196210 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4977104 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 1962.1
Current children cumulated vsize (KiB) 33080

[startup+2022.3 s]
/proc/loadavg: 2.07 2.04 2.05 4/243 13331
/proc/meminfo: memFree=32006000/32770624 swapFree=5824/201616
[pid=13273] ppid=13270 vsize=33080 CPUtime=2022.09 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 25371 0 0 0 202209 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4978093 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 2022.09
Current children cumulated vsize (KiB) 33080

[startup+2082.3 s]
/proc/loadavg: 2.03 2.03 2.05 4/243 13332
/proc/meminfo: memFree=32006344/32770624 swapFree=5824/201648
[pid=13273] ppid=13270 vsize=33080 CPUtime=2082.09 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 25858 0 0 0 208209 0 0 0 20 0 1 0 2361370 33873920 2369 33554432000 4194304 5970956 140731005581184 140731005578520 4974691 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2369 770 434 0 1634 0
Current children cumulated CPU time (s) 2082.09
Current children cumulated vsize (KiB) 33080

[startup+2142.3 s]
/proc/loadavg: 2.01 2.03 2.05 4/243 13333
/proc/meminfo: memFree=32006088/32770624 swapFree=5824/201692
[pid=13273] ppid=13270 vsize=33080 CPUtime=2142.08 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 26167 0 0 0 214208 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4974179 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2142.08
Current children cumulated vsize (KiB) 33080

[startup+2202.31 s]
/proc/loadavg: 2.00 2.02 2.05 4/243 13334
/proc/meminfo: memFree=32005400/32770624 swapFree=5824/201724
[pid=13273] ppid=13270 vsize=33080 CPUtime=2202.08 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 26470 0 0 0 220208 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4978176 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2202.08
Current children cumulated vsize (KiB) 33080

[startup+2262.3 s]
/proc/loadavg: 2.00 2.02 2.05 4/243 13342
/proc/meminfo: memFree=32005416/32770624 swapFree=5824/201788
[pid=13273] ppid=13270 vsize=33080 CPUtime=2262.07 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 26957 0 0 0 226207 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4974124 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2262.07
Current children cumulated vsize (KiB) 33080

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 13343
/proc/meminfo: memFree=32004908/32770624 swapFree=5824/201824
[pid=13273] ppid=13270 vsize=33080 CPUtime=2322.06 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 27257 0 0 0 232206 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4974712 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2322.06
Current children cumulated vsize (KiB) 33080

[startup+2382.3 s]
/proc/loadavg: 1.85 1.98 2.03 2/236 13395
/proc/meminfo: memFree=32016148/32770624 swapFree=5824/201860
[pid=13273] ppid=13270 vsize=33080 CPUtime=2382.06 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 27557 0 0 0 238206 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4974128 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2382.06
Current children cumulated vsize (KiB) 33080



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.31 s]
/proc/loadavg: 1.61 1.92 2.01 2/236 13395
/proc/meminfo: memFree=32016452/32770624 swapFree=5824/201876
[pid=13273] ppid=13270 vsize=33080 CPUtime=2400.06 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 27855 0 0 0 240006 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4970509 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2400.06
Current children cumulated vsize (KiB) 33080

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 13273 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.31 s]
/proc/loadavg: 1.61 1.92 2.01 2/236 13395
/proc/meminfo: memFree=32016452/32770624 swapFree=5824/201876
[pid=13273] ppid=13270 vsize=33080 CPUtime=2400.06 cores=1,3,5,7,9,11,13,15
/proc/13273/stat : 13273 (cosoco) R 13270 13273 9820 0 -1 4202496 27855 0 0 0 240006 0 0 0 20 0 1 0 2361370 33873920 2370 33554432000 4194304 5970956 140731005581184 140731005578520 4970509 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 36466688 140731005584577 140731005584707 140731005584707 140731005587406 0
/proc/13273/statm: 8270 2370 770 434 0 1634 0
Current children cumulated CPU time (s) 2400.06
Current children cumulated vsize (KiB) 33080

Child status: 1
Real time (s): 2400.31
CPU time (s): 2400.08
CPU user time (s): 2400.07
CPU system time (s): 0.008999
CPU usage (%): 99.9903
Max. virtual memory (cumulated for all children) (KiB): 33080

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.07
system time used= 0.008999
maximum resident set size= 9524
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27886
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 120674

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.47619 second user time and 10.1532 second system time

The end

Launcher Data 

Begin job on node147 at 2017-07-21 23:02:42
IDJOB=4243129
IDBENCH=138969
IDSOLVER=2620
FILE ID=node147/4243129-1500670962
RUNJOBID= node147-1500648172-9852
PBS_JOBID= 20623274
Free space on /tmp= 61932 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-15.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4243129-1500670962/watcher-4243129-1500670962 -o /tmp/evaluation-result-4243129-1500670962/solver-4243129-1500670962 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node147-1500648172-9852 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4243129-1500670962.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= fdd30079817c8a7e676a6353b2e6ebba
RANDOM SEED=1906083089

node147.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        32017228 kB
MemAvailable:   32019116 kB
Buffers:           38460 kB
Cached:           272880 kB
SwapCached:            0 kB
Active:           167392 kB
Inactive:         208672 kB
Active(anon):      67116 kB
Inactive(anon):     8680 kB
Active(file):     100276 kB
Inactive(file):   199992 kB
Unevictable:        5824 kB
Mlocked:            5824 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2548 kB
Writeback:             0 kB
AnonPages:         79064 kB
Mapped:            30076 kB
Shmem:              8852 kB
Slab:              67320 kB
SReclaimable:      34912 kB
SUnreclaim:        32408 kB
KernelStack:        4304 kB
PageTables:         5260 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     334360 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     22528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61932 MiB
End job on node147 at 2017-07-21 23:42:42