Trace number 4242512

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.04 2400.6

General information on the benchmark

NameKnightTour/KnightTour-int-s1/
KnightTour-10-int.xml
MD5SUMba113f9707e5398e41eeef1481acd1fa
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark19.046
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints102
Number of domains1
Minimum domain size100
Maximum domain size100
Distribution of domain sizes[{"size":100,"count":100}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":98},{"degree":3,"count":2}]
Minimum constraint arity2
Maximum constraint arity100
Distribution of constraint arities[{"arity":2,"count":101},{"arity":100,"count":1}]
Number of extensional constraints0
Number of intensional constraints100
Distribution of constraint types[{"type":"intension","count":100},{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.19/0.21	c root propagations     : 5286        
0.19/0.21	c restarts enabled, print stats at every restarts
0.19/0.21	c
0.19/0.21	c
0.19/0.21	c
0.19/0.21	c This is cosoco 1.0 --  
0.19/0.21	c
0.19/0.21	c ========================================[ Problem Statistics ]===========================================
0.19/0.21	c |                                                                                                       
0.19/0.21	c |  Parse time        :         0.17 s 
0.19/0.21	c |
0.19/0.21	c |               Variables: 100
0.19/0.21	c |            Domain Sizes: 100..100
0.19/0.21	c |
0.19/0.21	c |             Constraints: 103
0.19/0.21	c |                   Arity: 1..100  -- Unary: 2  -- Binary: 100
0.19/0.21	c | 
0.19/0.21	c |                   Types: 
0.19/0.21	c |                          All Different: 1
0.19/0.21	c |                          Intension: 100
0.19/0.21	c |                          Unary: 2
0.19/0.21	c |                          
0.19/0.21	c =========================================================================================================
0.19/0.21	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.19/0.26	c 101            366            6085           26526          100            0              70   88   82   
0.29/0.32	c 211            784            12736          50255          100            0              70   86   78   
0.29/0.39	c 332            1222           19524          75627          100            0              34   86   78   
0.39/0.45	c 465            1630           26316          96070          100            0              64   88   78   
0.49/0.54	c 611            2098           35420          134562         100            0              36   84   77   
0.59/0.62	c 771            2537           43199          172352         100            0              54   86   78   
0.59/0.69	c 947            3122           51914          203126         100            0              74   89   80   
0.69/0.79	c 1140           3674           60668          245961         100            0              36   85   76   
0.79/0.87	c 1352           4261           70167          276934         100            0              68   88   81   
0.89/0.97	c 1585           5077           81222          316588         100            0              64   87   79   
1.10/1.11	c 1841           5940           95972          371079         100            0              47   86   78   
1.29/1.37	c 2122           7032           117262         506581         100            0              35   86   78   
1.39/1.50	c 2431           8057           131529         558190         100            0              68   90   80   
1.59/1.66	c 2770           9183           149410         634824         100            0              74   90   82   
1.79/1.84	c 3142           10353          168057         706992         100            0              36   86   76   
1.89/1.98	c 3551           11608          185288         770751         100            0              73   89   81   
2.09/2.15	c 4000           12875          204859         830243         100            0              59   89   80   
2.49/2.52	c 4493           14370          236861         1004620        100            0              36   83   74   
2.79/2.84	c 5035           16059          266650         1143714        100            0              35   86   79   
2.99/3.04	c 5631           17853          291205         1223123        100            0              57   91   81   
3.19/3.29	c 6286           19678          319846         1320481        100            0              36   85   74   
3.49/3.56	c 7006           21810          352082         1429376        100            0              57   90   81   
3.79/3.86	c 7798           23881          384271         1539992        100            0              36   83   75   
4.09/4.19	c 8669           26453          421464         1672706        100            0              57   89   81   
4.59/4.65	c 9627           28961          465344         1875266        100            0              36   85   76   
5.19/5.20	c 10680          32151          519261         2103372        100            0              37   87   78   
5.60/5.65	c 11838          35746          572842         2281962        100            0              57   90   80   
6.09/6.15	c 13111          40595          634449         2504758        100            0              42   92   82   
6.79/6.81	c 14511          44500          699159         2772110        100            0              36   83   75   
7.59/7.65	c 16051          49774          781411         3140901        100            0              35   87   78   
8.19/8.26	c 17745          55307          857658         3374997        100            0              64   90   81   
8.90/8.96	c 19608          61014          939150         3679004        100            0              64   90   79   
9.90/9.91	c 21657          66515          1031588        4050052        100            0              36   83   74   
10.79/10.80	c 23910          73190          1136351        4395424        100            0              64   89   82   
11.59/11.64	c 26388          79948          1230875        4703673        100            0              58   89   81   
12.59/12.64	c 29113          88110          1353550        5090558        100            0              57   90   81   
13.69/13.78	c 32110          97810          1487880        5580770        100            0              59   90   80   
14.89/15.00	c 35406          108785         1632909        6103375        100            0              68   90   81   
16.39/16.46	c 39031          118652         1794714        6838770        100            0              48   90   80   
17.89/17.96	c 43018          130751         1971309        7436553        100            0              57   90   81   
19.59/19.69	c 47403          144058         2158236        8068244        100            0              34   88   79   
21.88/21.92	c 52226          160461         2394158        8993883        100            0              35   87   78   
23.88/23.91	c 57531          176394         2631643        9884284        100            0              69   90   81   
25.78/25.86	c 63366          194294         2877365        10611727       100            0              67   90   81   
28.08/28.15	c 69784          214073         3142336        11501912       100            0              57   90   81   
30.58/30.60	c 76843          234144         3432855        12459399       100            0              57   90   81   
33.28/33.30	c 84607          257368         3744953        13522909       100            0              57   90   81   
36.68/36.71	c 93147          283528         4135747        14941625       100            0              53   87   80   
41.48/41.57	c 102541         311917         4603290        17293133       100            0              35   90   79   
45.58/45.60	c 112874         345274         5085775        18838785       100            0              57   91   82   
48.88/48.96	c 124240         377982         5527822        20267120       100            0              71   92   84   
53.38/53.43	c 136742         411744         6035807        22303560       100            0              66   91   79   
57.48/57.51	c 150494         452035         6554957        23972837       100            0              70   91   81   
64.88/64.95	c 165621         502180         7323965        27227040       100            0              35   89   78   
70.57/70.69	c 182260         545345         7916951        29538048       100            0              36   88   77   
76.87/76.90	c 200562         598086         8655821        31971794       100            0              64   90   80   
83.68/83.73	c 220694         658672         9462917        34674676       100            0              57   90   81   
91.07/91.16	c 242839         722703         10353614       37359379       100            0              69   91   81   
99.67/99.77	c 267198         794355         11357990       40697729       100            0              57   90   81   
108.36/108.49	c 293992         876768         12525842       44416503       100            0              71   93   84   
118.87/118.99	c 323465         973600         13844147       48697000       100            0              64   92   81   
130.16/130.29	c 355885         1071630        15160518       53120659       100            0              57   90   81   
143.85/143.91	c 391547         1180540        16774743       59515086       100            0              63   91   81   
157.75/157.86	c 430775         1302234        18444785       64943013       100            0              57   90   82   
175.95/176.02	c 473925         1427350        20334370       72158104       100            0              45   90   81   
192.24/192.33	c 521390         1571310        22289481       78420153       100            0              59   90   81   
210.54/210.62	c 573601         1728221        24421975       85440271       100            0              57   90   81   
232.04/232.18	c 631033         1904346        27026180       95152372       100            0              63   91   81   
253.73/253.89	c 694208         2094350        29618883       103590215      100            0              57   90   82   
277.13/277.26	c 763700         2312228        32533889       113055816      100            0              67   93   82   
307.81/307.93	c 840141         2570069        36360718       126175864      100            0              68   93   82   
337.41/337.59	c 924226         2812420        39869751       138280355      100            0              64   90   81   
378.41/378.53	c 1016719        3080547        44213013       156541179      100            0              36   92   80   
420.59/420.77	c 1118461        3370771        49077143       176540354      100            0              48   90   79   
458.28/458.47	c 1230377        3698102        53612550       190781444      100            0              64   90   81   
508.27/508.48	c 1353484        4047220        59005724       210707564      100            0              36   87   75   
574.85/575.03	c 1488901        4490807        65805265       240349965      100            0              35   90   78   
624.44/624.64	c 1637859        4917399        71897873       261351612      100            0              57   91   81   
684.62/684.88	c 1801712        5428086        79261145       288018679      100            0              63   92   81   
740.61/740.80	c 1981950        5910417        85945806       310722955      100            0              59   90   80   
813.59/813.82	c 2180211        6542462        94567233       342581323      100            0              54   93   81   
878.69/878.93	c 2398298        7202601        103184790      368727305      100            0              72   94   85   
964.96/965.26	c 2638193        7897206        113810132      404730677      100            0              55   88   80   
1076.23/1076.54	c 2902077        8683777        125705595      445946637      100            0              39   89   78   
1179.91/1180.27	c 3192349        9539428        138010067      487880437      100            0              57   90   80   
1289.88/1290.24	c 3511648        10527858       151452227      530191243      100            0              66   91   82   
1405.35/1405.74	c 3862876        11574935       165713010      576137462      100            0              64   90   80   
1577.91/1578.34	c 4249226        12699369       184069515      652484402      100            0              40   90   79   
1722.48/1722.98	c 4674211        14097510       202349424      713090619      100            0              64   93   82   
1875.25/1875.71	c 5141694        15550764       221170731      773236315      100            0              57   91   80   
2053.22/2053.73	c 5655925        17146571       242920434      850858054      100            0              67   95   82   
2299.85/2300.41	c 6221579        18819920       269662455      959961465      100            0              40   90   80

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4242512-1500663821/watcher-4242512-1500663821 -o /tmp/evaluation-result-4242512-1500663821/solver-4242512-1500663821 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1500648174-9891 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4242512-1500663821.xml 

pid=12107
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.02 2.05 4/248 12110
/proc/meminfo: memFree=32020668/32770624 swapFree=5904/196736
[pid=12110] ppid=12107 vsize=27124 CPUtime=0.01 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1073 0 0 0 1 0 0 0 20 0 1 0 1649078 27774976 898 33554432000 4194304 5970956 140733912531536 140733912528184 139855738541696 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 6781 898 774 434 0 145 0

[startup+0.100145 s]
/proc/loadavg: 2.02 2.02 2.05 4/248 12110
/proc/meminfo: memFree=32020668/32770624 swapFree=5904/196736
[pid=12110] ppid=12107 vsize=27484 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1157 0 0 0 9 0 0 0 20 0 1 0 1649078 28143616 983 33554432000 4194304 5970956 140733912531536 140733912525240 139855729061709 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 6871 983 787 434 0 235 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27484

[startup+0.200298 s]
/proc/loadavg: 2.02 2.02 2.05 4/248 12110
/proc/meminfo: memFree=32020668/32770624 swapFree=5904/196736
[pid=12110] ppid=12107 vsize=27980 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1329 0 0 0 19 0 0 0 20 0 1 0 1649078 28651520 1139 33554432000 4194304 5970956 140733912531536 140733912528600 4964629 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 6995 1139 829 434 0 359 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 27980

[startup+0.300308 s]
/proc/loadavg: 2.02 2.02 2.05 4/248 12110
/proc/meminfo: memFree=32020668/32770624 swapFree=5904/196736
[pid=12110] ppid=12107 vsize=28112 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1371 0 0 0 29 0 0 0 20 0 1 0 1649078 28786688 1205 33554432000 4194304 5970956 140733912531536 140733912528872 5098928 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1205 830 434 0 392 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 28112

[startup+0.700255 s]
/proc/loadavg: 2.02 2.02 2.05 4/248 12110
/proc/meminfo: memFree=32020668/32770624 swapFree=5904/196736
[pid=12110] ppid=12107 vsize=28112 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1373 0 0 0 69 0 0 0 20 0 1 0 1649078 28786688 1205 33554432000 4194304 5970956 140733912531536 140733912528872 4974138 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1205 830 434 0 392 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 28112

[startup+1.50027 s]
/proc/loadavg: 2.02 2.02 2.05 4/249 12111
/proc/meminfo: memFree=32018880/32770624 swapFree=5904/196804
[pid=12110] ppid=12107 vsize=28112 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1373 0 0 0 149 0 0 0 20 0 1 0 1649078 28786688 1205 33554432000 4194304 5970956 140733912531536 140733912528872 4961411 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1205 830 434 0 392 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 28112

[startup+3.10028 s]
/proc/loadavg: 2.02 2.02 2.05 4/249 12111
/proc/meminfo: memFree=32018384/32770624 swapFree=5904/196804
[pid=12110] ppid=12107 vsize=28112 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 1696 0 0 0 309 0 0 0 20 0 1 0 1649078 28786688 1214 33554432000 4194304 5970956 140733912531536 140733912528872 4971137 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1214 831 434 0 392 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 28112

[startup+6.30028 s]
/proc/loadavg: 2.02 2.02 2.05 4/249 12111
/proc/meminfo: memFree=32018516/32770624 swapFree=5904/196816
[pid=12110] ppid=12107 vsize=28112 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 2019 0 0 0 629 0 0 0 20 0 1 0 1649078 28786688 1214 33554432000 4194304 5970956 140733912531536 140733912528872 5069712 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1214 831 434 0 392 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 28112

[startup+12.7002 s]
/proc/loadavg: 2.02 2.02 2.05 4/249 12111
/proc/meminfo: memFree=32017336/32770624 swapFree=5904/196820
[pid=12110] ppid=12107 vsize=28112 CPUtime=12.69 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 2342 0 0 0 1269 0 0 0 20 0 1 0 1649078 28786688 1214 33554432000 4194304 5970956 140733912531536 140733912528872 4969902 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1214 831 434 0 392 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 28112

[startup+25.5003 s]
/proc/loadavg: 2.01 2.02 2.05 4/249 12111
/proc/meminfo: memFree=32017708/32770624 swapFree=5904/196832
[pid=12110] ppid=12107 vsize=28112 CPUtime=25.48 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 2817 0 0 0 2548 0 0 0 20 0 1 0 1649078 28786688 1214 33554432000 4194304 5970956 140733912531536 140733912528872 4971260 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7028 1214 831 434 0 392 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 28112

[startup+51.1003 s]
/proc/loadavg: 2.01 2.02 2.05 4/249 12111
/proc/meminfo: memFree=32017708/32770624 swapFree=5904/196856
[pid=12110] ppid=12107 vsize=28244 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 3315 0 0 0 5108 0 0 0 20 0 1 0 1649078 28921856 1214 33554432000 4194304 5970956 140733912531536 140733912528872 5070932 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1214 831 434 0 425 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 28244

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/248 12112
/proc/meminfo: memFree=32017640/32770624 swapFree=5904/196940
[pid=12110] ppid=12107 vsize=28244 CPUtime=102.27 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 3639 0 0 0 10227 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4969776 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 28244

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/247 12113
/proc/meminfo: memFree=32017612/32770624 swapFree=5904/197004
[pid=12110] ppid=12107 vsize=28244 CPUtime=162.25 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 3963 0 0 0 16225 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5070008 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 28244

[startup+222.308 s]
/proc/loadavg: 2.07 2.03 2.05 4/247 12115
/proc/meminfo: memFree=32017680/32770624 swapFree=5904/197056
[pid=12110] ppid=12107 vsize=28244 CPUtime=222.24 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 4287 0 0 0 22224 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4970920 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 28244

[startup+282.3 s]
/proc/loadavg: 2.03 2.02 2.05 4/247 12247
/proc/meminfo: memFree=32027756/32770624 swapFree=5904/198844
[pid=12110] ppid=12107 vsize=28244 CPUtime=282.22 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 4611 0 0 0 28222 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5070106 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 28244

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/247 12248
/proc/meminfo: memFree=32027416/32770624 swapFree=5904/198932
[pid=12110] ppid=12107 vsize=28244 CPUtime=342.21 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 4935 0 0 0 34221 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4970584 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 342.21
Current children cumulated vsize (KiB) 28244

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/247 12256
/proc/meminfo: memFree=32026752/32770624 swapFree=5904/198968
[pid=12110] ppid=12107 vsize=28244 CPUtime=402.19 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 5259 0 0 0 40219 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5322463 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 402.19
Current children cumulated vsize (KiB) 28244

[startup+462.3 s]
/proc/loadavg: 2.08 2.03 2.05 5/247 12257
/proc/meminfo: memFree=32026480/32770624 swapFree=5904/199020
[pid=12110] ppid=12107 vsize=28244 CPUtime=462.18 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 5583 0 0 0 46218 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4971111 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 462.18
Current children cumulated vsize (KiB) 28244

[startup+522.3 s]
/proc/loadavg: 2.07 2.04 2.05 3/247 12259
/proc/meminfo: memFree=32026736/32770624 swapFree=5904/199072
[pid=12110] ppid=12107 vsize=28244 CPUtime=522.16 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 5907 0 0 0 52216 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4974138 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 522.16
Current children cumulated vsize (KiB) 28244

[startup+582.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/247 12260
/proc/meminfo: memFree=32026588/32770624 swapFree=5904/199116
[pid=12110] ppid=12107 vsize=28244 CPUtime=582.15 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 6231 0 0 0 58215 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4970584 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 582.15
Current children cumulated vsize (KiB) 28244


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/247 12287
/proc/meminfo: memFree=32023768/32770624 swapFree=5904/199804
[pid=12110] ppid=12107 vsize=28244 CPUtime=1481.94 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 10332 0 0 0 148194 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4976815 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1481.94
Current children cumulated vsize (KiB) 28244

[startup+1542.31 s]
/proc/loadavg: 2.03 2.03 2.05 3/246 12288
/proc/meminfo: memFree=32024748/32770624 swapFree=5904/199844
[pid=12110] ppid=12107 vsize=28244 CPUtime=1541.93 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 10498 0 0 0 154193 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4970002 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1541.93
Current children cumulated vsize (KiB) 28244

[startup+1602.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/247 12297
/proc/meminfo: memFree=32023112/32770624 swapFree=5904/199884
[pid=12110] ppid=12107 vsize=28244 CPUtime=1601.91 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 10822 0 0 0 160191 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5070016 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1601.91
Current children cumulated vsize (KiB) 28244

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/247 12298
/proc/meminfo: memFree=32023676/32770624 swapFree=5904/199924
[pid=12110] ppid=12107 vsize=28244 CPUtime=1661.89 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 10980 0 0 0 166189 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4969985 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1661.89
Current children cumulated vsize (KiB) 28244

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/247 12299
/proc/meminfo: memFree=32024044/32770624 swapFree=5904/199960
[pid=12110] ppid=12107 vsize=28244 CPUtime=1721.88 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 11144 0 0 0 172188 0 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4969752 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1721.88
Current children cumulated vsize (KiB) 28244

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/246 12300
/proc/meminfo: memFree=32024216/32770624 swapFree=5904/200000
[pid=12110] ppid=12107 vsize=28244 CPUtime=1781.87 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 11485 0 0 0 178186 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5069728 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1781.87
Current children cumulated vsize (KiB) 28244

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/246 12301
/proc/meminfo: memFree=32024112/32770624 swapFree=5904/200048
[pid=12110] ppid=12107 vsize=28244 CPUtime=1841.86 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 11663 0 0 0 184185 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4977120 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1841.86
Current children cumulated vsize (KiB) 28244

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/247 12303
/proc/meminfo: memFree=32023556/32770624 swapFree=5904/200100
[pid=12110] ppid=12107 vsize=28244 CPUtime=1901.85 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 11987 0 0 0 190184 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5098896 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1901.85
Current children cumulated vsize (KiB) 28244

[startup+1962.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/247 12304
/proc/meminfo: memFree=32023172/32770624 swapFree=5904/200136
[pid=12110] ppid=12107 vsize=28244 CPUtime=1961.83 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 12149 0 0 0 196182 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5070816 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 1961.83
Current children cumulated vsize (KiB) 28244

[startup+2022.3 s]
/proc/loadavg: 2.13 2.07 2.06 3/247 12305
/proc/meminfo: memFree=32023712/32770624 swapFree=5904/200184
[pid=12110] ppid=12107 vsize=28244 CPUtime=2021.82 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 12323 0 0 0 202181 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5070008 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2021.82
Current children cumulated vsize (KiB) 28244

[startup+2082.3 s]
/proc/loadavg: 2.08 2.07 2.06 3/247 12306
/proc/meminfo: memFree=32023332/32770624 swapFree=5904/200228
[pid=12110] ppid=12107 vsize=28244 CPUtime=2081.81 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 12647 0 0 0 208180 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5070793 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2081.81
Current children cumulated vsize (KiB) 28244

[startup+2142.3 s]
/proc/loadavg: 2.03 2.06 2.05 3/247 12307
/proc/meminfo: memFree=32023640/32770624 swapFree=5904/200264
[pid=12110] ppid=12107 vsize=28244 CPUtime=2141.79 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 12813 0 0 0 214178 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4977712 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2141.79
Current children cumulated vsize (KiB) 28244

[startup+2202.31 s]
/proc/loadavg: 2.05 2.06 2.05 3/248 12317
/proc/meminfo: memFree=32023324/32770624 swapFree=5904/200280
[pid=12110] ppid=12107 vsize=28244 CPUtime=2201.78 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 12968 0 0 0 220177 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5319801 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2201.78
Current children cumulated vsize (KiB) 28244

[startup+2262.3 s]
/proc/loadavg: 2.02 2.05 2.05 3/248 12318
/proc/meminfo: memFree=32021980/32770624 swapFree=5904/200316
[pid=12110] ppid=12107 vsize=28244 CPUtime=2261.76 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 13143 0 0 0 226175 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4974750 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2261.76
Current children cumulated vsize (KiB) 28244

[startup+2322.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/248 12319
/proc/meminfo: memFree=32022852/32770624 swapFree=5904/200360
[pid=12110] ppid=12107 vsize=28244 CPUtime=2321.75 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 13467 0 0 0 232174 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5098928 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2321.75
Current children cumulated vsize (KiB) 28244

[startup+2382.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/248 12320
/proc/meminfo: memFree=32022964/32770624 swapFree=5904/200392
[pid=12110] ppid=12107 vsize=28244 CPUtime=2381.73 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 13629 0 0 0 238172 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 5069968 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2381.73
Current children cumulated vsize (KiB) 28244



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.6 s]
/proc/loadavg: 2.00 2.03 2.05 3/248 12320
/proc/meminfo: memFree=32022120/32770624 swapFree=5904/200404
[pid=12110] ppid=12107 vsize=28244 CPUtime=2400.03 cores=1,3,5,7,9,11,13,15
/proc/12110/stat : 12110 (cosoco) R 12107 12110 9859 0 -1 4202496 13792 0 0 0 240002 1 0 0 20 0 1 0 1649078 28921856 1217 33554432000 4194304 5970956 140733912531536 140733912528872 4976815 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 20758528 140733912536257 140733912536387 140733912536387 140733912539086 0
/proc/12110/statm: 7061 1217 831 434 0 425 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 28244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 12110 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.6
CPU time (s): 2400.04
CPU user time (s): 2400.02
CPU system time (s): 0.012996
CPU usage (%): 99.9764
Max. virtual memory (cumulated for all children) (KiB): 28244

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.02
system time used= 0.012996
maximum resident set size= 4912
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13820
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 120635

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.33995 second user time and 10.7315 second system time

The end

Launcher Data 

Begin job on node133 at 2017-07-21 21:03:41
IDJOB=4242512
IDBENCH=134603
IDSOLVER=2620
FILE ID=node133/4242512-1500663821
RUNJOBID= node133-1500648174-9891
PBS_JOBID= 20623287
Free space on /tmp= 62016 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/KnightTour/KnightTour-int-s1/KnightTour-10-int.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4242512-1500663821/watcher-4242512-1500663821 -o /tmp/evaluation-result-4242512-1500663821/solver-4242512-1500663821 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1500648174-9891 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4242512-1500663821.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= ba113f9707e5398e41eeef1481acd1fa
RANDOM SEED=123358782

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2267.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5229.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        32020728 kB
MemAvailable:   32017764 kB
Buffers:           36684 kB
Cached:           270696 kB
SwapCached:            0 kB
Active:           168812 kB
Inactive:         205488 kB
Active(anon):      70012 kB
Inactive(anon):     8752 kB
Active(file):      98800 kB
Inactive(file):   196736 kB
Unevictable:        5904 kB
Mlocked:            5904 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2428 kB
Writeback:             0 kB
AnonPages:         76724 kB
Mapped:            30576 kB
Shmem:              8872 kB
Slab:              66744 kB
SReclaimable:      34668 kB
SUnreclaim:        32076 kB
KernelStack:        4352 kB
PageTables:         4760 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     340608 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     20480 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 62012 MiB
End job on node133 at 2017-07-21 21:43:42