Trace number 4397404

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.1 2400.3

General information on the benchmark

NameRandom/Random-RB-3-28-28f/
rand-3-28-28-93-632f-36.xml
MD5SUMe0a8d3734b0eaa27800dfa1f13e1fbfb
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables28
Number of constraints93
Number of domains1
Minimum domain size28
Maximum domain size28
Distribution of domain sizes[{"size":28,"count":28}]
Minimum variable degree4
Maximum variable degree16
Distribution of variable degrees[{"degree":4,"count":2},{"degree":5,"count":1},{"degree":6,"count":1},{"degree":7,"count":3},{"degree":8,"count":2},{"degree":9,"count":2},{"degree":10,"count":5},{"degree":11,"count":4},{"degree":12,"count":2},{"degree":13,"count":1},{"degree":14,"count":2},{"degree":15,"count":2},{"degree":16,"count":1}]
Minimum constraint arity3
Maximum constraint arity3
Distribution of constraint arities[{"arity":3,"count":93}]
Number of extensional constraints93
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":93}]
Optimization problemNO
Type of objective

Solver Data 

2.58/2.63	c root propagations     : 0           
2.58/2.63	c restarts enabled, print stats at every restarts
2.58/2.63	c
2.58/2.63	c
2.58/2.63	c
2.58/2.63	c This is cosoco 2.00 --  
2.58/2.63	c
2.58/2.63	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397404-1568574164.xml 
2.58/2.63	c ========================================[ Problem Statistics ]===========================================
2.58/2.63	c |                                                                                                       
2.58/2.63	c |  Parse time        :         2.59 s 
2.58/2.63	c |
2.58/2.63	c |               Variables: 28
2.58/2.63	c |            Domain Sizes: 28..28
2.58/2.63	c |
2.58/2.63	c |             Constraints: 93
2.58/2.63	c |                   Arity: 3..3  -- Ternary: 93
2.58/2.63	c | 
2.58/2.63	c |                   Types: 
2.58/2.63	c |                          Extension: 93  (nb tuples: 8079..8079) -- (shared: 0)
2.58/2.63	c |                          
2.58/2.63	c =========================================================================================================
2.58/2.63	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
2.78/2.81	c 101            151            11358          12868          0              0              8   11   9     
2.99/3.04	c 211            343            26538          30619          0              0              7   13   9     
3.18/3.24	c 332            567            43758          48454          0              0              7   12   9     
3.48/3.52	c 465            812            64023          71457          0              0              7   12   9     
3.78/3.89	c 611            1089           86137          95199          0              0              7   12   8     
4.09/4.16	c 771            1341           104132         114754         0              0              7   12   9     
4.38/4.47	c 947            1610           123176         139262         0              0              8   11   9     
4.88/4.93	c 1140           1932           145832         168374         0              0              7   12   8     
5.28/5.31	c 1352           2298           172804         194518         0              0              7   13   9     
5.78/5.82	c 1585           2735           206491         228025         0              0              6   12   8     
6.38/6.44	c 1841           3189           240030         260383         0              0              6   13   8     
6.99/7.06	c 2122           3656           275796         300371         0              0              7   12   9     
7.59/7.64	c 2431           4339           328635         341012         0              0              7   13   9     
8.38/8.42	c 2770           4935           371509         383847         0              0              6   14   8     
9.09/9.12	c 3142           5552           414842         434941         0              0              7   13   9     
9.48/9.52	c 3551           6186           464199         480815         0              0              7   12   9     
10.48/10.56	c 4000           6981           525620         539237         0              0              6   13   9     
11.48/11.56	c 4493           7812           581297         599904         0              0              6   13   8     
12.68/12.70	c 5035           8650           642413         672694         0              0              6   12   8     
13.99/14.08	c 5631           9776           723799         751711         0              0              6   12   8     
15.58/15.63	c 6286           10969          831527         853506         0              0              6   11   8     
16.58/16.67	c 7006           12211          931149         950646         0              0              7   12   9     
18.28/18.33	c 7798           13467          1009792        1048203        0              0              6   12   7     
19.68/19.79	c 8669           14905          1115567        1169867        0              0              6   12   8     
21.48/21.54	c 9627           16435          1209095        1272286        0              0              5   13   8     
23.08/23.19	c 10680          18156          1330737        1402178        0              0              6   12   8     
25.87/25.98	c 11838          20412          1519768        1554738        0              0              6   13   8     
29.08/29.13	c 13111          22657          1702150        1735108        0              0              6   13   8     
31.67/31.71	c 14511          25138          1901893        1918259        0              0              6   13   9     
33.98/34.09	c 16051          27566          2067390        2114279        0              0              5   13   8     
37.57/37.67	c 17745          30570          2298476        2340617        0              0              6   13   8     
41.78/41.86	c 19608          34154          2575390        2594750        0              0              6   13   9     
44.48/44.50	c 21657          37320          2788556        2858344        0              0              5   12   8     
47.78/47.84	c 23910          40624          2983788        3077758        0              0              5   13   8     
52.37/52.47	c 26388          44777          3327968        3435421        0              0              6   13   8     
57.37/57.48	c 29113          49691          3731783        3836991        0              0              5   14   8     
62.17/62.23	c 32110          54198          4018238        4160287        0              0              5   13   8     
69.67/69.70	c 35406          59165          4398110        4591299        0              0              4   13   8     
76.66/76.79	c 39031          64848          4828215        5098609        0              0              5   13   8     
84.56/84.63	c 43018          71951          5373286        5588383        0              0              6   14   8     
93.16/93.26	c 47403          79805          5930264        6135754        0              0              5   13   7     
101.07/101.17	c 52226          87222          6381911        6656284        0              0              5   14   8     
109.36/109.45	c 57531          96175          7079425        7375622        0              0              6   14   9     
122.55/122.61	c 63366          107225         7929578        8165646        0              0              5   13   8     
133.96/134.09	c 69784          118224         8824323        9105488        0              0              5   12   8     
144.65/144.77	c 76843          128886         9692659        9942643        0              0              5   12   8     
157.55/157.61	c 84607          141350         10515031       10830024       0              0              5   14   8     
171.34/171.45	c 93147          157398         11797192       11919857       0              0              5   14   8     
191.34/191.47	c 102541         174468         13116583       13150443       0              0              5   13   8     
207.84/207.98	c 112874         192256         14473647       14574757       0              0              5   14   9     
230.04/230.11	c 124240         212681         16041887       16032422       0              0              5   15   8     
251.93/252.09	c 136742         233284         17602211       17780018       0              0              5   14   8     
274.62/274.74	c 150494         254848         18996093       19331993       0              0              5   13   8     
296.82/296.92	c 165621         280886         20844851       21211605       0              0              4   15   8     
332.31/332.43	c 182260         311514         23396093       23579600       0              0              5   13   8     
359.70/359.82	c 200562         339773         25178953       25525361       0              0              5   14   8     
388.40/388.53	c 220694         373463         27707059       28201488       0              0              5   14   8     
433.39/433.57	c 242839         414544         31215901       31371539       0              0              5   12   8     
477.49/477.63	c 267198         458433         34663266       34703885       0              0              5   15   8     
519.18/519.36	c 293992         502229         37651061       37808807       0              0              5   14   8     
582.68/582.83	c 323465         550883         41151796       41470938       0              0              4   15   7     
634.58/634.78	c 355885         601029         44379215       45025523       0              0              4   15   8     
709.98/710.12	c 391547         657575         48723359       49594804       0              0              5   15   8     
788.17/788.35	c 430775         728828         54286138       55137814       0              0              5   14   8     
857.67/857.88	c 473925         800965         59109936       59984983       0              0              5   15   8     
928.98/929.11	c 521390         885980         65756177       66278214       0              0              4   14   9     
1028.87/1029.08	c 573601         976632         72691134       73479268       0              0              5   15   8     
1154.35/1154.58	c 631033         1080614        80449465       81476766       0              0              5   14   8     
1265.55/1265.79	c 694208         1201003        89819848       89613273       0              0              4   14   8     
1386.34/1386.51	c 763700         1319990        99025092       99286190       0              0              4   14   8     
1506.34/1506.50	c 840141         1440896        106738635      107552214      0              0              4   15   8     
1651.23/1651.44	c 924226         1587796        118002922      118707515      0              0              4   16   8     
1849.82/1850.08	c 1016719        1752768        130161594      131278938      0              0              4   14   8     
2057.81/2058.08	c 1118461        1940026        144216071      144519913      0              0              4   14   8     
2277.59/2277.81	c 1230377        2131639        158706787      160231569      0              0              4   15   8     
2400.08/2400.30	
2400.08/2400.30	c *** INTERRUPTED ***
2400.08/2400.30	c restarts              : 75          
2400.08/2400.30	c conflicts             : 1302840      (543 /sec)
2400.08/2400.30	c decisions             : 2250294      (938 /sec)
2400.08/2400.30	c propagations          : 168411610   (70170 /sec)
2400.08/2400.30	c root propagations     : 0           
2400.08/2400.30	c filter calls          : 166473447      (69363 /sec)
2400.08/2400.30	c useless filter calls  : 126483201      (75 %)
2400.08/2400.30	c Memory used           : 70.99 MB
2400.08/2400.30	c CPU time              : 2400.04 s
2400.08/2400.30	c real time             : 2400.3 s
2400.08/2400.30	
2400.08/2400.30	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15088 MiB free)
  memory of node 1: 16384 MiB (14830 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397404-1568574164/watcher-4397404-1568574164 -o /tmp/evaluation-result-4397404-1568574164/solver-4397404-1568574164 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568572744-5580 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397404-1568574164.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=6203, runsolver pid=6200

[startup+0.100822 s]*
/proc/loadavg: 2.01 2.02 1.61 3/205 6204
/proc/meminfo: memFree=30635536/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=29488 memory=5488 CPUtime=0.09 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 1625 0 0 0 9 0 0 0 20 0 1 0 433665989 30195712 1372 33554432000 4194304 6211092 140733919668496 140733919665768 5818434 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 7372 1372 809 493 0 677 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 29488 KiB
Current children cumulated memory: 5488 KiB

[startup+0.209833 s]*
/proc/loadavg: 2.01 2.02 1.61 3/205 6204
/proc/meminfo: memFree=30634464/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=31176 memory=7072 CPUtime=0.2 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 2009 0 0 0 20 0 0 0 20 0 1 0 433665989 31924224 1768 33554432000 4194304 6211092 140733919668496 140733919665768 5818493 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 7794 1768 809 493 0 1099 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 31176 KiB
Current children cumulated memory: 7072 KiB

[startup+0.309321 s]*
/proc/loadavg: 2.01 2.02 1.61 3/205 6204
/proc/meminfo: memFree=30632976/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=32444 memory=8128 CPUtime=0.3 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 2297 0 0 0 30 0 0 0 20 0 1 0 433665989 33222656 2032 33554432000 4194304 6211092 140733919668496 140733919665768 5286997 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 8111 2032 809 493 0 1416 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32444 KiB
Current children cumulated memory: 8128 KiB

[startup+0.700236 s]
/proc/loadavg: 2.01 2.02 1.61 3/205 6204
/proc/meminfo: memFree=30630264/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=38352 memory=13672 CPUtime=0.68 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 3641 0 0 0 68 0 0 0 20 0 1 0 433665989 39272448 3418 33554432000 4194304 6211092 140733919668496 140733919665768 140423207313340 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 9588 3418 810 493 0 2893 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 38352 KiB
Current children cumulated memory: 13672 KiB

[startup+1.50024 s]
/proc/loadavg: 2.01 2.02 1.61 3/205 6204
/proc/meminfo: memFree=30623568/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=50596 memory=24760 CPUtime=1.48 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 6423 0 0 0 148 0 0 0 20 0 1 0 433665989 51810304 6190 33554432000 4194304 6211092 140733919668496 140733919665768 5818403 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 12649 6190 810 493 0 5954 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 50596 KiB
Current children cumulated memory: 24760 KiB

[startup+3.10985 s]
/proc/loadavg: 2.01 2.02 1.61 3/205 6204
/proc/meminfo: memFree=30595908/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=45692 CPUtime=3.09 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 18729 0 0 0 308 1 0 0 20 0 1 0 433665989 74436608 11423 33554432000 4194304 6211092 140733919668496 140733919665768 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 11423 848 493 0 11478 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 45692 KiB

[startup+6.30031 s]
/proc/loadavg: 2.01 2.02 1.61 3/205 6205
/proc/meminfo: memFree=30596004/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=45720 CPUtime=6.28 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 29182 0 0 0 626 2 0 0 20 0 1 0 433665989 74436608 11430 33554432000 4194304 6211092 140733919668496 140733919666456 5038971 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 11430 854 493 0 11478 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 45720 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 1.61 3/205 6205
/proc/meminfo: memFree=30595792/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=45720 CPUtime=12.68 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 39635 0 0 0 1265 3 0 0 20 0 1 0 433665989 74436608 11430 33554432000 4194304 6211092 140733919668496 140733919666456 5039007 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 11430 854 493 0 11478 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 45720 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 1.62 3/205 6205
/proc/meminfo: memFree=30595888/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=45720 CPUtime=25.47 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 60541 0 0 0 2544 3 0 0 20 0 1 0 433665989 74436608 11430 33554432000 4194304 6211092 140733919668496 140733919666456 5038990 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 11430 854 493 0 11478 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 45720 KiB

[startup+51.1099 s]
/proc/loadavg: 2.00 2.01 1.63 3/205 6207
/proc/meminfo: memFree=30592824/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=47176 CPUtime=51.08 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 71000 0 0 0 5104 4 0 0 20 0 1 0 433665989 74436608 11794 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 11794 854 493 0 11478 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 47176 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 1.65 3/205 6211
/proc/meminfo: memFree=30591044/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=102.26 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 74077 0 0 0 10222 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038990 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 1.67 3/205 6215
/proc/meminfo: memFree=30591168/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=162.25 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 74736 0 0 0 16221 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 1.69 3/203 6221
/proc/meminfo: memFree=30590424/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=222.23 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 75395 0 0 0 22219 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039536 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 1.71 3/202 6225
/proc/meminfo: memFree=30590716/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=282.22 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 76054 0 0 0 28218 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 1.73 3/203 6230
/proc/meminfo: memFree=30591884/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=342.21 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 76713 0 0 0 34217 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039038 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 1.74 3/203 6236
/proc/meminfo: memFree=30591944/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=402.19 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 77372 0 0 0 40215 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+462.3 s]
/proc/loadavg: 1.96 2.00 1.76 3/203 6240
/proc/meminfo: memFree=30590336/32770624 swapFree=66970024/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=462.19 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 78031 0 0 0 46215 4 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039026 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB


################
# More data... #
################

/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 1662.13 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/203 6427
/proc/meminfo: memFree=30620360/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=1722.12 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 90288 0 0 0 172207 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038971 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/203 6431
/proc/meminfo: memFree=30619832/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=1782.12 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 90672 0 0 0 178207 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038990 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 1782.12 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/203 6437
/proc/meminfo: memFree=30619612/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=1842.12 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 91056 0 0 0 184207 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038992 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 1842.12 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/203 6441
/proc/meminfo: memFree=30620328/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=1902.11 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 91708 0 0 0 190206 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 1902.11 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/202 6445
/proc/meminfo: memFree=30619832/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=1962.11 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 92081 0 0 0 196206 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5037882 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 1962.11 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/202 6451
/proc/meminfo: memFree=30619940/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2022.11 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 92454 0 0 0 202206 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2022.11 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/202 6455
/proc/meminfo: memFree=30620256/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2082.1 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 93113 0 0 0 208205 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039007 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2082.1 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/202 6459
/proc/meminfo: memFree=30619572/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2142.1 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 93702 0 0 0 214205 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2142.1 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/204 6467
/proc/meminfo: memFree=30619520/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2202.1 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 94133 0 0 0 220205 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038990 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2202.1 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/204 6471
/proc/meminfo: memFree=30619668/32770624 swapFree=66970048/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2262.09 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 94875 0 0 0 226204 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039536 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2262.09 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/209 6504
/proc/meminfo: memFree=30618004/32770624 swapFree=66970068/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2322.09 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 95534 0 0 0 232204 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2322.09 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/205 6511
/proc/meminfo: memFree=30619576/32770624 swapFree=66970068/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2382.09 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 96124 0 0 0 238204 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5037759 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2382.09 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/205 6511
/proc/meminfo: memFree=30619820/32770624 swapFree=66970068/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2400.08 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 96665 0 0 0 240003 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039536 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.3 s]
# the end of solver process 6203 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.04 s, system=0.060995 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/205 6511
/proc/meminfo: memFree=30619820/32770624 swapFree=66970068/67108860
[pid=6203] ppid=6200 vsize=72692 memory=49248 CPUtime=2400.08 cores=0,2,4,6
/proc/6203/stat : 6203 (cosoco) R 6200 6203 5549 0 -1 4202496 96665 0 0 0 240003 5 0 0 20 0 1 0 433665989 74436608 12312 33554432000 4194304 6211092 140733919668496 140733919666456 5039536 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 32436224 140733919675403 140733919675505 140733919675505 140733919678414 0
/proc/6203/statm: 18173 12312 854 493 0 11478 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 72692 KiB
Current children cumulated memory: 49248 KiB

Child status: 1
Real time (s): 2400.3
CPU time (s): 2400.1
CPU user time (s): 2400.04
CPU system time (s): 0.060995
CPU usage (%): 99.9915
Max. virtual memory (cumulated for all children) (KiB): 72692
Max. memory (cumulated for all children) (KiB): 49248

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.04
system time used= 0.060995
maximum resident set size= 49316
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 96716
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 28
involuntary context switches= 2863


# summary of solver processes directly reported to runsolver:
#   pid: 6203
#   total CPU time (s): 2400.1
#   total CPU user time (s): 2400.04
#   total CPU system time (s): 0.060995

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.1268 second user time and 18.0249 second system time

The end

Launcher Data 

Begin job on node135 at 2019-09-15 21:02:04
IDJOB=4397404
IDBENCH=122820
IDSOLVER=2849
FILE ID=node135/4397404-1568574164
RUNJOBID= node135-1568572744-5580
PBS_JOBID= 21703319
Free space on /tmp= 61360 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Random/Random-RB-3-28-28f/rand-3-28-28-93-632f-36.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397404-1568574164/watcher-4397404-1568574164 -o /tmp/evaluation-result-4397404-1568574164/solver-4397404-1568574164 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node135-1568572744-5580 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397404-1568574164.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e0a8d3734b0eaa27800dfa1f13e1fbfb
RANDOM SEED=2120923994

node135.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30637168 kB
MemAvailable:   31820088 kB
Buffers:          183952 kB
Cached:          1277116 kB
SwapCached:        33324 kB
Active:           622108 kB
Inactive:         912332 kB
Active(anon):      46664 kB
Inactive(anon):    69428 kB
Active(file):     575444 kB
Inactive(file):   842904 kB
Unevictable:      109480 kB
Mlocked:          109480 kB
SwapTotal:      67108860 kB
SwapFree:       66970024 kB
Dirty:              9176 kB
Writeback:             4 kB
AnonPages:        150700 kB
Mapped:            42692 kB
Shmem:             34124 kB
Slab:             191632 kB
SReclaimable:     160812 kB
SUnreclaim:        30820 kB
KernelStack:        3664 kB
PageTables:         6020 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     571200 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    102400 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 61360 MiB
End job on node135 at 2019-09-15 21:42:05