Trace number 4295819

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.07 2520.01

General information on the benchmark

NameQuasigroups/
QuasiGroup-4-12_c18.xml
MD5SUM31fb3bf3c58be033c7e9cdff116e7260
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark394.459
Satisfiable
(Un)Satisfiability was proved
Number of variables288
Number of constraints266
Number of domains2
Minimum domain size12
Maximum domain size144
Distribution of domain sizes[{"size":12,"count":144},{"size":144,"count":132}]
Minimum variable degree0
Maximum variable degree135
Distribution of variable degrees[{"degree":0,"count":12},{"degree":2,"count":132},{"degree":134,"count":12},{"degree":135,"count":132}]
Minimum constraint arity3
Maximum constraint arity145
Distribution of constraint arities[{"arity":3,"count":132},{"arity":12,"count":1},{"arity":144,"count":1},{"arity":145,"count":132}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":132}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.07	c root propagations     : 2040        
0.00/0.07	c restarts enabled, print stats at every restarts
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c This is cosoco 1.12 --  
0.00/0.07	c
0.00/0.07	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4295819-1532571966.xml 
0.00/0.07	c ========================================[ Problem Statistics ]===========================================
0.00/0.07	c |                                                                                                       
0.00/0.07	c |  Parse time        :         0.06 s 
0.00/0.07	c |
0.00/0.07	c |               Variables: 288
0.00/0.07	c |            Domain Sizes: 12..144
0.00/0.07	c |
0.00/0.07	c |             Constraints: 300
0.00/0.07	c |                   Arity: 1..145  -- Unary: 12  -- Ternary: 132
0.00/0.07	c | 
0.00/0.07	c |                   Types: 
0.00/0.07	c |                          All Different: 24
0.00/0.07	c |                          Element Constant: 132
0.00/0.07	c |                          Intension: 132
0.00/0.07	c |                          Unary: 12
0.00/0.07	c |                          
0.00/0.07	c =========================================================================================================
0.00/0.07	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c remove useless variable y[0][0]
0.00/0.07	c remove useless variable y[1][1]
0.00/0.07	c remove useless variable y[2][2]
0.00/0.07	c remove useless variable y[3][3]
0.00/0.07	c remove useless variable y[4][4]
0.00/0.07	c remove useless variable y[5][5]
0.00/0.07	c remove useless variable y[6][6]
0.00/0.07	c remove useless variable y[7][7]
0.00/0.07	c remove useless variable y[8][8]
0.00/0.07	c remove useless variable y[9][9]
0.00/0.07	c remove useless variable y[10][10]
0.00/0.07	c remove useless variable y[11][11]
2.49/2.55	c 101            700            506772         242283         186            0              79   135   97  
4.59/4.60	c 211            1250           958018         419413         186            0              47   82   70   
6.89/6.95	c 332            1909           1511799        669556         186            0              31   89   79   
9.10/9.14	c 465            2503           1817296        800433         186            0              32   73   59   
11.19/11.26	c 611            3179           2460628        1062459        186            0              69   86   76   
13.89/13.95	c 771            4144           3142056        1377976        186            0              55   80   67   
16.19/16.25	c 947            4926           3683385        1626882        186            0              58   76   65   
19.79/19.82	c 1140           5723           4278480        1861909        186            0              25   69   57   
23.99/24.03	c 1352           6868           5265351        2403445        186            0              61   85   73   
28.29/28.38	c 1585           8030           6276050        2883804        186            0              25   83   67   
32.69/32.78	c 1841           9472           7517696        3379250        186            0              41   89   71   
38.10/38.14	c 2122           11025          8739561        3912844        186            0              60   88   71   
45.19/45.29	c 2431           13102          10289302       4556782        186            0              41   87   69   
50.69/50.71	c 2770           14728          11786314       5194929        186            0              66   89   75   
56.49/56.50	c 3142           16501          13500617       5838280        186            0              65   90   76   
64.39/64.49	c 3551           18604          15371235       6655224        186            0              59   86   68   
69.39/69.42	c 4000           20571          17252855       7314511        186            0              63   88   75   
74.69/74.77	c 4493           22835          19090730       8045495        186            0              34   91   77   
83.39/83.40	c 5035           25394          21371765       9123521        186            0              66   90   77   
92.79/92.85	c 5631           28274          24157813       10270218       186            0              31   94   78   
103.19/103.29	c 6286           31011          26785297       11502057       186            0              46   89   76   
112.69/112.70	c 7006           34293          29802201       12806840       186            0              25   92   76   
125.89/125.94	c 7798           38166          33535838       14299560       186            0              62   88   73   
139.89/139.97	c 8669           42172          37287905       15866905       186            0              63   90   75   
152.00/152.07	c 9627           46907          41491458       17388665       186            0              34   90   76   
167.19/167.23	c 10680          51651          46150921       19165192       186            0              69   92   78   
186.49/186.51	c 11838          57084          50923118       21405346       186            0              61   88   74   
203.29/203.34	c 13111          62398          56207533       23453901       186            0              65   87   74   
228.19/228.28	c 14511          69442          62581798       26249094       186            0              64   95   77   
253.69/253.78	c 16051          76015          69369023       29119349       186            0              64   84   72   
282.89/282.95	c 17745          83894          76687052       32517583       186            0              48   97   77   
311.29/311.33	c 19608          92478          85123443       35849755       186            0              64   89   76   
342.39/342.46	c 21657          102093         94036279       39617010       186            0              64   93   77   
385.19/385.28	c 23910          115235         103923365      44997233       186            0              37   87   69   
436.00/436.02	c 26388          125835         113897654      50260586       186            0              55   85   70   
479.40/479.42	c 29113          140274         126174313      55679647       186            0              64   96   76   
512.30/512.39	c 32110          155013         138534452      60317945       186            0              65   100   78  
573.20/573.26	c 35406          173566         153746921      66884251       186            0              53   93   72   
621.20/621.29	c 39031          188890         169564521      72802851       186            0              54   91   75   
679.80/679.87	c 43018          209202         187937985      79952846       186            0              45   95   76   
753.20/753.25	c 47403          232608         205542023      88364837       186            0              49   84   66   
821.51/821.57	c 52226          255442         224891518      96713814       186            0              63   96   77   
901.91/901.99	c 57531          279712         246494941      106124199      186            0              48   93   75   
1004.51/1004.55	c 63366          304321         269060506      118498774      186            0              50   85   67   
1095.51/1095.53	c 69784          330879         288074666      126330221      186            0              47   85   62   
1194.73/1194.73	c 76843          363729         313676415      136420585      186            0              49   92   71   
1303.23/1303.21	c 84607          396402         345926830      149026871      186            0              63   93   74   
1424.33/1424.37	c 93147          436175         381609008      163426947      186            0              45   89   74   
1554.83/1554.82	c 102541         477891         422536528      179346510      186            0              50   91   75   
1744.54/1744.60	c 112874         521466         459097151      195386393      186            0              41   82   62   
1964.55/1964.57	c 124240         578501         510491648      217301238      186            0              53   92   70   
2176.65/2176.68	c 136742         645468         564661967      240393884      186            0              49   89   67   
2375.25/2375.28	c 150494         705658         622840130      264010882      186            0              63   95   77   
2520.06/2520.00	
2520.06/2520.00	c *** INTERRUPTED ***
2520.06/2520.00	c restarts              : 53          
2520.06/2520.00	c conflicts             : 160229       (64 /sec)
2520.06/2520.00	c decisions             : 750094       (298 /sec)
2520.06/2520.00	c propagations          : 281163350   (111570 /sec)
2520.06/2520.00	c root propagations     : 2040        
2520.06/2520.00	c filter calls          : 665029224      (263895 /sec)
2520.06/2520.00	c useless filter calls  : 573174578      (86 %)
2520.06/2520.00	c Memory used           : 30.62 MB
2520.06/2520.00	c CPU time              : 2520.05 s
2520.06/2520.00	
2520.06/2520.00	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11620 MiB free)
  memory of node 1: 16384 MiB (9674 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4295819-1532571966/watcher-4295819-1532571966 -o /tmp/evaluation-result-4295819-1532571966/solver-4295819-1532571966 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1532542931-30488 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4295819-1532571966.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2204, runsolver pid=2201
Current StackSize limit: 8192 KiB


[startup+0.100152 s]*
/proc/loadavg: 1.99 2.00 2.04 3/187 2205
/proc/meminfo: memFree=21802444/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=30560 memory=6948 CPUtime=0.1 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 1945 0 0 0 10 0 0 0 20 0 1 0 74759811 31293440 1737 33554432000 4194304 6142532 140726703214768 140726703211400 140526337741671 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7640 1737 815 476 0 962 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30560 KiB
Current children cumulated memory: 6948 KiB

[startup+0.209739 s]*
/proc/loadavg: 1.99 2.00 2.04 3/187 2205
/proc/meminfo: memFree=21802444/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=30560 memory=7212 CPUtime=0.21 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 1965 0 0 0 21 0 0 0 20 0 1 0 74759811 31293440 1803 33554432000 4194304 6142532 140726703214768 140726703211400 5376422 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7640 1803 856 476 0 962 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30560 KiB
Current children cumulated memory: 7212 KiB

[startup+0.309059 s]*
/proc/loadavg: 1.99 2.00 2.04 3/187 2205
/proc/meminfo: memFree=21801764/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=30692 memory=7212 CPUtime=0.3 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 1980 0 0 0 30 0 0 0 20 0 1 0 74759811 31428608 1803 33554432000 4194304 6142532 140726703214768 140726703211400 5146777 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7673 1803 856 476 0 995 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 30692 KiB
Current children cumulated memory: 7212 KiB

[startup+0.700275 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 2205
/proc/meminfo: memFree=21801764/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=30956 memory=7476 CPUtime=0.69 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 2055 0 0 0 69 0 0 0 20 0 1 0 74759811 31698944 1869 33554432000 4194304 6142532 140726703214768 140726703211752 5363572 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7739 1869 856 476 0 1061 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 30956 KiB
Current children cumulated memory: 7476 KiB

[startup+1.50027 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 2205
/proc/meminfo: memFree=21801556/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31088 memory=7476 CPUtime=1.49 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 2069 0 0 0 149 0 0 0 20 0 1 0 74759811 31834112 1869 33554432000 4194304 6142532 140726703214768 140726703211752 5374073 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7772 1869 856 476 0 1094 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 31088 KiB
Current children cumulated memory: 7476 KiB

[startup+3.10919 s]
/proc/loadavg: 1.91 1.98 2.03 3/187 2205
/proc/meminfo: memFree=21801580/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31088 memory=7704 CPUtime=3.1 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 3093 0 0 0 310 0 0 0 20 0 1 0 74759811 31834112 1926 33554432000 4194304 6142532 140726703214768 140726703211752 5366713 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7772 1926 856 476 0 1094 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 31088 KiB
Current children cumulated memory: 7704 KiB

[startup+6.30027 s]
/proc/loadavg: 1.91 1.98 2.03 3/187 2205
/proc/meminfo: memFree=21800976/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31220 memory=7748 CPUtime=6.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 4123 0 0 0 629 0 0 0 20 0 1 0 74759811 31969280 1937 33554432000 4194304 6142532 140726703214768 140726703211912 5047869 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7805 1937 856 476 0 1127 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7748 KiB

[startup+12.7003 s]
/proc/loadavg: 1.92 1.98 2.03 3/187 2205
/proc/meminfo: memFree=21800976/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31220 memory=7836 CPUtime=12.69 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 5178 0 0 0 1269 0 0 0 20 0 1 0 74759811 31969280 1959 33554432000 4194304 6142532 140726703214768 140726703212168 5367440 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7805 1959 856 476 0 1127 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7836 KiB

[startup+25.5003 s]
/proc/loadavg: 1.94 1.98 2.03 3/187 2205
/proc/meminfo: memFree=21800976/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31220 memory=7892 CPUtime=25.49 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 7284 0 0 0 2549 0 0 0 20 0 1 0 74759811 31969280 1973 33554432000 4194304 6142532 140726703214768 140726703212168 5363641 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7805 1973 856 476 0 1127 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7892 KiB

[startup+51.1092 s]
/proc/loadavg: 1.96 1.99 2.03 3/187 2205
/proc/meminfo: memFree=21800408/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7904 CPUtime=51.1 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 8346 0 0 0 5110 0 0 0 20 0 1 0 74759811 32104448 1976 33554432000 4194304 6142532 140726703214768 140726703212168 140526337742398 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1976 856 476 0 1160 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7904 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 1.99 2.03 3/187 2206
/proc/meminfo: memFree=21801548/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7908 CPUtime=102.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 8893 0 0 0 10229 0 0 0 20 0 1 0 74759811 32104448 1977 33554432000 4194304 6142532 140726703214768 140726703212168 5361758 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1977 856 476 0 1160 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7908 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/187 2208
/proc/meminfo: memFree=21801580/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7912 CPUtime=162.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 9440 0 0 0 16229 0 0 0 20 0 1 0 74759811 32104448 1978 33554432000 4194304 6142532 140726703214768 140726703212168 140526346763078 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1978 856 476 0 1160 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7912 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 2209
/proc/meminfo: memFree=21802044/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7912 CPUtime=222.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 9988 0 0 0 22229 0 0 0 20 0 1 0 74759811 32104448 1978 33554432000 4194304 6142532 140726703214768 140726703212168 5375766 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1978 856 476 0 1160 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7912 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 2217
/proc/meminfo: memFree=21801004/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7916 CPUtime=282.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 10537 0 0 0 28229 0 0 0 20 0 1 0 74759811 32104448 1979 33554432000 4194304 6142532 140726703214768 140726703212168 140526337742401 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1979 856 476 0 1160 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7916 KiB

[startup+342.3 s]
/proc/loadavg: 2.45 2.12 2.08 3/187 2218
/proc/meminfo: memFree=21801148/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7920 CPUtime=342.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 11086 0 0 0 34229 0 0 0 20 0 1 0 74759811 32104448 1980 33554432000 4194304 6142532 140726703214768 140726703212168 5051328 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1980 856 476 0 1160 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7920 KiB

[startup+402.3 s]
/proc/loadavg: 2.16 2.10 2.07 3/187 2219
/proc/meminfo: memFree=21801164/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7920 CPUtime=402.29 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 11635 0 0 0 40229 0 0 0 20 0 1 0 74759811 32104448 1980 33554432000 4194304 6142532 140726703214768 140726703212168 4991580 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1980 856 476 0 1160 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7920 KiB

[startup+462.3 s]
/proc/loadavg: 2.06 2.08 2.07 3/187 2220
/proc/meminfo: memFree=21801216/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7920 CPUtime=462.3 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 12185 0 0 0 46230 0 0 0 20 0 1 0 74759811 32104448 1980 33554432000 4194304 6142532 140726703214768 140726703212168 5372387 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1980 856 476 0 1160 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7920 KiB


################
# More data... #
################

/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 1722.34 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2259
/proc/meminfo: memFree=21801108/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=1782.34 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 24022 0 0 0 178233 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5363636 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 1782.34 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2260
/proc/meminfo: memFree=21801160/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=1842.34 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 24543 0 0 0 184233 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 140526337742398 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 1842.34 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2261
/proc/meminfo: memFree=21801208/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=1902.34 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 25064 0 0 0 190233 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5372449 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 1902.34 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2263
/proc/meminfo: memFree=21801128/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=1962.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 25585 0 0 0 196234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5371800 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 1962.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/187 2325
/proc/meminfo: memFree=21802108/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2022.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 26139 0 0 0 202234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 140526346763112 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2022.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2082.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/188 2334
/proc/meminfo: memFree=21801816/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2082.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 26664 0 0 0 208234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5363633 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2082.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/188 2359
/proc/meminfo: memFree=21801752/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2142.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 27189 0 0 0 214234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5363597 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2142.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 2360
/proc/meminfo: memFree=21801568/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2202.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 27739 0 0 0 220234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5363572 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2202.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 2361
/proc/meminfo: memFree=21801376/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2262.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 28260 0 0 0 226234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5372468 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2262.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 2362
/proc/meminfo: memFree=21801540/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2322.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 28778 0 0 0 232234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5363612 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2322.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2363
/proc/meminfo: memFree=21801708/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2382.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 29328 0 0 0 238234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5374073 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2382.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2364
/proc/meminfo: memFree=21801592/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2442.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 29831 0 0 0 244234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5363683 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2442.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2365
/proc/meminfo: memFree=21801688/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2502.35 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 30342 0 0 0 250234 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5361726 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2502.35 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 2365
/proc/meminfo: memFree=21801688/32770624 swapFree=67108860/67108860
[pid=2204] ppid=2201 vsize=31352 memory=7924 CPUtime=2520.06 cores=1,3,5,7
/proc/2204/stat : 2204 (cosoco) R 2201 2204 30456 0 -1 4202496 30853 0 0 0 252005 1 0 0 20 0 1 0 74759811 32104448 1981 33554432000 4194304 6142532 140726703214768 140726703212168 5146698 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 36188160 140726703215750 140726703215880 140726703215880 140726703218638 0
/proc/2204/statm: 7838 1981 856 476 0 1160 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 31352 KiB
Current children cumulated memory: 7924 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 2204 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.05 s, system=0.02 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.07
CPU user time (s): 2520.05
CPU system time (s): 0.02
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 31352
Max. memory (cumulated for all children) (KiB): 7924

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.05
system time used= 0.02
maximum resident set size= 7988
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30899
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 749


# summary of solver processes directly reported to runsolver:
#   pid: 2204
#   total CPU time (s): 2520.07
#   total CPU user time (s): 2520.05
#   total CPU system time (s): 0.02

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.94156 second user time and 16.2006 second system time

The end

Launcher Data

Begin job on node149 at 2018-07-26 04:26:06
IDJOB=4295819
IDBENCH=141605
IDSOLVER=2752
FILE ID=node149/4295819-1532571966
RUNJOBID= node149-1532542931-30488
PBS_JOBID= 21021951
Free space on /tmp= 43260 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-4-12_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4295819-1532571966/watcher-4295819-1532571966 -o /tmp/evaluation-result-4295819-1532571966/solver-4295819-1532571966 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1532542931-30488 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4295819-1532571966.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 31fb3bf3c58be033c7e9cdff116e7260
RANDOM SEED=1485201832

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        21806280 kB
MemAvailable:   31927440 kB
Buffers:          138340 kB
Cached:         10126004 kB
SwapCached:            0 kB
Active:          2346776 kB
Inactive:        7975536 kB
Active(anon):       5964 kB
Inactive(anon):    79884 kB
Active(file):    2340812 kB
Inactive(file):  7895652 kB
Unevictable:        7608 kB
Mlocked:            7608 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2408 kB
Writeback:             0 kB
AnonPages:         79728 kB
Mapped:            41772 kB
Shmem:             25224 kB
Slab:             342112 kB
SReclaimable:     313156 kB
SUnreclaim:        28956 kB
KernelStack:        3568 kB
PageTables:         4804 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     355188 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     22528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 43256 MiB
End job on node149 at 2018-07-26 05:08:06