Trace number 4389468

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.04 2519.7

General information on the benchmark

NameSuperSolutions/SuperSolutions-Taillard-os10/
SuperTaillard-os-10-06.xml
MD5SUM6b3d88799df56964f86d557249875b85
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark56.1836
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints2800
Number of domains64
Minimum domain size440
Maximum domain size538
Distribution of domain sizes[{"size":440,"count":2},{"size":441,"count":2},{"size":442,"count":2},{"size":444,"count":2},{"size":445,"count":4},{"size":447,"count":2},{"size":448,"count":4},{"size":449,"count":4},{"size":450,"count":2},{"size":452,"count":2},{"size":455,"count":4},{"size":457,"count":4},{"size":459,"count":2},{"size":461,"count":2},{"size":462,"count":2},{"size":464,"count":4},{"size":466,"count":2},{"size":467,"count":2},{"size":470,"count":4},{"size":472,"count":8},{"size":474,"count":2},{"size":475,"count":2},{"size":477,"count":2},{"size":480,"count":6},{"size":483,"count":2},"...",{"size":505,"count":2}, {"size":506,"count":2}, {"size":508,"count":10}, {"size":509,"count":2}, {"size":511,"count":2}, {"size":512,"count":2}, {"size":513,"count":6}, {"size":514,"count":2}, {"size":515,"count":2}, {"size":516,"count":2}, {"size":517,"count":4}, {"size":518,"count":4}, {"size":519,"count":4}, {"size":520,"count":2}, {"size":521,"count":2}, {"size":522,"count":4}, {"size":523,"count":4}, {"size":524,"count":2}, {"size":526,"count":4}, {"size":528,"count":2}, {"size":529,"count":4}, {"size":530,"count":8}, {"size":531,"count":4}, {"size":534,"count":2}, {"size":538,"count":4}]
Minimum variable degree19
Maximum variable degree37
Distribution of variable degrees[{"degree":19,"count":100},{"degree":37,"count":100}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":2800}]
Number of extensional constraints0
Number of intensional constraints2800
Distribution of constraint types[{"type":"intension","count":2800}]
Optimization problemNO
Type of objective

Solver Data 

1.89/1.93	c root propagations     : 0           
1.89/1.93	c restarts enabled, print stats at every restarts
1.89/1.93	c
1.89/1.93	c
1.89/1.93	c
1.89/1.93	c This is cosoco 2.00 --  
1.89/1.93	c
1.89/1.93	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389468-1568357754.xml 
1.89/1.93	c ========================================[ Problem Statistics ]===========================================
1.89/1.93	c |                                                                                                       
1.89/1.93	c |  Parse time        :         1.88 s 
1.89/1.93	c |
1.89/1.93	c |               Variables: 200
1.89/1.93	c |            Domain Sizes: 440..538
1.89/1.93	c |
1.89/1.93	c |             Constraints: 2800
1.89/1.93	c |                   Arity: 2..2  -- Binary: 2800
1.89/1.93	c | 
1.89/1.93	c |                   Types: 
1.89/1.93	c |                          (X != Y): 100
1.89/1.93	c |                          Intension: 2700
1.89/1.93	c |                          
1.89/1.93	c =========================================================================================================
1.89/1.93	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
3.49/3.59	c 101            110            32422          223930         0              0              7   7   6      
6.89/6.97	c 211            292            104686         591079         0              0              7   46   31    
8.10/8.18	c 332            433            126195         976561         0              0              13   17   16   
9.69/9.74	c 465            577            151413         1338980        0              0              7   7   6      
11.70/11.78	c 611            736            187439         1695497        0              0              8   8   7      
15.20/15.24	c 771            962            273658         1928103        0              0              6   10   9     
18.39/18.48	c 947            1153           314969         2460047        0              0              7   9   8      
20.60/20.61	c 1140           1353           330655         2911346        0              0              7   7   6      
25.89/25.99	c 1352           1596           369463         3645872        0              0              28   28   27   
31.20/31.27	c 1585           1870           472121         4067269        0              0              20   21   20   
36.50/36.59	c 1841           2195           547935         4732780        0              0              42   51   50   
42.60/42.62	c 2122           2503           629689         5439934        0              0              21   21   20   
50.40/50.46	c 2431           2884           732465         6343610        0              0              20   51   46   
60.01/60.07	c 2770           3292           821546         7751263        0              0              22   61   59   
64.60/64.61	c 3142           3700           888099         8880559        0              0              10   21   19   
71.11/71.17	c 3551           4148           995556         10400226       0              0              5   6   5      
81.30/81.36	c 4000           4642           1188292        12139480       0              0              4   5   4      
93.50/93.50	c 4493           5172           1340788        14085059       0              0              4   5   4      
105.30/105.38	c 5035           5769           1571777        16029014       0              0              4   5   4      
109.90/109.93	c 5631           6377           1620663        17848996       0              0              5   5   4      
122.90/122.97	c 6286           7092           1888610        20268213       0              0              4   7   4      
130.11/130.12	c 7006           7827           1949426        22465037       0              0              5   5   4      
146.70/146.80	c 7798           8640           2113934        26426453       0              0              5   5   4      
163.80/163.82	c 8669           9543           2211041        29363407       0              0              5   6   5      
187.80/187.80	c 9627           10623          2823717        31464108       0              0              4   9   6      
215.02/215.01	c 10680          11774          3306948        34889986       0              0              4   8   5      
247.02/247.02	c 11838          13159          3982400        39124929       0              0              4   11   8     
271.71/271.74	c 13111          14604          4328122        44213680       0              0              4   11   7     
313.82/313.89	c 14511          16352          5140002        47230046       0              0              4   10   7     
347.13/347.16	c 16051          18339          5781993        50425991       0              0              5   10   8     
393.14/393.16	c 17745          20067          6012828        61288044       0              0              4   5   4      
421.33/421.30	c 19608          22058          6464942        66756542       0              0              6   9   7      
475.24/475.23	c 21657          24581          8102447        69936808       0              0              8   11   10    
512.85/512.89	c 23910          26959          8624426        77693788       0              0              5   8   6      
575.16/575.13	c 26388          30043          9987258        81657388       0              0              5   11   8     
650.87/650.87	c 29113          33057          11012393       91871887       0              0              5   9   5      
683.38/683.33	c 32110          36102          11280425       101747784      0              0              6   7   5      
736.49/736.47	c 35406          39578          12072100       112818994      0              0              4   9   7      
819.70/819.64	c 39031          43885          13622048       121321278      0              0              5   10   7     
900.61/900.59	c 43018          48183          14640227       131188504      0              0              5   8   7      
1010.13/1010.02	c 47403          53370          16805839       140873070      0              0              4   9   6      
1129.44/1129.32	c 52226          58964          19433558       151743148      0              0              5   10   7     
1238.16/1238.05	c 57531          64565          21266142       169139923      0              0              5   7   6      
1371.97/1371.80	c 63366          71275          23889571       182261491      0              0              4   10   7     
1512.49/1512.31	c 69784          77884          24811497       209621533      0              0              4   7   5      
1709.33/1709.11	c 76843          86415          28705893       225882619      0              0              4   11   7     
1946.26/1946.04	c 84607          95368          33459578       252809811      0              0              5   8   6      
2076.07/2075.86	c 93147          104412         34842792       283480773      0              0              4   7   5      
2241.89/2241.61	c 102541         114445         37012814       316109232      0              0              4   7   5      
2520.03/2519.70	
2520.03/2519.70	c *** INTERRUPTED ***
2520.03/2519.70	c restarts              : 49          
2520.03/2519.70	c conflicts             : 111922       (44 /sec)
2520.03/2519.70	c decisions             : 126005       (50 /sec)
2520.03/2519.70	c propagations          : 333502778   (132346 /sec)
2520.03/2519.70	c root propagations     : 0           
2520.03/2519.70	c filter calls          : 43267783       (17170 /sec)
2520.03/2519.70	c useless filter calls  : 37242953       (86 %)
2520.03/2519.70	c Memory used           : 155.95 MB
2520.03/2519.70	c CPU time              : 2519.92 s
2520.03/2519.70	c real time             : 2519.7 s
2520.03/2519.70	
2520.03/2519.70	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15327 MiB free)
  memory of node 1: 16384 MiB (15433 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389468-1568357754/watcher-4389468-1568357754 -o /tmp/evaluation-result-4389468-1568357754/solver-4389468-1568357754 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568357660-23541 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389468-1568357754.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=23896, runsolver pid=23893

[startup+0.10017 s]*
/proc/loadavg: 1.51 1.32 1.65 3/199 23897
/proc/meminfo: memFree=31497692/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=28840 memory=4928 CPUtime=0.1 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 1448 0 0 0 10 0 0 0 20 0 1 0 411713282 29532160 1232 33554432000 4194304 6210612 140726514378800 140726514375336 139840864754661 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 7210 1232 796 493 0 515 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28840 KiB
Current children cumulated memory: 4928 KiB

[startup+0.209587 s]*
/proc/loadavg: 1.51 1.32 1.65 3/199 23897
/proc/meminfo: memFree=31493228/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=34232 memory=10512 CPUtime=0.21 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 2808 0 0 0 21 0 0 0 20 0 1 0 411713282 35053568 2628 33554432000 4194304 6210612 140726514378800 140726514375336 139840864754661 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 8558 2628 815 493 0 1863 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 34232 KiB
Current children cumulated memory: 10512 KiB

[startup+0.309479 s]*
/proc/loadavg: 1.51 1.32 1.65 3/199 23897
/proc/meminfo: memFree=31488020/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=39656 memory=15788 CPUtime=0.31 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 4167 0 0 0 30 1 0 0 20 0 1 0 411713282 40607744 3947 33554432000 4194304 6210612 140726514378800 140726514375336 139840864754661 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 9914 3947 815 493 0 3219 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 39656 KiB
Current children cumulated memory: 15788 KiB

[startup+0.70036 s]
/proc/loadavg: 1.55 1.33 1.65 3/199 23897
/proc/meminfo: memFree=31477232/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=60348 memory=36492 CPUtime=0.69 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 9344 0 0 0 67 2 0 0 20 0 1 0 411713282 61796352 9123 33554432000 4194304 6210612 140726514378800 140726514375336 139840864754661 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 15087 9123 815 493 0 8392 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 60348 KiB
Current children cumulated memory: 36492 KiB

[startup+1.50036 s]
/proc/loadavg: 1.55 1.33 1.65 3/199 23897
/proc/meminfo: memFree=31449900/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=103764 memory=80040 CPUtime=1.49 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 20186 0 0 0 145 4 0 0 20 0 1 0 411713282 106254336 20010 33554432000 4194304 6210612 140726514378800 140726514372104 139840864754661 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 25941 20010 815 493 0 19246 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 103764 KiB
Current children cumulated memory: 80040 KiB

[startup+3.10925 s]
/proc/loadavg: 1.55 1.33 1.65 3/199 23897
/proc/meminfo: memFree=31396664/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=129332 memory=105804 CPUtime=3.1 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 29221 0 0 0 305 5 0 0 20 0 1 0 411713282 132435968 26451 33554432000 4194304 6210612 140726514378800 140726514372104 139840874699584 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 32333 26451 856 493 0 25638 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 129332 KiB
Current children cumulated memory: 105804 KiB

[startup+6.30036 s]
/proc/loadavg: 1.58 1.34 1.65 3/199 23897
/proc/meminfo: memFree=31386992/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=138836 memory=115284 CPUtime=6.29 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 46323 0 0 0 622 7 0 0 20 0 1 0 411713282 142168064 28821 33554432000 4194304 6210612 140726514378800 140726514376456 5442807 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 34709 28821 859 493 0 28014 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 138836 KiB
Current children cumulated memory: 115284 KiB

[startup+12.7003 s]
/proc/loadavg: 1.62 1.35 1.65 3/199 23898
/proc/meminfo: memFree=31382936/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=141608 memory=118124 CPUtime=12.7 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 55768 0 0 0 1262 8 0 0 20 0 1 0 411713282 145006592 29531 33554432000 4194304 6210612 140726514378800 140726514376456 5164344 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 35402 29531 859 493 0 28707 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 141608 KiB
Current children cumulated memory: 118124 KiB

[startup+25.5003 s]
/proc/loadavg: 1.68 1.37 1.66 3/200 23900
/proc/meminfo: memFree=31380696/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=142928 memory=119464 CPUtime=25.49 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 69974 0 0 0 2541 8 0 0 20 0 1 0 411713282 146358272 29866 33554432000 4194304 6210612 140726514378800 140726514376456 5452071 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 35732 29866 859 493 0 29037 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 142928 KiB
Current children cumulated memory: 119464 KiB

[startup+51.1095 s]
/proc/loadavg: 1.80 1.43 1.67 3/199 23900
/proc/meminfo: memFree=31363416/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=151112 memory=127652 CPUtime=51.11 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 98992 0 0 0 5101 10 0 0 20 0 1 0 411713282 154738688 31913 33554432000 4194304 6210612 140726514378800 140726514376456 5478158 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 37778 31913 859 493 0 31083 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 151112 KiB
Current children cumulated memory: 127652 KiB

[startup+102.3 s]
/proc/loadavg: 1.91 1.52 1.69 3/199 23904
/proc/meminfo: memFree=31352488/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=156788 memory=133212 CPUtime=102.3 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 109695 0 0 0 10220 10 0 0 20 0 1 0 411713282 160550912 33303 33554432000 4194304 6210612 140726514378800 140726514376456 5451426 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39197 33303 859 493 0 32502 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 156788 KiB
Current children cumulated memory: 133212 KiB

[startup+162.3 s]
/proc/loadavg: 1.97 1.61 1.71 3/199 23910
/proc/meminfo: memFree=31349808/32770624 swapFree=66918080/67108860
[pid=23896] ppid=23893 vsize=157448 memory=133944 CPUtime=162.3 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 116041 0 0 0 16220 10 0 0 20 0 1 0 411713282 161226752 33486 33554432000 4194304 6210612 140726514378800 140726514376760 5453766 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39362 33486 859 493 0 32667 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 157448 KiB
Current children cumulated memory: 133944 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.68 1.72 3/199 23915
/proc/meminfo: memFree=31348560/32770624 swapFree=66918084/67108860
[pid=23896] ppid=23893 vsize=157976 memory=134452 CPUtime=222.31 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 116552 0 0 0 22221 10 0 0 20 0 1 0 411713282 161767424 33613 33554432000 4194304 6210612 140726514378800 140726514376456 139840865680825 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39494 33613 859 493 0 32799 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 157976 KiB
Current children cumulated memory: 134452 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.74 1.74 3/199 23919
/proc/meminfo: memFree=31347444/32770624 swapFree=66918084/67108860
[pid=23896] ppid=23893 vsize=158504 memory=134936 CPUtime=282.32 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 116675 0 0 0 28222 10 0 0 20 0 1 0 411713282 162308096 33734 33554432000 4194304 6210612 140726514378800 140726514376456 139840874699663 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39626 33734 859 493 0 32931 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 158504 KiB
Current children cumulated memory: 134936 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.79 1.76 3/201 23934
/proc/meminfo: memFree=31346564/32770624 swapFree=66918096/67108860
[pid=23896] ppid=23893 vsize=158636 memory=135132 CPUtime=342.32 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 117292 0 0 0 34222 10 0 0 20 0 1 0 411713282 162443264 33783 33554432000 4194304 6210612 140726514378800 140726514376456 5442912 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39659 33783 859 493 0 32964 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 158636 KiB
Current children cumulated memory: 135132 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.82 1.77 3/202 23961
/proc/meminfo: memFree=31346964/32770624 swapFree=66918104/67108860
[pid=23896] ppid=23893 vsize=158768 memory=135236 CPUtime=402.33 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 117353 0 0 0 40223 10 0 0 20 0 1 0 411713282 162578432 33809 33554432000 4194304 6210612 140726514378800 140726514376760 5480039 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39692 33809 859 493 0 32997 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 158768 KiB
Current children cumulated memory: 135236 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.86 1.79 3/202 23965
/proc/meminfo: memFree=31345560/32770624 swapFree=66918104/67108860
[pid=23896] ppid=23893 vsize=158900 memory=135388 CPUtime=462.34 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 117834 0 0 0 46224 10 0 0 20 0 1 0 411713282 162713600 33847 33554432000 4194304 6210612 140726514378800 140726514376456 5446767 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39725 33847 859 493 0 33030 0
Current children cumulated CPU time: 462.34 s
Current children cumulated vsize: 158900 KiB
Current children cumulated memory: 135388 KiB


################
# More data... #
################

/proc/23896/statm: 39890 34032 859 493 0 33195 0
Current children cumulated CPU time: 1782.53 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136128 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 1.97 3/199 24090
/proc/meminfo: memFree=31342876/32770624 swapFree=66918132/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136128 CPUtime=1842.54 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 120937 0 0 0 184243 11 0 0 20 0 1 0 411713282 163389440 34032 33554432000 4194304 6210612 140726514378800 140726514376760 5446066 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34032 859 493 0 33195 0
Current children cumulated CPU time: 1842.54 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136128 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 1.97 3/200 24095
/proc/meminfo: memFree=31338592/32770624 swapFree=66918132/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136128 CPUtime=1902.55 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 121153 0 0 0 190244 11 0 0 20 0 1 0 411713282 163389440 34032 33554432000 4194304 6210612 140726514378800 140726514376760 5068903 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34032 859 493 0 33195 0
Current children cumulated CPU time: 1902.55 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136128 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 1.97 3/200 24101
/proc/meminfo: memFree=31338160/32770624 swapFree=66918132/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136128 CPUtime=1962.55 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 121203 0 0 0 196244 11 0 0 20 0 1 0 411713282 163389440 34032 33554432000 4194304 6210612 140726514378800 140726514376760 5451292 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34032 859 493 0 33195 0
Current children cumulated CPU time: 1962.55 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136128 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 1.97 3/200 24106
/proc/meminfo: memFree=31338640/32770624 swapFree=66918132/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136156 CPUtime=2022.56 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 121428 0 0 0 202245 11 0 0 20 0 1 0 411713282 163389440 34039 33554432000 4194304 6210612 140726514378800 140726514376760 5446446 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34039 859 493 0 33195 0
Current children cumulated CPU time: 2022.56 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136156 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/200 24110
/proc/meminfo: memFree=31337740/32770624 swapFree=66918132/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136156 CPUtime=2082.57 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 121482 0 0 0 208246 11 0 0 20 0 1 0 411713282 163389440 34039 33554432000 4194304 6210612 140726514378800 140726514376760 5446470 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34039 859 493 0 33195 0
Current children cumulated CPU time: 2082.57 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136156 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/201 24124
/proc/meminfo: memFree=31335656/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136160 CPUtime=2142.58 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 121754 0 0 0 214247 11 0 0 20 0 1 0 411713282 163389440 34040 33554432000 4194304 6210612 140726514378800 140726514376760 5440914 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34040 859 493 0 33195 0
Current children cumulated CPU time: 2142.58 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136160 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/200 24128
/proc/meminfo: memFree=31335436/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159560 memory=136160 CPUtime=2202.59 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 121766 0 0 0 220248 11 0 0 20 0 1 0 411713282 163389440 34040 33554432000 4194304 6210612 140726514378800 140726514376760 5442814 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39890 34040 859 493 0 33195 0
Current children cumulated CPU time: 2202.59 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136160 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/199 24132
/proc/meminfo: memFree=31335900/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136204 CPUtime=2262.59 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122091 0 0 0 226248 11 0 0 20 0 1 0 411713282 163524608 34051 33554432000 4194304 6210612 140726514378800 140726514376760 139840865675188 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34051 859 493 0 33228 0
Current children cumulated CPU time: 2262.59 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136204 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/200 24139
/proc/meminfo: memFree=31333476/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136204 CPUtime=2322.6 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122099 0 0 0 232249 11 0 0 20 0 1 0 411713282 163524608 34051 33554432000 4194304 6210612 140726514378800 140726514376760 5442932 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34051 859 493 0 33228 0
Current children cumulated CPU time: 2322.6 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136204 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/200 24143
/proc/meminfo: memFree=31333916/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136216 CPUtime=2382.61 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122362 0 0 0 238250 11 0 0 20 0 1 0 411713282 163524608 34054 33554432000 4194304 6210612 140726514378800 140726514376760 5442840 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34054 859 493 0 33228 0
Current children cumulated CPU time: 2382.61 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136216 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/199 24147
/proc/meminfo: memFree=31332972/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136216 CPUtime=2442.62 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122380 0 0 0 244251 11 0 0 20 0 1 0 411713282 163524608 34054 33554432000 4194304 6210612 140726514378800 140726514376760 5446050 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34054 859 493 0 33228 0
Current children cumulated CPU time: 2442.62 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136216 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/199 24153
/proc/meminfo: memFree=31329272/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136220 CPUtime=2502.63 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122583 0 0 0 250252 11 0 0 20 0 1 0 411713282 163524608 34055 33554432000 4194304 6210612 140726514378800 140726514376760 5478208 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34055 859 493 0 33228 0
Current children cumulated CPU time: 2502.63 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136220 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.7 s]
/proc/loadavg: 2.08 2.03 1.98 3/199 24214
/proc/meminfo: memFree=31252032/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136220 CPUtime=2520.03 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122583 0 0 0 251992 11 0 0 20 0 1 0 411713282 163524608 34055 33554432000 4194304 6210612 140726514378800 140726514376760 5451322 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34055 859 493 0 33228 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136220 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.7 s]
# the end of solver process 23896 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.92 s, system=0.117016 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.7 s]
/proc/loadavg: 2.08 2.03 1.98 3/199 24214
/proc/meminfo: memFree=31252032/32770624 swapFree=66918148/67108860
[pid=23896] ppid=23893 vsize=159692 memory=136220 CPUtime=2520.03 cores=0,2,4,6
/proc/23896/stat : 23896 (cosoco) R 23893 23896 21964 0 -1 4202496 122583 0 0 0 251992 11 0 0 20 0 1 0 411713282 163524608 34055 33554432000 4194304 6210612 140726514378800 140726514376760 5451322 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12054528 140726514381835 140726514381937 140726514381937 140726514384846 0
/proc/23896/statm: 39923 34055 859 493 0 33228 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136220 KiB

Child status: 1
Real time (s): 2519.7
CPU time (s): 2520.04
CPU user time (s): 2519.92
CPU system time (s): 0.117016
CPU usage (%): 100.014
Max. virtual memory (cumulated for all children) (KiB): 159692
Max. memory (cumulated for all children) (KiB): 136220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.92
system time used= 0.117016
maximum resident set size= 136292
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 122631
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 19
involuntary context switches= 817


# summary of solver processes directly reported to runsolver:
#   pid: 23896
#   total CPU time (s): 2520.04
#   total CPU user time (s): 2519.92
#   total CPU system time (s): 0.117016

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.34115 second user time and 16.9696 second system time

The end

Launcher Data 

Begin job on node141 at 2019-09-13 08:55:12
IDJOB=4389468
IDBENCH=138444
IDSOLVER=2829
FILE ID=node141/4389468-1568357754
RUNJOBID= node141-1568357660-23541
PBS_JOBID= 21701171
Free space on /tmp= 56108 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/SuperSolutions/SuperSolutions-Taillard-os10/SuperTaillard-os-10-06.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389468-1568357754/watcher-4389468-1568357754 -o /tmp/evaluation-result-4389468-1568357754/solver-4389468-1568357754 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568357660-23541 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389468-1568357754.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b3d88799df56964f86d557249875b85
RANDOM SEED=1604067325

node141.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31499128 kB
MemAvailable:   31730260 kB
Buffers:          139324 kB
Cached:           379520 kB
SwapCached:        81380 kB
Active:           347636 kB
Inactive:         371156 kB
Active(anon):     124232 kB
Inactive(anon):   106240 kB
Active(file):     223404 kB
Inactive(file):   264916 kB
Unevictable:      109200 kB
Mlocked:          109200 kB
SwapTotal:      67108860 kB
SwapFree:       66918080 kB
Dirty:              3076 kB
Writeback:             4 kB
AnonPages:        227412 kB
Mapped:            36024 kB
Shmem:             22128 kB
Slab:             147372 kB
SReclaimable:     117292 kB
SUnreclaim:        30080 kB
KernelStack:        3552 kB
PageTables:         5788 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     642616 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      128384 kB
DirectMap2M:    33417216 kB

Free space on /tmp at the end= 56036 MiB
End job on node141 at 2019-09-13 09:37:12