Trace number 4396748

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2519.98 2520.01

General information on the benchmark

NameSuperSolutions/SuperSolutions-Taillard-os10/
SuperTaillard-os-10-06.xml
MD5SUM6b3d88799df56964f86d557249875b85
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark56.1836
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints2800
Number of domains64
Minimum domain size440
Maximum domain size538
Distribution of domain sizes[{"size":440,"count":2},{"size":441,"count":2},{"size":442,"count":2},{"size":444,"count":2},{"size":445,"count":4},{"size":447,"count":2},{"size":448,"count":4},{"size":449,"count":4},{"size":450,"count":2},{"size":452,"count":2},{"size":455,"count":4},{"size":457,"count":4},{"size":459,"count":2},{"size":461,"count":2},{"size":462,"count":2},{"size":464,"count":4},{"size":466,"count":2},{"size":467,"count":2},{"size":470,"count":4},{"size":472,"count":8},{"size":474,"count":2},{"size":475,"count":2},{"size":477,"count":2},{"size":480,"count":6},{"size":483,"count":2},"...",{"size":505,"count":2}, {"size":506,"count":2}, {"size":508,"count":10}, {"size":509,"count":2}, {"size":511,"count":2}, {"size":512,"count":2}, {"size":513,"count":6}, {"size":514,"count":2}, {"size":515,"count":2}, {"size":516,"count":2}, {"size":517,"count":4}, {"size":518,"count":4}, {"size":519,"count":4}, {"size":520,"count":2}, {"size":521,"count":2}, {"size":522,"count":4}, {"size":523,"count":4}, {"size":524,"count":2}, {"size":526,"count":4}, {"size":528,"count":2}, {"size":529,"count":4}, {"size":530,"count":8}, {"size":531,"count":4}, {"size":534,"count":2}, {"size":538,"count":4}]
Minimum variable degree19
Maximum variable degree37
Distribution of variable degrees[{"degree":19,"count":100},{"degree":37,"count":100}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":2800}]
Number of extensional constraints0
Number of intensional constraints2800
Distribution of constraint types[{"type":"intension","count":2800}]
Optimization problemNO
Type of objective

Solver Data 

1.89/1.93	c root propagations     : 0           
1.89/1.93	c restarts enabled, print stats at every restarts
1.89/1.93	c
1.89/1.93	c
1.89/1.93	c
1.89/1.93	c This is cosoco 2.00 --  
1.89/1.93	c
1.89/1.93	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396748-1568592870.xml 
1.89/1.93	c ========================================[ Problem Statistics ]===========================================
1.89/1.93	c |                                                                                                       
1.89/1.93	c |  Parse time        :         1.88 s 
1.89/1.93	c |
1.89/1.93	c |               Variables: 200
1.89/1.93	c |            Domain Sizes: 440..538
1.89/1.93	c |
1.89/1.93	c |             Constraints: 2800
1.89/1.93	c |                   Arity: 2..2  -- Binary: 2800
1.89/1.93	c | 
1.89/1.93	c |                   Types: 
1.89/1.93	c |                          (X != Y): 100
1.89/1.93	c |                          Intension: 2700
1.89/1.93	c |                          
1.89/1.93	c =========================================================================================================
1.89/1.93	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
3.48/3.58	c 101            110            32422          223930         0              0              7   7   6      
6.88/6.94	c 211            292            104686         591079         0              0              7   46   31    
8.10/8.15	c 332            433            126195         976561         0              0              13   17   16   
9.59/9.69	c 465            577            151413         1338980        0              0              7   7   6      
11.68/11.70	c 611            736            187439         1695497        0              0              8   8   7      
15.09/15.17	c 771            962            273658         1928103        0              0              6   10   9     
18.28/18.37	c 947            1153           314969         2460047        0              0              7   9   8      
20.38/20.47	c 1140           1353           330655         2911346        0              0              7   7   6      
25.68/25.75	c 1352           1596           369463         3645872        0              0              28   28   27   
30.89/30.97	c 1585           1870           472121         4067269        0              0              20   21   20   
36.18/36.20	c 1841           2195           547935         4732780        0              0              42   51   50   
42.09/42.13	c 2122           2503           629689         5439934        0              0              21   21   20   
49.78/49.83	c 2431           2884           732465         6343610        0              0              20   51   46   
59.29/59.33	c 2770           3292           821546         7751263        0              0              22   61   59   
63.79/63.80	c 3142           3700           888099         8880559        0              0              10   21   19   
70.19/70.27	c 3551           4148           995556         10400226       0              0              5   6   5      
80.28/80.34	c 4000           4642           1188292        12139480       0              0              4   5   4      
92.18/92.24	c 4493           5172           1340788        14085059       0              0              4   5   4      
103.88/103.99	c 5035           5769           1571777        16029014       0              0              4   5   4      
108.38/108.45	c 5631           6377           1620663        17848996       0              0              5   5   4      
121.28/121.38	c 6286           7092           1888610        20268213       0              0              4   7   4      
128.28/128.37	c 7006           7827           1949426        22465037       0              0              5   5   4      
144.88/144.90	c 7798           8640           2113934        26426453       0              0              5   5   4      
161.78/161.82	c 8669           9543           2211041        29363407       0              0              5   6   5      
185.38/185.43	c 9627           10623          2823717        31464108       0              0              4   9   6      
212.38/212.43	c 10680          11774          3306948        34889986       0              0              4   8   5      
244.10/244.12	c 11838          13159          3982400        39124929       0              0              4   11   8     
268.49/268.51	c 13111          14604          4328122        44213680       0              0              4   11   7     
310.49/310.51	c 14511          16352          5140002        47230046       0              0              4   10   7     
343.39/343.46	c 16051          18339          5781993        50425991       0              0              5   10   8     
389.00/389.06	c 17745          20067          6012828        61288044       0              0              4   5   4      
416.89/416.95	c 19608          22058          6464942        66756542       0              0              6   9   7      
470.68/470.72	c 21657          24581          8102447        69936808       0              0              8   11   10    
507.78/507.84	c 23910          26959          8624426        77693788       0              0              5   8   6      
569.88/569.95	c 26388          30043          9987258        81657388       0              0              5   11   8     
645.09/645.12	c 29113          33057          11012393       91871887       0              0              5   9   5      
676.88/676.99	c 32110          36102          11280425       101747784      0              0              6   7   5      
729.78/729.84	c 35406          39578          12072100       112818994      0              0              4   9   7      
812.68/812.79	c 39031          43885          13622048       121321278      0              0              5   10   7     
893.16/893.25	c 43018          48183          14640227       131188504      0              0              5   8   7      
1002.64/1002.79	c 47403          53370          16805839       140873070      0              0              4   9   6      
1121.54/1121.68	c 52226          58964          19433558       151743148      0              0              5   10   7     
1229.14/1229.21	c 57531          64565          21266142       169139923      0              0              5   7   6      
1362.34/1362.45	c 63366          71275          23889571       182261491      0              0              4   10   7     
1499.84/1499.98	c 69784          77884          24811497       209621533      0              0              4   7   5      
1695.05/1695.14	c 76843          86415          28705893       225882619      0              0              4   11   7     
1930.35/1930.49	c 84607          95368          33459578       252809811      0              0              5   8   6      
2057.86/2057.99	c 93147          104412         34842792       283480773      0              0              4   7   5      
2221.86/2221.97	c 102541         114445         37012814       316109232      0              0              4   7   5      
2519.97/2520.00	
2519.97/2520.00	c *** INTERRUPTED ***
2519.97/2520.00	c restarts              : 49          
2519.97/2520.00	c conflicts             : 112730       (45 /sec)
2519.97/2520.00	c decisions             : 126925       (50 /sec)
2519.97/2520.00	c propagations          : 335596655   (133181 /sec)
2519.97/2520.00	c root propagations     : 0           
2519.97/2520.00	c filter calls          : 43721099       (17351 /sec)
2519.97/2520.00	c useless filter calls  : 37644227       (86 %)
2519.97/2520.00	c Memory used           : 155.95 MB
2519.97/2520.00	c CPU time              : 2519.85 s
2519.97/2520.00	c real time             : 2520.01 s
2519.97/2520.00	
2519.97/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13782 MiB free)
  memory of node 1: 16384 MiB (14173 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396748-1568592870/watcher-4396748-1568592870 -o /tmp/evaluation-result-4396748-1568592870/solver-4396748-1568592870 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568572744-4121 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396748-1568592870.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=7792, runsolver pid=7789

[startup+0.100211 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28625260/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=28840 memory=4936 CPUtime=0.1 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 1443 0 0 0 10 0 0 0 20 0 1 0 435227141 29532160 1234 33554432000 4194304 6211092 140724665272992 140724665270264 5685477 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 7210 1234 798 493 0 515 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28840 KiB
Current children cumulated memory: 4936 KiB

[startup+0.209509 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28621668/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=33844 memory=9992 CPUtime=0.2 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 2701 0 0 0 20 0 0 0 20 0 1 0 435227141 34656256 2498 33554432000 4194304 6211092 140724665272992 140724665270264 140648381787109 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 8461 2498 816 493 0 1766 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 33844 KiB
Current children cumulated memory: 9992 KiB

[startup+0.309376 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28616212/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=39256 memory=15528 CPUtime=0.3 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 4066 0 0 0 30 0 0 0 20 0 1 0 435227141 40198144 3882 33554432000 4194304 6211092 140724665272992 140724665268088 5071149 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 9814 3882 816 493 0 3119 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 39256 KiB
Current children cumulated memory: 15528 KiB

[startup+0.700249 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28604752/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=60084 memory=36236 CPUtime=0.68 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 9265 0 0 0 67 1 0 0 20 0 1 0 435227141 61526016 9059 33554432000 4194304 6211092 140724665272992 140724665268088 5448817 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 15021 9059 816 493 0 8326 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 60084 KiB
Current children cumulated memory: 36236 KiB

[startup+1.50025 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28578348/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=103500 memory=79784 CPUtime=1.48 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 20133 0 0 0 145 3 0 0 20 0 1 0 435227141 105984000 19946 33554432000 4194304 6211092 140724665272992 140724665266296 140648381787109 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 25875 19946 816 493 0 19180 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 103500 KiB
Current children cumulated memory: 79784 KiB

[startup+3.10922 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28525200/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=129332 memory=105848 CPUtime=3.09 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 27614 0 0 0 305 4 0 0 20 0 1 0 435227141 132435968 26462 33554432000 4194304 6211092 140724665272992 140724665270648 140648382710657 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 32333 26462 859 493 0 25638 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 129332 KiB
Current children cumulated memory: 105848 KiB

[startup+6.30025 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7793
/proc/meminfo: memFree=28515228/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=138836 memory=115292 CPUtime=6.28 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 47813 0 0 0 622 6 0 0 20 0 1 0 435227141 142168064 28823 33554432000 4194304 6211092 140724665272992 140724665270648 140648391732038 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 34709 28823 861 493 0 28014 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 138836 KiB
Current children cumulated memory: 115292 KiB

[startup+12.7003 s]
/proc/loadavg: 1.92 2.00 2.04 3/199 7793
/proc/meminfo: memFree=28512996/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=141608 memory=118132 CPUtime=12.68 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 60060 0 0 0 1261 7 0 0 20 0 1 0 435227141 145006592 29533 33554432000 4194304 6211092 140724665272992 140724665270648 5443112 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 35402 29533 861 493 0 28707 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 141608 KiB
Current children cumulated memory: 118132 KiB

[startup+25.5003 s]
/proc/loadavg: 2.16 2.05 2.06 3/199 7795
/proc/meminfo: memFree=28511752/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=142928 memory=119472 CPUtime=25.48 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 73691 0 0 0 2540 8 0 0 20 0 1 0 435227141 146358272 29868 33554432000 4194304 6211092 140724665272992 140724665270648 140648382707619 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 35732 29868 861 493 0 29037 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 142928 KiB
Current children cumulated memory: 119472 KiB

[startup+51.1096 s]
/proc/loadavg: 2.45 2.12 2.08 3/199 7796
/proc/meminfo: memFree=28502976/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=152300 memory=128904 CPUtime=51.1 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 96667 0 0 0 5100 10 0 0 20 0 1 0 435227141 155955200 32226 33554432000 4194304 6211092 140724665272992 140724665270648 5480225 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 38075 32226 861 493 0 31380 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 152300 KiB
Current children cumulated memory: 128904 KiB

[startup+102.3 s]
/proc/loadavg: 2.23 2.12 2.08 3/199 7800
/proc/meminfo: memFree=28497880/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=156788 memory=133148 CPUtime=102.28 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 100676 0 0 0 10218 10 0 0 20 0 1 0 435227141 160550912 33287 33554432000 4194304 6211092 140724665272992 140724665270648 140648382707636 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39197 33287 861 493 0 32502 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 156788 KiB
Current children cumulated memory: 133148 KiB

[startup+162.3 s]
/proc/loadavg: 2.09 2.10 2.07 3/199 7806
/proc/meminfo: memFree=28496656/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=157448 memory=133916 CPUtime=162.28 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 101540 0 0 0 16218 10 0 0 20 0 1 0 435227141 161226752 33479 33554432000 4194304 6211092 140724665272992 140724665270952 5439602 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39362 33479 861 493 0 32667 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 157448 KiB
Current children cumulated memory: 133916 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 2.08 2.07 3/199 7810
/proc/meminfo: memFree=28495484/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=158108 memory=134460 CPUtime=222.28 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 102515 0 0 0 22218 10 0 0 20 0 1 0 435227141 161902592 33615 33554432000 4194304 6211092 140724665272992 140724665270648 5446238 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39527 33615 861 493 0 32832 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 158108 KiB
Current children cumulated memory: 134460 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/199 7814
/proc/meminfo: memFree=28494752/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=158504 memory=135000 CPUtime=282.29 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 103530 0 0 0 28218 11 0 0 20 0 1 0 435227141 162308096 33750 33554432000 4194304 6211092 140724665272992 140724665270648 5453912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39626 33750 861 493 0 32931 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 158504 KiB
Current children cumulated memory: 135000 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/199 7820
/proc/meminfo: memFree=28495040/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=158636 memory=135120 CPUtime=342.29 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 104108 0 0 0 34218 11 0 0 20 0 1 0 435227141 162443264 33780 33554432000 4194304 6211092 140724665272992 140724665270648 5480256 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39659 33780 861 493 0 32964 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 158636 KiB
Current children cumulated memory: 135120 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 7832
/proc/meminfo: memFree=28495016/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=158768 memory=135292 CPUtime=402.29 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 104621 0 0 0 40218 11 0 0 20 0 1 0 435227141 162578432 33823 33554432000 4194304 6211092 140724665272992 140724665270952 5453912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39692 33823 861 493 0 32997 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 158768 KiB
Current children cumulated memory: 135292 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 7899
/proc/meminfo: memFree=27556380/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=158900 memory=135424 CPUtime=462.28 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 105206 0 0 0 46216 12 0 0 20 0 1 0 435227141 162713600 33856 33554432000 4194304 6211092 140724665272992 140724665270648 5476813 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39725 33856 861 493 0 33030 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 158900 KiB
Current children cumulated memory: 135424 KiB


################
# More data... #
################

/proc/7792/statm: 39890 34032 861 493 0 33195 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136128 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 8022
/proc/meminfo: memFree=27238768/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136136 CPUtime=1782.25 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 116424 0 0 0 178213 12 0 0 20 0 1 0 435227141 163389440 34034 33554432000 4194304 6211092 140724665272992 140724665270952 5440716 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34034 861 493 0 33195 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136136 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8026
/proc/meminfo: memFree=27227720/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136136 CPUtime=1842.25 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 116733 0 0 0 184213 12 0 0 20 0 1 0 435227141 163389440 34034 33554432000 4194304 6211092 140724665272992 140724665270952 140648391732056 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34034 861 493 0 33195 0
Current children cumulated CPU time: 1842.25 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136136 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8030
/proc/meminfo: memFree=27227044/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136136 CPUtime=1902.25 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 117050 0 0 0 190213 12 0 0 20 0 1 0 435227141 163389440 34034 33554432000 4194304 6211092 140724665272992 140724665270952 5480288 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34034 861 493 0 33195 0
Current children cumulated CPU time: 1902.25 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136136 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8036
/proc/meminfo: memFree=27223568/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136160 CPUtime=1962.25 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 117370 0 0 0 196213 12 0 0 20 0 1 0 435227141 163389440 34040 33554432000 4194304 6211092 140724665272992 140724665270952 5446226 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34040 861 493 0 33195 0
Current children cumulated CPU time: 1962.25 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136160 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8040
/proc/meminfo: memFree=27223192/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136164 CPUtime=2022.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 117663 0 0 0 202213 13 0 0 20 0 1 0 435227141 163389440 34041 33554432000 4194304 6211092 140724665272992 140724665270952 5446218 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34041 861 493 0 33195 0
Current children cumulated CPU time: 2022.26 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136164 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 8044
/proc/meminfo: memFree=27222800/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136164 CPUtime=2082.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 117982 0 0 0 208213 13 0 0 20 0 1 0 435227141 163389440 34041 33554432000 4194304 6211092 140724665272992 140724665270952 5456306 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34041 861 493 0 33195 0
Current children cumulated CPU time: 2082.26 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136164 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8050
/proc/meminfo: memFree=27222456/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159560 memory=136168 CPUtime=2142.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 118314 0 0 0 214213 13 0 0 20 0 1 0 435227141 163389440 34042 33554432000 4194304 6211092 140724665272992 140724665270952 5446197 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39890 34042 861 493 0 33195 0
Current children cumulated CPU time: 2142.26 s
Current children cumulated vsize: 159560 KiB
Current children cumulated memory: 136168 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8062
/proc/meminfo: memFree=27222708/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136172 CPUtime=2202.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 118629 0 0 0 220213 13 0 0 20 0 1 0 435227141 163524608 34043 33554432000 4194304 6211092 140724665272992 140724665270952 5440616 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34043 861 493 0 33228 0
Current children cumulated CPU time: 2202.26 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136172 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8066
/proc/meminfo: memFree=27220804/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136196 CPUtime=2262.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 118965 0 0 0 226213 13 0 0 20 0 1 0 435227141 163524608 34049 33554432000 4194304 6211092 140724665272992 140724665270952 5164752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34049 861 493 0 33228 0
Current children cumulated CPU time: 2262.26 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136196 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 8072
/proc/meminfo: memFree=27219760/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136220 CPUtime=2322.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 119286 0 0 0 232213 13 0 0 20 0 1 0 435227141 163524608 34055 33554432000 4194304 6211092 140724665272992 140724665270952 5455642 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34055 861 493 0 33228 0
Current children cumulated CPU time: 2322.26 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136220 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8076
/proc/meminfo: memFree=27214524/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136224 CPUtime=2382.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 119608 0 0 0 238213 13 0 0 20 0 1 0 435227141 163524608 34056 33554432000 4194304 6211092 140724665272992 140724665270952 5478406 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34056 861 493 0 33228 0
Current children cumulated CPU time: 2382.26 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136224 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 8080
/proc/meminfo: memFree=27210060/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136228 CPUtime=2442.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 119906 0 0 0 244213 13 0 0 20 0 1 0 435227141 163524608 34057 33554432000 4194304 6211092 140724665272992 140724665270952 5443000 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34057 861 493 0 33228 0
Current children cumulated CPU time: 2442.26 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136228 KiB

[startup+2502.3 s]
/proc/loadavg: 2.35 2.13 2.08 3/200 8087
/proc/meminfo: memFree=27210048/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136228 CPUtime=2502.26 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 120213 0 0 0 250213 13 0 0 20 0 1 0 435227141 163524608 34057 33554432000 4194304 6211092 140724665272992 140724665270952 5443092 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34057 861 493 0 33228 0
Current children cumulated CPU time: 2502.26 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136228 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.25 2.12 2.08 3/199 8087
/proc/meminfo: memFree=27209848/32770624 swapFree=66959728/67108860
[pid=7792] ppid=7789 vsize=159692 memory=136228 CPUtime=2519.97 cores=0,2,4,6
/proc/7792/stat : 7792 (cosoco) R 7789 7792 4090 0 -1 4202496 120539 0 0 0 251984 13 0 0 20 0 1 0 435227141 163524608 34057 33554432000 4194304 6211092 140724665272992 140724665270952 5452153 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 23891968 140724665275403 140724665275505 140724665275505 140724665278414 0
/proc/7792/statm: 39923 34057 861 493 0 33228 0
Current children cumulated CPU time: 2519.97 s
Current children cumulated vsize: 159692 KiB
Current children cumulated memory: 136228 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 7792 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.85 s, system=0.138999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.98
CPU user time (s): 2519.85
CPU system time (s): 0.138999
CPU usage (%): 99.999
Max. virtual memory (cumulated for all children) (KiB): 159692
Max. memory (cumulated for all children) (KiB): 136228

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.85
system time used= 0.138999
maximum resident set size= 136296
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 120589
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 3482


# summary of solver processes directly reported to runsolver:
#   pid: 7792
#   total CPU time (s): 2519.98
#   total CPU user time (s): 2519.85
#   total CPU system time (s): 0.138999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.11216 second user time and 17.3186 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-16 02:13:50
IDJOB=4396748
IDBENCH=138444
IDSOLVER=2848
FILE ID=node124/4396748-1568592870
RUNJOBID= node124-1568572744-4121
PBS_JOBID= 21703326
Free space on /tmp= 61808 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SuperSolutions/SuperSolutions-Taillard-os10/SuperTaillard-os-10-06.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396748-1568592870/watcher-4396748-1568592870 -o /tmp/evaluation-result-4396748-1568592870/solver-4396748-1568592870 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568572744-4121 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396748-1568592870.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b3d88799df56964f86d557249875b85
RANDOM SEED=1592817590

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28627656 kB
MemAvailable:   31830628 kB
Buffers:          212572 kB
Cached:          3279016 kB
SwapCached:        46376 kB
Active:          1013660 kB
Inactive:        2542356 kB
Active(anon):      15000 kB
Inactive(anon):    99216 kB
Active(file):     998660 kB
Inactive(file):  2443140 kB
Unevictable:      106528 kB
Mlocked:          106528 kB
SwapTotal:      67108860 kB
SwapFree:       66959728 kB
Dirty:              2712 kB
Writeback:             0 kB
AnonPages:        127360 kB
Mapped:            49384 kB
Shmem:             40944 kB
Slab:             184180 kB
SReclaimable:     154012 kB
SUnreclaim:        30168 kB
KernelStack:        3664 kB
PageTables:         6036 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     545952 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     79872 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 61808 MiB
End job on node124 at 2019-09-16 02:55:50