Trace number 4408653

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.03 2399.7

General information on the benchmark

NameBlackhole/Blackhole-xcsp2-s07/
Blackhole-4-07-4_X2.xml
MD5SUM69e102c6eb18d0fe6bc9694d1b83e185
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark565.312
Satisfiable
(Un)Satisfiability was proved
Number of variables112
Number of constraints1262
Number of domains4
Minimum domain size1
Maximum domain size28
Distribution of domain sizes[{"size":1,"count":2},{"size":7,"count":28},{"size":14,"count":27},{"size":28,"count":54}]
Minimum variable degree0
Maximum variable degree56
Distribution of variable degrees[{"degree":0,"count":1},{"degree":2,"count":29},{"degree":3,"count":26},{"degree":28,"count":1},{"degree":29,"count":18},{"degree":30,"count":9},{"degree":56,"count":28}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":1262}]
Number of extensional constraints1262
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":1262}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 280         
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408653-1569799089.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.02 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 112
0.00/0.02	c |            Domain Sizes: 1..28
0.00/0.02	c |
0.00/0.02	c |             Constraints: 1262
0.00/0.02	c |                   Arity: 2..2  -- Binary: 1262
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          Extension: 1262  (nb tuples: 0..378) -- (shared: 1252)
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.02	c remove useless variable z[0]
0.00/0.03	c 101            305            106513         6782           66             0              21   63   43   
0.00/0.04	c 211            686            192362         11277          66             0              48   79   58   
0.00/0.05	c 332            1085           278195         14962          66             0              18   24   21   
0.00/0.06	c 465            1600           386278         20917          66             0              16   27   23   
0.00/0.07	c 611            1979           508074         28451          66             0              16   23   19   
0.00/0.09	c 771            2582           663118         40393          66             0              14   27   23   
0.00/0.10	c 947            3035           811529         49663          66             0              19   22   21   
0.10/0.12	c 1140           3543           972828         62035          66             0              15   22   19   
0.10/0.14	c 1352           4083           1168732        76910          66             0              16   19   18   
0.10/0.16	c 1585           4663           1373717        94478          66             0              15   21   18   
0.10/0.18	c 1841           5596           1626101        117517         66             0              22   31   27   
0.21/0.22	c 2122           6680           1982469        151869         66             0              14   25   18   
0.21/0.25	c 2431           7749           2281010        177003         66             0              22   31   27   
0.21/0.29	c 2770           9079           2649361        206457         66             0              16   26   21   
0.31/0.32	c 3142           10317          2965516        228340         66             0              19   29   27   
0.31/0.38	c 3551           11538          3620571        293673         66             0              13   22   18   
0.41/0.43	c 4000           13187          4097046        337322         66             0              22   32   28   
0.41/0.49	c 4493           14545          4721084        406641         66             0              15   23   18   
0.51/0.53	c 5035           15999          5182775        438039         66             0              24   30   27   
0.51/0.59	c 5631           18023          5772761        485967         66             0              12   26   20   
0.60/0.64	c 6286           19888          6316404        512810         66             0              21   25   24   
0.60/0.69	c 7006           22431          6843834        535714         66             0              14   30   24   
0.69/0.79	c 7798           24420          7768910        667533         66             0              11   19   13   
0.79/0.86	c 8669           26883          8524595        714166         66             0              19   23   22   
0.89/0.93	c 9627           30456          9197121        741602         66             0              14   31   24   
0.89/1.00	c 10680          34805          10020396       775204         66             0              22   30   29   
1.10/1.14	c 11838          38467          11372367       914626         66             0              13   25   18   
1.19/1.24	c 13111          42044          12462282       984258         66             0              19   28   23   
1.29/1.34	c 14511          45912          13481272       1035700        66             0              12   19   17   
1.39/1.49	c 16051          50614          15055110       1176634        66             0              20   30   25   
1.59/1.65	c 17745          57265          16704573       1310589        66             0              15   27   23   
1.69/1.78	c 19608          63580          18142440       1382712        66             0              17   28   26   
1.89/1.98	c 21657          70989          20180919       1545754        66             0              16   27   23   
2.19/2.21	c 23910          78933          22563893       1757205        66             0              15   26   21   
2.39/2.41	c 26388          86986          24651520       1857264        66             0              12   25   19   
2.59/2.61	c 29113          94945          26759489       1957849        66             0              12   25   17   
2.79/2.82	c 32110          105584         28997206       2081039        66             0              16   27   23   
3.00/3.10	c 35406          115092         31800013       2263342        66             0              13   24   17   
3.29/3.33	c 39031          127653         34441076       2365721        66             0              14   26   24   
3.59/3.67	c 43018          138807         37810599       2581768        66             0              11   20   15   
4.00/4.05	c 47403          151049         41744347       2884226        66             0              13   25   18   
4.29/4.35	c 52226          169415         45074119       2995996        66             0              13   25   24   
4.79/4.84	c 57531          184852         49958869       3383473        66             0              10   25   16   
5.39/5.42	c 63366          202483         55761814       3918504        66             0              11   25   17   
5.89/5.93	c 69784          227415         61161100       4222134        66             0              14   25   22   
6.59/6.60	c 76843          252364         68144913       4800145        66             0              13   25   20   
7.19/7.20	c 84607          276069         74507333       5135832        66             0              12   25   19   
7.89/7.99	c 93147          309181         82765015       5736115        66             0              12   25   21   
8.69/8.70	c 102541         342812         90333549       6166167        66             0              13   25   21   
9.69/9.71	c 112874         379462         101133634      6986997        66             0              13   25   21   
10.69/10.70	c 124240         415973         111323733      7624300        66             0              12   25   19   
11.89/12.00	c 136742         457119         124654521      8784725        66             0              12   25   18   
13.39/13.44	c 150494         510974         139303532      10039489       66             0              13   25   21   
14.79/14.89	c 165621         562174         154575799      11273938       66             0              12   25   20   
16.19/16.24	c 182260         616612         168828409      12111849       66             0              12   25   20   
18.10/18.19	c 200562         679719         188699805      13867370       66             0              12   25   19   
19.79/19.83	c 220694         739465         205538916      14896725       66             0              9   25   17    
22.00/22.10	c 242839         816002         229188598      16875675       66             0              11   25   19   
24.19/24.23	c 267198         908759         251138117      18543161       66             0              11   25   21   
26.79/26.89	c 293992         1003806        278372019      20766033       66             0              11   25   19   
30.29/30.35	c 323465         1099345        313713725      24111397       66             0              12   26   19   
33.49/33.56	c 355885         1223679        346874928      26786317       66             0              12   26   22   
37.00/37.10	c 391547         1358856        384211574      29623714       66             0              13   26   22   
40.49/40.52	c 430775         1474888        419658378      31912387       66             0              12   25   18   
44.69/44.79	c 473925         1625225        465010142      35411304       66             0              12   25   20   
49.50/49.57	c 521390         1799393        514483950      39430246       66             0              14   26   22   
54.80/54.82	c 573601         2002126        568850338      43530761       66             0              12   25   20   
60.90/60.99	c 631033         2201356        632153902      49240467       66             0              11   28   19   
66.90/66.91	c 694208         2426636        692752271      53975923       66             0              12   26   21   
74.90/74.98	c 763700         2687121        775793996      61405328       66             0              14   28   22   
82.11/82.13	c 840141         2978914        850836723      66591690       66             0              13   25   21   
90.30/90.37	c 924226         3271912        938028092      73369631       66             0              13   27   21   
99.20/99.22	c 1016719        3607776        1030227200     80350046       66             0              12   25   21   
109.60/109.67	c 1118461        4008176        1137674109     88927959       66             0              12   25   21   
121.11/121.12	c 1230377        4433906        1255078672     98466455       66             0              12   26   21   
135.31/135.39	c 1353484        4835112        1400095600     112089092      66             0              13   28   22   
148.71/148.74	c 1488901        5305950        1536063695     123618755      66             0              13   28   22   
163.02/163.03	c 1637859        5876683        1684266245     134446643      66             0              12   28   21   
181.91/181.96	c 1801712        6438815        1878608661     152155445      66             0              10   28   22   
195.32/195.30	c 1981950        7119531        2022298939     158968353      66             0              12   28   22   
211.72/211.74	c 2180211        7876784        2198980879     169411914      66             0              12   25   22   
229.92/229.93	c 2398298        8519609        2386338277     180081423      66             0              10   27   17   
252.72/252.71	c 2638193        9213628        2610319566     198779114      66             0              8   25   15    
272.62/272.68	c 2902077        10250782       2825309947     209957179      66             0              12   27   24   
305.83/305.83	c 3192349        11315896       3162361786     241347626      66             0              9   25   20    
337.53/337.55	c 3511648        12420467       3496867347     268405774      66             0              13   28   23   
367.84/367.86	c 3862876        13657973       3810706410     290722980      66             0              8   25   21    
402.15/402.12	c 4249226        14978077       4175582234     316765184      66             0              14   28   23   
445.95/445.99	c 4674211        16565622       4626137146     353371845      66             0              11   25   20   
498.45/498.40	c 5141694        18176655       5169623157     401633282      66             0              13   28   22   
554.96/554.91	c 5655925        20018332       5747637148     451886708      66             0              10   26   20   
605.57/605.58	c 6221579        22114613       6281408999     488053154      66             0              9   26   21    
665.88/665.80	c 6843798        24540907       6912840218     535668121      66             0              13   28   23   
716.98/716.93	c 7528238        26838756       7453453221     562402734      66             0              9   26   20    
799.39/799.32	c 8281122        29541652       8311248898     635503303      66             0              11   27   20   
877.00/876.96	c 9109294        32279587       9091328990     695729684      66             0              8   25   18    
966.32/966.23	c 10020283       35484678       10033349998    770197049      66             0              12   28   22   
1059.63/1059.51	c 11022370       39216285       11002885334    839954801      66             0              11   29   22   
1176.85/1176.77	c 12124665       43463672       12217381475    939623753      66             0              10   27   21   
1296.17/1296.09	c 13337189       48009473       13460580789    1031372908     66             0              11   25   21   
1420.19/1420.09	c 14670965       53176716       14774087874    1122751102     66             0              10   27   22   
1540.50/1540.39	c 16138118       58711563       16046837689    1198440495     66             0              10   26   23   
1706.73/1706.55	c 17751986       64466430       17796063700    1336995695     66             0              13   28   23   
1879.26/1879.06	c 19527240       71247258       19574562395    1471023370     66             0              9   25   21    
2067.77/2067.50	c 21480019       77863363       21483627731    1620948527     66             0              7   26   19    
2296.90/2296.66	c 23628075       84449421       23729400711    1844572972     66             0              10   29   21   
2400.02/2399.70	
2400.02/2399.70	c *** INTERRUPTED ***
2400.02/2399.70	c restarts              : 106         
2400.02/2399.70	c conflicts             : 24852044     (10355 /sec)
2400.02/2399.70	c decisions             : 89077995     (37116 /sec)
2400.02/2399.70	c propagations          : 1912773898  (796984 /sec)
2400.02/2399.70	c root propagations     : 280         
2400.02/2399.70	c filter calls          : 24821680932    (10342305 /sec)
2400.02/2399.70	c useless filter calls  : 23654660791    (95 %)
2400.02/2399.70	c Memory used           : 28.14 MB
2400.02/2399.70	c CPU time              : 2400.01 s
2400.02/2399.70	c real time             : 2399.7 s
2400.02/2399.70	
2400.02/2399.70	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15126 MiB free)
  memory of node 1: 16384 MiB (15173 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408653-1569799089/watcher-4408653-1569799089 -o /tmp/evaluation-result-4408653-1569799089/solver-4408653-1569799089 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node105-1569783690-24392 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408653-1569799089.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=27204, runsolver pid=27201
Current StackSize limit: 8192 KiB


[startup+0.100152 s]*
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31025324/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5272 CPUtime=0.1 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 1495 0 0 0 10 0 0 0 20 0 1 0 556166373 29507584 1318 33554432000 4194304 6211132 140723410826400 140723410822936 5017373 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1318 844 493 0 509 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5272 KiB

[startup+0.209432 s]*
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31025324/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5272 CPUtime=0.21 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 1495 0 0 0 21 0 0 0 20 0 1 0 556166373 29507584 1318 33554432000 4194304 6211132 140723410826400 140723410822936 5017491 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1318 844 493 0 509 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5272 KiB

[startup+0.308799 s]*
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31025324/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5272 CPUtime=0.31 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 1495 0 0 0 31 0 0 0 20 0 1 0 556166373 29507584 1318 33554432000 4194304 6211132 140723410826400 140723410822936 5017569 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1318 844 493 0 509 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5272 KiB

[startup+0.700267 s]
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31025324/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5272 CPUtime=0.69 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 1495 0 0 0 69 0 0 0 20 0 1 0 556166373 29507584 1318 33554432000 4194304 6211132 140723410826400 140723410824360 5017286 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1318 844 493 0 509 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5272 KiB

[startup+1.50028 s]
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31024996/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5272 CPUtime=1.49 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 1495 0 0 0 149 0 0 0 20 0 1 0 556166373 29507584 1318 33554432000 4194304 6211132 140723410826400 140723410824360 5017370 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1318 844 493 0 509 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5272 KiB

[startup+3.1089 s]
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31024828/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=3.1 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 1903 0 0 0 310 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017569 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+6.30027 s]
/proc/loadavg: 2.05 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31024692/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=6.29 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 2310 0 0 0 629 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017515 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+12.7003 s]
/proc/loadavg: 2.04 2.03 2.05 3/198 27205
/proc/meminfo: memFree=31024684/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=12.69 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 2717 0 0 0 1269 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017564 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+25.5003 s]
/proc/loadavg: 2.03 2.03 2.05 3/198 27207
/proc/meminfo: memFree=31023816/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=25.49 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 3531 0 0 0 2549 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5397407 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+51.1089 s]
/proc/loadavg: 2.02 2.02 2.05 3/198 27208
/proc/meminfo: memFree=31024176/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=51.1 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 3940 0 0 0 5110 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5008844 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/198 27212
/proc/meminfo: memFree=31024216/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=102.3 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 4348 0 0 0 10230 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017559 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27218
/proc/meminfo: memFree=31023512/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=162.31 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 4756 0 0 0 16231 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017206 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27230
/proc/meminfo: memFree=31022996/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=222.32 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 5163 0 0 0 22232 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017515 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 222.32 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27234
/proc/meminfo: memFree=31022892/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=282.33 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 5163 0 0 0 28233 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017252 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 282.33 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 27240
/proc/meminfo: memFree=31024088/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=342.33 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 5570 0 0 0 34233 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5397407 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27244
/proc/meminfo: memFree=31023512/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=402.34 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 5571 0 0 0 40234 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017191 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 402.34 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27248
/proc/meminfo: memFree=31023904/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=462.35 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 5979 0 0 0 46235 0 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017472 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 462.35 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB


################
# More data... #
################

/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 1662.52 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 27425
/proc/meminfo: memFree=30960748/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=1722.53 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 10053 0 0 0 172252 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017564 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 1722.53 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27431
/proc/meminfo: memFree=30960272/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=1782.53 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 10413 0 0 0 178252 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5397493 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 1782.53 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 27435
/proc/meminfo: memFree=30960312/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=1842.54 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 10413 0 0 0 184253 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5397407 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 1842.54 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 27439
/proc/meminfo: memFree=30960660/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=1902.55 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 10820 0 0 0 190254 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017476 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 1902.55 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27445
/proc/meminfo: memFree=30960392/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=1962.56 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 10820 0 0 0 196255 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5396704 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 1962.56 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27457
/proc/meminfo: memFree=30959420/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2022.57 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 11202 0 0 0 202256 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017744 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2022.57 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27461
/proc/meminfo: memFree=30958588/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2082.58 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 11227 0 0 0 208257 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5008827 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2082.58 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 27467
/proc/meminfo: memFree=30958136/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2142.58 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 11586 0 0 0 214257 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017549 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2142.58 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27471
/proc/meminfo: memFree=30958560/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2202.59 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 11602 0 0 0 220258 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017559 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2202.59 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27475
/proc/meminfo: memFree=30958836/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2262.6 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 11977 0 0 0 226259 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017491 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2262.6 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 27482
/proc/meminfo: memFree=30959016/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2322.61 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 12009 0 0 0 232260 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017217 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2322.61 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 27486
/proc/meminfo: memFree=30959224/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2382.62 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 12385 0 0 0 238261 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017373 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2382.62 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 27487
/proc/meminfo: memFree=30959412/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2400.02 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 12385 0 0 0 240001 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017462 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2400.02 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.7 s]
# the end of solver process 27204 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.01 s, system=0.014001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 27487
/proc/meminfo: memFree=30959412/32770624 swapFree=66957812/67108860
[pid=27204] ppid=27201 vsize=28816 memory=5332 CPUtime=2400.02 cores=1,3,5,7
/proc/27204/stat : 27204 (cosoco) R 27201 27204 24360 0 -1 4202496 12385 0 0 0 240001 1 0 0 20 0 1 0 556166373 29507584 1333 33554432000 4194304 6211132 140723410826400 140723410824360 5017462 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8568832 140723410830347 140723410830449 140723410830449 140723410833358 0
/proc/27204/statm: 7204 1333 857 493 0 509 0
Current children cumulated CPU time: 2400.02 s
Current children cumulated vsize: 28816 KiB
Current children cumulated memory: 5332 KiB

Child status: 1
Real time (s): 2399.7
CPU time (s): 2400.03
CPU user time (s): 2400.01
CPU system time (s): 0.014001
CPU usage (%): 100.014
Max. virtual memory (cumulated for all children) (KiB): 28816
Max. memory (cumulated for all children) (KiB): 5332

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.01
system time used= 0.014001
maximum resident set size= 5396
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 12435
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 603


# summary of solver processes directly reported to runsolver:
#   pid: 27204
#   total CPU time (s): 2400.03
#   total CPU user time (s): 2400.01
#   total CPU system time (s): 0.014001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.60352 second user time and 14.9702 second system time

The end

Launcher Data 

Begin job on node105 at 2019-09-30 00:16:25
IDJOB=4408653
IDBENCH=134575
IDSOLVER=2875
FILE ID=node105/4408653-1569799089
RUNJOBID= node105-1569783690-24392
PBS_JOBID= 21705838
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Blackhole/Blackhole-xcsp2-s07/Blackhole-4-07-4_X2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408653-1569799089/watcher-4408653-1569799089 -o /tmp/evaluation-result-4408653-1569799089/solver-4408653-1569799089 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node105-1569783690-24392 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408653-1569799089.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 69e102c6eb18d0fe6bc9694d1b83e185
RANDOM SEED=1667953480

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31027064 kB
MemAvailable:   31834804 kB
Buffers:          216400 kB
Cached:           930584 kB
SwapCached:        48112 kB
Active:           505112 kB
Inactive:         692636 kB
Active(anon):      18368 kB
Inactive(anon):   111884 kB
Active(file):     486744 kB
Inactive(file):   580752 kB
Unevictable:      110516 kB
Mlocked:          110516 kB
SwapTotal:      67108860 kB
SwapFree:       66957812 kB
Dirty:              2720 kB
Writeback:             0 kB
AnonPages:        114936 kB
Mapped:            28068 kB
Shmem:             70752 kB
Slab:             140740 kB
SReclaimable:     112160 kB
SUnreclaim:        28580 kB
KernelStack:        3472 kB
PageTables:         5452 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     561184 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 62024 MiB
End job on node105 at 2019-09-30 00:56:25