Trace number 4396850

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.01 2519.9

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-20.xml
MD5SUMcc39eb921a5cd1c2fcd1d541ff73edd4
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark28.8683
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4641        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396850-1568593461.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 585
0.00/0.02	c |                   Arity: 1..30  -- Unary: 525
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 525
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.10	c 101            1245           17779          61708          889            0              613   674   645
0.10/0.16	c 211            2335           28342          107839         889            0              480   559   528
0.21/0.23	c 332            3526           42423          168565         889            0              433   588   555
0.21/0.28	c 465            4519           51614          212771         889            0              423   507   490
0.31/0.40	c 611            6522           74135          298078         889            0              399   604   564
0.41/0.47	c 771            7882           87547          355488         889            0              470   620   568
0.60/0.64	c 947            10176          118766         488531         889            0              502   695   640
0.69/0.72	c 1140           11719          133703         544086         889            0              554   662   632
0.79/0.89	c 1352           13580          165097         710537         889            0              497   703   678
1.00/1.08	c 1585           15780          198435         878280         889            0              618   705   678
1.29/1.30	c 1841           17813          238820         1081512        889            0              535   712   685
1.39/1.49	c 2122           20035          274655         1262902        889            0              546   730   687
1.59/1.65	c 2431           21892          302430         1391929        889            0              527   745   601
1.79/1.80	c 2770           24105          330152         1511256        889            0              593   708   679
2.00/2.03	c 3142           26611          372101         1720976        889            0              585   685   658
2.29/2.34	c 3551           29599          428234         2010001        889            0              622   723   691
2.79/2.80	c 4000           34447          511053         2433237        889            0              667   736   704
3.19/3.20	c 4493           39151          585521         2756778        889            0              643   701   675
3.59/3.61	c 5035           43403          659535         3132079        889            0              559   730   693
4.10/4.18	c 5631           49409          763579         3577292        889            0              575   728   694
4.79/4.88	c 6286           55245          890554         4189065        889            0              642   729   687
5.69/5.77	c 7006           59860          1048030        5017824        889            0              573   693   662
6.39/6.46	c 7798           65008          1171804        5641299        889            0              591   717   684
7.29/7.36	c 8669           72620          1332518        6418275        889            0              595   715   671
8.10/8.11	c 9627           80067          1470609        7036393        889            0              613   723   687
8.69/8.75	c 10680          85191          1584938        7595860        889            0              627   706   679
9.69/9.79	c 11838          94613          1773516        8491247        889            0              554   730   689
10.59/10.66	c 13111          102541         1929483        9221344        889            0              556   711   682
11.69/11.78	c 14511          112174         2132243        10173149       889            0              544   712   676
12.69/12.79	c 16051          120147         2312162        11071218       889            0              570   690   647
14.19/14.24	c 17745          131505         2570966        12358518       889            0              569   693   659
15.69/15.77	c 19608          145119         2847117        13624156       889            0              571   706   664
17.19/17.23	c 21657          158450         3105945        14953229       889            0              581   708   670
18.49/18.55	c 23910          168638         3343799        16129572       889            0              581   689   668
19.89/19.98	c 26388          181995         3600513        17362050       889            0              588   701   658
21.59/21.65	c 29113          197156         3903024        18859572       889            0              580   714   674
24.00/24.07	c 32110          215858         4341355        20946850       889            0              580   725   693
26.19/26.24	c 35406          235474         4735113        22899132       889            0              593   730   697
29.10/29.12	c 39031          258014         5249661        25546916       889            0              638   719   677
32.00/32.07	c 43018          283669         5781878        28178542       889            0              629   727   675
35.00/35.02	c 47403          316836         6315123        30818654       889            0              630   720   678
37.39/37.47	c 52226          340665         6751362        33102629       889            0              573   706   667
40.39/40.40	c 57531          363201         7276954        35674784       889            0              580   698   660
46.00/46.07	c 63366          400946         8291207        40578899       889            0              564   726   685
51.49/51.53	c 69784          452833         9277351        45313096       889            0              580   713   670
61.10/61.11	c 76843          520118         10982704       53272313       889            0              567   704   660
66.59/66.62	c 84607          573439         11972001       58165545       889            0              571   721   669
72.49/72.58	c 93147          619963         13045850       63743446       889            0              562   721   676
79.29/79.34	c 102541         671559         14242845       69678223       889            0              568   717   687
85.79/85.89	c 112874         735325         15408921       75505313       889            0              555   705   658
96.29/96.38	c 124240         811926         17287579       83932974       889            0              586   706   651
103.79/103.84	c 136742         878163         18638317       90785460       889            0              548   716   671
110.39/110.48	c 150494         958493         19842789       95940404       889            0              540   698   642
120.29/120.31	c 165621         1034345        21606739       104560192      889            0              539   701   667
132.89/132.96	c 182260         1121479        23853174       115892714      889            0              541   686   652
147.00/147.03	c 200562         1229407        26371868       128243609      889            0              585   725   666
163.80/163.83	c 220694         1345395        29356186       141214786      889            0              544   702   650
172.40/172.40	c 242839         1466742        30943015       148286269      889            0              547   718   654
187.60/187.68	c 267198         1596253        33680448       161307368      889            0              557   706   651
207.90/207.92	c 293992         1767496        37293138       178944938      889            0              562   712   658
224.80/224.85	c 323465         1912775        40316274       193152994      889            0              540   706   651
247.40/247.49	c 355885         2096907        44369500       213118928      889            0              560   724   673
272.60/272.68	c 391547         2327002        48882178       234580339      889            0              541   719   654
297.11/297.14	c 430775         2545851        53282033       256005888      889            0              557   728   673
324.90/324.99	c 473925         2800527        58288614       279973656      889            0              540   729   671
358.30/358.37	c 521390         3136179        64311265       307782651      889            0              547   721   657
395.40/395.49	c 573601         3531889        71034446       339802659      889            0              559   735   678
446.61/446.60	c 631033         3920330        80154578       383228806      889            0              567   708   648
492.71/492.79	c 694208         4287497        88470856       423663385      889            0              547   748   687
527.21/527.22	c 763700         4722373        94746510       451126845      889            0              539   726   648
564.12/564.11	c 840141         5125639        101443582      479938831      889            0              537   723   653
624.02/624.04	c 924226         5765995        112157744      535772750      889            0              545   723   675
670.82/670.89	c 1016719        6267062        120816688      572192031      889            0              547   719   651
741.62/741.62	c 1118461        7004110        133564241      629408590      889            0              546   723   655
825.52/825.57	c 1230377        7775237        148701588      697636568      889            0              547   713   663
904.83/904.89	c 1353484        8386105        162855617      768098719      889            0              552   693   649
997.53/997.57	c 1488901        9138397        179369086      849987727      889            0              549   703   650
1099.14/1099.18	c 1637859        9923915        197460327      946760209      889            0              552   718   670
1200.64/1200.61	c 1801712        10839118       215680537      1039534013     889            0              566   713   661
1318.34/1318.30	c 1981950        11964080       236892472      1144010616     889            0              556   747   689
1472.95/1472.96	c 2180211        13116245       264534931      1280704826     889            0              554   720   670
1655.36/1655.31	c 2398298        14324908       296814640      1450136529     889            0              558   729   683
1892.57/1892.52	c 2638193        15873903       338913999      1670033720     889            0              578   745   689
2099.58/2099.53	c 2902077        17433276       376035002      1859569030     889            0              619   745   685
2327.20/2327.15	c 3192349        19217918       416860786      2071570326     889            0              596   747   684
2520.00/2519.90	
2520.00/2519.90	c *** INTERRUPTED ***
2520.00/2519.90	c restarts              : 85          
2520.00/2519.90	c conflicts             : 3444708      (1367 /sec)
2520.00/2519.90	c decisions             : 20640869     (8191 /sec)
2520.00/2519.90	c propagations          : 2251414968  (893417 /sec)
2520.00/2519.90	c root propagations     : 4641        
2520.00/2519.90	c filter calls          : 451469788      (179154 /sec)
2520.00/2519.90	c useless filter calls  : 115703675      (25 %)
2520.00/2519.90	c Memory used           : 32.52 MB
2520.00/2519.90	c CPU time              : 2520 s
2520.00/2519.90	c real time             : 2519.9 s
2520.00/2519.90	
2520.00/2519.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14937 MiB free)
  memory of node 1: 16384 MiB (15504 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396850-1568593461/watcher-4396850-1568593461 -o /tmp/evaluation-result-4396850-1568593461/solver-4396850-1568593461 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1568572747-30995 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396850-1568593461.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2583, runsolver pid=2580
Current StackSize limit: 8192 KiB


[startup+0.100146 s]*
/proc/loadavg: 2.00 2.06 2.07 3/200 2584
/proc/meminfo: memFree=31167912/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=32504 memory=8936 CPUtime=0.1 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 2429 0 0 0 10 0 0 0 20 0 1 0 435507727 33284096 2234 33554432000 4194304 6211092 140735967060560 140735967057096 5409424 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8126 2234 864 493 0 1431 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32504 KiB
Current children cumulated memory: 8936 KiB

[startup+0.209767 s]*
/proc/loadavg: 2.00 2.06 2.07 3/200 2584
/proc/meminfo: memFree=31167540/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=32768 memory=9200 CPUtime=0.21 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 2494 0 0 0 21 0 0 0 20 0 1 0 435507727 33554432 2300 33554432000 4194304 6211092 140735967060560 140735967057096 5081398 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8192 2300 866 493 0 1497 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.309017 s]*
/proc/loadavg: 2.00 2.06 2.07 3/200 2584
/proc/meminfo: memFree=31167260/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=32768 memory=9200 CPUtime=0.31 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 2509 0 0 0 31 0 0 0 20 0 1 0 435507727 33554432 2300 33554432000 4194304 6211092 140735967060560 140735967057096 5079440 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8192 2300 866 493 0 1497 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.700271 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 2584
/proc/meminfo: memFree=31167028/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33032 memory=9464 CPUtime=0.69 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 2579 0 0 0 69 0 0 0 20 0 1 0 435507727 33824768 2366 33554432000 4194304 6211092 140735967060560 140735967058520 5081305 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8258 2366 866 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+1.50027 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 2584
/proc/meminfo: memFree=31166936/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33168 memory=9464 CPUtime=1.49 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 2588 0 0 0 149 0 0 0 20 0 1 0 435507727 33964032 2366 33554432000 4194304 6211092 140735967060560 140735967058520 5074670 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8292 2366 866 493 0 1597 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33168 KiB
Current children cumulated memory: 9464 KiB

[startup+3.10905 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 2584
/proc/meminfo: memFree=31166600/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33168 memory=9724 CPUtime=3.1 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 4063 0 0 0 310 0 0 0 20 0 1 0 435507727 33964032 2431 33554432000 4194304 6211092 140735967060560 140735967058520 5193696 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8292 2431 866 493 0 1597 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33168 KiB
Current children cumulated memory: 9724 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 2585
/proc/meminfo: memFree=31166632/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33168 memory=9732 CPUtime=6.29 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 5539 0 0 0 629 0 0 0 20 0 1 0 435507727 33964032 2433 33554432000 4194304 6211092 140735967060560 140735967058520 5193696 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8292 2433 866 493 0 1597 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33168 KiB
Current children cumulated memory: 9732 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.05 2.07 3/200 2585
/proc/meminfo: memFree=31166756/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33168 memory=9760 CPUtime=12.69 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 7017 0 0 0 1269 0 0 0 20 0 1 0 435507727 33964032 2440 33554432000 4194304 6211092 140735967060560 140735967058520 5081371 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8292 2440 866 493 0 1597 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33168 KiB
Current children cumulated memory: 9760 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.05 2.07 3/200 2587
/proc/meminfo: memFree=31165232/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33168 memory=9816 CPUtime=25.49 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 8984 0 0 0 2549 0 0 0 20 0 1 0 435507727 33964032 2454 33554432000 4194304 6211092 140735967060560 140735967058520 5075237 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8292 2454 866 493 0 1597 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33168 KiB
Current children cumulated memory: 9816 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 2.05 2.07 3/200 2587
/proc/meminfo: memFree=31165508/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9832 CPUtime=51.1 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 9475 0 0 0 5110 0 0 0 20 0 1 0 435507727 34099200 2458 33554432000 4194304 6211092 140735967060560 140735967058520 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2458 866 493 0 1630 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9832 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/199 2592
/proc/meminfo: memFree=31165604/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9844 CPUtime=102.29 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 9959 0 0 0 10229 0 0 0 20 0 1 0 435507727 34099200 2461 33554432000 4194304 6211092 140735967060560 140735967058520 5081320 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2461 866 493 0 1630 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9844 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.05 2.06 3/199 2598
/proc/meminfo: memFree=31165812/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9844 CPUtime=162.3 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 10445 0 0 0 16230 0 0 0 20 0 1 0 435507727 34099200 2461 33554432000 4194304 6211092 140735967060560 140735967058520 5081280 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2461 866 493 0 1630 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9844 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/199 2602
/proc/meminfo: memFree=31166152/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9856 CPUtime=222.3 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 10934 0 0 0 22230 0 0 0 20 0 1 0 435507727 34099200 2464 33554432000 4194304 6211092 140735967060560 140735967058520 5078765 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2464 866 493 0 1630 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9856 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 2607
/proc/meminfo: memFree=31165300/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9860 CPUtime=282.3 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 11423 0 0 0 28230 0 0 0 20 0 1 0 435507727 34099200 2465 33554432000 4194304 6211092 140735967060560 140735967058520 5081703 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2465 866 493 0 1630 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9860 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 2613
/proc/meminfo: memFree=31164820/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9860 CPUtime=342.3 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 11423 0 0 0 34230 0 0 0 20 0 1 0 435507727 34099200 2465 33554432000 4194304 6211092 140735967060560 140735967058520 5193696 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2465 866 493 0 1630 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9860 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 2625
/proc/meminfo: memFree=31164636/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9864 CPUtime=402.3 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 11913 0 0 0 40230 0 0 0 20 0 1 0 435507727 34099200 2466 33554432000 4194304 6211092 140735967060560 140735967058520 5081762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2466 866 493 0 1630 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9864 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 2629
/proc/meminfo: memFree=31165016/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9864 CPUtime=462.31 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 11914 0 0 0 46231 0 0 0 20 0 1 0 435507727 34099200 2466 33554432000 4194304 6211092 140735967060560 140735967058520 5081762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2466 866 493 0 1630 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9864 KiB


################
# More data... #
################

/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 1782.36 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2751
/proc/meminfo: memFree=31154436/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=1842.37 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 17651 0 0 0 184237 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 1842.37 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2756
/proc/meminfo: memFree=31149388/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=1902.37 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 17865 0 0 0 190237 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5081669 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 1902.37 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+1962.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/199 2885
/proc/meminfo: memFree=30813404/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=1962.37 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 18141 0 0 0 196237 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5083172 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 1962.37 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 2889
/proc/meminfo: memFree=30330948/32770624 swapFree=67004292/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2022.38 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 18142 0 0 0 202238 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5076405 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2022.38 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 2894
/proc/meminfo: memFree=30271364/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2082.38 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 18418 0 0 0 208238 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5076018 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2082.38 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2900
/proc/meminfo: memFree=30244832/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2142.38 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 18907 0 0 0 214238 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5078752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2142.38 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2202.3 s]
/proc/loadavg: 2.50 2.14 2.08 3/200 2912
/proc/meminfo: memFree=30215920/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2202.38 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 18908 0 0 0 220238 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5082803 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2202.38 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2262.3 s]
/proc/loadavg: 2.22 2.13 2.08 3/201 2938
/proc/meminfo: memFree=30149992/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2262.39 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19186 0 0 0 226239 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5081379 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2262.39 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2322.3 s]
/proc/loadavg: 2.08 2.10 2.08 3/201 2944
/proc/meminfo: memFree=30135344/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2322.39 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19186 0 0 0 232239 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5079284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2322.39 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2382.3 s]
/proc/loadavg: 2.03 2.09 2.07 3/201 2948
/proc/meminfo: memFree=30132740/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2382.39 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19678 0 0 0 238239 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5081703 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2382.39 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/201 2952
/proc/meminfo: memFree=30109232/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2442.39 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19679 0 0 0 244239 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5075208 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2442.39 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/200 2958
/proc/meminfo: memFree=30070908/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2502.4 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19959 0 0 0 250240 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5393236 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2502.4 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.05 2.06 3/200 2958
/proc/meminfo: memFree=30067732/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2520 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19960 0 0 0 252000 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5186286 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 2583 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.009 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.00 2.05 2.06 3/200 2958
/proc/meminfo: memFree=30067732/32770624 swapFree=67004296/67108860
[pid=2583] ppid=2580 vsize=33300 memory=9884 CPUtime=2520 cores=0,2,4,6
/proc/2583/stat : 2583 (cosoco) R 2580 2583 30964 0 -1 4202496 19960 0 0 0 252000 0 0 0 20 0 1 0 435507727 34099200 2471 33554432000 4194304 6211092 140735967060560 140735967058520 5186286 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 9359360 140735967065099 140735967065201 140735967065201 140735967068110 0
/proc/2583/statm: 8325 2471 866 493 0 1630 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 33300 KiB
Current children cumulated memory: 9884 KiB

Child status: 1
Real time (s): 2519.9
CPU time (s): 2520.01
CPU user time (s): 2520
CPU system time (s): 0.009
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 33300
Max. memory (cumulated for all children) (KiB): 9884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.009
maximum resident set size= 9948
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20011
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 3153


# summary of solver processes directly reported to runsolver:
#   pid: 2583
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.009

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.82337 second user time and 16.3623 second system time

The end

Launcher Data 

Begin job on node148 at 2019-09-16 02:23:45
IDJOB=4396850
IDBENCH=138939
IDSOLVER=2848
FILE ID=node148/4396850-1568593461
RUNJOBID= node148-1568572747-30995
PBS_JOBID= 21703309
Free space on /tmp= 61308 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-20.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396850-1568593461/watcher-4396850-1568593461 -o /tmp/evaluation-result-4396850-1568593461/solver-4396850-1568593461 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1568572747-30995 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396850-1568593461.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cc39eb921a5cd1c2fcd1d541ff73edd4
RANDOM SEED=1252106350

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31172752 kB
MemAvailable:   31769436 kB
Buffers:          124376 kB
Cached:           775592 kB
SwapCached:         3752 kB
Active:           550064 kB
Inactive:         490928 kB
Active(anon):     138400 kB
Inactive(anon):    51620 kB
Active(file):     411664 kB
Inactive(file):   439308 kB
Unevictable:      109236 kB
Mlocked:          109236 kB
SwapTotal:      67108860 kB
SwapFree:       67004292 kB
Dirty:              2756 kB
Writeback:             0 kB
AnonPages:        247376 kB
Mapped:            49076 kB
Shmem:             40604 kB
Slab:             151556 kB
SReclaimable:     123092 kB
SUnreclaim:        28464 kB
KernelStack:        3568 kB
PageTables:         5972 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     669392 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    198656 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 61184 MiB
End job on node148 at 2019-09-16 03:05:45