Trace number 4268487

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.05 2519.8999

General information on the benchmark

NameSchurrLemma/SchurrLemma-nor-s1/
SchurrLemma-nor-067-4.xml
MD5SUM22c6c6446a04b334dd8f238e60106d6c
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables67
Number of constraints1089
Number of domains1
Minimum domain size4
Maximum domain size4
Distribution of domain sizes[{"size":4,"count":67}]
Minimum variable degree33
Maximum variable degree65
Distribution of variable degrees[{"degree":33,"count":2},{"degree":34,"count":2},{"degree":35,"count":2},{"degree":36,"count":2},{"degree":37,"count":2},{"degree":38,"count":2},{"degree":39,"count":2},{"degree":40,"count":2},{"degree":41,"count":2},{"degree":42,"count":2},{"degree":43,"count":2},{"degree":44,"count":2},{"degree":45,"count":2},{"degree":46,"count":2},{"degree":47,"count":2},{"degree":48,"count":2},{"degree":49,"count":4},{"degree":50,"count":2},{"degree":51,"count":2},{"degree":52,"count":2},{"degree":53,"count":2},{"degree":54,"count":2},{"degree":55,"count":2},{"degree":56,"count":2},{"degree":57,"count":2},{"degree":58,"count":2},{"degree":59,"count":2},{"degree":60,"count":2},{"degree":61,"count":2},{"degree":62,"count":2},{"degree":63,"count":2},{"degree":64,"count":2},{"degree":65,"count":1}]
Minimum constraint arity3
Maximum constraint arity3
Distribution of constraint arities[{"arity":3,"count":1089}]
Number of extensional constraints0
Number of intensional constraints1089
Distribution of constraint types[{"type":"intension","count":1089}]
Optimization problemNO
Type of objective

Solver Data 

1.10/1.19	c root propagations     : 0           
1.10/1.19	c restarts enabled, print stats at every restarts
1.10/1.19	c
1.10/1.19	c
1.10/1.19	c
1.10/1.19	c This is cosoco 1.12 --  
1.10/1.19	c
1.10/1.19	c command line: cosoco -lc -model -restarts HOME/instance-4268487-1502619579.xml 
1.10/1.19	c ========================================[ Problem Statistics ]===========================================
1.10/1.19	c |                                                                                                       
1.10/1.19	c |  Parse time        :         1.18 s 
1.10/1.19	c |
1.10/1.19	c |               Variables: 67
1.10/1.19	c |            Domain Sizes: 4..4
1.10/1.19	c |
1.10/1.19	c |             Constraints: 1089
1.10/1.19	c |                   Arity: 3..3  -- Ternary: 1089
1.10/1.19	c | 
1.10/1.19	c |                   Types: 
1.10/1.19	c |                          Intension: 1089
1.10/1.19	c |                          
1.10/1.19	c =========================================================================================================
1.10/1.19	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
1.19/1.25	c 101            331            105019         6879           0              0              21   36   26   
1.29/1.32	c 211            745            223431         14121          0              0              15   26   20   
1.29/1.40	c 332            1251           347347         21069          0              0              13   26   20   
1.39/1.48	c 465            1759           485947         29479          0              0              14   35   20   
1.49/1.58	c 611            2290           656223         39751          0              0              15   29   22   
1.59/1.69	c 771            2825           832863         50373          0              0              17   27   22   
1.79/1.81	c 947            3525           1040618        62867          0              0              20   32   24   
1.89/1.93	c 1140           4232           1249546        77017          0              0              15   32   22   
1.99/2.08	c 1352           5004           1495378        92226          0              0              18   29   22   
2.19/2.23	c 1585           5929           1757073        109181         0              0              17   32   23   
2.29/2.34	c 1841           6602           1966839        122755         0              0              26   39   30   
2.49/2.52	c 2122           7615           2262413        141126         0              0              15   32   22   
2.69/2.75	c 2431           8844           2637250        163294         0              0              16   28   21   
2.89/2.99	c 2770           10130          3041281        187944         0              0              15   28   21   
3.10/3.19	c 3142           11446          3384916        211038         0              0              15   34   25   
3.39/3.45	c 3551           12976          3825907        238998         0              0              15   38   23   
3.69/3.72	c 4000           14337          4268879        266064         0              0              18   39   24   
3.79/3.86	c 4493           15696          4528280        286437         0              0              21   41   31   
4.10/4.16	c 5035           17543          5041653        321869         0              0              16   33   22   
4.49/4.53	c 5631           19747          5671573        364062         0              0              16   33   23   
4.69/4.75	c 6286           21725          6093708        393599         0              0              20   39   29   
5.19/5.20	c 7006           24331          6873753        440839         0              0              17   32   24   
5.69/5.74	c 7798           27290          7796478        498883         0              0              16   31   23   
6.29/6.34	c 8669           30065          8792607        562176         0              0              19   31   23   
6.69/6.70	c 9627           33065          9456476        609786         0              0              19   39   29   
7.29/7.33	c 10680          37083          10535546       681464         0              0              13   36   22   
7.99/8.02	c 11838          40676          11721187       758146         0              0              20   34   30   
8.59/8.69	c 13111          44998          12863934       837542         0              0              15   31   23   
9.69/9.71	c 14511          51213          14592803       936073         0              0              13   35   23   
10.49/10.59	c 16051          55654          16137076       1035607        0              0              19   36   30   
11.49/11.57	c 17745          61666          17828177       1142432        0              0              14   40   24   
12.69/12.71	c 19608          68473          19755808       1259923        0              0              14   38   22   
13.99/14.10	c 21657          75822          22084567       1404454        0              0              14   31   22   
15.58/15.62	c 23910          84551          24646007       1559457        0              0              15   35   22   
16.99/17.09	c 26388          93461          27110791       1717788        0              0              13   33   22   
18.58/18.62	c 29113          103367         29768638       1889293        0              0              13   42   25   
20.38/20.43	c 32110          113024         32843129       2080355        0              0              15   34   24   
22.28/22.34	c 35406          125166         36100321       2296547        0              0              13   37   23   
24.58/24.66	c 39031          137597         40012941       2534570        0              0              14   33   23   
27.18/27.27	c 43018          151426         44463564       2809391        0              0              15   34   22   
30.18/30.29	c 47403          168216         49594833       3116737        0              0              13   30   22   
31.99/32.03	c 52226          183230         52798769       3345659        0              0              14   43   30   
34.78/34.81	c 57531          201258         57727107       3660341        0              0              14   40   25   
38.09/38.14	c 63366          219458         63464555       4028606        0              0              16   34   26   
42.09/42.14	c 69784          242722         70229113       4442560        0              0              12   37   22   
45.98/46.08	c 76843          264361         76927553       4863671        0              0              13   36   24   
50.87/50.92	c 84607          290728         85065241       5361507        0              0              14   37   22   
55.67/55.74	c 93147          319636         93237373       5873979        0              0              12   37   23   
60.57/60.61	c 102541         352640         101726353      6443686        0              0              14   45   25   
65.57/65.66	c 112874         382772         110660022      7024605        0              0              14   43   26   
70.67/70.74	c 124240         419329         119587853      7674162        0              0              13   43   26   
78.87/78.95	c 136742         466023         133590575      8542810        0              0              11   37   22   
86.57/86.64	c 150494         513779         146548112      9432735        0              0              12   40   22   
94.47/94.59	c 165621         563326         160363206      10336388       0              0              12   42   25   
105.08/105.13	c 182260         623855         178358979      11445541       0              0              13   39   22   
114.68/114.72	c 200562         686610         194701150      12548147       0              0              11   46   23   
126.38/126.46	c 220694         752251         215306562      13839392       0              0              14   38   25   
138.78/138.89	c 242839         831060         237258387      15154525       0              0              14   40   24   
151.58/151.66	c 267198         916428         259231368      16619725       0              0              12   41   24   
169.48/169.50	c 293992         1021904        289730967      18430177       0              0              12   41   22   
187.48/187.53	c 323465         1118046        320853885      20422701       0              0              13   35   25   
207.58/207.65	c 355885         1237859        355075319      22494078       0              0              11   46   22   
231.09/231.15	c 391547         1369623        395770678      24958418       0              0              14   35   22   
248.69/248.70	c 430775         1487718        426741642      26960192       0              0              14   42   26   
274.79/274.84	c 473925         1644809        471541974      29713931       0              0              11   37   22   
301.00/301.06	c 521390         1810964        515754048      32669610       0              0              11   41   22   
331.10/331.13	c 573601         1976279        568042786      36009033       0              0              14   46   26   
360.00/360.08	c 631033         2179125        618564991      39415841       0              0              11   45   25   
400.10/400.15	c 694208         2405051        687623307      43678175       0              0              12   46   24   
434.01/434.10	c 763700         2649921        747495570      47777522       0              0              11   45   25   
478.50/478.54	c 840141         2927477        823929312      52509704       0              0              11   38   23   
535.70/535.74	c 924226         3246749        921637794      58610883       0              0              13   40   23   
575.81/575.83	c 1016719        3539821        992339704      63342101       0              0              10   52   29   
636.12/636.18	c 1118461        3914246        1093520551     70023768       0              0              10   41   22   
693.02/693.09	c 1230377        4310209        1192103396     76694726       0              0              10   46   25   
771.62/771.60	c 1353484        4774571        1327582111     85043666       0              0              10   45   23   
866.93/866.94	c 1488901        5332312        1489661748     94912328       0              0              11   38   22   
939.14/939.13	c 1637859        5836273        1616569532     103058966      0              0              11   55   28   
1014.94/1014.97	c 1801712        6339619        1751800659     112102929      0              0              11   52   28   
1114.64/1114.66	c 1981950        6976124        1923012186     122854482      0              0              9   46   23    
1206.25/1206.21	c 2180211        7665048        2084610972     133902724      0              0              10   52   27   
1321.66/1321.63	c 2398298        8456083        2283814903     147567537      0              0              10   45   24   
1458.07/1458.03	c 2638193        9291709        2519040250     162668369      0              0              11   45   24   
1612.58/1612.59	c 2902077        10256499       2779314503     179933932      0              0              9   43   22    
1780.39/1780.39	c 3192349        11327117       3063344836     197989792      0              0              9   48   23    
1907.80/1907.76	c 3511648        12343031       3295765277     214196282      0              0              12   50   28   
2132.01/2131.97	c 3862876        13642393       3684031227     238671346      0              0              12   45   25   
2351.63/2351.54	c 4249226        15037210       4066812634     262533814      0              0              9   40   24    
2520.04/2519.90	
2520.04/2519.90	c *** INTERRUPTED ***
2520.04/2519.90	c restarts              : 88          
2520.04/2519.90	c conflicts             : 4567952      (1813 /sec)
2520.04/2519.90	c decisions             : 16187072     (6423 /sec)
2520.04/2519.90	c propagations          : 281449575   (111685 /sec)
2520.04/2519.90	c root propagations     : 0           
2520.04/2519.90	c filter calls          : 4360796170     (1730451 /sec)
2520.04/2519.90	c useless filter calls  : 4116235592     (94 %)
2520.04/2519.90	c Memory used           : 29.51 MB
2520.04/2519.90	c CPU time              : 2520.03 s
2520.04/2519.90	
2520.04/2519.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15353 MiB free)
  memory of node 1: 16384 MiB (15528 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4268487-1502619579/watcher-4268487-1502619579 -o /tmp/evaluation-result-4268487-1502619579/solver-4268487-1502619579 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1502618721-8287 --watchdog 2580 cosoco -lc -model -restarts HOME/instance-4268487-1502619579.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=8302, runsolver pid=8299

[startup+0.100286 s]*
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31518092/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=27264 memory=3700 CPUtime=0.1 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 1115 0 0 0 10 0 0 0 20 0 1 0 95046255 27918336 925 33554432000 4194304 5972588 140724067906176 140724067899976 140381917170661 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 6816 925 787 435 0 179 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27264 KiB
Current children cumulated memory: 3700 KiB

[startup+0.209482 s]*
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31464164/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=27636 memory=4068 CPUtime=0.2 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 1179 0 0 0 20 0 0 0 20 0 1 0 95046255 28299264 1017 33554432000 4194304 5972588 140724067906176 140724067899976 140381917168207 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 6909 1017 787 435 0 272 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 27636 KiB
Current children cumulated memory: 4068 KiB

[startup+0.309206 s]*
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31442216/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=27760 memory=4192 CPUtime=0.3 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 1239 0 0 0 30 0 0 0 20 0 1 0 95046255 28426240 1048 33554432000 4194304 5972588 140724067906176 140724067899976 140381917170661 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 6940 1048 787 435 0 303 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 27760 KiB
Current children cumulated memory: 4192 KiB

[startup+0.700225 s]
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31426592/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=28736 memory=5176 CPUtime=0.69 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 1468 0 0 0 69 0 0 0 20 0 1 0 95046255 29425664 1294 33554432000 4194304 5972588 140724067906176 140724067899976 140381926528148 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7184 1294 787 435 0 547 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 28736 KiB
Current children cumulated memory: 5176 KiB

[startup+1.50024 s]
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31425476/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6644 CPUtime=1.49 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 1877 0 0 0 149 0 0 0 20 0 1 0 95046255 30941184 1661 33554432000 4194304 5972588 140724067906176 140724067899976 4965312 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1661 819 435 0 917 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6644 KiB

[startup+3.10919 s]
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31423732/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6860 CPUtime=3.1 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 2707 0 0 0 310 0 0 0 20 0 1 0 95046255 30941184 1715 33554432000 4194304 5972588 140724067906176 140724067903480 4968801 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1715 823 435 0 917 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6860 KiB

[startup+6.30023 s]
/proc/loadavg: 1.00 1.09 1.39 3/187 8318
/proc/meminfo: memFree=31422652/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6864 CPUtime=6.29 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 3537 0 0 0 628 1 0 0 20 0 1 0 95046255 30941184 1716 33554432000 4194304 5972588 140724067906176 140724067903480 4965382 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1716 823 435 0 917 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6864 KiB

[startup+12.7002 s]
/proc/loadavg: 1.08 1.10 1.39 3/187 8318
/proc/meminfo: memFree=31422732/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6864 CPUtime=12.69 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 4367 0 0 0 1268 1 0 0 20 0 1 0 95046255 30941184 1716 33554432000 4194304 5972588 140724067906176 140724067903480 5053056 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1716 823 435 0 917 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6864 KiB

[startup+25.5002 s]
/proc/loadavg: 1.29 1.15 1.40 3/187 8318
/proc/meminfo: memFree=31422672/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6864 CPUtime=25.48 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 6027 0 0 0 2547 1 0 0 20 0 1 0 95046255 30941184 1716 33554432000 4194304 5972588 140724067906176 140724067903480 5053094 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1716 823 435 0 917 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6864 KiB

[startup+51.1091 s]
/proc/loadavg: 1.53 1.22 1.42 3/187 8318
/proc/meminfo: memFree=31422420/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=51.08 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 6859 0 0 0 5107 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5099648 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+102.3 s]
/proc/loadavg: 1.80 1.34 1.45 3/187 8319
/proc/meminfo: memFree=31422436/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=102.28 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 7690 0 0 0 10227 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5071999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+162.3 s]
/proc/loadavg: 1.92 1.46 1.48 3/187 8320
/proc/meminfo: memFree=31421580/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=162.28 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 8521 0 0 0 16227 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5053094 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.56 1.52 3/187 8321
/proc/meminfo: memFree=31421696/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=222.28 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 9352 0 0 0 22227 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5099648 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 1.65 1.55 3/187 8329
/proc/meminfo: memFree=31421040/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=282.29 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 9352 0 0 0 28228 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4965342 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 1.72 1.58 3/187 8330
/proc/meminfo: memFree=31421676/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=342.29 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 10183 0 0 0 34228 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5071280 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 1.77 1.61 3/187 8331
/proc/meminfo: memFree=31421420/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=402.3 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 10183 0 0 0 40229 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5072015 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.81 1.63 3/187 8332
/proc/meminfo: memFree=31421796/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=462.3 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 11014 0 0 0 46229 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5072017 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB


################
# More data... #
################

/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 1782.39 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/187 8375
/proc/meminfo: memFree=31421208/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=1842.39 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 20143 0 0 0 184238 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5053056 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 1842.39 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/187 8376
/proc/meminfo: memFree=31421332/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=1902.4 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 20962 0 0 0 190239 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4965400 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 1902.4 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/187 8377
/proc/meminfo: memFree=31421336/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=1962.4 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 20974 0 0 0 196239 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5071952 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 1962.4 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/187 8378
/proc/meminfo: memFree=31421356/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2022.41 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 21793 0 0 0 202240 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4965817 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2022.41 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/188 8387
/proc/meminfo: memFree=31419972/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2082.41 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 21793 0 0 0 208240 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5053061 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2082.41 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/188 8388
/proc/meminfo: memFree=31420140/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2142.41 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 22624 0 0 0 214240 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4962170 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2142.41 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/188 8389
/proc/meminfo: memFree=31420156/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2202.42 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 22624 0 0 0 220241 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5053094 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2202.42 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2262.3 s]
/proc/loadavg: 2.04 2.01 1.95 3/188 8390
/proc/meminfo: memFree=31420460/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2262.42 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 23443 0 0 0 226241 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4965216 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2262.42 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.01 1.95 3/188 8391
/proc/meminfo: memFree=31420708/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2322.43 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 23443 0 0 0 232242 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4908909 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2322.43 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.01 1.95 3/187 8392
/proc/meminfo: memFree=31420824/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2382.43 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 24274 0 0 0 238242 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4962396 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2382.43 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/187 8393
/proc/meminfo: memFree=31421176/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2442.43 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 24274 0 0 0 244242 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4909616 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2442.43 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/187 8394
/proc/meminfo: memFree=31421052/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2502.44 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 25093 0 0 0 250243 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 5099648 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2502.44 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.29 2.08 1.98 3/187 8394
/proc/meminfo: memFree=31421052/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2520.04 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 25093 0 0 0 252003 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4966124 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 8302 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.04 s, system=0.016 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.29 2.08 1.98 3/187 8394
/proc/meminfo: memFree=31421052/32770624 swapFree=67108860/67108860
[pid=8302] ppid=8299 vsize=30216 memory=6868 CPUtime=2520.04 cores=0,2,4,6
/proc/8302/stat : 8302 (cosoco) R 8299 8302 2539 0 -1 4202496 25093 0 0 0 252003 1 0 0 20 0 1 0 95046255 30941184 1717 33554432000 4194304 5972588 140724067906176 140724067903480 4966124 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 23650304 140724067914943 140724067915038 140724067915038 140724067917774 0
/proc/8302/statm: 7554 1717 823 435 0 917 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 30216 KiB
Current children cumulated memory: 6868 KiB

Child status: 1
Real time (s): 2519.9
CPU time (s): 2520.05
CPU user time (s): 2520.04
CPU system time (s): 0.016
CPU usage (%): 100.006
Max. virtual memory (cumulated for all children) (KiB): 30216
Max. memory (cumulated for all children) (KiB): 6868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.04
system time used= 0.016
maximum resident set size= 6940
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25143
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 742


# summary of solver processes directly reported to runsolver:
#   pid: 8302
#   total CPU time (s): 2520.05
#   total CPU user time (s): 2520.04
#   total CPU system time (s): 0.016

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.99147 second user time and 16.8212 second system time

The end

Launcher Data 

Begin job on node102 at 2017-08-13 12:05:21
IDJOB=4268487
IDBENCH=140599
IDSOLVER=2658
FILE ID=node102/4268487-1502619579
RUNJOBID= node102-1502618721-8287
PBS_JOBID= 20628294
Free space on /tmp= 61912 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP17/SchurrLemma/SchurrLemma-nor-s1/SchurrLemma-nor-067-4.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4268487-1502619579/watcher-4268487-1502619579 -o /tmp/evaluation-result-4268487-1502619579/solver-4268487-1502619579 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1502618721-8287 --watchdog 2580  cosoco -lc -model -restarts HOME/instance-4268487-1502619579.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 22c6c6446a04b334dd8f238e60106d6c
RANDOM SEED=624636431

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31623288 kB
MemAvailable:   31990208 kB
Buffers:          100432 kB
Cached:           551140 kB
SwapCached:            0 kB
Active:           573144 kB
Inactive:         128948 kB
Active(anon):       2804 kB
Inactive(anon):    75648 kB
Active(file):     570340 kB
Inactive(file):    53300 kB
Unevictable:        6436 kB
Mlocked:            6436 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2440 kB
Writeback:             0 kB
AnonPages:         75464 kB
Mapped:            43252 kB
Shmem:             25228 kB
Slab:             144308 kB
SReclaimable:     118232 kB
SUnreclaim:        26076 kB
KernelStack:        3456 kB
PageTables:         5100 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     325368 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     22528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 61904 MiB
End job on node102 at 2017-08-13 12:47:21