Trace number 4390042

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.06 2400.11

General information on the benchmark

NamePseudoBoolean/PseudoBoolean-dec-fpga/
Pb-fpga45-44-sat.xml
MD5SUM5bcfa8fa7457011a5ed18201858fb80b
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark16.3776
Satisfiable
(Un)Satisfiability was proved
Number of variables2970
Number of constraints2113
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":2970}]
Minimum variable degree3
Maximum variable degree45
Distribution of variable degrees[{"degree":3,"count":1980},{"degree":45,"count":990}]
Minimum constraint arity22
Maximum constraint arity45
Distribution of constraint arities[{"arity":22,"count":22},{"arity":23,"count":2002},{"arity":44,"count":45},{"arity":45,"count":44}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":2113}]
Optimization problemNO
Type of objective

Solver Data 

0.21/0.26	c root propagations     : 0           
0.21/0.26	c restarts enabled, print stats at every restarts
0.21/0.26	c
0.21/0.26	c
0.21/0.26	c
0.21/0.26	c This is cosoco 2.00 --  
0.21/0.26	c
0.21/0.26	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390042-1568346425.xml 
0.21/0.26	c ========================================[ Problem Statistics ]===========================================
0.21/0.26	c |                                                                                                       
0.21/0.26	c |  Parse time        :         0.22 s 
0.21/0.26	c |
0.21/0.26	c |               Variables: 2970
0.21/0.26	c |            Domain Sizes: 2..2
0.21/0.26	c |
0.21/0.26	c |             Constraints: 2113
0.21/0.26	c |                   Arity: 22..45
0.21/0.26	c | 
0.21/0.26	c |                   Types: 
0.21/0.26	c |                          Sum: 2113
0.21/0.26	c |                          
0.21/0.26	c =========================================================================================================
0.21/0.26	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.30/0.40	c 101            4120           76251          40430          0              0              2641   2700   2633
0.50/0.52	c 211            7284           136897         56239          0              0              2538   2598   2530
0.59/0.66	c 332            10669          220109         87994          0              0              2324   2426   2377
0.69/0.77	c 465            14383          270465         106738         0              0              2267   2301   2266
0.79/0.87	c 611            18792          294215         125158         0              0              1650   1725   1676
0.89/0.98	c 771            23890          322104         146760         0              0              1610   1766   1654
0.99/1.10	c 947            28749          355463         178398         0              0              1727   1788   1752
1.18/1.21	c 1140           32408          397276         221317         0              0              1651   1738   1667
1.28/1.35	c 1352           35836          454476         267980         0              0              1527   1611   1544
1.48/1.53	c 1585           39337          534763         322701         0              0              1214   1351   1255
1.68/1.71	c 1841           47086          588109         367914         0              0              918   1639   1572
1.78/1.86	c 2122           53100          630826         399264         0              0              1633   1767   1704
2.10/2.16	c 2431           63656          735756         488963         0              0              1466   1586   1516
2.39/2.42	c 2770           68874          831582         568627         0              0              994   1160   1041
2.59/2.66	c 3142           80085          905370         642948         0              0              1773   1871   1823
2.89/2.92	c 3551           88860          1001325        748863         0              0              1491   1737   1572
3.19/3.29	c 4000           99425          1132926        843237         0              0              1241   1414   1323
3.59/3.69	c 4493           107856         1273211        961164         0              0              924   1025   964
4.00/4.04	c 5035           122637         1388650        1059309        0              0              568   1827   1662
4.29/4.30	c 5631           131925         1477605        1165086        0              0              1606   1728   1645
4.49/4.56	c 6286           143701         1560033        1234654        0              0              1765   1830   1787
4.79/4.89	c 7006           158314         1683596        1342661        0              0              1730   1890   1811
5.18/5.26	c 7798           175907         1804587        1451259        0              0              1735   1880   1828
5.58/5.64	c 8669           193464         1938457        1570590        0              0              1775   1863   1834
6.18/6.28	c 9627           218669         2203463        1797572        0              0              1752   1829   1797
6.99/7.07	c 10680          247271         2483723        2096325        0              0              1452   1584   1540
8.10/8.16	c 11838          277729         2806570        2379440        0              0              808   1766   1051
9.00/9.02	c 13111          316101         3075192        2670639        0              0              1547   1686   1643
10.00/10.07	c 14511          347065         3427300        3002472        0              0              1182   1350   1224
11.19/11.27	c 16051          383073         3805015        3378087        0              0              1093   1212   1156
12.79/12.85	c 17745          414595         4366887        3889818        0              0              662   796   726
14.00/14.05	c 19608          465670         4745216        4216333        0              0              226   1747   1536
15.29/15.30	c 21657          524312         5118639        4566552        0              0              1536   1711   1628
16.68/16.74	c 23910          591913         5587480        5097245        0              0              1564   1818   1644
18.28/18.34	c 26388          670332         6111625        5630557        0              0              1139   1828   1628
19.88/19.92	c 29113          733385         6726678        6311638        0              0              1500   1681   1584
22.48/22.59	c 32110          816448         7725684        7196946        0              0              901   1647   1314
24.09/24.11	c 35406          887605         8244938        7734588        0              0              1431   1710   1620
25.88/25.99	c 39031          970072         8996236        8515022        0              0              1621   1730   1688
28.87/28.97	c 43018          1079700        10191742       9765335        0              0              1466   1663   1574
33.27/33.35	c 47403          1202589        11837027       11307036       0              0              1059   1312   1172
37.77/37.81	c 52226          1327094        13205149       12685317       0              0              890   1056   974
40.17/40.28	c 57531          1450092        14055076       13547224       0              0              852   1731   1688
43.17/43.24	c 63366          1576703        15226622       14670454       0              0              1578   1694   1646
48.97/49.06	c 69784          1755130        17187729       16639190       0              0              1128   1267   1206
53.97/54.08	c 76843          1884665        19069657       18243178       0              0              731   1268   1167
56.46/56.56	c 84607          2004951        20025080       19118184       0              0              800   1835   1753
59.86/59.90	c 93147          2167922        21339935       20257848       0              0              1718   1819   1777
64.56/64.66	c 102541         2383711        23113786       21795959       0              0              1613   1769   1695
72.66/72.70	c 112874         2711525        26121819       24637169       0              0              1503   1687   1608
83.56/83.65	c 124240         3117242        30162647       28715627       0              0              1408   1612   1542
94.26/94.33	c 136742         3583909        33302674       31574618       0              0              1347   1580   1473
98.97/99.02	c 150494         3818433        35201017       33242436       0              0              1271   1886   1848
105.76/105.89	c 165621         4192385        37867611       35469016       0              0              1736   1876   1847
117.46/117.59	c 182260         4720365        42866153       40737424       0              0              1690   1838   1791
136.86/136.98	c 200562         5538615        48106695       45921288       0              0              1195   1519   1356
148.97/149.03	c 220694         6197424        52522368       50280265       0              0              789   1862   1828
172.26/172.34	c 242839         7214716        60714221       58332946       0              0              1451   1736   1621
183.56/183.61	c 267198         7806614        64747275       62381960       0              0              1324   1910   1795
197.16/197.23	c 293992         8565405        69884703       67187387       0              0              1770   1913   1860
218.26/218.32	c 323465         9702599        76805920       74203177       0              0              1609   1786   1738
254.36/254.42	c 355885         10947899       89899626       86768565       0              0              1242   1606   1396
269.16/269.29	c 391547         11742730       95142360       91493158       0              0              1670   1912   1817
298.66/298.71	c 430775         13297860       106486349      103435247      0              0              1695   1881   1823
323.16/323.28	c 473925         14625852       115210688      112474683      0              0              1128   1897   1799
371.46/371.58	c 521390         16342288       132998526      129650361      0              0              1298   1822   1467
390.86/390.91	c 573601         17154318       140186992      135371120      0              0              866   1961   1799
408.46/408.56	c 631033         18169818       147247091      141410242      0              0              1859   1949   1927
450.56/450.65	c 694208         20387372       163870780      157897647      0              0              1704   1907   1837
508.06/508.12	c 763700         22662745       184888047      179703323      0              0              1167   1809   1557
576.96/577.03	c 840141         24841120       207671632      202144479      0              0              1102   1557   1238
620.35/620.42	c 924226         27034342       223390447      217131014      0              0              993   1900   1804
679.96/680.05	c 1016719        29383121       245146240      237912218      0              0              1409   1735   1553
764.75/764.83	c 1118461        32030164       272822237      262269086      0              0              1071   1574   1197
799.35/799.45	c 1230377        33744495       285978795      273989857      0              0              996   1944   1819
857.56/857.61	c 1353484        36707043       309263168      297633842      0              0              1718   1889   1831
961.16/961.23	c 1488901        40793897       349585889      340203192      0              0              1479   1852   1612
1080.46/1080.57	c 1637859        44976769       389823079      376526608      0              0              970   1676   1387
1193.46/1193.51	c 1801712        48867008       428081997      412464770      0              0              841   1918   1411
1252.55/1252.61	c 1981950        51863976       452158173      434507668      0              0              1752   1911   1839
1335.25/1335.33	c 2180211        56080522       485993531      463226985      0              0              1598   1891   1834
1472.45/1472.51	c 2398298        62449206       537834973      527067774      0              0              1572   1815   1726
1659.96/1660.05	c 2638193        70033596       599122246      593071815      0              0              663   1545   1479
1774.65/1774.72	c 2902077        76112736       640955690      627915000      0              0              1072   1875   1794
1914.55/1914.68	c 3192349        83096557       694255090      679546234      0              0              1634   1841   1768
2063.45/2063.56	c 3511648        90518311       750989104      732290037      0              0              1583   1871   1789
2400.05/2400.10	
2400.05/2400.10	c *** INTERRUPTED ***
2400.05/2400.10	c restarts              : 86          
2400.05/2400.10	c conflicts             : 3852183      (1605 /sec)
2400.05/2400.10	c decisions             : 104795782    (43665 /sec)
2400.05/2400.10	c propagations          : 842150409   (350895 /sec)
2400.05/2400.10	c root propagations     : 0           
2400.05/2400.10	c filter calls          : 869219607      (362174 /sec)
2400.05/2400.10	c useless filter calls  : 811005467      (93 %)
2400.05/2400.10	c Memory used           : 87.56 MB
2400.05/2400.10	c CPU time              : 2400 s
2400.05/2400.10	c real time             : 2400.1 s
2400.05/2400.10	
2400.05/2400.10	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10684 MiB free)
  memory of node 1: 16384 MiB (13043 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390042-1568346425/watcher-4390042-1568346425 -o /tmp/evaluation-result-4390042-1568346425/solver-4390042-1568346425 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node143-1568335547-17181 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390042-1568346425.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=20253, runsolver pid=20250
Current StackSize limit: 8192 KiB


[startup+0.100156 s]*
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24287392/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=38572 memory=14968 CPUtime=0.09 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 3934 0 0 0 9 0 0 0 20 0 1 0 410579831 39497728 3742 33554432000 4194304 6210612 140734755753520 140734755750056 140538338798565 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 9643 3742 834 493 0 2948 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 38572 KiB
Current children cumulated memory: 14968 KiB

[startup+0.209648 s]*
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24270280/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=54992 memory=31392 CPUtime=0.21 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 8012 0 0 0 20 1 0 0 20 0 1 0 410579831 56311808 7848 33554432000 4194304 6210612 140734755753520 140734755750056 5816963 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 13748 7848 834 493 0 7053 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 54992 KiB
Current children cumulated memory: 31392 KiB

[startup+0.309581 s]*
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24265816/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=60912 memory=37436 CPUtime=0.3 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 9558 0 0 0 29 1 0 0 20 0 1 0 410579831 62373888 9359 33554432000 4194304 6210612 140734755753520 140734755750056 140538338867755 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 15228 9359 870 493 0 8533 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 60912 KiB
Current children cumulated memory: 37436 KiB

[startup+0.700372 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24241648/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=86540 memory=62780 CPUtime=0.69 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 15882 0 0 0 67 2 0 0 20 0 1 0 410579831 88616960 15695 33554432000 4194304 6210612 140734755753520 140734755750056 5409293 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 21635 15695 872 493 0 14940 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 86540 KiB
Current children cumulated memory: 62780 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24237184/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=88036 memory=64100 CPUtime=1.48 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 16252 0 0 0 146 2 0 0 20 0 1 0 410579831 90148864 16025 33554432000 4194304 6210612 140734755753520 140734755751480 5249727 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22009 16025 872 493 0 15314 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 88036 KiB
Current children cumulated memory: 64100 KiB

[startup+3.10935 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24236328/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=88440 memory=64760 CPUtime=3.1 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 24701 0 0 0 307 3 0 0 20 0 1 0 410579831 90562560 16190 33554432000 4194304 6210612 140734755753520 140734755751480 5249712 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22110 16190 872 493 0 15415 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 88440 KiB
Current children cumulated memory: 64760 KiB

[startup+6.30026 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24235456/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=88984 memory=65360 CPUtime=6.28 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 33930 0 0 0 625 3 0 0 20 0 1 0 410579831 91119616 16340 33554432000 4194304 6210612 140734755753520 140734755751480 5186084 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22246 16340 872 493 0 15551 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 88984 KiB
Current children cumulated memory: 65360 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20254
/proc/meminfo: memFree=24235580/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=88984 memory=65360 CPUtime=12.69 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 42117 0 0 0 1265 4 0 0 20 0 1 0 410579831 91119616 16340 33554432000 4194304 6210612 140734755753520 140734755751480 5249712 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22246 16340 872 493 0 15551 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 88984 KiB
Current children cumulated memory: 65360 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20256
/proc/meminfo: memFree=24235324/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89120 memory=65448 CPUtime=25.48 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 55752 0 0 0 2544 4 0 0 20 0 1 0 410579831 91258880 16362 33554432000 4194304 6210612 140734755753520 140734755751480 5409284 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22280 16362 872 493 0 15585 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 89120 KiB
Current children cumulated memory: 65448 KiB

[startup+51.1089 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20257
/proc/meminfo: memFree=24235120/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89120 memory=65708 CPUtime=51.07 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 57745 0 0 0 5103 4 0 0 20 0 1 0 410579831 91258880 16427 33554432000 4194304 6210612 140734755753520 140734755751480 5409293 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22280 16427 872 493 0 15585 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 89120 KiB
Current children cumulated memory: 65708 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 20261
/proc/meminfo: memFree=24235332/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89392 memory=65868 CPUtime=102.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 58383 0 0 0 10222 4 0 0 20 0 1 0 410579831 91537408 16467 33554432000 4194304 6210612 140734755753520 140734755751112 5409284 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22348 16467 872 493 0 15653 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 89392 KiB
Current children cumulated memory: 65868 KiB

[startup+162.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/200 20267
/proc/meminfo: memFree=24234432/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89392 memory=66020 CPUtime=162.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 58965 0 0 0 16222 4 0 0 20 0 1 0 410579831 91537408 16505 33554432000 4194304 6210612 140734755753520 140734755751480 5154977 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22348 16505 872 493 0 15653 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 89392 KiB
Current children cumulated memory: 66020 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/200 20279
/proc/meminfo: memFree=24233952/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89524 memory=66084 CPUtime=222.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 59577 0 0 0 22222 4 0 0 20 0 1 0 410579831 91672576 16521 33554432000 4194304 6210612 140734755753520 140734755751480 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22381 16521 872 493 0 15686 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 89524 KiB
Current children cumulated memory: 66084 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 20283
/proc/meminfo: memFree=24234232/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66164 CPUtime=282.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 60156 0 0 0 28222 4 0 0 20 0 1 0 410579831 91807744 16541 33554432000 4194304 6210612 140734755753520 140734755751112 5380096 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16541 872 493 0 15719 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66164 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/201 20289
/proc/meminfo: memFree=24233928/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66224 CPUtime=342.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 60762 0 0 0 34222 4 0 0 20 0 1 0 410579831 91807744 16556 33554432000 4194304 6210612 140734755753520 140734755751480 5155436 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16556 872 493 0 15719 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66224 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 20293
/proc/meminfo: memFree=24234552/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66224 CPUtime=402.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 61342 0 0 0 40222 4 0 0 20 0 1 0 410579831 91807744 16556 33554432000 4194304 6210612 140734755753520 140734755751480 5249719 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16556 872 493 0 15719 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66224 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 20297
/proc/meminfo: memFree=24234496/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66248 CPUtime=462.26 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 61905 0 0 0 46222 4 0 0 20 0 1 0 410579831 91807744 16562 33554432000 4194304 6210612 140734755753520 140734755751480 5409279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16562 872 493 0 15719 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66248 KiB


################
# More data... #
################

/proc/20253/statm: 22414 16567 872 493 0 15719 0
Current children cumulated CPU time: 1662.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66268 KiB

[startup+1722.3 s]
/proc/loadavg: 2.11 2.12 2.08 3/199 20495
/proc/meminfo: memFree=24110596/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=1722.25 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 71234 0 0 0 172220 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5409301 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+1782.3 s]
/proc/loadavg: 2.04 2.10 2.07 3/200 20501
/proc/meminfo: memFree=24110512/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=1782.25 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 71725 0 0 0 178220 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5249890 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.08 2.07 3/199 20505
/proc/meminfo: memFree=24111248/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=1842.25 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 71993 0 0 0 184220 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5155560 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 1842.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/199 20509
/proc/meminfo: memFree=24110656/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=1902.25 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 72260 0 0 0 190220 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5380096 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 1902.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/200 20515
/proc/meminfo: memFree=24110464/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=1962.25 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 72812 0 0 0 196220 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5155428 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 1962.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.07 2.06 3/200 20527
/proc/meminfo: memFree=24110120/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=2022.25 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 73105 0 0 0 202220 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 2022.25 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+2082.3 s]
/proc/loadavg: 2.03 2.06 2.06 3/200 20531
/proc/meminfo: memFree=24110492/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66280 CPUtime=2082.24 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 73649 0 0 0 208219 5 0 0 20 0 1 0 410579831 91807744 16570 33554432000 4194304 6210612 140734755753520 140734755751480 5154973 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16570 872 493 0 15719 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66280 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/201 20537
/proc/meminfo: memFree=24110608/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2142.24 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 73960 0 0 0 214219 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 20541
/proc/meminfo: memFree=24110236/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2202.24 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 74270 0 0 0 220219 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5249738 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 20545
/proc/meminfo: memFree=24109624/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2262.24 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 74598 0 0 0 226219 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 20552
/proc/meminfo: memFree=24110096/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2322.24 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 74915 0 0 0 232219 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2322.24 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 20556
/proc/meminfo: memFree=24110040/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2382.24 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 75235 0 0 0 238219 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2382.24 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 20558
/proc/meminfo: memFree=24110352/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2400.05 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 75546 0 0 0 240000 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5155311 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 20253 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400 s, system=0.057999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 20558
/proc/meminfo: memFree=24110352/32770624 swapFree=67108848/67108860
[pid=20253] ppid=20250 vsize=89656 memory=66288 CPUtime=2400.05 cores=1,3,5,7
/proc/20253/stat : 20253 (cosoco) R 20250 20253 17149 0 -1 4202496 75546 0 0 0 240000 5 0 0 20 0 1 0 410579831 91807744 16572 33554432000 4194304 6210612 140734755753520 140734755751480 5155311 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38371328 140734755755019 140734755755121 140734755755121 140734755758030 0
/proc/20253/statm: 22414 16572 872 493 0 15719 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 89656 KiB
Current children cumulated memory: 66288 KiB

Child status: 1
Real time (s): 2400.11
CPU time (s): 2400.06
CPU user time (s): 2400
CPU system time (s): 0.057999
CPU usage (%): 99.998
Max. virtual memory (cumulated for all children) (KiB): 89656
Max. memory (cumulated for all children) (KiB): 66288

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400
system time used= 0.057999
maximum resident set size= 66356
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 75600
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 42
involuntary context switches= 720


# summary of solver processes directly reported to runsolver:
#   pid: 20253
#   total CPU time (s): 2400.06
#   total CPU user time (s): 2400
#   total CPU system time (s): 0.057999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.16253 second user time and 14.493 second system time

The end

Launcher Data 

Begin job on node143 at 2019-09-13 05:46:24
IDJOB=4390042
IDBENCH=134701
IDSOLVER=2830
FILE ID=node143/4390042-1568346425
RUNJOBID= node143-1568335547-17181
PBS_JOBID= 21701163
Free space on /tmp= 58852 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/PseudoBoolean/PseudoBoolean-dec-fpga/Pb-fpga45-44-sat.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390042-1568346425/watcher-4390042-1568346425 -o /tmp/evaluation-result-4390042-1568346425/solver-4390042-1568346425 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node143-1568335547-17181 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390042-1568346425.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5bcfa8fa7457011a5ed18201858fb80b
RANDOM SEED=1643094661

node143.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24297700 kB
MemAvailable:   31756396 kB
Buffers:          171960 kB
Cached:          7574148 kB
SwapCached:            8 kB
Active:          2147860 kB
Inactive:        5650964 kB
Active(anon):       7568 kB
Inactive(anon):   144520 kB
Active(file):    2140292 kB
Inactive(file):  5506444 kB
Unevictable:      107780 kB
Mlocked:          107780 kB
SwapTotal:      67108860 kB
SwapFree:       67108848 kB
Dirty:              2732 kB
Writeback:             0 kB
AnonPages:        160784 kB
Mapped:            49664 kB
Shmem:             90756 kB
Slab:             269320 kB
SReclaimable:     240420 kB
SUnreclaim:        28900 kB
KernelStack:        3552 kB
PageTables:         5336 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     530724 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      132480 kB
DirectMap2M:    33413120 kB

Free space on /tmp at the end= 58848 MiB
End job on node143 at 2019-09-13 06:26:24