Trace number 3282594

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
glucose 2? (TO) 1300.02 1300.01

General information on the benchmark

NameAPPLICATIONS/crypto/
md5gen/gus-md5-12.cnf
MD5SUM0621e557bffdc18ca509447665adecda
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables69553
Number of clauses226752
Sum of the clauses size587624
Maximum clause length3
Minimum clause length1
Number of clauses of size 1129
Number of clauses of size 292374
Number of clauses of size 3134249
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c
0.00/0.00	c Starting SatElite Preprocessing
0.00/0.00	c
0.00/0.00	c Parsing...
0.00/0.09	c ==============================================================================
0.00/0.09	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.09	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.09	c ==============================================================================
0.00/0.09	c |         0 |  226109   585954 |   67832       0        0     nan |  0.000 % |
0.00/0.49	c |         0 |  163329   552676 |      --       0       --      -- |     --   | -62780/-33278
0.00/0.49	c ==============================================================================
0.00/0.49	c Result  :   #vars: 28500   #clauses: 163329   #literals: 552676
0.00/0.49	c CPU time:   0.468928 s
0.00/0.49	c ==============================================================================
0.00/0.59	c
0.00/0.59	c Starting glucose
0.00/0.59	c
294.59/294.61	c This is glucose 2.0 --  based on MiniSAT (Many thanks to MiniSAT team)
294.59/294.61	c WARNING: for repeatability, setting FPU to use double precision
294.59/294.61	c ============================[ Problem Statistics ]=============================
294.59/294.61	c |                                                                             |
294.59/294.61	c |  Number of variables:         28500                                         |
294.59/294.61	c |  Number of clauses:          163329                                         |
294.59/294.61	c |  Parse time:                   0.04 s                                       |
294.59/294.61	c |                                                                             |
294.59/294.61	c ============================[ Search Statistics ]==============================
294.59/294.61	c | Conflicts |          ORIGINAL         |          LEARNT          | Progress |
294.59/294.61	c |           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
294.59/294.61	c ===============================================================================
294.59/294.61	c |       228 |   28491   163329   552676 |        1      222     65 |  0.032 % |
294.59/294.61	c |       328 |   28489   163277   552502 |        1      319     83 |  0.039 % |
294.59/294.61	c |     29785 |   28458   163130   552023 |        1    16733    127 |  0.147 % |
294.59/294.61	c |     30387 |   28458   163130   552023 |        1    17335    127 |  0.147 % |
294.59/294.61	c |     30749 |   28458   163130   552023 |        1    17697    127 |  0.147 % |
294.59/294.61	c |     43239 |   28458   163130   552023 |        1    20917    120 |  0.147 % |
294.59/294.61	c |     43339 |   28458   163130   552023 |        1    21017    121 |  0.147 % |
294.59/294.61	c |     45221 |   28455   163102   551927 |        1    22894    123 |  0.158 % |
294.59/294.61	c |     48800 |   28454   163097   551912 |        1    14640     76 |  0.161 % |
294.59/294.61	c |     55237 |   28454   163097   551912 |        1    21077    103 |  0.161 % |
294.59/294.61	c |     67528 |   28450   163086   551879 |        1    18954     77 |  0.175 % |
294.59/294.61	c |     69208 |   28447   163055   551774 |        1    20622     84 |  0.186 % |
294.59/294.61	c |     69308 |   28447   163055   551774 |        1    20722     84 |  0.186 % |
294.59/294.61	c |     69776 |   28447   163055   551774 |        1    21190     86 |  0.186 % |
294.59/294.61	c |     73448 |   28447   163055   551774 |        1    24862     97 |  0.186 % |
294.59/294.61	c |     79616 |   28447   163055   551774 |        1    31030    110 |  0.186 % |
294.59/294.61	c |     79731 |   28447   163055   551774 |        1    31145    110 |  0.186 % |
294.59/294.61	c |     79834 |   28447   163055   551774 |        1    31248    110 |  0.186 % |
294.59/294.61	c |     91938 |   28447   163055   551774 |        1    26347     84 |  0.186 % |
294.59/294.61	c |     93326 |   28447   163055   551774 |        1    27735     87 |  0.186 % |
294.59/294.61	c |     93426 |   28447   163055   551774 |        1    27835     87 |  0.186 % |
294.59/294.61	c |     94422 |   28447   163055   551774 |        1    28831     88 |  0.186 % |
294.59/294.61	c |    101161 |   28447   163055   551774 |        1    35570    101 |  0.186 % |
294.59/294.61	c |    101262 |   28447   163055   551774 |        1    35671    101 |  0.186 % |
294.59/294.61	c |    101362 |   28447   163055   551774 |        1    35771    101 |  0.186 % |
294.59/294.61	c |    101588 |   28447   163055   551774 |        1    35997    101 |  0.186 % |
294.59/294.61	c |    104954 |   28447   163055   551774 |        1    19765     40 |  0.186 % |
294.59/294.61	c |    105232 |   28447   163055   551774 |        1    20043     41 |  0.186 % |
294.59/294.61	c |    116730 |   28447   163055   551774 |        1    31541     84 |  0.186 % |
294.59/294.61	c |    119317 |   28442   163041   551732 |        1    34122     88 |  0.204 % |
294.59/294.61	c |    125443 |   28442   163041   551732 |        1    40248     98 |  0.204 % |
294.59/294.61	c |    126387 |   28442   163041   551732 |        1    41192     99 |  0.204 % |
294.59/294.61	c |    129656 |   28440   163036   551717 |        1    22259     32 |  0.211 % |
294.59/294.61	c |    129757 |   28440   163036   551717 |        1    22360     32 |  0.211 % |
294.59/294.61	c |    132845 |   28440   163036   551717 |        1    25448     46 |  0.211 % |
294.59/294.61	c |    132953 |   28440   163036   551717 |        1    25556     46 |  0.211 % |
294.59/294.61	c |    133230 |   28440   163036   551717 |        1    25833     47 |  0.211 % |
294.59/294.61	c |    140163 |   28440   163036   551717 |        1    32766     69 |  0.211 % |
294.59/294.61	c |    146737 |   28440   163036   551717 |        1    39340     81 |  0.211 % |
696.59/696.64	c |    153719 |   28440   163036   551717 |        1    46322     90 |  0.211 % |
696.59/696.64	c |    156598 |   28440   163036   551717 |        1    49201     92 |  0.211 % |
696.59/696.64	c |    156698 |   28440   163036   551717 |        1    49301     92 |  0.211 % |
696.59/696.64	c |    165893 |   28440   163036   551717 |        1    33704     59 |  0.211 % |
696.59/696.64	c |    170141 |   28440   163036   551717 |        1    37952     67 |  0.211 % |
696.59/696.64	c |    177533 |   28440   163036   551717 |        1    45344     79 |  0.211 % |
696.59/696.64	c |    178865 |   28440   163036   551717 |        1    46676     80 |  0.211 % |
696.59/696.64	c |    186998 |   28440   163036   551717 |        1    54809     88 |  0.211 % |
696.59/696.64	c |    188137 |   28440   163036   551717 |        1    28545     27 |  0.211 % |
696.59/696.64	c |    188263 |   28440   163036   551717 |        1    28671     27 |  0.211 % |
696.59/696.64	c |    191399 |   28440   163036   551717 |        1    31807     37 |  0.211 % |
696.59/696.64	c |    191500 |   28440   163036   551717 |        1    31908     37 |  0.211 % |
696.59/696.64	c |    206034 |   28440   163036   551717 |        1    46442     69 |  0.211 % |
696.59/696.64	c |    220030 |   28440   163036   551717 |        1    30436     21 |  0.211 % |
696.59/696.64	c |    220560 |   28440   163036   551717 |        1    30966     22 |  0.211 % |
696.59/696.64	c |    220662 |   28440   163036   551717 |        1    31068     22 |  0.211 % |
696.59/696.64	c |    220762 |   28440   163036   551717 |        1    31168     23 |  0.211 % |
696.59/696.64	c |    220886 |   28440   163036   551717 |        1    31292     23 |  0.211 % |
696.59/696.64	c |    229783 |   28440   163036   551717 |        1    40189     50 |  0.211 % |
696.59/696.64	c |    231593 |   28440   163036   551717 |        1    41999     53 |  0.211 % |
696.59/696.64	c |    235109 |   28440   163036   551717 |        1    45515     60 |  0.211 % |
696.59/696.64	c |    235622 |   28440   163036   551717 |        1    46028     61 |  0.211 % |
696.59/696.64	c |    238961 |   28440   163036   551717 |        1    49367     66 |  0.211 % |
696.59/696.64	c |    240713 |   28440   163036   551717 |        1    51119     69 |  0.211 % |
696.59/696.64	c |    240905 |   28440   163036   551717 |        1    51311     69 |  0.211 % |
696.59/696.64	c |    241402 |   28440   163036   551717 |        1    51808     69 |  0.211 % |
696.59/696.64	c |    241677 |   28440   163036   551717 |        1    52083     69 |  0.211 % |
696.59/696.64	c |    249092 |   28440   163036   551717 |        1    59498     77 |  0.211 % |
696.59/696.64	c |    249192 |   28440   163036   551717 |        1    59598     77 |  0.211 % |
696.59/696.64	c |    249292 |   28440   163036   551717 |        1    59698     78 |  0.211 % |
696.59/696.64	c |    249968 |   28440   163036   551717 |        1    60374     78 |  0.211 % |
696.59/696.64	c |    264079 |   28440   163036   551717 |        1    41893     46 |  0.211 % |
696.59/696.64	c |    266313 |   28440   163036   551717 |        1    44127     50 |  0.211 % |
696.59/696.64	c |    266414 |   28440   163036   551717 |        1    44228     50 |  0.211 % |
696.59/696.64	c |    281467 |   28440   163036   551717 |        1    59281     72 |  0.211 % |
696.59/696.64	c |    281891 |   28440   163036   551717 |        1    59705     72 |  0.211 % |
696.59/696.64	c |    302650 |   28440   163036   551717 |        1    45267     45 |  0.211 % |
696.59/696.64	c |    302750 |   28440   163036   551717 |        1    45367     45 |  0.211 % |
696.59/696.64	c |    302973 |   28440   163036   551717 |        1    45590     45 |  0.211 % |
696.59/696.64	c |    303203 |   28440   163036   551717 |        1    45820     46 |  0.211 % |
696.59/696.64	c |    303621 |   28440   163036   551717 |        1    46238     46 |  0.211 % |
696.59/696.64	c |    303722 |   28440   163036   551717 |        1    46339     46 |  0.211 % |
696.59/696.64	c |    314643 |   28440   163036   551717 |        1    57260     65 |  0.211 % |
696.59/696.64	c |    315178 |   28440   163036   551717 |        1    57795     65 |  0.211 % |
696.59/696.64	c |    322244 |   28440   163036   551717 |        1    64861     73 |  0.211 % |
696.59/696.64	c |    323482 |   28440   163036   551717 |        1    66099     74 |  0.211 % |
696.59/696.64	c |    323585 |   28440   163036   551717 |        1    66202     74 |  0.211 % |
696.59/696.64	c |    337053 |   28440   163036   551717 |        1    41873     29 |  0.211 % |
696.59/696.64	c |    349175 |   28440   163036   551717 |        1    53995     55 |  0.211 % |
696.59/696.64	c |    357185 |   28440   163036   551717 |        1    62005     64 |  0.211 % |
1113.21/1113.27	c |    361407 |   28440   163036   551717 |        1    66227     70 |  0.211 % |
1113.21/1113.27	c |    367538 |   28439   163027   551686 |        1    72355     75 |  0.214 % |
1113.21/1113.27	c |    367639 |   28439   163027   551686 |        1    72456     75 |  0.214 % |
1113.21/1113.27	c |    374272 |   28439   163027   551686 |        1    79089     81 |  0.214 % |
1113.21/1113.27	c |    374477 |   28439   163027   551686 |        1    79294     81 |  0.214 % |
1113.21/1113.27	c |    381087 |   28439   163027   551686 |        1    45507     36 |  0.214 % |
1113.21/1113.27	c |    387786 |   28439   163027   551686 |        1    52206     50 |  0.214 % |
1113.21/1113.27	c |    397764 |   28439   163027   551686 |        1    62184     65 |  0.214 % |
1113.21/1113.27	c |    414603 |   28436   163002   551599 |        1    79011     81 |  0.225 % |
1113.21/1113.27	c |    421417 |   28436   163002   551599 |        1    85825     86 |  0.225 % |
1113.21/1113.27	c |    421517 |   28436   163002   551599 |        1    85925     86 |  0.225 % |
1113.21/1113.27	c |    421617 |   28436   163002   551599 |        1    43028     23 |  0.225 % |
1113.21/1113.27	c |    435368 |   28436   163002   551599 |        1    56779     52 |  0.225 % |
1113.21/1113.27	c |    450483 |   28436   163002   551599 |        1    71894     71 |  0.225 % |
1113.21/1113.27	c |    450786 |   28436   163002   551599 |        1    72197     71 |  0.225 % |
1113.21/1113.27	c |    465913 |   28436   163002   551599 |        1    87324     83 |  0.225 % |
1113.21/1113.27	c |    473370 |   28436   163002   551599 |        1    49182     30 |  0.225 % |
1113.21/1113.27	c |    484251 |   28436   163002   551599 |        1    60063     52 |  0.225 % |
1113.21/1113.27	c |    484352 |   28436   163002   551599 |        1    60164     52 |  0.225 % |
1113.21/1113.27	c |    484962 |   28436   163002   551599 |        1    60774     53 |  0.225 % |
1113.21/1113.27	c |    486380 |   28436   163002   551599 |        1    62192     55 |  0.225 % |
1113.21/1113.27	c |    486481 |   28436   163002   551599 |        1    62293     55 |  0.225 % |
1113.21/1113.27	c |    486581 |   28436   163002   551599 |        1    62393     55 |  0.225 % |
1113.21/1113.27	c |    486681 |   28436   163002   551599 |        1    62493     55 |  0.225 % |
1113.21/1113.27	c |    494228 |   28436   163002   551599 |        1    70040     64 |  0.225 % |
1113.21/1113.27	c |    494332 |   28436   163002   551599 |        1    70144     64 |  0.225 % |
1113.21/1113.27	c |    494433 |   28436   163002   551599 |        1    70245     64 |  0.225 % |
1113.21/1113.27	c |    504522 |   28436   163002   551599 |        1    80334     75 |  0.225 % |
1113.21/1113.27	c |    511849 |   28436   163002   551599 |        1    87661     82 |  0.225 % |
1113.21/1113.27	c |    520033 |   28436   163002   551599 |        1    95845     87 |  0.225 % |
1113.21/1113.27	c |    522672 |   28436   163002   551599 |        1    50437     30 |  0.225 % |
1113.21/1113.27	c |    522772 |   28436   163002   551599 |        1    50537     30 |  0.225 % |
1113.21/1113.27	c |    525044 |   28436   163002   551599 |        1    52809     35 |  0.225 % |
1113.21/1113.27	c |    525144 |   28436   163002   551599 |        1    52909     35 |  0.225 % |
1113.21/1113.27	c |    528409 |   28436   163002   551599 |        1    56174     42 |  0.225 % |
1113.21/1113.27	c |    535395 |   28436   163002   551599 |        1    63160     55 |  0.225 % |
1113.21/1113.27	c |    537398 |   28436   163002   551599 |        1    65163     57 |  0.225 % |
1113.21/1113.27	c |    539181 |   28436   163002   551599 |        1    66946     60 |  0.225 % |
1113.21/1113.27	c |    556613 |   28436   163002   551599 |        1    84378     80 |  0.225 % |
1113.21/1113.27	c |    556933 |   28436   163002   551599 |        1    84698     80 |  0.225 % |
1113.21/1113.27	c |    561122 |   28436   163002   551599 |        1    88887     83 |  0.225 % |
1113.21/1113.27	c |    561753 |   28436   163002   551599 |        1    89518     83 |  0.225 % |
1113.21/1113.27	c |    561855 |   28436   163002   551599 |        1    89620     83 |  0.225 % |
1113.21/1113.27	c |    561956 |   28436   163002   551599 |        1    89721     83 |  0.225 % |
1113.21/1113.27	c |    562057 |   28436   163002   551599 |        1    89822     83 |  0.225 % |
1113.21/1113.27	c |    562158 |   28436   163002   551599 |        1    89923     83 |  0.225 % |
1113.21/1113.27	c |    562751 |   28436   163002   551599 |        1    90516     84 |  0.225 % |
1113.21/1113.27	c |    563735 |   28436   163002   551599 |        1    91500     84 |  0.225 % |
1113.21/1113.27	c |    566106 |   28436   163002   551599 |        1    93871     86 |  0.225 % |
1113.21/1113.27	c |    575360

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3282594-1303753091/watcher-3282594-1303753091 -o /tmp/evaluation-result-3282594-1303753091/solver-3282594-1303753091 -C 2400 -W 1300 -M 7680 glucose.sh HOME/instance-3282594-1303753091.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 3.58 3.37 4/192 4501
/proc/meminfo: memFree=13074768/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) R 4499 4501 3507 0 -1 4202496 317 0 0 0 0 0 0 0 25 0 1 0 565539786 8912896 253 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895310741 0 65538 4100 65536 0 0 0 17 4 0 0 0
/proc/4501/statm: 2176 253 211 178 0 69 0

[startup+0.0957739 s]
/proc/loadavg: 3.99 3.58 3.37 4/192 4501
/proc/meminfo: memFree=13074768/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 334 0 0 0 0 0 0 0 25 0 1 0 565539786 8912896 253 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/4501/statm: 2176 253 211 178 0 69 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8704

[startup+0.100753 s]
/proc/loadavg: 3.99 3.58 3.37 4/192 4501
/proc/meminfo: memFree=13074768/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 334 0 0 0 0 0 0 0 25 0 1 0 565539786 8912896 253 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/4501/statm: 2176 253 211 178 0 69 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8704

[startup+0.300719 s]
/proc/loadavg: 3.99 3.58 3.37 4/192 4501
/proc/meminfo: memFree=13074768/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 334 0 0 0 0 0 0 0 25 0 1 0 565539786 8912896 253 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/4501/statm: 2176 253 211 178 0 69 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8704

[startup+0.700585 s]
/proc/loadavg: 3.99 3.58 3.37 4/192 4501
/proc/meminfo: memFree=13074768/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 8704

[startup+1.5005 s]
/proc/loadavg: 3.99 3.58 3.37 5/194 4504
/proc/meminfo: memFree=13047960/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=31148 CPUtime=0.89 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 4541 0 0 0 89 0 0 0 25 0 1 0 565539845 31895552 4222 33554432000 4194304 4260849 140736684591136 18446744073709551615 4225124 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 7787 4222 250 17 0 4428 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 39852

[startup+3.10119 s]
/proc/loadavg: 3.99 3.58 3.37 5/194 4505
/proc/meminfo: memFree=13013116/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=31408 CPUtime=2.5 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 4733 0 0 0 249 1 0 0 25 0 1 0 565539845 32161792 4409 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224428 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 7852 4409 250 17 0 4493 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 40112

[startup+6.30059 s]
/proc/loadavg: 3.99 3.58 3.37 5/194 4505
/proc/meminfo: memFree=13001208/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=34292 CPUtime=5.69 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 5003 0 0 0 568 1 0 0 25 0 1 0 565539845 35115008 4676 33554432000 4194304 4260849 140736684591136 18446744073709551615 4209368 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 8573 4676 250 17 0 5214 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 42996

[startup+12.7004 s]
/proc/loadavg: 3.99 3.60 3.37 5/194 4505
/proc/meminfo: memFree=13018336/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=34424 CPUtime=12.09 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 6751 0 0 0 1208 1 0 0 25 0 1 0 565539845 35250176 4857 33554432000 4194304 4260849 140736684591136 18446744073709551615 4226718 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 8606 4857 251 17 0 5247 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 43128

[startup+25.501 s]
/proc/loadavg: 3.99 3.61 3.38 5/194 4505
/proc/meminfo: memFree=13061604/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=34852 CPUtime=24.9 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 9136 0 0 0 2488 2 0 0 25 0 1 0 565539845 35688448 5099 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224658 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 8713 5099 251 17 0 5354 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 43556

[startup+51.1012 s]
/proc/loadavg: 3.99 3.64 3.40 5/194 4509
/proc/meminfo: memFree=13019684/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=53296 CPUtime=50.49 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 13896 0 0 0 5046 3 0 0 25 0 1 0 565539845 54575104 9682 33554432000 4194304 4260849 140736684591136 18446744073709551615 4209242 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 13324 9682 251 17 0 9965 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 62000

[startup+102.308 s]
/proc/loadavg: 4.04 3.71 3.43 5/194 4510
/proc/meminfo: memFree=12984728/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=60480 CPUtime=101.7 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 16064 0 0 0 10167 3 0 0 25 0 1 0 565539845 61931520 11676 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224779 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 15120 11676 251 17 0 11761 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 69184

[startup+162.301 s]
/proc/loadavg: 4.01 3.76 3.47 5/194 4512
/proc/meminfo: memFree=12959760/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=60480 CPUtime=161.69 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 16065 0 0 0 16166 3 0 0 25 0 1 0 565539845 61931520 11677 33554432000 4194304 4260849 140736684591136 18446744073709551615 4227007 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 15120 11677 252 17 0 11761 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 69184

[startup+222.301 s]
/proc/loadavg: 4.00 3.80 3.50 5/194 4513
/proc/meminfo: memFree=12958992/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=221.7 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 28353 0 0 0 22164 6 0 0 25 0 1 0 565539845 85766144 12427 33554432000 4194304 4260849 140736684591136 18446744073709551615 4209599 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 12427 252 17 0 17580 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 92460

[startup+282.301 s]
/proc/loadavg: 4.10 3.87 3.54 5/194 4515
/proc/meminfo: memFree=12983116/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=281.71 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 31241 0 0 0 28163 8 0 0 25 0 1 0 565539845 85766144 15299 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224331 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 15299 252 17 0 17580 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 92460

[startup+342.3 s]
/proc/loadavg: 4.03 3.89 3.56 5/194 4517
/proc/meminfo: memFree=12924316/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=341.71 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 31371 0 0 0 34163 8 0 0 25 0 1 0 565539845 85766144 15429 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224658 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 15429 252 17 0 17580 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 92460

[startup+402.301 s]
/proc/loadavg: 4.05 3.92 3.59 5/194 4518
/proc/meminfo: memFree=12917580/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6

################
# More data... #
################

/proc/4504/statm: 20939 16670 252 17 0 17580 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 92460

[startup+642.301 s]
/proc/loadavg: 4.00 3.95 3.67 5/194 4525
/proc/meminfo: memFree=12926992/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=641.72 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 32622 0 0 0 64164 8 0 0 25 0 1 0 565539845 85766144 16670 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224658 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 16670 252 17 0 17580 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 92460

[startup+702.3 s]
/proc/loadavg: 4.00 3.96 3.69 5/194 4526
/proc/meminfo: memFree=12944704/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=701.71 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 33062 0 0 0 70163 8 0 0 25 0 1 0 565539845 85766144 17109 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224665 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 17109 252 17 0 17580 0
Current children cumulated CPU time (s) 702.29
Current children cumulated vsize (KiB) 92460

[startup+762.307 s]
/proc/loadavg: 4.00 3.97 3.71 5/194 4528
/proc/meminfo: memFree=12937364/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=761.72 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 33468 0 0 0 76164 8 0 0 25 0 1 0 565539845 85766144 17513 33554432000 4194304 4260849 140736684591136 18446744073709551615 4209925 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 17513 252 17 0 17580 0
Current children cumulated CPU time (s) 762.3
Current children cumulated vsize (KiB) 92460

[startup+822.301 s]
/proc/loadavg: 4.03 3.98 3.73 5/194 4617
/proc/meminfo: memFree=13249904/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=821.72 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 41830 0 0 0 82162 10 0 0 25 0 1 0 565539845 85766144 17523 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224867 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 17523 252 17 0 17580 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 92460

[startup+882.3 s]
/proc/loadavg: 4.01 3.98 3.74 5/194 4621
/proc/meminfo: memFree=13214592/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=881.72 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 41830 0 0 0 88162 10 0 0 25 0 1 0 565539845 85766144 17523 33554432000 4194304 4260849 140736684591136 18446744073709551615 4227024 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 17523 252 17 0 17580 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 92460

[startup+942.301 s]
/proc/loadavg: 4.33 4.09 3.79 5/194 4682
/proc/meminfo: memFree=9306568/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=83756 CPUtime=941.72 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 50560 0 0 0 94161 11 0 0 25 0 1 0 565539845 85766144 17523 33554432000 4194304 4260849 140736684591136 18446744073709551615 4209358 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 20939 17523 252 17 0 17580 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 92460

[startup+1002.3 s]
/proc/loadavg: 4.20 4.10 3.81 5/190 4718
/proc/meminfo: memFree=11963036/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=133076 CPUtime=1001.73 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 59507 0 0 0 100160 13 0 0 25 0 1 0 565539845 136269824 26460 33554432000 4194304 4260849 140736684591136 18446744073709551615 4209368 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 33269 26460 252 17 0 29910 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 141780

[startup+1062.3 s]
/proc/loadavg: 3.99 4.06 3.82 5/190 4891
/proc/meminfo: memFree=12995824/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=95940 CPUtime=1061.73 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 61939 0 0 0 106159 14 0 0 25 0 1 0 565539845 98242560 19531 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224707 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 23985 19531 252 17 0 20626 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 104644

[startup+1122.3 s]
/proc/loadavg: 3.99 4.05 3.82 5/194 4930
/proc/meminfo: memFree=12692236/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=95940 CPUtime=1121.73 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 73183 0 0 0 112157 16 0 0 25 0 1 0 565539845 98242560 20569 33554432000 4194304 4260849 140736684591136 18446744073709551615 4226301 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 23985 20569 252 17 0 20626 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 104644

[startup+1182.3 s]
/proc/loadavg: 3.99 4.04 3.83 5/194 4932
/proc/meminfo: memFree=12597740/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=145260 CPUtime=1181.74 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 81473 0 0 0 118156 18 0 0 25 0 1 0 565539845 148746240 28852 33554432000 4194304 4260849 140736684591136 18446744073709551615 4225310 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 36315 28852 252 17 0 32956 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 153964

[startup+1242.3 s]
/proc/loadavg: 3.99 4.03 3.83 5/194 4934
/proc/meminfo: memFree=12639920/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=95940 CPUtime=1241.74 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 83681 0 0 0 124155 19 0 0 25 0 1 0 565539845 98242560 20569 33554432000 4194304 4260849 140736684591136 18446744073709551615 4226529 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 23985 20569 252 17 0 20626 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 104644



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.99 4.02 3.84 5/194 4935
/proc/meminfo: memFree=12601388/32950928 swapFree=67111528/67111528
[pid=4501] ppid=4499 vsize=8704 CPUtime=0.58 cores=4,6
/proc/4501/stat : 4501 (glucose.sh) S 4499 4501 3507 0 -1 4202496 360 9868 0 0 0 0 56 2 20 0 1 0 565539786 8912896 255 33554432000 4194304 4922060 140734564637088 18446744073709551615 231895309445 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/4501/statm: 2176 255 211 178 0 69 0
[pid=4504] ppid=4501 vsize=145260 CPUtime=1299.44 cores=4,6
/proc/4504/stat : 4504 (glucose_static) R 4501 4501 3507 0 -1 4202496 92831 0 0 0 129924 20 0 0 25 0 1 0 565539845 148746240 29714 33554432000 4194304 4260849 140736684591136 18446744073709551615 4224606 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4504/statm: 36315 29714 252 17 0 32956 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 153964

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4501 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=564914
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=29995
# CPU time returned by wait4() is 0.594909
# while last known CPU time is 1300.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.02
CPU user time (s): 1299.8
CPU system time (s): 0.22
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 153964

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.564914
system time used= 0.029995
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10228
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 3

runsolver used 2.33264 second user time and 4.77227 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-25 19:38:11
IDJOB=3282594
IDBENCH=70829
IDSOLVER=1651
FILE ID=node114/3282594-1303753091
RUNJOBID= node114-1303752609-4412
PBS_JOBID= 13154048
Free space on /tmp= 71608 MiB

SOLVER NAME= glucose 2
BENCH NAME= SAT09/APPLICATIONS/crypto/md5gen/gus-md5-12.cnf
COMMAND LINE= glucose.sh BENCHNAME 
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3282594-1303753091/watcher-3282594-1303753091 -o /tmp/evaluation-result-3282594-1303753091/solver-3282594-1303753091 -C 2400 -W 1300 -M 7680  glucose.sh HOME/instance-3282594-1303753091.cnf 

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 0621e557bffdc18ca509447665adecda
RANDOM SEED=1040653141

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13075040 kB
Buffers:       2308928 kB
Cached:       16569160 kB
SwapCached:          0 kB
Active:        9705756 kB
Inactive:      9578436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13075040 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            5212 kB
Writeback:           0 kB
AnonPages:      405120 kB
Mapped:          15332 kB
Slab:           524992 kB
PageTables:       6020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   651492 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71468 MiB
End job on node114 at 2011-04-25 19:59:53