Trace number 3733381

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver? 1789.87 1790.17

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/unibo/normalized-mps-v2-20-10-blp-ic98.opb
MD5SUMcbbc019f11b539634b02edfceafed9db
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1090626176
Best CPU time to get the best result obtained on this benchmark1800.08
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables15501
Total number of constraints763
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)627
Number of constraints which are nor clauses,nor cardinality constraints136
Minimum length of a constraint8
Maximum length of a constraint13581
Number of terms in the objective function 31
Biggest coefficient in the objective function 1073741824
Number of bits for the biggest coefficient in the objective function 31
Sum of the numbers in the objective function 2147483647
Number of bits of the sum of numbers in the objective function 31
Biggest number in a constraint 83886080000000
Number of bits of the biggest number in a constraint 47
Biggest sum of numbers in a constraint 783292842349555
Number of bits of the biggest sum of numbers50
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 1.2.1.3 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.4.2]
0.00/0.00	c Copyright (c) 2002-2010 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3733381-1338696743.opb>
0.19/0.20	c original problem has 15501 variables (15501 bin, 0 int, 0 impl, 0 cont) and 763 constraints
0.19/0.20	c problem read
0.19/0.20	c presolving settings loaded
0.19/0.28	c presolving:
0.29/0.38	c (round 1) 323 del vars, 0 del conss, 233 chg bounds, 63 chg sides, 63 chg coeffs, 0 upgd conss, 0 impls, 627 clqs
0.29/0.38	c (round 2) 323 del vars, 0 del conss, 233 chg bounds, 126 chg sides, 126 chg coeffs, 0 upgd conss, 0 impls, 627 clqs
0.39/0.40	c (round 3) 323 del vars, 0 del conss, 233 chg bounds, 126 chg sides, 126 chg coeffs, 673 upgd conss, 0 impls, 627 clqs
0.39/0.41	c (round 4) 323 del vars, 0 del conss, 233 chg bounds, 172 chg sides, 710 chg coeffs, 673 upgd conss, 652 impls, 627 clqs
8.39/8.45	c    (8.2s) probing: 1000/15178 (6.6%) - 0 fixings, 0 aggregations, 1042 implications, 0 bound changes
15.39/15.48	c    (15.3s) probing: 2000/15178 (13.2%) - 0 fixings, 0 aggregations, 2095 implications, 0 bound changes
15.39/15.49	c    (15.3s) probing: 2001/15178 (13.2%) - 0 fixings, 0 aggregations, 2096 implications, 0 bound changes
15.39/15.49	c    (15.3s) probing aborted: 2000/2000 successive useless probings
15.39/15.49	c presolving (5 rounds):
15.39/15.49	c  323 deleted vars, 0 deleted constraints, 233 tightened bounds, 0 added holes, 172 changed sides, 710 changed coefficients
15.39/15.49	c  4844 implications, 627 cliques
15.39/15.49	c presolved problem has 15178 variables (15178 bin, 0 int, 0 impl, 0 cont) and 763 constraints
15.39/15.49	c      46 constraints of type <knapsack>
15.39/15.49	c     627 constraints of type <setppc>
15.39/15.49	c      90 constraints of type <linear>
15.39/15.49	c transformed objective value is always integral (scale: 2)
15.39/15.49	c Presolving Time: 15.23
15.39/15.49	c - non default parameters ----------------------------------------------------------------------
15.39/15.49	c # SCIP version 1.2.1.3
15.39/15.49	c 
15.39/15.49	c # frequency for displaying node information lines
15.39/15.49	c # [type: int, range: [-1,2147483647], default: 100]
15.39/15.49	c display/freq = 10000
15.39/15.49	c 
15.39/15.49	c # maximal time in seconds to run
15.39/15.49	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
15.39/15.49	c limits/time = 1789.81
15.39/15.49	c 
15.39/15.49	c # maximal memory usage in MB; reported memory usage is lower than real memory usage!
15.39/15.49	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
15.39/15.49	c limits/memory = 13950
15.39/15.49	c 
15.39/15.49	c # default clock type (1: CPU user seconds, 2: wall clock time)
15.39/15.49	c # [type: int, range: [1,2], default: 1]
15.39/15.49	c timing/clocktype = 2
15.39/15.49	c 
15.39/15.49	c # should presolving try to simplify inequalities
15.39/15.49	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
15.39/15.49	c constraints/linear/simplifyinequalities = TRUE
15.39/15.49	c 
15.39/15.49	c # add initial coupling inequalities as linear constraints, if 'addCoupling' is true
15.39/15.49	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
15.39/15.49	c constraints/indicator/addCouplingCons = TRUE
15.39/15.49	c 
15.39/15.49	c # should presolving try to simplify knapsacks
15.39/15.49	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
15.39/15.49	c constraints/knapsack/simplifyinequalities = TRUE
15.39/15.49	c 
15.39/15.49	c # frequency for calling separator <rapidlearning> (-1: never, 0: only in root node)
15.39/15.49	c # [type: int, range: [-1,2147483647], default: -1]
15.39/15.49	c separating/rapidlearning/freq = 0
15.39/15.49	c 
15.39/15.49	c -----------------------------------------------------------------------------------------------
15.39/15.49	c start solving
15.39/15.49	c 
15.68/15.71	c  time | node  | left  |LP iter|LP it/n| mem |mdpt |frac |vars |cons |cols |rows |cuts |confs|strbr|  dualbound   | primalbound  |  gap   
15.68/15.71	c  15.5s|     1 |     0 |   425 |     - |  56M|   0 |  74 |  15k| 763 |  15k| 763 |   0 |   0 |   0 | 1.078176e+09 |      --      |    Inf 
16.69/16.73	c  16.5s|     1 |     0 |  2048 |     - |  56M|   0 |  74 |  15k| 763 |  15k| 763 |   0 |   0 |   0 | 1.078176e+09 |      --      |    Inf 
259.34/259.44	c   259s|     1 |     0 |  2122 |     - |  67M|   0 |  78 |  15k| 763 |  15k| 777 |  14 |   0 |   0 | 1.078180e+09 |      --      |    Inf 
498.30/498.47	c   498s|     1 |     0 |  2130 |     - |  67M|   0 |  81 |  15k| 763 |  15k| 785 |  22 |   0 |   0 | 1.078180e+09 |      --      |    Inf 
737.36/737.55	c   737s|     1 |     0 |  2136 |     - |  67M|   0 |  82 |  15k| 763 |  15k| 787 |  24 |   0 |   0 | 1.078180e+09 |      --      |    Inf 
977.53/977.73	c   978s|     1 |     2 |  2136 |     - |  67M|   0 |  82 |  15k| 763 |  15k| 787 |  24 |   0 |  21 | 1.078180e+09 |      --      |    Inf 
1789.69/1790.09	c 
1789.69/1790.09	c SCIP Status        : solving was interrupted [time limit reached]
1789.69/1790.09	c Solving Time (sec) : 1789.89
1789.69/1790.09	c Solving Nodes      : 4577
1789.69/1790.09	c Primal Bound       : +1.00000000000000e+20 (0 solutions)
1789.69/1790.09	c Dual Bound         : +1.07819280949430e+09
1789.69/1790.09	c Gap                : infinite
1789.69/1790.09	s UNKNOWN
1789.69/1790.09	c SCIP Status        : solving was interrupted [time limit reached]
1789.69/1790.09	c Solving Time       :    1789.89
1789.69/1790.09	c Original Problem   :
1789.69/1790.09	c   Problem name     : HOME/instance-3733381-1338696743.opb
1789.69/1790.09	c   Variables        : 15501 (15501 binary, 0 integer, 0 implicit integer, 0 continuous)
1789.69/1790.09	c   Constraints      : 763 initial, 763 maximal
1789.69/1790.09	c Presolved Problem  :
1789.69/1790.09	c   Problem name     : t_HOME/instance-3733381-1338696743.opb
1789.69/1790.09	c   Variables        : 15178 (15178 binary, 0 integer, 0 implicit integer, 0 continuous)
1789.69/1790.09	c   Constraints      : 763 initial, 3447 maximal
1789.69/1790.09	c Presolvers         :       Time  FixedVars   AggrVars   ChgTypes  ChgBounds   AddHoles    DelCons   ChgSides   ChgCoefs
1789.69/1790.09	c   trivial          :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   dualfix          :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   boundshift       :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   inttobinary      :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   implics          :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   probing          :      15.08          0          0          0          0          0          0          0          0
1789.69/1790.09	c   knapsack         :       0.00          0          0          0          0          0          0         46        584
1789.69/1790.09	c   setppc           :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   linear           :       0.11        323          0          0        233          0          0        126        126
1789.69/1790.09	c   logicor          :       0.00          0          0          0          0          0          0          0          0
1789.69/1790.09	c   root node        :          -          6          -          -          6          -          -          -          -
1789.69/1790.09	c Constraints        :     Number  #Separate #Propagate    #EnfoLP    #EnfoPS    Cutoffs    DomReds       Cuts      Conss   Children
1789.69/1790.09	c   integral         :          0          0          0       3841          0          0        160          0          0       7454
1789.69/1790.09	c   knapsack         :         46          4      51497          0          0          8       5766          0          0          0
1789.69/1790.09	c   setppc           :        627          4      51489          0          0          1      46925          0          0          0
1789.69/1790.09	c   linear           :         90          4      51488          0          0       2660    1541910         18          0          0
1789.69/1790.09	c   logicor          :          0+         0       6889          0          0         18       1289          0          0          0
1789.69/1790.09	c   countsols        :          0          0          0          0          0          0          0          0          0          0
1789.69/1790.09	c Constraint Timings :  TotalTime   Separate  Propagate     EnfoLP     EnfoPS
1789.69/1790.09	c   integral         :      68.30       0.00       0.00      68.30       0.00
1789.69/1790.09	c   knapsack         :       0.31       0.00       0.31       0.00       0.00
1789.69/1790.09	c   setppc           :       1.06       0.00       1.06       0.00       0.00
1789.69/1790.09	c   linear           :    1477.54     958.58     518.95       0.00       0.00
1789.69/1790.09	c   logicor          :       0.51       0.00       0.51       0.00       0.00
1789.69/1790.09	c   countsols        :       0.00       0.00       0.00       0.00       0.00
1789.69/1790.09	c Propagators        :       Time      Calls    Cutoffs    DomReds
1789.69/1790.09	c   vbounds          :       0.02          2          0          0
1789.69/1790.09	c   rootredcost      :       0.02          0          0          0
1789.69/1790.09	c   pseudoobj        :       0.10      45508          0          1
1789.69/1790.09	c Conflict Analysis  :       Time      Calls    Success  Conflicts   Literals    Reconvs ReconvLits   LP Iters
1789.69/1790.09	c   propagation      :     436.88       2435       2435      17124      696.5         11      587.1          -
1789.69/1790.09	c   infeasible LP    :      35.37        414        358       4006      778.1         17     1742.2          0
1789.69/1790.09	c   bound exceed. LP :       0.00          0          0          0        0.0          0        0.0          0
1789.69/1790.09	c   strong branching :       0.00          0          0          0        0.0          0        0.0          0
1789.69/1790.09	c   pseudo solution  :       0.00          0          0          0        0.0          0        0.0          -
1789.69/1790.09	c   applied globally :          -          -          -       6750      296.4          -          -          -
1789.69/1790.09	c   applied locally  :          -          -          -          0        0.0          -          -          -
1789.69/1790.09	c Separators         :       Time      Calls    Cutoffs    DomReds       Cuts      Conss
1789.69/1790.09	c   cut pool         :       0.00          3          -          -          1          -    (maximal pool size: 38)
1789.69/1790.09	c   redcost          :       2.48       3827          0          0          0          0
1789.69/1790.09	c   impliedbounds    :       0.00          4          0          0          0          0
1789.69/1790.09	c   intobj           :       0.00          0          0          0          0          0
1789.69/1790.09	c   cgmip            :       0.00          0          0          0          0          0
1789.69/1790.09	c   gomory           :       0.02          4          0          0          0          0
1789.69/1790.09	c   strongcg         :       0.02          4          0          0          1          0
1789.69/1790.09	c   cmir             :       0.06          4          0          0          6          0
1789.69/1790.09	c   flowcover        :       1.12          4          0          0         32          0
1789.69/1790.09	c   clique           :       0.01          4          0          0          0          0
1789.69/1790.09	c   zerohalf         :       0.00          0          0          0          0          0
1789.69/1790.09	c   mcf              :       0.00          1          0          0          0          0
1789.69/1790.09	c   rapidlearning    :       0.00          0          0          0          0          0
1789.69/1790.09	c Pricers            :       Time      Calls       Vars
1789.69/1790.09	c   problem variables:       0.00          0          0
1789.69/1790.09	c Branching Rules    :       Time      Calls    Cutoffs    DomReds       Cuts      Conss   Children
1789.69/1790.09	c   relpscost        :      68.29       3841          0        160          0          0       7454
1789.69/1790.09	c   pscost           :       0.00          0          0          0          0          0          0
1789.69/1790.09	c   inference        :       0.00          0          0          0          0          0          0
1789.69/1790.09	c   mostinf          :       0.00          0          0          0          0          0          0
1789.69/1790.09	c   leastinf         :       0.00          0          0          0          0          0          0
1789.69/1790.09	c   fullstrong       :       0.00          0          0          0          0          0          0
1789.69/1790.09	c   allfullstrong    :       0.00          0          0          0          0          0          0
1789.69/1790.09	c   random           :       0.00          0          0          0          0          0          0
1789.69/1790.09	c Primal Heuristics  :       Time      Calls      Found
1789.69/1790.09	c   LP solutions     :       0.00          -          0
1789.69/1790.09	c   pseudo solutions :       0.00          -          0
1789.69/1790.09	c   oneopt           :       0.00          0          0
1789.69/1790.09	c   crossover        :       0.00          0          0
1789.69/1790.09	c   linesearchdiving :     109.90         10          0
1789.69/1790.09	c   coefdiving       :      22.84         11          0
1789.69/1790.09	c   feaspump         :       3.36          8          0
1789.69/1790.09	c   fracdiving       :      49.57         19          0
1789.69/1790.09	c   pscostdiving     :      56.55         26          0
1789.69/1790.09	c   objpscostdiving  :       1.05         26          0
1789.69/1790.09	c   trivial          :       0.01          2          0
1789.69/1790.09	c   simplerounding   :       0.00          0          0
1789.69/1790.09	c   zirounding       :       0.06       1000          0
1789.69/1790.09	c   rounding         :       0.73        832          0
1789.69/1790.09	c   shifting         :       6.82        242          0
1789.69/1790.09	c   intshifting      :       0.00          0          0
1789.69/1790.09	c   twoopt           :       0.00          0          0
1789.69/1790.09	c   fixandinfer      :       0.00          0          0
1789.69/1790.09	c   veclendiving     :     233.83          6          0
1789.69/1790.09	c   intdiving        :       0.00          0          0
1789.69/1790.09	c   actconsdiving    :       0.00          0          0
1789.69/1790.09	c   rootsoldiving    :       3.68          2          0
1789.69/1790.09	c   guideddiving     :       0.00          0          0
1789.69/1790.09	c   octane           :       0.00          0          0
1789.69/1790.09	c   rens             :       0.15          1          0
1789.69/1790.09	c   rins             :       0.00          0          0
1789.69/1790.09	c   localbranching   :       0.00          0          0
1789.69/1790.09	c   mutation         :       0.00          0          0
1789.69/1790.09	c   dins             :       0.00          0          0
1789.69/1790.09	c   undercover       :       0.00          0          0
1789.69/1790.09	c   nlp              :       0.00          0          0
1789.69/1790.09	c   trysol           :       0.00          0          0
1789.69/1790.09	c LP                 :       Time      Calls Iterations  Iter/call   Iter/sec
1789.69/1790.09	c   primal LP        :       0.00          0          0       0.00          -
1789.69/1790.09	c   dual LP          :      67.69       3866     175349      45.36    2590.46
1789.69/1790.09	c   lex dual LP      :       0.00          0          0       0.00          -
1789.69/1790.09	c   barrier LP       :       0.00          0          0       0.00          -
1789.69/1790.09	c   diving/probing LP:      82.71      23352     108852       4.66    1316.02
1789.69/1790.09	c   strong branching :      68.12       5842     146720      25.11    2153.70
1789.69/1790.09	c     (at root node) :          -         21       1951      92.90          -
1789.69/1790.09	c   conflict analysis:       0.00          0          0       0.00          -
1789.69/1790.09	c B&B Tree           :
1789.69/1790.09	c   number of runs   :          1
1789.69/1790.09	c   nodes            :       4577
1789.69/1790.09	c   nodes (total)    :       4577
1789.69/1790.09	c   nodes left       :       2878
1789.69/1790.09	c   max depth        :         97
1789.69/1790.09	c   max depth (total):         97
1789.69/1790.09	c   backtracks       :        143 (3.1%)
1789.69/1790.09	c   delayed cutoffs  :          0
1789.69/1790.09	c   repropagations   :       9330 (830 domain reductions, 0 cutoffs)
1789.69/1790.09	c   avg switch length:       5.97
1789.69/1790.09	c   switching time   :       2.79
1789.69/1790.09	c Solution           :
1789.69/1790.09	c   Solutions found  :          0 (0 improvements)
1789.69/1790.09	c   Primal Bound     :          -
1789.69/1790.09	c   Dual Bound       : +1.07819280949430e+09
1789.69/1790.09	c   Gap              :   infinite
1789.69/1790.09	c   Root Dual Bound  : +1.07818029052218e+09
1789.69/1790.09	c   Root Iterations  :       2136
1789.79/1790.17	c Time complete: 1789.86.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3733381-1338696743/watcher-3733381-1338696743 -o /tmp/evaluation-result-3733381-1338696743/solver-3733381-1338696743 -C 1800 -W 1900 -M 15500 HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3733381-1338696743.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10941
/proc/meminfo: memFree=26228384/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=9972 CPUtime=0 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 1538 0 0 0 0 0 0 0 20 0 1 0 335799745 10211328 1485 33554432000 4194304 8395647 140736244793152 140733208895896 7382157 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/10941/statm: 2493 1499 374 1026 0 1463 0

[startup+0.057459 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10941
/proc/meminfo: memFree=26228384/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=21460 CPUtime=0.04 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 4586 0 0 0 4 0 0 0 20 0 1 0 335799745 21975040 4533 33554432000 4194304 8395647 140736244793152 140733208895896 6766224 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/10941/statm: 5365 4533 393 1026 0 4335 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 21460

[startup+0.100209 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10941
/proc/meminfo: memFree=26228384/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=22484 CPUtime=0.09 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 4766 0 0 0 9 0 0 0 20 0 1 0 335799745 23023616 4713 33554432000 4194304 8395647 140736244793152 140733208895896 5758032 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/10941/statm: 5621 4713 394 1026 0 4591 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 22484

[startup+0.300212 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10941
/proc/meminfo: memFree=26228384/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=63808 CPUtime=0.29 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 14951 0 0 0 27 2 0 0 20 0 1 0 335799745 65339392 14539 33554432000 4194304 8395647 140736244793152 140736244790712 4684092 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/10941/statm: 15952 14539 465 1026 0 14922 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63808

[startup+0.700159 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10941
/proc/meminfo: memFree=26228384/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=67156 CPUtime=0.69 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 15807 0 0 0 67 2 0 0 20 0 1 0 335799745 68767744 15323 33554432000 4194304 8395647 140736244793152 140736244790712 5027348 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/10941/statm: 16789 15323 498 1026 0 15759 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 67156

[startup+1.50015 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26169204/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=67156 CPUtime=1.49 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 15822 0 0 0 147 2 0 0 20 0 1 0 335799745 68767744 15338 33554432000 4194304 8395647 140736244793152 140736244788952 5006496 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/10941/statm: 16789 15338 498 1026 0 15759 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 67156

[startup+3.10026 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26168584/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=67156 CPUtime=3.09 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 15825 0 0 0 307 2 0 0 20 0 1 0 335799745 68767744 15341 33554432000 4194304 8395647 140736244793152 140736244788952 5026402 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 16789 15341 498 1026 0 15759 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 67156

[startup+6.30015 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26165060/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=67156 CPUtime=6.29 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 15830 0 0 0 627 2 0 0 20 0 1 0 335799745 68767744 15346 33554432000 4194304 8395647 140736244793152 140736244788952 5005879 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 16789 15346 498 1026 0 15759 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 67156

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26165076/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=67584 CPUtime=12.69 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 15955 0 0 0 1267 2 0 0 20 0 1 0 335799745 69206016 15471 33554432000 4194304 8395647 140736244793152 140736244788088 5005864 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 16896 15471 504 1026 0 15866 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 67584

[startup+25.5002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26131348/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=107144 CPUtime=25.49 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 25741 0 0 0 2545 4 0 0 20 0 1 0 335799745 109715456 24114 33554432000 4194304 8395647 140736244793152 140736244786696 6013877 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 26786 24114 592 1026 0 25756 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 107144

[startup+51.1001 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26123588/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=111716 CPUtime=51.08 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 26885 0 0 0 5104 4 0 0 20 0 1 0 335799745 114397184 25502 33554432000 4194304 8395647 140736244793152 140736244786696 6013877 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 27929 25502 593 1026 0 26899 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 111716

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10942
/proc/meminfo: memFree=26115148/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=111716 CPUtime=102.27 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 26950 0 0 0 10223 4 0 0 20 0 1 0 335799745 114397184 26663 33554432000 4194304 8395647 140736244793152 140736244786696 6013893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 27929 26663 593 1026 0 26899 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 111716

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10943
/proc/meminfo: memFree=26088352/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=113812 CPUtime=162.26 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 27462 0 0 0 16222 4 0 0 20 0 1 0 335799745 116543488 27175 33554432000 4194304 8395647 140736244793152 140736244786696 6013893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 28453 27175 593 1026 0 27423 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 113812

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10943
/proc/meminfo: memFree=26104040/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=113956 CPUtime=222.25 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 27495 0 0 0 22221 4 0 0 20 0 1 0 335799745 116690944 27414 33554432000 4194304 8395647 140736244793152 140736244786696 6013877 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 28489 27414 593 1026 0 27459 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 113956

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10943
/proc/meminfo: memFree=26089216/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=127924 CPUtime=282.23 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 29627 0 0 0 28219 4 0 0 20 0 1 0 335799745 130994176 30567 33554432000 4194304 8395647 140736244793152 140736244787768 6013893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 31981 30567 619 1026 0 30951 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 127924

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10943
/proc/meminfo: memFree=26063428/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=127924 CPUtime=342.22 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 29627 0 0 0 34218 4 0 0 20 0 1 0 335799745 130994176 30567 33554432000 4194304 8395647 140736244793152 140736244787768 6013880 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 31981 30567 619 1026 0 30951 0
Current children cumulated CPU time (s) 342.22
Current children cumulated vsize (KiB) 127924

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10943
/proc/meminfo: memFree=26078976/32873648 swapFree=6868/6868
[pid=10941] ppid=10939 vsize=127924 CPUtime=402.21 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 29628 0 0 0 40217 4 0 0 20 0 1 0 335799745 130994176 30723 33554432000 4194304 8395647 140736244793152 140736244787768 4299034 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 31981 30723 619 1026 0 30951 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 127924

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10946
/proc/meminfo: memFree=26072864/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=127924 CPUtime=462.2 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 29628 0 0 0 46216 4 0 0 20 0 1 0 335799745 130994176 30723 33554432000 4194304 8395647 140736244793152 140736244787768 6013893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 31981 30723 619 1026 0 30951 0
Current children cumulated CPU time (s) 462.2
Current children cumulated vsize (KiB) 127924

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10947
/proc/meminfo: memFree=26070048/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=128076 CPUtime=522.19 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 29762 0 0 0 52215 4 0 0 20 0 1 0 335799745 131149824 30857 33554432000 4194304 8395647 140736244793152 140736244787768 6013893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 32019 30857 619 1026 0 30989 0
Current children cumulated CPU time (s) 522.19
Current children cumulated vsize (KiB) 128076

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10947
/proc/meminfo: memFree=26066824/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=128076 CPUtime=582.18 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 29762 0 0 0 58214 4 0 0 20 0 1 0 335799745 131149824 30857 33554432000 4194304 8395647 140736244793152 140736244787768 6013893 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 32019 30857 619 1026 0 30989 0
Current children cumulated CPU time (s) 582.18
Current children cumulated vsize (KiB) 128076

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=26131824/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=133636 CPUtime=1002.11 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 43814 0 0 0 100195 16 0 0 20 0 1 0 335799745 136843264 32113 33554432000 4194304 8395647 140736244793152 140736244788456 7428202 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 33409 32113 638 1026 0 32379 0
Current children cumulated CPU time (s) 1002.11
Current children cumulated vsize (KiB) 133636

[startup+1062.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 11066
/proc/meminfo: memFree=26059576/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=149188 CPUtime=1062.11 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 47632 0 0 0 106187 24 0 0 20 0 1 0 335799745 152768512 35931 33554432000 4194304 8395647 140736244793152 140736244788872 5025147 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 37297 35931 638 1026 0 36267 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 149188

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11067
/proc/meminfo: memFree=25998424/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=164980 CPUtime=1122.1 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 51548 0 0 0 112180 30 0 0 20 0 1 0 335799745 168939520 39847 33554432000 4194304 8395647 140736244793152 140736244788696 7428202 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 41245 39847 638 1026 0 40215 0
Current children cumulated CPU time (s) 1122.1
Current children cumulated vsize (KiB) 164980

[startup+1182.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 11067
/proc/meminfo: memFree=25932836/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=176704 CPUtime=1182.09 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 54529 0 0 0 118169 40 0 0 20 0 1 0 335799745 180944896 42902 33554432000 4194304 8395647 140736244793152 140736244788872 6028415 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 44176 42902 736 1026 0 43146 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 176704

[startup+1242.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 11067
/proc/meminfo: memFree=25862028/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=186232 CPUtime=1242.08 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 56916 0 0 0 124159 49 0 0 20 0 1 0 335799745 190701568 45362 33554432000 4194304 8395647 140736244793152 140736244788760 7428202 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 46558 45362 736 1026 0 45528 0
Current children cumulated CPU time (s) 1242.08
Current children cumulated vsize (KiB) 186232

[startup+1302.3 s]
/proc/loadavg: 2.11 2.03 2.01 3/177 11067
/proc/meminfo: memFree=25792724/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=196464 CPUtime=1302.08 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 59391 0 0 0 130150 58 0 0 20 0 1 0 335799745 201179136 47837 33554432000 4194304 8395647 140736244793152 140736244788872 5024839 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 49116 47837 736 1026 0 48086 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 196464

[startup+1362.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 11067
/proc/meminfo: memFree=25729840/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=208916 CPUtime=1362.06 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 62408 0 0 0 136137 69 0 0 20 0 1 0 335799745 213929984 50854 33554432000 4194304 8395647 140736244793152 140736244788712 7428202 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 52229 50854 736 1026 0 51199 0
Current children cumulated CPU time (s) 1362.06
Current children cumulated vsize (KiB) 208916

[startup+1422.31 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 11068
/proc/meminfo: memFree=25667524/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=218952 CPUtime=1422.06 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 64938 0 0 0 142129 77 0 0 20 0 1 0 335799745 224206848 53384 33554432000 4194304 8395647 140736244793152 140736244788872 5005871 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 54738 53384 737 1026 0 53708 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 218952

[startup+1482.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 11068
/proc/meminfo: memFree=25628988/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=221604 CPUtime=1482.04 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 65582 0 0 0 148127 77 0 0 20 0 1 0 335799745 226922496 54028 33554432000 4194304 8395647 140736244793152 140736244788872 5024807 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 55401 54028 737 1026 0 54371 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 221604

[startup+1542.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 11068
/proc/meminfo: memFree=25583256/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=225088 CPUtime=1542.03 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 66466 0 0 0 154125 78 0 0 20 0 1 0 335799745 230490112 54912 33554432000 4194304 8395647 140736244793152 140736244788872 5024855 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 56272 54912 737 1026 0 55242 0
Current children cumulated CPU time (s) 1542.03
Current children cumulated vsize (KiB) 225088

[startup+1602.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 11068
/proc/meminfo: memFree=25522144/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=238488 CPUtime=1602.02 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 69756 0 0 0 160121 81 0 0 20 0 1 0 335799745 244211712 58203 33554432000 4194304 8395647 140736244793152 140736244788760 6028086 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 59622 58203 737 1026 0 58592 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 238488

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 11071
/proc/meminfo: memFree=25472036/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=247232 CPUtime=1662.01 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 71944 0 0 0 166116 85 0 0 20 0 1 0 335799745 253165568 60596 33554432000 4194304 8395647 140736244793152 140736244788712 7428202 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 61808 60596 737 1026 0 60778 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 247232

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25468408/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250112 CPUtime=1722 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72681 0 0 0 172113 87 0 0 20 0 1 0 335799745 256114688 61333 33554432000 4194304 8395647 140736244793152 140736244788872 4786350 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62528 61333 737 1026 0 61498 0
Current children cumulated CPU time (s) 1722
Current children cumulated vsize (KiB) 250112

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25465700/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250256 CPUtime=1781.99 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72709 0 0 0 178111 88 0 0 20 0 1 0 335799745 256262144 61361 33554432000 4194304 8395647 140736244793152 140736244788872 4474282 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62564 61361 737 1026 0 61534 0
Current children cumulated CPU time (s) 1781.99
Current children cumulated vsize (KiB) 250256

Solver just ended. Dumping a history of the last processes samples

[startup+1785.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25465704/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250256 CPUtime=1785.19 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72709 0 0 0 178431 88 0 0 20 0 1 0 335799745 256262144 61361 33554432000 4194304 8395647 140736244793152 140736244788872 6028107 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62564 61361 737 1026 0 61534 0
Current children cumulated CPU time (s) 1785.19
Current children cumulated vsize (KiB) 250256

[startup+1788.7 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25465704/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250256 CPUtime=1788.39 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72709 0 0 0 178751 88 0 0 20 0 1 0 335799745 256262144 61361 33554432000 4194304 8395647 140736244793152 140736244788872 5024677 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62564 61361 737 1026 0 61534 0
Current children cumulated CPU time (s) 1788.39
Current children cumulated vsize (KiB) 250256

[startup+1789.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25465704/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250256 CPUtime=1789.19 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72709 0 0 0 178831 88 0 0 20 0 1 0 335799745 256262144 61361 33554432000 4194304 8395647 140736244793152 140736244788872 6028175 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62564 61361 737 1026 0 61534 0
Current children cumulated CPU time (s) 1789.19
Current children cumulated vsize (KiB) 250256

[startup+1789.9 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25465704/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250256 CPUtime=1789.59 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72709 0 0 0 178871 88 0 0 20 0 1 0 335799745 256262144 61361 33554432000 4194304 8395647 140736244793152 140736244788872 6003107 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62564 61361 737 1026 0 61534 0
Current children cumulated CPU time (s) 1789.59
Current children cumulated vsize (KiB) 250256

[startup+1790.1 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11072
/proc/meminfo: memFree=25465704/32873648 swapFree=6864/6864
[pid=10941] ppid=10939 vsize=250256 CPUtime=1789.79 cores=0,2,4,6
/proc/10941/stat : 10941 (pbscip.linux.x8) R 10939 10941 7869 0 -1 4202496 72711 0 0 0 178891 88 0 0 20 0 1 0 335799745 256262144 61363 33554432000 4194304 8395647 140736244793152 140736244788872 4995709 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/10941/statm: 62564 61363 739 1026 0 61534 0
Current children cumulated CPU time (s) 1789.79
Current children cumulated vsize (KiB) 250256

Child status: 0
Real time (s): 1790.17
CPU time (s): 1789.87
CPU user time (s): 1788.98
CPU system time (s): 0.885865
CPU usage (%): 99.9829
Max. virtual memory (cumulated for all children) (KiB): 250256

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1788.98
system time used= 0.885865
maximum resident set size= 245452
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 72712
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 2084

runsolver used 2.6216 second user time and 7.15191 second system time

The end

Launcher Data 

Begin job on node125 at 2012-06-03 06:12:23
IDJOB=3733381
IDBENCH=2366
IDSOLVER=2326
FILE ID=node125/3733381-1338696743
RUNJOBID= node125-1338678622-7888
PBS_JOBID= 14636688
Free space on /tmp= 70428 MiB

SOLVER NAME= PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/unibo/normalized-mps-v2-20-10-blp-ic98.opb
COMMAND LINE= HOME/pbscip.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3733381-1338696743/watcher-3733381-1338696743 -o /tmp/evaluation-result-3733381-1338696743/solver-3733381-1338696743 -C 1800 -W 1900 -M 15500  HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3733381-1338696743.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cbbc019f11b539634b02edfceafed9db
RANDOM SEED=1858531461

node125.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26228648 kB
Buffers:          604644 kB
Cached:          5042548 kB
SwapCached:         2308 kB
Active:          2578080 kB
Inactive:        3162996 kB
Active(anon):      85304 kB
Inactive(anon):     9240 kB
Active(file):    2492776 kB
Inactive(file):  3153756 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67102524 kB
Dirty:             12852 kB
Writeback:             0 kB
AnonPages:        102828 kB
Mapped:            17432 kB
Shmem:                96 kB
Slab:             766680 kB
SReclaimable:     210648 kB
SUnreclaim:       556032 kB
KernelStack:        1480 kB
PageTables:         4344 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     209768 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     73728 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70420 MiB
End job on node125 at 2012-06-03 06:42:13