Trace number 3741545

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)? (TO) 1800.14 1800.43

General information on the benchmark

Name/OPT-SMALLINT-LIN/
heinz/normalized-ns894788.opb
MD5SUMca3efe2da0610ce6a80a42a3887418e6
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark7
Best CPU time to get the best result obtained on this benchmark180.313
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables3463
Total number of constraints2279
Number of constraints which are clauses678
Number of constraints which are cardinality constraints (but not clauses)145
Number of constraints which are nor clauses,nor cardinality constraints1456
Minimum length of a constraint1
Maximum length of a constraint97
Number of terms in the objective function 7
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 7
Number of bits of the sum of numbers in the objective function 3
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 97
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.02	c SCIP version 1.1.0.7
0.00/0.02	c LP-Solver SoPlex 1.4.1
0.00/0.02	c user parameter file <scip.set> not found - using default parameters
0.00/0.02	c read problem <HOME/instance-3741545-1338773171.opb>
0.00/0.02	c original problem has 3463 variables (3463 bin, 0 int, 0 impl, 0 cont) and 2279 constraints
0.00/0.03	c start presolving problem
0.00/0.03	c presolving:
0.04/0.04	c (round 1) 950 del vars, 586 del conss, 950 chg bounds, 0 chg sides, 0 chg coeffs, 0 upgd conss, 3240 impls, 1136 clqs
0.04/0.05	c (round 2) 1147 del vars, 717 del conss, 1112 chg bounds, 0 chg sides, 0 chg coeffs, 0 upgd conss, 3270 impls, 1083 clqs
0.04/0.05	c (round 3) 1175 del vars, 753 del conss, 1127 chg bounds, 0 chg sides, 0 chg coeffs, 0 upgd conss, 3270 impls, 1079 clqs
0.04/0.05	c (round 4) 1175 del vars, 754 del conss, 1127 chg bounds, 0 chg sides, 0 chg coeffs, 0 upgd conss, 3270 impls, 1079 clqs
0.04/0.08	c (round 5) 1175 del vars, 1152 del conss, 1127 chg bounds, 398 chg sides, 0 chg coeffs, 0 upgd conss, 3270 impls, 1079 clqs
0.04/0.08	c (round 6) 1207 del vars, 1152 del conss, 1127 chg bounds, 398 chg sides, 0 chg coeffs, 0 upgd conss, 3270 impls, 1079 clqs
0.04/0.08	c (round 7) 1207 del vars, 1152 del conss, 1127 chg bounds, 430 chg sides, 0 chg coeffs, 0 upgd conss, 3270 impls, 1079 clqs
0.04/0.08	c (round 8) 1333 del vars, 1200 del conss, 1127 chg bounds, 430 chg sides, 0 chg coeffs, 0 upgd conss, 3304 impls, 1017 clqs
0.04/0.08	c (round 9) 1344 del vars, 1200 del conss, 1127 chg bounds, 430 chg sides, 0 chg coeffs, 0 upgd conss, 3304 impls, 1017 clqs
0.04/0.08	c (round 10) 1344 del vars, 1200 del conss, 1127 chg bounds, 441 chg sides, 0 chg coeffs, 0 upgd conss, 3304 impls, 1017 clqs
0.04/0.08	c (round 11) 1383 del vars, 1216 del conss, 1127 chg bounds, 441 chg sides, 0 chg coeffs, 0 upgd conss, 3316 impls, 996 clqs
0.04/0.08	c (round 12) 1386 del vars, 1216 del conss, 1127 chg bounds, 441 chg sides, 0 chg coeffs, 0 upgd conss, 3316 impls, 996 clqs
0.04/0.08	c (round 13) 1386 del vars, 1216 del conss, 1127 chg bounds, 444 chg sides, 0 chg coeffs, 0 upgd conss, 3316 impls, 996 clqs
0.04/0.09	c (round 14) 1396 del vars, 1219 del conss, 1127 chg bounds, 444 chg sides, 0 chg coeffs, 0 upgd conss, 3320 impls, 992 clqs
0.04/0.09	c (round 15) 1396 del vars, 1219 del conss, 1127 chg bounds, 444 chg sides, 0 chg coeffs, 1060 upgd conss, 3320 impls, 992 clqs
0.09/0.10	c (round 16) 1396 del vars, 1297 del conss, 1127 chg bounds, 444 chg sides, 0 chg coeffs, 1060 upgd conss, 3320 impls, 992 clqs
0.29/0.36	c    (0.3s) probing: 1000/2067 (48.4%) - 17 fixings, 0 aggregations, 38937 implications, 0 bound changes
0.49/0.56	c    (0.5s) probing: 2000/2067 (96.8%) - 18 fixings, 0 aggregations, 53109 implications, 1 bound changes
0.49/0.57	c (round 17) 1414 del vars, 1297 del conss, 1128 chg bounds, 444 chg sides, 0 chg coeffs, 1060 upgd conss, 133809 impls, 987 clqs
0.49/0.58	c (round 18) 1414 del vars, 1301 del conss, 1128 chg bounds, 444 chg sides, 0 chg coeffs, 1060 upgd conss, 133809 impls, 987 clqs
0.49/0.58	c presolving (19 rounds):
0.49/0.58	c  1414 deleted vars, 1301 deleted constraints, 1128 tightened bounds, 0 added holes, 444 changed sides, 0 changed coefficients
0.49/0.58	c  133809 implications, 987 cliques
0.49/0.58	c presolved problem has 2049 variables (2049 bin, 0 int, 0 impl, 0 cont) and 978 constraints
0.49/0.58	c     913 constraints of type <setppc>
0.49/0.58	c      65 constraints of type <logicor>
0.49/0.58	c transformed objective value is always integral (scale: 1)
0.49/0.58	c Presolving Time: 0.53
0.49/0.58	c OPT-LIN
0.49/0.58	c -----------------------------------------------------------------------------------------------
0.49/0.58	c # maximal memory usage in MB; reported memory usage is lower than real memory usage!
0.49/0.58	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
0.49/0.58	c limits/memory = c 13950
0.49/0.58	c # maximal time in seconds to run
0.49/0.58	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
0.49/0.58	c limits/time = c 1791
0.49/0.58	c # frequency for displaying node information lines
0.49/0.58	c # [type: int, range: [-1,2147483647], default: 100]
0.49/0.58	c display/freq = c 10000
0.49/0.58	c -----------------------------------------------------------------------------------------------
0.49/0.58	c start solving problem
0.49/0.58	c 
0.79/0.89	c  time | node  | left  |LP iter| mem |mdpt |frac |vars |cons |ccons|cols |rows |cuts |confs|strbr|  dualbound   | primalbound  |  gap   
0.79/0.89	c   0.8s|     1 |     0 |  2438 |  13M|   0 | 392 |2049 | 978 | 978 |2049 | 978 |   0 |   0 |   0 | 6.328049e+00 |      --      |    Inf 
2.19/2.23	c   2.2s|     1 |     0 |  8717 |  13M|   0 | 539 |2049 | 976 | 976 |2049 | 978 |   0 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
3.09/3.16	c   3.1s|     1 |     0 |  9344 |  24M|   0 | 557 |2049 | 976 | 976 |2049 |1010 |  32 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
3.29/3.37	c   3.3s|     1 |     0 |  9846 |  24M|   0 | 503 |2049 | 976 | 976 |2049 |1026 |  48 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
3.49/3.56	c   3.5s|     1 |     0 | 10297 |  24M|   0 | 514 |2049 | 976 | 976 |2049 |1042 |  64 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
3.69/3.75	c   3.7s|     1 |     0 | 10714 |  24M|   0 | 550 |2049 | 976 | 976 |2049 |1054 |  76 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
3.89/3.90	c   3.8s|     1 |     0 | 10976 |  24M|   0 | 562 |2049 | 976 | 976 |2049 |1063 |  85 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
3.99/4.07	c   4.0s|     1 |     0 | 11307 |  24M|   0 | 580 |2049 | 976 | 976 |2049 |1072 |  94 |   0 |   0 | 7.000000e+00 |      --      |    Inf 
7.29/7.31	c   7.2s|     1 |     2 | 11307 |  24M|   0 | 580 |2049 | 976 | 976 |2049 |1072 |  94 |   0 |  17 | 7.000000e+00 |      --      |    Inf 
872.16/872.36	c   867s| 10000 |   162 |  2906k|  28M|  42 | 272 |2049 |5214 | 724 |2049 |1017 |  94 |6893 |3783 | 7.000000e+00 |      --      |    Inf 
1087.73/1087.99	c [src/scip/lpi_spx.cpp:265] Warning: SoPlex threw an exception: XSOLVE21 Basis is singular (numerical troubles, delta = 1e-06)
1658.83/1659.16	c [src/scip/lpi_spx.cpp:265] Warning: SoPlex threw an exception: XSOLVE21 Basis is singular (numerical troubles, delta = 1e-06)
1790.31/1790.61	c  1779s| 20000 |   154 |  6251k|  30M|  42 | 354 |2049 |9329 | 837 |2049 |1017 |  94 |  14k|6111 | 7.000000e+00 |      --      |    Inf 
1800.01/1800.40	c 
1800.01/1800.40	c SCIP Status        : solving was interrupted [user interrupt]
1800.01/1800.40	c Solving Time (sec) : 1788.89
1800.01/1800.40	c Solving Nodes      : 20086
1800.01/1800.40	c Primal Bound       : +1.00000000000000e+20 (0 solutions)
1800.01/1800.40	c Dual Bound         : +7.00000000000000e+00
1800.01/1800.40	c Gap                : infinite
1800.01/1800.40	c NODE         20086
1800.01/1800.40	c DUAL BOUND   7
1800.01/1800.40	c PRIMAL BOUND 1e+20
1800.01/1800.40	c GAP          1e+20
1800.01/1800.40	s UNKNOWN
1800.01/1800.40	c SCIP Status        : solving was interrupted [user interrupt]
1800.01/1800.40	c Solving Time       :    1788.89
1800.01/1800.40	c Original Problem   :
1800.01/1800.40	c   Problem name     : HOME/instance-3741545-1338773171.opb
1800.01/1800.40	c   Variables        : 3463 (3463 binary, 0 integer, 0 implicit integer, 0 continuous)
1800.01/1800.40	c   Constraints      : 2279 initial, 2279 maximal
1800.01/1800.40	c Presolved Problem  :
1800.01/1800.40	c   Problem name     : t_HOME/instance-3741545-1338773171.opb
1800.01/1800.40	c   Variables        : 2049 (2049 binary, 0 integer, 0 implicit integer, 0 continuous)
1800.01/1800.40	c   Constraints      : 978 initial, 9408 maximal
1800.01/1800.40	c Presolvers         :       Time  FixedVars   AggrVars   ChgTypes  ChgBounds   AddHoles    DelCons   ChgSides   ChgCoefs
1800.01/1800.40	c   trivial          :       0.00          0          0          0          0          0          0          0          0
1800.01/1800.40	c   dualfix          :       0.00        175          0          0          0          0          0          0          0
1800.01/1800.40	c   boundshift       :       0.00          0          0          0          0          0          0          0          0
1800.01/1800.40	c   inttobinary      :       0.00          0          0          0          0          0          0          0          0
1800.01/1800.40	c   implics          :       0.00          0          0          0          0          0          0          0          0
1800.01/1800.40	c   probing          :       0.46         18          0          0          1          0          0          0          0
1800.01/1800.40	c   setppc           :       0.00          0          0          0          0          0         78          0          0
1800.01/1800.40	c   linear           :       0.05       1127         94          0       1127          0       1219        444          0
1800.01/1800.40	c   logicor          :       0.00          0          0          0          0          0          4          0          0
1800.01/1800.40	c   root node        :          -          3          -          -          3          -          -          -          -
1800.01/1800.40	c Constraints        :     Number  #Separate #Propagate    #EnfoLP    #EnfoPS    Cutoffs    DomReds       Cuts      Conss   Children
1800.01/1800.40	c   integral         :          0          0          0      10864          0         60        974          0          0      20278
1800.01/1800.40	c   setppc           :        913          6     109667          0          0         48     579042          0          0          0
1800.01/1800.40	c   logicor          :         65+         6      27382          0          0         19      12818          0          0          0
1800.01/1800.40	c   countsols        :          0          0          0          0          0          0          0          0          0          0
1800.01/1800.40	c Constraint Timings :  TotalTime   Separate  Propagate     EnfoLP     EnfoPS
1800.01/1800.40	c   integral         :     516.00       0.00       0.00     516.00       0.00
1800.01/1800.40	c   setppc           :       1.73       0.00       1.73       0.00       0.00
1800.01/1800.40	c   logicor          :       0.78       0.00       0.78       0.00       0.00
1800.01/1800.40	c   countsols        :       0.00       0.00       0.00       0.00       0.00
1800.01/1800.40	c Propagators        :       Time      Calls    Cutoffs    DomReds
1800.01/1800.40	c   rootredcost      :       0.01          0          0          0
1800.01/1800.40	c   pseudoobj        :       0.03     101763          0          3
1800.01/1800.40	c Conflict Analysis  :       Time      Calls    Success  Conflicts   Literals    Reconvs ReconvLits   LP Iters
1800.01/1800.40	c   propagation      :       0.00         65         60        310       66.5          6        8.8          -
1800.01/1800.40	c   infeasible LP    :      13.62       9991       8203     169427      222.4         18       31.9          0
1800.01/1800.40	c   bound exceed. LP :       0.00          0          0          0        0.0          0        0.0          0
1800.01/1800.40	c   strong branching :       0.00          0          0          0        0.0          0        0.0          0
1800.01/1800.40	c   pseudo solution  :       0.00          0          0          0        0.0          0        0.0          -
1800.01/1800.40	c   applied globally :          -          -          -      14755       78.8          -          -          -
1800.01/1800.40	c   applied locally  :          -          -          -        122      299.0          -          -          -
1800.01/1800.40	c Separators         :       Time      Calls    Cutoffs    DomReds       Cuts      Conss
1800.01/1800.40	c   cut pool         :       0.02          5          -          -          5          -    (maximal pool size: 480)
1800.01/1800.40	c   redcost          :       0.32      10865          0          0          0          0
1800.01/1800.40	c   impliedbounds    :       0.01          6          0          0         80          0
1800.01/1800.40	c   intobj           :       0.00          0          0          0          0          0
1800.01/1800.40	c   gomory           :       0.35          6          0          0         50          0
1800.01/1800.40	c   strongcg         :       0.42          6          0          0        544          0
1800.01/1800.40	c   cmir             :       0.05          6          0          0          0          0
1800.01/1800.40	c   flowcover        :       0.05          6          0          0          0          0
1800.01/1800.40	c   clique           :       0.18          6          0          0         44          0
1800.01/1800.40	c   zerohalf         :       0.00          0          0          0          0          0
1800.01/1800.40	c   mcf              :       0.00          1          0          0          0          0
1800.01/1800.40	c Pricers            :       Time      Calls       Vars
1800.01/1800.40	c   problem variables:       0.00          0          0
1800.01/1800.40	c Branching Rules    :       Time      Calls    Cutoffs    DomReds       Cuts      Conss   Children
1800.01/1800.40	c   relpscost        :     516.00      10864         60        974          0          0      20278
1800.01/1800.40	c   pscost           :       0.00          0          0          0          0          0          0
1800.01/1800.40	c   inference        :       0.00          0          0          0          0          0          0
1800.01/1800.40	c   mostinf          :       0.00          0          0          0          0          0          0
1800.01/1800.40	c   leastinf         :       0.00          0          0          0          0          0          0
1800.01/1800.40	c   fullstrong       :       0.00          0          0          0          0          0          0
1800.01/1800.40	c   allfullstrong    :       0.00          0          0          0          0          0          0
1800.01/1800.40	c   random           :       0.00          0          0          0          0          0          0
1800.01/1800.40	c Primal Heuristics  :       Time      Calls      Found
1800.01/1800.40	c   LP solutions     :       0.00          -          0
1800.01/1800.40	c   pseudo solutions :       0.00          -          0
1800.01/1800.40	c   oneopt           :       0.00          0          0
1800.01/1800.40	c   crossover        :       0.00          0          0
1800.01/1800.40	c   guideddiving     :       0.00          0          0
1800.01/1800.40	c   pscostdiving     :       3.74         10          0
1800.01/1800.40	c   fracdiving       :       4.06         10          0
1800.01/1800.40	c   linesearchdiving :       1.87         10          0
1800.01/1800.40	c   veclendiving     :       8.33         10          0
1800.01/1800.40	c   coefdiving       :       5.37         11          0
1800.01/1800.40	c   rootsoldiving    :       2.39          6          0
1800.01/1800.40	c   feaspump         :       3.32          6          0
1800.01/1800.40	c   objpscostdiving  :       2.58          6          0
1800.01/1800.40	c   simplerounding   :       0.00          0          0
1800.01/1800.40	c   rounding         :       0.25       1411          0
1800.01/1800.40	c   shifting         :       0.19        458          0
1800.01/1800.40	c   intshifting      :       0.01          0          0
1800.01/1800.40	c   fixandinfer      :       0.00          0          0
1800.01/1800.40	c   intdiving        :       0.00          0          0
1800.01/1800.40	c   actconsdiving    :       0.00          0          0
1800.01/1800.40	c   octane           :       0.00          0          0
1800.01/1800.40	c   rens             :       0.34          1          0
1800.01/1800.40	c   rins             :       0.00          0          0
1800.01/1800.40	c   localbranching   :       0.00          0          0
1800.01/1800.40	c   mutation         :       0.00          0          0
1800.01/1800.40	c   dins             :       0.00          0          0
1800.01/1800.40	c LP                 :       Time      Calls Iterations  Iter/call   Iter/sec
1800.01/1800.40	c   primal LP        :       0.00          0          0       0.00          -
1800.01/1800.40	c   dual LP          :    1216.53      20713    6148322     296.83    5053.98
1800.01/1800.40	c   barrier LP       :       0.00          0          0       0.00          -
1800.01/1800.40	c   diving/probing LP:      29.85       5082     139877      27.52    4686.00
1800.01/1800.40	c   strong branching :     515.18       6129    2480940     404.79    4815.68
1800.01/1800.40	c     (at root node) :          -         17      10274     604.35          -
1800.01/1800.40	c   conflict analysis:       0.00          0          0       0.00          -
1800.01/1800.40	c B&B Tree           :
1800.01/1800.40	c   number of runs   :          1
1800.01/1800.40	c   nodes            :      20086
1800.01/1800.40	c   nodes (total)    :      20086
1800.01/1800.40	c   nodes left       :        140
1800.01/1800.40	c   max depth        :         42
1800.01/1800.40	c   max depth (total):         42
1800.01/1800.40	c   backtracks       :       4604 (22.9%)
1800.01/1800.40	c   delayed cutoffs  :         53
1800.01/1800.40	c   repropagations   :      14539 (103574 domain reductions, 15 cutoffs)
1800.01/1800.40	c   avg switch length:       3.59
1800.01/1800.40	c   switching time   :       1.63
1800.01/1800.40	c Solution           :
1800.01/1800.40	c   Solutions found  :          0 (0 improvements)
1800.01/1800.40	c   Primal Bound     :          -
1800.01/1800.40	c   Dual Bound       : +7.00000000000000e+00
1800.01/1800.40	c   Gap              :   infinite
1800.01/1800.40	c   Root Dual Bound  : +7.00000000000000e+00
1800.11/1800.42	c Time complete: 1800.14.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741545-1338773171/watcher-3741545-1338773171 -o /tmp/evaluation-result-3741545-1338773171/solver-3741545-1338773171 -C 1800 -W 1900 -M 15500 HOME/pbscip.linux.x86_64.gnu.opt-gcc42.spx -t 1800 -m 15500 -f HOME/instance-3741545-1338773171.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.11 2.08 2.02 3/176 4387
/proc/meminfo: memFree=30104544/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=8712 CPUtime=0 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 1519 0 0 0 0 0 0 0 20 0 1 0 343445633 8921088 1472 33554432000 4194304 7823515 140733878846928 140734236819128 6883856 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 2178 1472 354 887 0 1288 0

[startup+0.0441779 s]
/proc/loadavg: 2.11 2.08 2.02 3/176 4387
/proc/meminfo: memFree=30104544/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=19928 CPUtime=0.04 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 4440 0 0 0 3 1 0 0 20 0 1 0 343445633 20406272 4038 33554432000 4194304 7823515 140733878846928 140734236819128 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 4982 4040 429 887 0 4092 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 19928

[startup+0.100273 s]
/proc/loadavg: 2.11 2.08 2.02 3/176 4387
/proc/meminfo: memFree=30104544/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=23408 CPUtime=0.09 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 5305 0 0 0 8 1 0 0 20 0 1 0 343445633 23969792 4903 33554432000 4194304 7823515 140733878846928 140734236819128 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 5852 4903 444 887 0 4962 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23408

[startup+0.300276 s]
/proc/loadavg: 2.11 2.08 2.02 3/176 4387
/proc/meminfo: memFree=30104544/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=26656 CPUtime=0.29 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 6173 0 0 0 28 1 0 0 20 0 1 0 343445633 27295744 5771 33554432000 4194304 7823515 140733878846928 140734236819128 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 6664 5771 456 887 0 5774 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26656

[startup+0.700264 s]
/proc/loadavg: 2.11 2.08 2.02 3/176 4387
/proc/meminfo: memFree=30104544/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=33688 CPUtime=0.69 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 8020 0 0 0 67 2 0 0 20 0 1 0 343445633 34496512 7598 33554432000 4194304 7823515 140733878846928 140733878843624 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 8422 7598 529 887 0 7532 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 33688

[startup+1.50026 s]
/proc/loadavg: 2.10 2.08 2.02 3/177 4388
/proc/meminfo: memFree=30074544/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=34480 CPUtime=1.49 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 8264 0 0 0 146 3 0 0 20 0 1 0 343445633 35307520 7842 33554432000 4194304 7823515 140733878846928 140733878841608 6208324 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 8620 7842 539 887 0 7730 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 34480

[startup+3.10027 s]
/proc/loadavg: 2.10 2.08 2.02 3/177 4388
/proc/meminfo: memFree=30069460/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=53816 CPUtime=3.09 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 12810 0 0 0 304 5 0 0 20 0 1 0 343445633 55107584 12362 33554432000 4194304 7823515 140733878846928 140733878842072 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 13454 12362 568 887 0 12564 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 53816

[startup+6.30027 s]
/proc/loadavg: 2.10 2.08 2.02 3/177 4388
/proc/meminfo: memFree=30041916/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=55312 CPUtime=6.29 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 16871 0 0 0 620 9 0 0 20 0 1 0 343445633 56639488 12799 33554432000 4194304 7823515 140733878846928 140733878841624 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 13828 12799 578 887 0 12938 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 55312

[startup+12.7003 s]
/proc/loadavg: 2.23 2.11 2.03 3/177 4388
/proc/meminfo: memFree=30040816/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=55772 CPUtime=12.69 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 16913 0 0 0 1256 13 0 0 20 0 1 0 343445633 57110528 12841 33554432000 4194304 7823515 140733878846928 140733878841976 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 13943 12841 578 887 0 13053 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 55772

[startup+25.5003 s]
/proc/loadavg: 2.20 2.10 2.03 3/177 4388
/proc/meminfo: memFree=30005568/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=55772 CPUtime=25.49 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 16913 0 0 0 2528 21 0 0 20 0 1 0 343445633 57110528 12841 33554432000 4194304 7823515 140733878846928 140733878840952 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 13943 12841 578 887 0 13053 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 55772

[startup+51.1003 s]
/proc/loadavg: 2.12 2.09 2.03 3/177 4388
/proc/meminfo: memFree=29931508/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=56076 CPUtime=51.08 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 16978 0 0 0 5070 38 0 0 20 0 1 0 343445633 57421824 12906 33554432000 4194304 7823515 140733878846928 140733878842680 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 14019 12906 584 887 0 13129 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 56076

[startup+102.307 s]
/proc/loadavg: 2.05 2.08 2.02 3/177 4388
/proc/meminfo: memFree=29803956/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=57064 CPUtime=102.28 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 17291 0 0 0 10153 75 0 0 20 0 1 0 343445633 58433536 13219 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 14266 13219 584 887 0 13376 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 57064

[startup+162.3 s]
/proc/loadavg: 2.02 2.06 2.01 3/177 4388
/proc/meminfo: memFree=29629392/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=58932 CPUtime=162.27 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 17764 0 0 0 16115 112 0 0 20 0 1 0 343445633 60346368 13692 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 14733 13692 584 887 0 13843 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 58932

[startup+222.3 s]
/proc/loadavg: 2.00 2.05 2.01 3/177 4388
/proc/meminfo: memFree=29442676/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=59704 CPUtime=222.26 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 17979 0 0 0 22078 148 0 0 20 0 1 0 343445633 61136896 13907 33554432000 4194304 7823515 140733878846928 140733878842088 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 14926 13907 584 887 0 14036 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 59704

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/178 4391
/proc/meminfo: memFree=29253968/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=60528 CPUtime=282.25 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 18163 0 0 0 28043 182 0 0 20 0 1 0 343445633 61980672 14091 33554432000 4194304 7823515 140733878846928 140733878843704 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 15132 14091 584 887 0 14242 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 60528

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/177 4392
/proc/meminfo: memFree=29055480/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=61004 CPUtime=342.23 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 18243 0 0 0 34008 215 0 0 20 0 1 0 343445633 62468096 14171 33554432000 4194304 7823515 140733878846928 140733878842264 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 15251 14171 584 887 0 14361 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 61004

[startup+402.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/177 4392
/proc/meminfo: memFree=28940312/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=61004 CPUtime=402.23 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 18298 0 0 0 39975 248 0 0 20 0 1 0 343445633 62468096 14226 33554432000 4194304 7823515 140733878846928 140733878841624 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 15251 14226 584 887 0 14361 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 61004

[startup+462.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/177 4392
/proc/meminfo: memFree=28758928/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=62680 CPUtime=462.22 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 18724 0 0 0 45938 284 0 0 20 0 1 0 343445633 64184320 14652 33554432000 4194304 7823515 140733878846928 140733878842264 6177559 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 15670 14652 584 887 0 14780 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 62680

[startup+522.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4392
/proc/meminfo: memFree=28638740/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=63416 CPUtime=522.21 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 18839 0 0 0 51902 319 0 0 20 0 1 0 343445633 64937984 14767 33554432000 4194304 7823515 140733878846928 140733878841624 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 15854 14767 584 887 0 14964 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 63416

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 4392
/proc/meminfo: memFree=28503112/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=63416 CPUtime=582.2 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 18854 0 0 0 57864 356 0 0 20 0 1 0 343445633 64937984 14782 33554432000 4194304 7823515 140733878846928 140733878842264 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 15854 14782 584 887 0 14964 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 63416

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 4396
/proc/meminfo: memFree=27750440/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=64516 CPUtime=882.16 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19178 0 0 0 87690 526 0 0 20 0 1 0 343445633 66064384 15106 33554432000 4194304 7823515 140733878846928 140733878842088 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16129 15106 584 887 0 15239 0
Current children cumulated CPU time (s) 882.16
Current children cumulated vsize (KiB) 64516

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4397
/proc/meminfo: memFree=27596468/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=65120 CPUtime=942.15 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19258 0 0 0 93656 559 0 0 20 0 1 0 343445633 66682880 15186 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16280 15186 584 887 0 15390 0
Current children cumulated CPU time (s) 942.15
Current children cumulated vsize (KiB) 65120

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4397
/proc/meminfo: memFree=27449928/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=65368 CPUtime=1002.14 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19327 0 0 0 99617 597 0 0 20 0 1 0 343445633 66936832 15255 33554432000 4194304 7823515 140733878846928 140733878842616 5751959 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16342 15255 584 887 0 15452 0
Current children cumulated CPU time (s) 1002.14
Current children cumulated vsize (KiB) 65368

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4397
/proc/meminfo: memFree=27307976/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=65368 CPUtime=1062.13 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19338 0 0 0 105585 628 0 0 20 0 1 0 343445633 66936832 15266 33554432000 4194304 7823515 140733878846928 140733878842088 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16342 15266 584 887 0 15452 0
Current children cumulated CPU time (s) 1062.13
Current children cumulated vsize (KiB) 65368

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4397
/proc/meminfo: memFree=27136264/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=65368 CPUtime=1122.12 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19474 0 0 0 111549 663 0 0 20 0 1 0 343445633 66936832 15402 33554432000 4194304 7823515 140733878846928 140733878841624 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16342 15402 671 887 0 15452 0
Current children cumulated CPU time (s) 1122.12
Current children cumulated vsize (KiB) 65368

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4397
/proc/meminfo: memFree=26976332/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=65616 CPUtime=1182.11 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19525 0 0 0 117515 696 0 0 20 0 1 0 343445633 67190784 15453 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16404 15453 671 887 0 15514 0
Current children cumulated CPU time (s) 1182.11
Current children cumulated vsize (KiB) 65616

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 4399
/proc/meminfo: memFree=26852600/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=66064 CPUtime=1242.1 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19602 0 0 0 123480 730 0 0 20 0 1 0 343445633 67649536 15530 33554432000 4194304 7823515 140733878846928 140733878841624 6206197 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16516 15530 671 887 0 15626 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 66064

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4399
/proc/meminfo: memFree=26656716/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=66064 CPUtime=1302.1 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19602 0 0 0 129446 764 0 0 20 0 1 0 343445633 67649536 15530 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16516 15530 671 887 0 15626 0
Current children cumulated CPU time (s) 1302.1
Current children cumulated vsize (KiB) 66064

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4399
/proc/meminfo: memFree=26531504/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=66384 CPUtime=1362.08 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19671 0 0 0 135413 795 0 0 20 0 1 0 343445633 67977216 15599 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16596 15599 671 887 0 15706 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 66384

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4399
/proc/meminfo: memFree=26405424/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=66384 CPUtime=1422.08 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19672 0 0 0 141383 825 0 0 20 0 1 0 343445633 67977216 15600 33554432000 4194304 7823515 140733878846928 140733878841944 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16596 15600 671 887 0 15706 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 66384

[startup+1482.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 4402
/proc/meminfo: memFree=26299672/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=66384 CPUtime=1482.06 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19713 0 0 0 147333 873 0 0 20 0 1 0 343445633 67977216 15641 33554432000 4194304 7823515 140733878846928 140733878842264 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16596 15641 671 887 0 15706 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 66384

[startup+1542.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4441
/proc/meminfo: memFree=31392688/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=66384 CPUtime=1542.05 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 19749 0 0 0 153283 922 0 0 20 0 1 0 343445633 67977216 16267 33554432000 4194304 7823515 140733878846928 140733878842680 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16596 16267 671 887 0 15706 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 66384

[startup+1602.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 4441
/proc/meminfo: memFree=31387052/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=67432 CPUtime=1602.04 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 20018 0 0 0 159233 971 0 0 20 0 1 0 343445633 69050368 16534 33554432000 4194304 7823515 140733878846928 140733878842264 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16858 16534 671 887 0 15968 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 67432

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4441
/proc/meminfo: memFree=31387608/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=67804 CPUtime=1662.03 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 20082 0 0 0 165186 1017 0 0 20 0 1 0 343445633 69431296 16597 33554432000 4194304 7823515 140733878846928 140733878841624 6254008 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 16951 16597 671 887 0 16061 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 67804

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4441
/proc/meminfo: memFree=31386864/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=68020 CPUtime=1722.02 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 20163 0 0 0 171142 1060 0 0 20 0 1 0 343445633 69652480 16678 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 17005 16678 671 887 0 16115 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 68020

[startup+1782.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 4441
/proc/meminfo: memFree=31387236/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=68976 CPUtime=1782.01 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 20328 0 0 0 177094 1107 0 0 20 0 1 0 343445633 70631424 16843 33554432000 4194304 7823515 140733878846928 140733878842264 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 17244 16843 671 887 0 16354 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 68976



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 4441
/proc/meminfo: memFree=31384880/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=68976 CPUtime=1800.01 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 20341 0 0 0 178880 1121 0 0 20 0 1 0 343445633 70631424 16856 33554432000 4194304 7823515 140733878846928 140733878842728 6954986 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 17244 16856 671 887 0 16354 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 68976

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.41 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 4441
/proc/meminfo: memFree=31384880/32873844 swapFree=7116/7116
[pid=4387] ppid=4385 vsize=68976 CPUtime=1800.11 cores=1,3,5,7
/proc/4387/stat : 4387 (pbscip.linux.x8) R 4385 4387 2584 0 -1 4202496 20343 0 0 0 178890 1121 0 0 20 0 1 0 343445633 70631424 16858 33554432000 4194304 7823515 140733878846928 140733878842680 6957296 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/4387/statm: 17244 16858 673 887 0 16354 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 68976

Child status: 0
Real time (s): 1800.43
CPU time (s): 1800.14
CPU user time (s): 1788.92
CPU system time (s): 11.2203
CPU usage (%): 99.9842
Max. virtual memory (cumulated for all children) (KiB): 71196

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1788.92
system time used= 11.2203
maximum resident set size= 67432
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20344
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 1854

runsolver used 2.21266 second user time and 10.0235 second system time

The end

Launcher Data 

Begin job on node103 at 2012-06-04 03:26:11
IDJOB=3741545
IDBENCH=89875
IDSOLVER=2321
FILE ID=node103/3741545-1338773171
RUNJOBID= node103-1338749472-2601
PBS_JOBID= 14636802
Free space on /tmp= 71100 MiB

SOLVER NAME= PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/heinz/normalized-ns894788.opb
COMMAND LINE= HOME/pbscip.linux.x86_64.gnu.opt-gcc42.spx -t TIMEOUT -m MEMLIMIT -f BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741545-1338773171/watcher-3741545-1338773171 -o /tmp/evaluation-result-3741545-1338773171/solver-3741545-1338773171 -C 1800 -W 1900 -M 15500  HOME/pbscip.linux.x86_64.gnu.opt-gcc42.spx -t 1800 -m 15500 -f HOME/instance-3741545-1338773171.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca3efe2da0610ce6a80a42a3887418e6
RANDOM SEED=55817073

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5411.36
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30104816 kB
Buffers:          198244 kB
Cached:           404372 kB
SwapCached:         5648 kB
Active:          1589224 kB
Inactive:         405392 kB
Active(anon):    1389256 kB
Inactive(anon):     4740 kB
Active(file):     199968 kB
Inactive(file):   400652 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67096352 kB
Dirty:              9716 kB
Writeback:             0 kB
AnonPages:       1398460 kB
Mapped:            10636 kB
Shmem:                 0 kB
Slab:             633460 kB
SReclaimable:      74168 kB
SUnreclaim:       559292 kB
KernelStack:        1472 kB
PageTables:         6836 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1529148 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    260096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71108 MiB
End job on node103 at 2012-06-04 03:56:13