Trace number 3743927

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver? (TO) 1800.33 1800.61

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Large/
normalized-minisat100_16_6_5_ic.opb
MD5SUM6addefc6c4fab0b060566769c28f9c6a
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark15413119
Best CPU time to get the best result obtained on this benchmark1801.3
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1000400
Total number of constraints2000307
Number of constraints which are clauses980300
Number of constraints which are cardinality constraints (but not clauses)7
Number of constraints which are nor clauses,nor cardinality constraints1020000
Minimum length of a constraint2
Maximum length of a constraint4950
Number of terms in the objective function 29800
Biggest coefficient in the objective function 170953875
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 187029967016
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 170953875
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 187029967016
Number of bits of the biggest sum of numbers38
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 1.2.1.3 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.4.2]
0.00/0.00	c Copyright (c) 2002-2010 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743927-1338797083.opb>
24.39/24.42	c original problem has 1000400 variables (1000400 bin, 0 int, 0 impl, 0 cont) and 2000307 constraints
24.39/24.42	c problem read
24.39/24.44	c presolving settings loaded
32.49/32.51	c presolving:
40.68/40.72	c (round 1) 15150 del vars, 29703 del conss, 300 chg bounds, 4950 chg sides, 14850 chg coeffs, 0 upgd conss, 29900 impls, 1 clqs
54.48/54.57	c (round 2) 15150 del vars, 29703 del conss, 300 chg bounds, 4950 chg sides, 14850 chg coeffs, 1970601 upgd conss, 29900 impls, 1 clqs
134.08/134.16	c    (109.7s) probing: 101/985250 (0.0%) - 0 fixings, 0 aggregations, 0 implications, 0 bound changes
134.08/134.16	c    (109.7s) probing aborted: 100/100 successive totally useless probings
134.18/134.22	c presolving (3 rounds):
134.18/134.22	c  15150 deleted vars, 29703 deleted constraints, 300 tightened bounds, 0 added holes, 4950 changed sides, 14850 changed coefficients
134.18/134.22	c  5851100 implications, 1 cliques
134.18/134.22	c presolved problem has 985250 variables (985250 bin, 0 int, 0 impl, 0 cont) and 1970604 constraints
134.18/134.22	c  985350 constraints of type <knapsack>
134.18/134.22	c     101 constraints of type <setppc>
134.18/134.22	c       3 constraints of type <linear>
134.18/134.22	c  985150 constraints of type <logicor>
134.18/134.22	c transformed objective value is always integral (scale: 1)
134.18/134.22	c Presolving Time: 104.40
134.18/134.22	c - non default parameters ----------------------------------------------------------------------
134.18/134.22	c # SCIP version 1.2.1.3
134.18/134.22	c 
134.18/134.22	c # frequency for displaying node information lines
134.18/134.22	c # [type: int, range: [-1,2147483647], default: 100]
134.18/134.22	c display/freq = 10000
134.18/134.22	c 
134.18/134.22	c # maximal time in seconds to run
134.18/134.22	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
134.18/134.22	c limits/time = 1765.57
134.18/134.22	c 
134.18/134.22	c # maximal memory usage in MB; reported memory usage is lower than real memory usage!
134.18/134.22	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
134.18/134.22	c limits/memory = 13950
134.18/134.22	c 
134.18/134.22	c # default clock type (1: CPU user seconds, 2: wall clock time)
134.18/134.22	c # [type: int, range: [1,2], default: 1]
134.18/134.22	c timing/clocktype = 2
134.18/134.22	c 
134.18/134.22	c # should presolving try to simplify inequalities
134.18/134.22	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
134.18/134.22	c constraints/linear/simplifyinequalities = TRUE
134.18/134.22	c 
134.18/134.22	c # add initial coupling inequalities as linear constraints, if 'addCoupling' is true
134.18/134.22	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
134.18/134.22	c constraints/indicator/addCouplingCons = TRUE
134.18/134.22	c 
134.18/134.22	c # should presolving try to simplify knapsacks
134.18/134.22	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
134.18/134.22	c constraints/knapsack/simplifyinequalities = TRUE
134.18/134.22	c 
134.18/134.22	c # frequency for calling separator <rapidlearning> (-1: never, 0: only in root node)
134.18/134.22	c # [type: int, range: [-1,2147483647], default: -1]
134.18/134.22	c separating/rapidlearning/freq = 0
134.18/134.22	c 
134.18/134.22	c -----------------------------------------------------------------------------------------------
134.18/134.22	c start solving
134.47/134.53	c 
1093.72/1093.90	c  time | node  | left  |LP iter|LP it/n| mem |mdpt |frac |vars |cons |cols |rows |cuts |confs|strbr|  dualbound   | primalbound  |  gap   
1093.72/1093.90	c  1069s|     1 |     0 | 11796 |     - |5428M|   0 |1131 | 985k|1970k| 985k|1970k|   0 |   0 |   0 | 1.382446e+06 |      --      |    Inf 
1791.11/1791.49	c  1767s|     1 |     2 | 16537 |     - |5453M|   0 |   - | 985k|1970k| 985k|1970k|   0 |   0 |   0 | 1.382446e+06 |      --      |    Inf 
1791.11/1791.49	c 
1791.11/1791.49	c SCIP Status        : solving was interrupted [time limit reached]
1791.11/1791.49	c Solving Time (sec) : 1767.06
1791.11/1791.49	c Solving Nodes      : 1
1791.11/1791.49	c Primal Bound       : +1.00000000000000e+20 (0 solutions)
1791.11/1791.49	c Dual Bound         : +1.38244600229469e+06
1791.11/1791.49	c Gap                : infinite
1791.11/1791.49	s UNKNOWN
1791.11/1791.49	c SCIP Status        : solving was interrupted [time limit reached]
1791.11/1791.49	c Solving Time       :    1767.06
1791.11/1791.49	c Original Problem   :
1791.11/1791.49	c   Problem name     : HOME/instance-3743927-1338797083.opb
1791.11/1791.49	c   Variables        : 1000400 (1000400 binary, 0 integer, 0 implicit integer, 0 continuous)
1791.11/1791.49	c   Constraints      : 2000307 initial, 2000307 maximal
1791.11/1791.49	c Presolved Problem  :
1791.11/1791.49	c   Problem name     : t_HOME/instance-3743927-1338797083.opb
1791.11/1791.49	c   Variables        : 985250 (985250 binary, 0 integer, 0 implicit integer, 0 continuous)
1791.11/1791.49	c   Constraints      : 1970604 initial, 1970604 maximal
1791.11/1791.49	c Presolvers         :       Time  FixedVars   AggrVars   ChgTypes  ChgBounds   AddHoles    DelCons   ChgSides   ChgCoefs
1791.11/1791.49	c   trivial          :       0.19          0          0          0          0          0          0          0          0
1791.11/1791.49	c   dualfix          :       0.16          0          0          0          0          0          0          0          0
1791.11/1791.49	c   boundshift       :       0.00          0          0          0          0          0          0          0          0
1791.11/1791.49	c   inttobinary      :       0.00          0          0          0          0          0          0          0          0
1791.11/1791.49	c   implics          :       0.11          0          0          0          0          0          0          0          0
1791.11/1791.49	c   probing          :      15.99          0          0          0          0          0          0          0          0
1791.11/1791.49	c   knapsack         :      62.13          0          0          0          0          0          0          0          0
1791.11/1791.49	c   setppc           :       0.00          0          0          0          0          0          0          0          0
1791.11/1791.49	c   linear           :      17.01        300      14850          0        300          0      29703       4950      14850
1791.11/1791.49	c   logicor          :       2.75          0          0          0          0          0          0          0          0
1791.11/1791.49	c   root node        :          -          0          -          -          0          -          -          -          -
1791.11/1791.49	c Constraints        :     Number  #Separate #Propagate    #EnfoLP    #EnfoPS    Cutoffs    DomReds       Cuts      Conss   Children
1791.11/1791.49	c   integral         :          0          0          0          0          0          0          0          0          0          0
1791.11/1791.49	c   knapsack         :     985350          0        201          0          1          0          0          0          0          0
1791.11/1791.49	c   setppc           :        101          0        201          0          1          0          0          0          0          0
1791.11/1791.49	c   linear           :          3          0        201          0          0          0          0          0          0          0
1791.11/1791.49	c   logicor          :     985150          0        200          0          1          0          0          0          0          0
1791.11/1791.49	c   countsols        :          0          0          0          0          1          0          0          0          0          0
1791.11/1791.49	c Constraint Timings :  TotalTime   Separate  Propagate     EnfoLP     EnfoPS
1791.11/1791.49	c   integral         :       0.00       0.00       0.00       0.00       0.00
1791.11/1791.49	c   knapsack         :       6.19       0.00       6.19       0.00       0.00
1791.11/1791.49	c   setppc           :       0.00       0.00       0.00       0.00       0.00
1791.11/1791.49	c   linear           :       0.08       0.00       0.08       0.00       0.00
1791.11/1791.49	c   logicor          :       1.02       0.00       0.85       0.00       0.17
1791.11/1791.49	c   countsols        :       0.00       0.00       0.00       0.00       0.00
1791.11/1791.49	c Propagators        :       Time      Calls    Cutoffs    DomReds
1791.11/1791.49	c   vbounds          :       0.00          2          0          0
1791.11/1791.49	c   rootredcost      :       0.00          0          0          0
1791.11/1791.49	c   pseudoobj        :       0.02          2          0          0
1791.11/1791.49	c Conflict Analysis  :       Time      Calls    Success  Conflicts   Literals    Reconvs ReconvLits   LP Iters
1791.11/1791.49	c   propagation      :       0.00          0          0          0        0.0          0        0.0          -
1791.11/1791.49	c   infeasible LP    :       0.00          0          0          0        0.0          0        0.0          0
1791.11/1791.49	c   bound exceed. LP :       0.00          0          0          0        0.0          0        0.0          0
1791.11/1791.49	c   strong branching :       0.00          0          0          0        0.0          0        0.0          0
1791.11/1791.49	c   pseudo solution  :       0.00          0          0          0        0.0          0        0.0          -
1791.11/1791.49	c   applied globally :          -          -          -          0        0.0          -          -          -
1791.11/1791.49	c   applied locally  :          -          -          -          0        0.0          -          -          -
1791.11/1791.49	c Separators         :       Time      Calls    Cutoffs    DomReds       Cuts      Conss
1791.11/1791.49	c   cut pool         :       0.00          0          -          -          0          -    (maximal pool size: 0)
1791.11/1791.49	c   redcost          :       0.00          0          0          0          0          0
1791.11/1791.49	c   impliedbounds    :       0.00          0          0          0          0          0
1791.11/1791.49	c   intobj           :       0.00          0          0          0          0          0
1791.11/1791.49	c   cgmip            :       0.00          0          0          0          0          0
1791.11/1791.49	c   gomory           :       0.00          0          0          0          0          0
1791.11/1791.49	c   strongcg         :       0.00          0          0          0          0          0
1791.11/1791.49	c   cmir             :       0.00          0          0          0          0          0
1791.11/1791.49	c   flowcover        :       0.00          0          0          0          0          0
1791.11/1791.49	c   clique           :       0.00          0          0          0          0          0
1791.11/1791.49	c   zerohalf         :       0.00          0          0          0          0          0
1791.11/1791.49	c   mcf              :       0.00          0          0          0          0          0
1791.11/1791.49	c   rapidlearning    :       0.00          0          0          0          0          0
1791.11/1791.49	c Pricers            :       Time      Calls       Vars
1791.11/1791.49	c   problem variables:       0.00          0          0
1791.11/1791.49	c Branching Rules    :       Time      Calls    Cutoffs    DomReds       Cuts      Conss   Children
1791.11/1791.49	c   relpscost        :       0.00          0          0          0          0          0          0
1791.11/1791.49	c   pscost           :       0.00          0          0          0          0          0          0
1791.11/1791.49	c   inference        :       0.11          1          0          0          0          0          2
1791.11/1791.49	c   mostinf          :       0.00          0          0          0          0          0          0
1791.11/1791.49	c   leastinf         :       0.00          0          0          0          0          0          0
1791.11/1791.49	c   fullstrong       :       0.00          0          0          0          0          0          0
1791.11/1791.49	c   allfullstrong    :       0.00          0          0          0          0          0          0
1791.11/1791.49	c   random           :       0.00          0          0          0          0          0          0
1791.11/1791.49	c Primal Heuristics  :       Time      Calls      Found
1791.11/1791.49	c   LP solutions     :       0.00          -          0
1791.11/1791.49	c   pseudo solutions :       0.00          -          0
1791.11/1791.49	c   oneopt           :       0.00          0          0
1791.11/1791.49	c   trivial          :       1.79          2          0
1791.11/1791.49	c   simplerounding   :       0.05          0          0
1791.11/1791.49	c   zirounding       :       0.00          0          0
1791.11/1791.49	c   rounding         :       0.09          1          0
1791.11/1791.49	c   shifting         :       0.47          1          0
1791.11/1791.49	c   intshifting      :       0.00          0          0
1791.11/1791.49	c   twoopt           :       0.00          0          0
1791.11/1791.49	c   fixandinfer      :       0.00          0          0
1791.11/1791.49	c   feaspump         :     696.68          1          0
1791.11/1791.49	c   coefdiving       :       0.00          0          0
1791.11/1791.49	c   pscostdiving     :       0.00          0          0
1791.11/1791.49	c   fracdiving       :       0.00          0          0
1791.11/1791.49	c   veclendiving     :       0.00          0          0
1791.11/1791.49	c   intdiving        :       0.00          0          0
1791.11/1791.49	c   actconsdiving    :       0.00          0          0
1791.11/1791.49	c   objpscostdiving  :       0.00          0          0
1791.11/1791.49	c   rootsoldiving    :       0.00          0          0
1791.11/1791.49	c   linesearchdiving :       0.00          0          0
1791.11/1791.49	c   guideddiving     :       0.00          0          0
1791.11/1791.49	c   octane           :       0.00          0          0
1791.11/1791.49	c   rens             :       0.00          0          0
1791.11/1791.49	c   rins             :       0.00          0          0
1791.11/1791.49	c   localbranching   :       0.00          0          0
1791.11/1791.49	c   mutation         :       0.00          0          0
1791.11/1791.49	c   crossover        :       0.00          0          0
1791.11/1791.49	c   dins             :       0.00          0          0
1791.11/1791.49	c   undercover       :       0.00          0          0
1791.11/1791.49	c   nlp              :       0.00          0          0
1791.11/1791.49	c   trysol           :       0.00          0          0
1791.11/1791.49	c LP                 :       Time      Calls Iterations  Iter/call   Iter/sec
1791.11/1791.49	c   primal LP        :       0.00          0          0       0.00          -
1791.11/1791.49	c   dual LP          :     951.42          1      11796   11796.00      12.40
1791.11/1791.49	c   lex dual LP      :       0.00          0          0       0.00          -
1791.11/1791.49	c   barrier LP       :       0.00          0          0       0.00          -
1791.11/1791.49	c   diving/probing LP:     696.25          1       4741    4741.00       6.81
1791.11/1791.49	c   strong branching :       0.00          0          0       0.00          -
1791.11/1791.49	c     (at root node) :          -          0          0       0.00          -
1791.11/1791.49	c   conflict analysis:       0.00          0          0       0.00          -
1791.11/1791.49	c B&B Tree           :
1791.11/1791.49	c   number of runs   :          1
1791.11/1791.49	c   nodes            :          1
1791.11/1791.49	c   nodes (total)    :          1
1791.11/1791.49	c   nodes left       :          2
1791.11/1791.49	c   max depth        :          0
1791.11/1791.49	c   max depth (total):          0
1791.11/1791.49	c   backtracks       :          0 (0.0%)
1791.11/1791.49	c   delayed cutoffs  :          0
1791.11/1791.49	c   repropagations   :          0 (0 domain reductions, 0 cutoffs)
1791.11/1791.49	c   avg switch length:       1.00
1791.11/1791.49	c   switching time   :       0.00
1791.11/1791.49	c Solution           :
1791.11/1791.49	c   Solutions found  :          0 (0 improvements)
1791.11/1791.49	c   Primal Bound     :          -
1791.11/1791.49	c   Dual Bound       : +1.38244600229469e+06
1791.11/1791.49	c   Gap              :   infinite
1791.11/1791.49	c   Root Dual Bound  : +1.38244600229469e+06
1791.11/1791.49	c   Root Iterations  :      16537

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743927-1338797083/watcher-3743927-1338797083 -o /tmp/evaluation-result-3743927-1338797083/solver-3743927-1338797083 -C 1800 -W 1900 -M 15500 HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3743927-1338797083.opb -t 1800 -m 15500 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 3172
/proc/meminfo: memFree=20470300/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7916 CPUtime=0 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1241 0 0 0 0 0 0 0 20 0 1 0 345837223 8105984 1188 33554432000 4194304 8395647 140735217440272 140737300906600 7385025 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1979 1188 370 1026 0 949 0

[startup+0.0980219 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 3172
/proc/meminfo: memFree=20470300/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=33328 CPUtime=0.08 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 7597 0 0 0 8 0 0 0 20 0 1 0 345837223 34127872 7538 33554432000 4194304 8395647 140735217440272 140737300906600 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 8332 7538 394 1026 0 7302 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 33328

[startup+0.100357 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 3172
/proc/meminfo: memFree=20470300/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=33536 CPUtime=0.08 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 7621 0 0 0 8 0 0 0 20 0 1 0 345837223 34340864 7562 33554432000 4194304 8395647 140735217440272 140737300906600 6347101 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 8384 7583 394 1026 0 7354 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 33536

[startup+0.300299 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 3172
/proc/meminfo: memFree=20470300/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=45236 CPUtime=0.29 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 10540 0 0 0 28 1 0 0 20 0 1 0 345837223 46321664 10481 33554432000 4194304 8395647 140735217440272 140737300906600 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 11309 10481 394 1026 0 10279 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 45236

[startup+0.700304 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 3172
/proc/meminfo: memFree=20470300/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=96104 CPUtime=0.69 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 23222 0 0 0 66 3 0 0 20 0 1 0 345837223 98410496 23163 33554432000 4194304 8395647 140735217440272 140735217305480 5758044 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 24026 23163 394 1026 0 22996 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 96104

[startup+1.50031 s]
/proc/loadavg: 2.00 2.00 2.00 4/177 3173
/proc/meminfo: memFree=20340348/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=198704 CPUtime=1.49 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 48865 0 0 0 142 7 0 0 20 0 1 0 345837223 203472896 48806 33554432000 4194304 8395647 140735217440272 140735217305480 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 49676 48806 394 1026 0 48646 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 198704

[startup+3.10032 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3173
/proc/meminfo: memFree=20206900/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=391692 CPUtime=3.08 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 97005 0 0 0 292 16 0 0 20 0 1 0 345837223 401092608 96946 33554432000 4194304 8395647 140735217440272 140735217302760 7382051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 97923 96946 394 1026 0 96893 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 391692

[startup+6.30031 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3173
/proc/meminfo: memFree=19836264/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=733592 CPUtime=6.29 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 182646 0 0 0 598 31 0 0 20 0 1 0 345837223 751198208 182587 33554432000 4194304 8395647 140735217440272 140735217305480 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 183398 182587 394 1026 0 182368 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 733592

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3173
/proc/meminfo: memFree=19350428/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=1154184 CPUtime=12.69 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 287501 0 0 0 1220 49 0 0 20 0 1 0 345837223 1181884416 287442 33554432000 4194304 8395647 140735217440272 140735217305480 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 288546 287442 394 1026 0 287516 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1154184

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3173
/proc/meminfo: memFree=18345076/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=2292528 CPUtime=25.49 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 570912 0 0 0 2456 93 0 0 20 0 1 0 345837223 2347548672 572032 33554432000 4194304 8395647 140735217440272 140735217436536 4423932 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 573132 572033 413 1026 0 572102 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 2292528

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3173
/proc/meminfo: memFree=15712964/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=4757800 CPUtime=51.08 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1160982 0 0 0 4922 186 0 0 20 0 1 0 345837223 4871987200 1184699 33554432000 4194304 8395647 140735217440272 140735217436264 6063744 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1189450 1184699 483 1026 0 1188420 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 4757800

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3173
/proc/meminfo: memFree=15489916/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=5031100 CPUtime=102.28 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1216961 0 0 0 10033 195 0 0 20 0 1 0 345837223 5151846400 1239740 33554432000 4194304 8395647 140735217440272 140735217435944 4954803 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1257775 1239740 496 1026 0 1256745 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 5031100

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3174
/proc/meminfo: memFree=12967372/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7840592 CPUtime=162.26 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1517502 0 0 0 15946 280 0 0 20 0 1 0 345837223 8028766208 1868736 33554432000 4194304 8395647 140735217440272 140735217435736 6585955 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1960148 1868736 580 1026 0 1959118 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 7840592

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3174
/proc/meminfo: memFree=12844636/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7948580 CPUtime=222.25 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1522217 0 0 0 21936 289 0 0 20 0 1 0 345837223 8139345920 1899287 33554432000 4194304 8395647 140735217440272 140735217435400 6696767 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1987145 1899287 585 1026 0 1986115 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 7948580

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3174
/proc/meminfo: memFree=12827164/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7967700 CPUtime=282.24 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1525489 0 0 0 27927 297 0 0 20 0 1 0 345837223 8158924800 1903856 33554432000 4194304 8395647 140735217440272 140735217435400 6697790 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1991925 1903856 585 1026 0 1990895 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 7967700

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 3177
/proc/meminfo: memFree=12826384/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7967700 CPUtime=342.23 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1526253 0 0 0 33920 303 0 0 20 0 1 0 345837223 8158924800 1903941 33554432000 4194304 8395647 140735217440272 140735217435400 6697060 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1991925 1903941 585 1026 0 1990895 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 7967700

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3177
/proc/meminfo: memFree=12820828/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7978524 CPUtime=402.22 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1527985 0 0 0 39913 309 0 0 20 0 1 0 345837223 8170008576 1904994 33554432000 4194304 8395647 140735217440272 140735217435400 6391404 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1994631 1904994 585 1026 0 1993601 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 7978524

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3178
/proc/meminfo: memFree=12820660/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7978524 CPUtime=462.22 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1528510 0 0 0 45909 313 0 0 20 0 1 0 345837223 8170008576 1905549 33554432000 4194304 8395647 140735217440272 140735217435400 6697155 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1994631 1905549 585 1026 0 1993601 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 7978524

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3178
/proc/meminfo: memFree=12805308/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7978524 CPUtime=522.21 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1529242 0 0 0 51902 319 0 0 20 0 1 0 345837223 8170008576 1905581 33554432000 4194304 8395647 140735217440272 140735217435400 6698157 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1994631 1905581 585 1026 0 1993601 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 7978524

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3178
/proc/meminfo: memFree=12792836/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=7978524 CPUtime=582.2 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1529807 0 0 0 57896 324 0 0 20 0 1 0 345837223 8170008576 1906618 33554432000 4194304 8395647 140735217440272 140735217435400 6696861 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1994631 1906618 585 1026 0 1993601 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 7978524

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/177 3180
/proc/meminfo: memFree=12626788/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8025300 CPUtime=882.15 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1535092 0 0 0 87864 351 0 0 20 0 1 0 345837223 8217907200 1919553 33554432000 4194304 8395647 140735217440272 140735217435400 6697804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2006325 1919553 585 1026 0 2005295 0
Current children cumulated CPU time (s) 882.15
Current children cumulated vsize (KiB) 8025300

[startup+942.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/178 3183
/proc/meminfo: memFree=12607112/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8025300 CPUtime=942.15 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1535517 0 0 0 93860 355 0 0 20 0 1 0 345837223 8217907200 1919565 33554432000 4194304 8395647 140735217440272 140735217435400 6698218 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2006325 1919565 585 1026 0 2005295 0
Current children cumulated CPU time (s) 942.15
Current children cumulated vsize (KiB) 8025300

[startup+1002.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/178 3184
/proc/meminfo: memFree=12600448/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8025300 CPUtime=1002.14 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1535931 0 0 0 99856 358 0 0 20 0 1 0 345837223 8217907200 1919572 33554432000 4194304 8395647 140735217440272 140735217435400 6697804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2006325 1919572 585 1026 0 2005295 0
Current children cumulated CPU time (s) 1002.14
Current children cumulated vsize (KiB) 8025300

[startup+1062.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 3185
/proc/meminfo: memFree=12590740/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8025300 CPUtime=1062.12 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1536365 0 0 0 105851 361 0 0 20 0 1 0 345837223 8217907200 1919587 33554432000 4194304 8395647 140735217440272 140735217435400 6697155 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2006325 1919587 585 1026 0 2005295 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 8025300

[startup+1122.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 3185
/proc/meminfo: memFree=12537440/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8089204 CPUtime=1122.12 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1540144 0 0 0 111842 370 0 0 20 0 1 0 345837223 8283344896 1932223 33554432000 4194304 8395647 140735217440272 140735217434840 7428202 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2022301 1932223 590 1026 0 2021271 0
Current children cumulated CPU time (s) 1122.12
Current children cumulated vsize (KiB) 8089204

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3185
/proc/meminfo: memFree=12527176/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8099752 CPUtime=1182.1 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1540855 0 0 0 117835 375 0 0 20 0 1 0 345837223 8294146048 1933257 33554432000 4194304 8395647 140735217440272 140735217434840 6503540 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2024938 1933257 590 1026 0 2023908 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 8099752

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3185
/proc/meminfo: memFree=12599536/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8099752 CPUtime=1242.1 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1541079 0 0 0 123832 378 0 0 20 0 1 0 345837223 8294146048 1933263 33554432000 4194304 8395647 140735217440272 140735217434840 6697271 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2024938 1933263 590 1026 0 2023908 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 8099752

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3185
/proc/meminfo: memFree=12560456/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8147472 CPUtime=1302.09 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1542454 0 0 0 129827 382 0 0 20 0 1 0 345837223 8343011328 1941352 33554432000 4194304 8395647 140735217440272 140735217434840 6696767 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2036868 1941352 590 1026 0 2035838 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 8147472

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3186
/proc/meminfo: memFree=12521052/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8175076 CPUtime=1362.08 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1543393 0 0 0 135820 388 0 0 20 0 1 0 345837223 8371277824 1950815 33554432000 4194304 8395647 140735217440272 140735217434840 6635121 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2043769 1950815 590 1026 0 2042739 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 8175076

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3186
/proc/meminfo: memFree=12461992/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8188412 CPUtime=1422.08 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1545013 0 0 0 141813 395 0 0 20 0 1 0 345837223 8384933888 1955974 33554432000 4194304 8395647 140735217440272 140735217434840 6696973 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2047103 1955974 590 1026 0 2046073 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 8188412

[startup+1482.3 s]
/proc/loadavg: 2.10 2.03 2.01 3/177 3224
/proc/meminfo: memFree=19667528/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8155672 CPUtime=1482.07 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1546634 0 0 0 147804 403 0 0 20 0 1 0 345837223 8351408128 1943136 33554432000 4194304 8395647 140735217440272 140735217434792 6635121 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2038918 1943136 590 1026 0 2037888 0
Current children cumulated CPU time (s) 1482.07
Current children cumulated vsize (KiB) 8155672

[startup+1542.3 s]
/proc/loadavg: 2.07 2.04 2.01 3/178 3227
/proc/meminfo: memFree=19419456/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8159288 CPUtime=1542.05 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1548341 0 0 0 153794 411 0 0 20 0 1 0 345837223 8355110912 1947298 33554432000 4194304 8395647 140735217440272 140735217434840 6708477 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2039822 1947298 590 1026 0 2038792 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 8159288

[startup+1602.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/177 3227
/proc/meminfo: memFree=19222620/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8162180 CPUtime=1602.05 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1548826 0 0 0 159789 416 0 0 20 0 1 0 345837223 8358072320 1947306 33554432000 4194304 8395647 140735217440272 140735217434792 6708416 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2040545 1947306 590 1026 0 2039515 0
Current children cumulated CPU time (s) 1602.05
Current children cumulated vsize (KiB) 8162180

[startup+1662.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 3228
/proc/meminfo: memFree=19222132/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8166960 CPUtime=1662.03 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1549565 0 0 0 165781 422 0 0 20 0 1 0 345837223 8362967040 1947318 33554432000 4194304 8395647 140735217440272 140735217435096 6636751 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2041740 1947318 590 1026 0 2040710 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 8166960

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3228
/proc/meminfo: memFree=19151132/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8170456 CPUtime=1722.03 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1550306 0 0 0 171774 429 0 0 20 0 1 0 345837223 8366546944 1947327 33554432000 4194304 8395647 140735217440272 140735217434840 6697376 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2042614 1947327 590 1026 0 2041584 0
Current children cumulated CPU time (s) 1722.03
Current children cumulated vsize (KiB) 8170456

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3228
/proc/meminfo: memFree=19117524/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=8239940 CPUtime=1782.02 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1551303 0 0 0 177770 432 0 0 20 0 1 0 345837223 8437698560 1955231 33554432000 4194304 8395647 140735217440272 140735217434792 6637037 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 2059985 1955231 590 1026 0 2058955 0
Current children cumulated CPU time (s) 1782.02
Current children cumulated vsize (KiB) 8239940



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3228
/proc/meminfo: memFree=20406992/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=6677212 CPUtime=1800.02 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) R 3170 3172 2230 0 -1 4202496 1552603 0 0 0 179564 438 0 0 20 0 1 0 345837223 6837465088 1631493 33554432000 4194304 8395647 140735217440272 140735217439656 6345196 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 1669303 1631493 601 1026 0 1668273 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 6677212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 3229
/proc/meminfo: memFree=26939580/32873844 swapFree=7372/7372
[pid=3172] ppid=3170 vsize=0 CPUtime=1800.31 cores=1,3,5,7
/proc/3172/stat : 3172 (pbscip.linux.x8) Z 3170 3172 2230 0 -1 4203532 1552603 0 0 0 179564 467 0 0 20 0 1 0 345837223 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3172/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.31
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.61
CPU time (s): 1800.33
CPU user time (s): 1795.65
CPU system time (s): 4.67829
CPU usage (%): 99.9844
Max. virtual memory (cumulated for all children) (KiB): 8438028

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.65
system time used= 4.67829
maximum resident set size= 7975316
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1552603
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1857

runsolver used 4.14137 second user time and 9.8635 second system time

The end

Launcher Data 

Begin job on node109 at 2012-06-04 10:04:46
IDJOB=3743927
IDBENCH=92649
IDSOLVER=2326
FILE ID=node109/3743927-1338797083
RUNJOBID= node109-1338782366-2247
PBS_JOBID= 14636835
Free space on /tmp= 70508 MiB

SOLVER NAME= PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Large/normalized-minisat100_16_6_5_ic.opb
COMMAND LINE= HOME/pbscip.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743927-1338797083/watcher-3743927-1338797083 -o /tmp/evaluation-result-3743927-1338797083/solver-3743927-1338797083 -C 1800 -W 1900 -M 15500  HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3743927-1338797083.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6addefc6c4fab0b060566769c28f9c6a
RANDOM SEED=1776065342

node109.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        20474656 kB
Buffers:         1875268 kB
Cached:          1980268 kB
SwapCached:          988 kB
Active:         10263244 kB
Inactive:        1234168 kB
Active(anon):    7602192 kB
Inactive(anon):    38536 kB
Active(file):    2661052 kB
Inactive(file):  1195632 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67105540 kB
Dirty:            110096 kB
Writeback:             0 kB
AnonPages:       7646968 kB
Mapped:            12436 kB
Shmem:                 4 kB
Slab:             743884 kB
SReclaimable:     185632 kB
SUnreclaim:       558252 kB
KernelStack:        1448 kB
PageTables:        19192 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    8104896 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1353728 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70592 MiB
End job on node109 at 2012-06-04 10:34:49