Trace number 3481604

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 146.81 144.086

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/bsg/normalized-bsg_200_10_2.opb
MD5SUMb5a23f46b7c8ffe564ae87cb51d69480
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-57
Best CPU time to get the best result obtained on this benchmark1797.09
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -59
Optimality of the best value was proved NO
Number of variables400
Total number of constraints601
Number of constraints which are clauses200
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints401
Minimum length of a constraint2
Maximum length of a constraint400
Number of terms in the objective function 200
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 200
Number of bits of the sum of numbers in the objective function 8
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 400
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)4984
Sum of products size (including duplicates)9968
Number of different products2492
Sum of products size4984

Solver Data 

0.31/0.48	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.31/0.48	c INFO: solving HOME/instance-3481604-1307578477.opb
0.38/0.52	c INFO: wrote linearized instance to HOME/tmpa7T62k.opb
0.38/0.56	c INFO: parsing took 0.04 s
0.51/0.63	c INFO: features took 0.07 CPU seconds
0.51/0.66	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.40)
47.93/47.80	c INFO: running scip-2.0.1-clp@0 for 45 with 1753 remaining (b = 0.09)
96.12/95.86	c INFO: running sat4j-pb-v20101225@0 for 45 with 1705 remaining (b = 0.03)
145.11/143.31	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1657 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481604-1307578477/watcher-3481604-1307578477 -o /tmp/evaluation-result-3481604-1307578477/solver-3481604-1307578477 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481604-1307578477.opb -seed 1028587990 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.24 2.13 1.85 2/854 23590
/proc/meminfo: memFree=12385132/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=16400 CPUtime=0 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 1077 0 0 0 0 0 0 0 23 0 1 0 948078464 16793600 947 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415389696 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/23590/statm: 4100 947 383 364 0 587 0

[startup+0.0903221 s]
/proc/loadavg: 2.24 2.13 1.85 2/854 23590
/proc/meminfo: memFree=12385132/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=94068 CPUtime=0.07 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 2797 0 1 0 5 2 0 0 17 0 1 0 948078464 96325632 2468 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415391488 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/23590/statm: 23517 2468 788 364 0 1628 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 94068

[startup+0.104405 s]
/proc/loadavg: 2.24 2.13 1.85 2/854 23590
/proc/meminfo: memFree=12385132/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=96128 CPUtime=0.08 cores=1,3,5,7
/proc/23590/stat : 23590 (python) R 23588 23590 21667 0 -1 4202496 3170 927 1 0 6 2 0 0 18 0 1 0 948078464 98435072 2483 33554432000 4194304 5683644 140736842618960 18446744073709551615 5170248 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/23590/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 96128

[startup+0.300379 s]
/proc/loadavg: 2.24 2.13 1.85 2/854 23590
/proc/meminfo: memFree=12385132/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=197648 CPUtime=0.23 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 6615 927 1 0 16 7 0 0 17 0 1 0 948078464 202391552 4903 33554432000 4194304 5683644 140736842618960 18446744073709551615 256410467975 0 2147483391 16781312 2 18446744071699199166 0 0 17 3 0 0 0
/proc/23590/statm: 50195 4905 1436 364 0 3677 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 197648

[startup+0.700272 s]
/proc/loadavg: 2.24 2.13 1.85 2/854 23590
/proc/meminfo: memFree=12385132/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=294884 CPUtime=0.57 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 11108 1345 1 0 42 12 2 1 20 0 2 0 948078464 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23590/statm: 73721 7560 1871 364 0 8608 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 294884

[startup+1.50112 s]
/proc/loadavg: 2.24 2.13 1.85 3/858 23599
/proc/meminfo: memFree=12251304/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=294884 CPUtime=0.57 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 11108 1345 1 0 42 12 2 1 20 0 2 0 948078464 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23590/statm: 73721 7560 1871 364 0 8608 0
[pid=23597] ppid=23590 vsize=284640 CPUtime=0 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 715 0 0 0 0 0 0 0 17 0 1 0 948078530 291471360 6004 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411727 0 0 16781312 33554946 7251134775497294085 0 0 17 7 0 0 0
/proc/23597/statm: 71160 6004 319 364 0 6047 0
[pid=23599] ppid=23597 vsize=46504 CPUtime=0.83 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) R 23597 23599 23599 0 -1 4202496 9988 0 0 0 66 17 0 0 19 0 1 0 948078530 47620096 9219 33554432000 4194304 13684479 140737395471680 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23599/statm: 11626 9219 732 2317 0 9304 0
[pid=23590/tid=23598] ppid=23588 vsize=294884 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 2 0 948078530 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 626028

[startup+3.10082 s]
/proc/loadavg: 2.24 2.13 1.85 4/858 23599
/proc/meminfo: memFree=12152832/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=294884 CPUtime=0.57 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 11108 1345 1 0 42 12 2 1 20 0 2 0 948078464 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23590/statm: 73721 7560 1871 364 0 8608 0
[pid=23597] ppid=23590 vsize=284640 CPUtime=0 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 725 0 0 0 0 0 0 0 15 0 1 0 948078530 291471360 6004 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411727 0 0 16781312 33554946 7251134775497294085 0 0 17 7 0 0 0
/proc/23597/statm: 71160 6004 319 364 0 6047 0
[pid=23599] ppid=23597 vsize=77332 CPUtime=2.42 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) R 23597 23599 23599 0 -1 4202496 18383 0 0 0 219 23 0 0 18 0 1 0 948078530 79187968 16769 33554432000 4194304 13684479 140737395471680 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23599/statm: 19333 16769 817 2317 0 17011 0
[pid=23590/tid=23598] ppid=23588 vsize=294884 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 2 0 948078530 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 656856

[startup+6.30121 s]
/proc/loadavg: 2.22 2.13 1.85 4/858 23599
/proc/meminfo: memFree=11849776/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=294884 CPUtime=0.57 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 11108 1345 1 0 42 12 2 1 20 0 2 0 948078464 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23590/statm: 73721 7560 1871 364 0 8608 0
[pid=23597] ppid=23590 vsize=284640 CPUtime=0.01 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 875 0 0 0 1 0 0 0 15 0 1 0 948078530 291471360 6028 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411727 0 0 16781312 33554946 7251136287325782277 0 0 17 7 0 0 0
/proc/23597/statm: 71160 6028 343 364 0 6047 0
[pid=23599] ppid=23597 vsize=77332 CPUtime=5.63 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) R 23597 23599 23599 0 -1 4202496 18387 0 0 0 530 33 0 0 25 0 1 0 948078530 79187968 16773 33554432000 4194304 13684479 140737395471680 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23599/statm: 19333 16773 821 2317 0 17011 0
[pid=23590/tid=23598] ppid=23588 vsize=294884 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 2 0 948078530 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 656856

[startup+12.701 s]
/proc/loadavg: 2.20 2.12 1.85 4/858 23600
/proc/meminfo: memFree=11662280/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=294884 CPUtime=0.57 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 11108 1345 1 0 42 12 2 1 20 0 2 0 948078464 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23590/statm: 73721 7560 1871 364 0 8608 0
[pid=23597] ppid=23590 vsize=284640 CPUtime=0.04 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 879 0 0 0 2 2 0 0 15 0 1 0 948078530 291471360 6028 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411727 0 0 16781312 33554946 3987655939225288704 0 0 17 7 0 0 0
/proc/23597/statm: 71160 6028 343 364 0 6047 0
[pid=23599] ppid=23597 vsize=79856 CPUtime=12.03 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) R 23597 23599 23599 0 -1 4202496 19138 0 0 0 1156 47 0 0 25 0 1 0 948078530 81772544 17524 33554432000 4194304 13684479 140737395471680 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23599/statm: 19964 17524 835 2317 0 17642 0
[pid=23590/tid=23598] ppid=23588 vsize=294884 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 2 0 948078530 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.64
Current children cumulated vsize (KiB) 659380

[startup+25.5005 s]
/proc/loadavg: 2.23 2.13 1.86 3/859 23601
/proc/meminfo: memFree=11660044/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=294884 CPUtime=0.57 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 11108 1345 1 0 42 12 2 1 20 0 2 0 948078464 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/23590/statm: 73721 7560 1871 364 0 8608 0
[pid=23597] ppid=23590 vsize=284640 CPUtime=0.11 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 887 0 0 0 5 6 0 0 15 0 1 0 948078530 291471360 6028 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411727 0 0 16781312 33554946 576845486883864576 0 0 17 7 0 0 0
/proc/23597/statm: 71160 6028 343 364 0 6047 0
[pid=23599] ppid=23597 vsize=79856 CPUtime=24.83 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) R 23597 23599 23599 0 -1 4202496 19326 0 0 0 2425 58 0 0 25 0 1 0 948078530 81772544 17709 33554432000 4194304 13684479 140737395471680 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23599/statm: 19964 17709 834 2317 0 17642 0
[pid=23590/tid=23598] ppid=23588 vsize=294884 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 2 0 948078530 301961216 7560 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.51
Current children cumulated vsize (KiB) 659380

[startup+51.1006 s]
/proc/loadavg: 2.15 2.12 1.86 3/863 23606
/proc/meminfo: memFree=11622472/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=305644 CPUtime=0.59 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 12024 1345 1 0 44 12 2 1 20 0 3 0 948078464 312979456 7693 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/23590/statm: 76411 7693 1874 364 0 11295 0
[pid=23597] ppid=23590 vsize=294884 CPUtime=0.23 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 1097 0 0 0 10 13 0 0 17 0 2 0 948078530 301961216 6096 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/23597/statm: 73721 6096 406 364 0 8608 0
[pid=23599] ppid=23597 vsize=79856 CPUtime=47.11 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) T 23597 23599 23599 0 -1 4202496 19329 0 0 0 4617 94 0 0 25 0 1 0 948078530 81772544 17712 33554432000 4194304 13684479 140737395471680 18446744073709551615 7361281 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23599/statm: 19964 17712 837 2317 0 17642 0
[pid=23597/tid=23603] ppid=23590 vsize=294884 CPUtime=0 cores=1,3,5,7
/proc/23597/task/23603/stat : 23603 (python) S 23590 23590 21667 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 948083242 301961216 6096 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554946 18446604457470212928 0 0 -1 1 0 0 0
[pid=23604] ppid=23590 vsize=295400 CPUtime=0 cores=1,3,5,7
/proc/23604/stat : 23604 (python) S 23590 23590 21667 0 -1 4202560 759 0 0 0 0 0 0 0 15 0 1 0 948083244 302489600 6135 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411782 0 0 16781312 33554946 1173048679133609984 0 0 17 3 0 0 0
/proc/23604/statm: 73850 6135 320 364 0 8734 0
[pid=23606] ppid=23604 vsize=84716 CPUtime=3.28 cores=1,3,5,7
/proc/23606/stat : 23606 (scip-2.0.1.linu) R 23604 23606 23606 0 -1 4202496 20879 0 0 0 310 18 0 0 25 0 1 0 948083245 86749184 17374 33554432000 4194304 15243407 140736483609600 18446744073709551615 13277498 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/23606/statm: 21179 17374 914 2698 0 18474 0
[pid=23590/tid=23598] ppid=23588 vsize=305644 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 3 0 948078530 312979456 7693 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
[pid=23590/tid=23605] ppid=23588 vsize=305644 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23605/stat : 23605 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 3 0 948083244 312979456 7693 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 51.21
Current children cumulated vsize (KiB) 1060500

[startup+102.323 s]
/proc/loadavg: 2.06 2.10 1.87 4/885 23629
/proc/meminfo: memFree=11078472/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=315900 CPUtime=0.61 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 12949 1345 1 0 46 12 2 1 20 0 4 0 948078464 323481600 7699 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23590/statm: 78975 7699 1876 364 0 13856 0
[pid=23597] ppid=23590 vsize=294884 CPUtime=0.23 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 1097 0 0 0 10 13 0 0 17 0 2 0 948078530 301961216 6096 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/23597/statm: 73721 6096 406 364 0 8608 0
[pid=23599] ppid=23597 vsize=79856 CPUtime=47.11 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) T 23597 23599 23599 0 -1 4202496 19329 0 0 0 4617 94 0 0 25 0 1 0 948078530 81772544 17712 33554432000 4194304 13684479 140737395471680 18446744073709551615 7361281 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23599/statm: 19964 17712 837 2317 0 17642 0
[pid=23597/tid=23603] ppid=23590 vsize=294884 CPUtime=0 cores=1,3,5,7
/proc/23597/task/23603/stat : 23603 (python) S 23590 23590 21667 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 948083242 301961216 6096 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554946 18446604457470212928 0 0 -1 1 0 0 0
[pid=23604] ppid=23590 vsize=295400 CPUtime=0.23 cores=1,3,5,7
/proc/23604/stat : 23604 (python) S 23590 23590 21667 0 -1 4202560 1122 0 0 0 12 11 0 0 17 0 2 0 948083244 302489600 6207 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23604/statm: 73850 6207 391 364 0 8734 0
[pid=23606] ppid=23604 vsize=84716 CPUtime=48.02 cores=1,3,5,7
/proc/23606/stat : 23606 (scip-2.0.1.linu) T 23604 23606 23606 0 -1 4202496 21609 0 0 0 4772 30 0 0 25 0 1 0 948083245 86749184 18104 33554432000 4194304 15243407 140736483609600 18446744073709551615 8134473 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23606/statm: 21179 18104 959 2698 0 18474 0
[pid=23604/tid=23608] ppid=23590 vsize=295400 CPUtime=0 cores=1,3,5,7
/proc/23604/task/23608/stat : 23608 (python) S 23590 23590 21667 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 948088047 302489600 6207 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554946 18446604467172296576 0 0 -1 7 0 0 0
[pid=23609] ppid=23590 vsize=305656 CPUtime=0.02 cores=1,3,5,7
/proc/23609/stat : 23609 (python) S 23590 23590 21667 0 -1 4202560 924 0 0 0 1 1 0 0 15 0 1 0 948088050 312991744 6163 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411782 0 0 16781312 33554946 4294934791 0 0 17 1 0 0 0

################
# More data... #
################

[pid=23611/tid=23620] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23620/stat : 23620 (java) S 23609 23611 23611 0 -1 4202560 316 0 0 0 0 0 0 0 15 0 19 0 948088052 8749318144 131014 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446604460577771712 0 0 -1 1 0 0 0
[pid=23611/tid=23621] ppid=23609 vsize=8544256 CPUtime=0.01 cores=1,3,5,7
/proc/23611/task/23621/stat : 23621 (java) S 23609 23611 23611 0 -1 4202560 1048 0 0 0 1 0 0 0 15 0 19 0 948088053 8749318144 131014 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427208192 0 0 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23622] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23622/stat : 23622 (java) S 23609 23611 23611 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 948088053 8749318144 131015 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23623] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23623/stat : 23623 (java) S 23609 23611 23611 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 948088053 8749318144 131018 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23624] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23624/stat : 23624 (java) S 23609 23611 23611 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 948088056 8749318144 131021 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427215281 0 4 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23625] ppid=23609 vsize=8544256 CPUtime=0.54 cores=1,3,5,7
/proc/23611/task/23625/stat : 23625 (java) S 23609 23611 23611 0 -1 4202560 5835 0 0 0 53 1 0 0 16 0 19 0 948088056 8749318144 131023 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23626] ppid=23609 vsize=8544256 CPUtime=0.51 cores=1,3,5,7
/proc/23611/task/23626/stat : 23626 (java) S 23609 23611 23611 0 -1 4202560 5715 0 0 0 51 0 0 0 16 0 19 0 948088056 8749318144 131026 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446604460577771712 0 0 -1 1 0 0 0
[pid=23611/tid=23627] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23627/stat : 23627 (java) S 23609 23611 23611 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 948088056 8749318144 131028 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23628] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23628/stat : 23628 (java) S 23609 23611 23611 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 948088056 8749318144 131031 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427208192 0 4 0 16800975 18446604460577771712 0 0 -1 5 0 0 0
[pid=23611/tid=23629] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23629/stat : 23629 (java) S 23609 23611 23611 0 -1 4202560 7 0 0 0 0 0 0 0 24 0 19 0 948088088 8749318144 131031 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427208192 0 4 0 16800975 18446604460577771712 0 0 -1 7 0 0 0
[pid=23590/tid=23598] ppid=23588 vsize=315900 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 4 0 948078530 323481600 7699 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
[pid=23590/tid=23605] ppid=23588 vsize=315900 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23605/stat : 23605 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 4 0 948083244 323481600 7699 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 1 0 0 0
[pid=23590/tid=23610] ppid=23588 vsize=315900 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23610/stat : 23610 (python) S 23588 23590 21667 0 -1 4202560 27 1345 0 0 0 0 2 1 20 0 4 0 948088050 323481600 7699 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 103.72
Current children cumulated vsize (KiB) 9920668



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+144.002 s]
/proc/loadavg: 2.03 2.08 1.87 7/907 23652
/proc/meminfo: memFree=10969668/32950928 swapFree=50514916/67111528
[pid=23590] ppid=23588 vsize=326156 CPUtime=0.65 cores=1,3,5,7
/proc/23590/stat : 23590 (python) S 23588 23590 21667 0 -1 4202496 13890 1345 1 0 49 13 2 1 19 0 5 0 948078464 333983744 7705 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/23590/statm: 81539 7705 1878 364 0 16417 0
[pid=23597] ppid=23590 vsize=294884 CPUtime=0.23 cores=1,3,5,7
/proc/23597/stat : 23597 (python) S 23590 23590 21667 0 -1 4202560 1097 0 0 0 10 13 0 0 17 0 2 0 948078530 301961216 6096 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/23597/statm: 73721 6096 406 364 0 8608 0
[pid=23599] ppid=23597 vsize=79856 CPUtime=47.11 cores=1,3,5,7
/proc/23599/stat : 23599 (scip-2.0.1.linu) T 23597 23599 23599 0 -1 4202496 19329 0 0 0 4617 94 0 0 25 0 1 0 948078530 81772544 17712 33554432000 4194304 13684479 140737395471680 18446744073709551615 7361281 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23599/statm: 19964 17712 837 2317 0 17642 0
[pid=23597/tid=23603] ppid=23590 vsize=294884 CPUtime=0 cores=1,3,5,7
/proc/23597/task/23603/stat : 23603 (python) S 23590 23590 21667 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 948083242 301961216 6096 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554946 18446604457470212928 0 0 -1 1 0 0 0
[pid=23604] ppid=23590 vsize=295400 CPUtime=0.23 cores=1,3,5,7
/proc/23604/stat : 23604 (python) S 23590 23590 21667 0 -1 4202560 1122 0 0 0 12 11 0 0 17 0 2 0 948083244 302489600 6207 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23604/statm: 73850 6207 391 364 0 8734 0
[pid=23606] ppid=23604 vsize=84716 CPUtime=48.02 cores=1,3,5,7
/proc/23606/stat : 23606 (scip-2.0.1.linu) T 23604 23606 23606 0 -1 4202496 21609 0 0 0 4772 30 0 0 25 0 1 0 948083245 86749184 18104 33554432000 4194304 15243407 140736483609600 18446744073709551615 8134473 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/23606/statm: 21179 18104 959 2698 0 18474 0
[pid=23604/tid=23608] ppid=23590 vsize=295400 CPUtime=0 cores=1,3,5,7
/proc/23604/task/23608/stat : 23608 (python) S 23590 23590 21667 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 948088047 302489600 6207 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554946 18446604467172296576 0 0 -1 7 0 0 0
[pid=23609] ppid=23590 vsize=305656 CPUtime=0.26 cores=1,3,5,7
/proc/23609/stat : 23609 (python) S 23590 23590 21667 0 -1 4202560 1133 0 0 0 13 13 0 0 16 0 2 0 948088050 312991744 6211 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427218379 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/23609/statm: 76414 6211 391 364 0 11295 0
[pid=23611] ppid=23609 vsize=8544256 CPUtime=48.62 cores=1,3,5,7
/proc/23611/stat : 23611 (java) T 23609 23611 23611 0 -1 4202496 149555 0 1 0 4845 17 0 0 18 0 19 0 948088050 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/23611/statm: 2136064 132793 2259 9 0 2126805 0
[pid=23611/tid=23612] ppid=23609 vsize=8544256 CPUtime=47.02 cores=1,3,5,7
/proc/23611/task/23612/stat : 23612 (java) T 23609 23611 23611 0 -1 4202560 128543 0 1 0 4688 14 0 0 25 0 19 0 948088051 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 46912505813381 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23613] ppid=23609 vsize=8544256 CPUtime=0.02 cores=1,3,5,7
/proc/23611/task/23613/stat : 23613 (java) T 23609 23611 23611 0 -1 4202560 866 0 0 0 2 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23611/tid=23614] ppid=23609 vsize=8544256 CPUtime=0.02 cores=1,3,5,7
/proc/23611/task/23614/stat : 23614 (java) T 23609 23611 23611 0 -1 4202560 328 0 0 0 2 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23611/tid=23615] ppid=23609 vsize=8544256 CPUtime=0.02 cores=1,3,5,7
/proc/23611/task/23615/stat : 23615 (java) T 23609 23611 23611 0 -1 4202560 1290 0 0 0 2 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23611/tid=23616] ppid=23609 vsize=8544256 CPUtime=0.03 cores=1,3,5,7
/proc/23611/task/23616/stat : 23616 (java) T 23609 23611 23611 0 -1 4202560 2184 0 0 0 3 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23611/tid=23617] ppid=23609 vsize=8544256 CPUtime=0.01 cores=1,3,5,7
/proc/23611/task/23617/stat : 23617 (java) T 23609 23611 23611 0 -1 4202560 70 0 0 0 1 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23611/tid=23618] ppid=23609 vsize=8544256 CPUtime=0.02 cores=1,3,5,7
/proc/23611/task/23618/stat : 23618 (java) T 23609 23611 23611 0 -1 4202560 711 0 0 0 2 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23611/tid=23619] ppid=23609 vsize=8544256 CPUtime=0.02 cores=1,3,5,7
/proc/23611/task/23619/stat : 23619 (java) T 23609 23611 23611 0 -1 4202560 551 0 0 0 2 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23611/tid=23620] ppid=23609 vsize=8544256 CPUtime=0.02 cores=1,3,5,7
/proc/23611/task/23620/stat : 23620 (java) T 23609 23611 23611 0 -1 4202560 318 0 0 0 2 0 0 0 15 0 19 0 948088052 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23611/tid=23621] ppid=23609 vsize=8544256 CPUtime=0.21 cores=1,3,5,7
/proc/23611/task/23621/stat : 23621 (java) T 23609 23611 23611 0 -1 4202560 1695 0 0 0 21 0 0 0 15 0 19 0 948088053 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427208192 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23622] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23622/stat : 23622 (java) T 23609 23611 23611 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 948088053 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23623] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23623/stat : 23623 (java) T 23609 23611 23611 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 948088053 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23624] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23624/stat : 23624 (java) T 23609 23611 23611 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948088056 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427215281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23625] ppid=23609 vsize=8544256 CPUtime=0.54 cores=1,3,5,7
/proc/23611/task/23625/stat : 23625 (java) T 23609 23611 23611 0 -1 4202560 5835 0 0 0 53 1 0 0 15 0 19 0 948088056 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23626] ppid=23609 vsize=8544256 CPUtime=0.61 cores=1,3,5,7
/proc/23611/task/23626/stat : 23626 (java) T 23609 23611 23611 0 -1 4202560 5768 0 0 0 61 0 0 0 15 0 19 0 948088056 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23611/tid=23627] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23627/stat : 23627 (java) T 23609 23611 23611 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 948088056 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427207577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=23611/tid=23628] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23628/stat : 23628 (java) T 23609 23611 23611 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 948088056 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427208192 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=23611/tid=23629] ppid=23609 vsize=8544256 CPUtime=0 cores=1,3,5,7
/proc/23611/task/23629/stat : 23629 (java) T 23609 23611 23611 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 948088088 8749318144 132793 33554432000 1073741824 1073778376 140733324401408 18446744073709551615 256427208192 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=23609/tid=23631] ppid=23590 vsize=305656 CPUtime=0 cores=1,3,5,7
/proc/23609/task/23631/stat : 23631 (python) S 23590 23590 21667 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 948092792 312991744 6211 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554946 18446604459961792320 0 0 -1 7 0 0 0
[pid=23632] ppid=23590 vsize=315912 CPUtime=0 cores=1,3,5,7
/proc/23632/stat : 23632 (python) R 23590 23590 21667 0 -1 4202560 794 0 0 0 0 0 0 0 15 0 1 0 948092795 323493888 6143 33554432000 4194304 5683644 140736842618960 18446744073709551615 256415411782 0 0 16781312 33554946 0 0 0 17 7 0 0 0
/proc/23632/statm: 78978 6143 320 364 0 13856 0
[pid=23634] ppid=23632 vsize=8550044 CPUtime=1.69 cores=1,3,5,7
/proc/23634/stat : 23634 (java) S 23632 23634 23634 0 -1 4202496 27822 0 1 0 166 3 0 0 18 0 19 0 948092795 8755245056 22504 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427194341 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/23634/statm: 2137511 22506 2225 9 0 2128252 0
[pid=23634/tid=23635] ppid=23632 vsize=8550044 CPUtime=0.71 cores=1,3,5,7
/proc/23634/task/23635/stat : 23635 (java) R 23632 23634 23634 0 -1 4202560 14062 0 1 0 70 1 0 0 18 0 19 0 948092796 8755245056 22749 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 46912505833950 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=23634/tid=23636] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23636/stat : 23636 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 948092796 8755245056 22751 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 1 0 0 0
[pid=23634/tid=23637] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23637/stat : 23637 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 948092796 8755245056 22753 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 5 0 0 0
[pid=23634/tid=23638] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23638/stat : 23638 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 948092796 8755245056 22755 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 5 0 0 0
[pid=23634/tid=23639] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23639/stat : 23639 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 948092796 8755245056 22757 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 5 0 0 0
[pid=23634/tid=23640] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23640/stat : 23640 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 948092796 8755245056 22759 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 5 0 0 0
[pid=23634/tid=23641] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23641/stat : 23641 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 948092796 8755245056 22761 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 7 0 0 0
[pid=23634/tid=23642] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23642/stat : 23642 (java) S 23632 23634 23634 0 -1 4202560 2 0 0 0 0 0 0 0 22 0 19 0 948092796 8755245056 22762 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 7 0 0 0
[pid=23634/tid=23643] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23643/stat : 23643 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 19 0 948092796 8755245056 22764 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 5 0 0 0
[pid=23634/tid=23644] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23644/stat : 23644 (java) S 23632 23634 23634 0 -1 4202560 2 0 0 0 0 0 0 0 24 0 19 0 948092797 8755245056 22766 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427208192 0 0 0 16800975 18446604461596266624 0 0 -1 7 0 0 0
[pid=23634/tid=23645] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23645/stat : 23645 (java) S 23632 23634 23634 0 -1 4202560 16 0 0 0 0 0 0 0 24 0 19 0 948092798 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 1 0 0 0
[pid=23634/tid=23646] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23646/stat : 23646 (java) S 23632 23634 23634 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 948092798 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 5 0 0 0
[pid=23634/tid=23647] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23647/stat : 23647 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948092800 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427215281 0 4 0 16800975 18446604461596266624 0 0 -1 1 0 0 0
[pid=23634/tid=23648] ppid=23632 vsize=8550044 CPUtime=0.48 cores=1,3,5,7
/proc/23634/task/23648/stat : 23648 (java) R 23632 23634 23634 0 -1 4202560 6448 0 0 0 48 0 0 0 17 0 19 0 948092800 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 47725041391322 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=23634/tid=23649] ppid=23632 vsize=8550044 CPUtime=0.47 cores=1,3,5,7
/proc/23634/task/23649/stat : 23649 (java) R 23632 23634 23634 0 -1 4202560 6152 0 0 0 47 0 0 0 16 0 19 0 948092800 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 47725042902034 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=23634/tid=23650] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23650/stat : 23650 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 948092800 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427207577 0 4 0 16800975 18446604461596266624 0 0 -1 1 0 0 0
[pid=23634/tid=23651] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23651/stat : 23651 (java) S 23632 23634 23634 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 948092800 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427208192 0 4 0 16800975 18446604461596266624 0 0 -1 3 0 0 0
[pid=23634/tid=23652] ppid=23632 vsize=8550044 CPUtime=0 cores=1,3,5,7
/proc/23634/task/23652/stat : 23652 (java) S 23632 23634 23634 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 948092832 8755245056 22770 33554432000 1073741824 1073778376 140733537917856 18446744073709551615 256427208192 0 4 0 16800975 18446604461596266624 0 0 -1 1 0 0 0
[pid=23590/tid=23598] ppid=23588 vsize=326156 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23598/stat : 23598 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 5 0 948078530 333983744 7705 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 7 0 0 0
[pid=23590/tid=23605] ppid=23588 vsize=326156 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23605/stat : 23605 (python) S 23588 23590 21667 0 -1 4202560 30 1345 0 0 0 0 2 1 20 0 5 0 948083244 333983744 7705 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 1 0 0 0
[pid=23590/tid=23610] ppid=23588 vsize=326156 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23610/stat : 23610 (python) S 23588 23590 21667 0 -1 4202560 27 1345 0 0 0 0 2 1 20 0 5 0 948088050 333983744 7705 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 5 0 0 0
[pid=23590/tid=23633] ppid=23588 vsize=326156 CPUtime=0.03 cores=1,3,5,7
/proc/23590/task/23633/stat : 23633 (python) S 23588 23590 21667 0 -1 4202560 31 1345 0 0 0 0 2 1 20 0 5 0 948092795 333983744 7705 33554432000 4194304 5683644 140736842618960 18446744073709551615 256427215281 0 0 16781312 33554434 18446604461596269312 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 146.81
Current children cumulated vsize (KiB) 18796880

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23590 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=522920
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=147977
# CPU time returned by wait4() is 0.670897
# while last known CPU time is 146.81
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 144.086
CPU time (s): 146.81
CPU user time (s): 144.86
CPU system time (s): 1.95
CPU usage (%): 101.89
Max. virtual memory (cumulated for all children) (KiB): 18796880

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.52292
system time used= 0.147977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15236
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3146
involuntary context switches= 22

runsolver used 0.961853 second user time and 2.13468 second system time

The end

Launcher Data 

Begin job on node115 at 2011-06-09 02:14:37
IDJOB=3481604
IDBENCH=48271
IDSOLVER=1970
FILE ID=node115/3481604-1307578477
RUNJOBID= node115-1307576359-21686
PBS_JOBID= 13547684
Free space on /tmp= 73488 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/bsg/normalized-bsg_200_10_2.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481604-1307578477/watcher-3481604-1307578477 -o /tmp/evaluation-result-3481604-1307578477/solver-3481604-1307578477 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481604-1307578477.opb -seed 1028587990 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b5a23f46b7c8ffe564ae87cb51d69480
RANDOM SEED=1028587990

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12385288 kB
Buffers:        172760 kB
Cached:         832424 kB
SwapCached:       9708 kB
Active:       20074048 kB
Inactive:       157892 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12385288 kB
SwapTotal:    67111528 kB
SwapFree:     50514916 kB
Dirty:          102412 kB
Writeback:           0 kB
AnonPages:    19224012 kB
Mapped:         103344 kB
Slab:           139880 kB
PageTables:     119756 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 177293820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73384 MiB
End job on node115 at 2011-06-09 02:17:04