Trace number 3482310

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 665.37 659.803

General information on the benchmark

Name/OPT-SMALLINT-LIN/heinz/
normalized-queens-30.opb
MD5SUMac9944a86f58bd3c1af4c4c4a209f399
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-37
Best CPU time to get the best result obtained on this benchmark1798.05
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables900
Total number of constraints960
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints960
Minimum length of a constraint88
Maximum length of a constraint116
Number of terms in the objective function 900
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 900
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 8
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 900
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.34/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.34/0.68	c INFO: solving HOME/instance-3482310-1307578979.opb
0.53/0.81	c INFO: parsing took 0.14 s
0.73/1.09	c INFO: features took 0.27 CPU seconds
0.73/1.11	c INFO: running clasp-1.3.7@0 for 45 with 1799 remaining (b = 0.97)
48.67/48.73	c INFO: running wbo1.4a@0 for 45 with 1751 remaining (b = 0.11)
96.02/95.86	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1705 remaining (b = 0.01)
146.43/143.87	c INFO: running bsolo_pb10-l3@0 for 136 with 1655 remaining (b = 0.02)
286.55/283.27	c INFO: running wbo1.4a@46 for 45 with 1518 remaining (b = 0.00)
332.92/329.24	c INFO: running scip-2.0.1-spx@0 for 45 with 1472 remaining (b = 0.01)
379.41/375.57	c INFO: running bsolo_pb10-l3@137 for 45 with 1426 remaining (b = 0.00)
429.48/425.42	c INFO: running wbo1.4a@91 for 136 with 1377 remaining (b = 0.01)
569.85/564.97	c INFO: running scip-2.0.1-clp@0 for 45 with 1240 remaining (b = 0.00)
618.55/613.48	c INFO: running wbo1.4a@229 for 45 with 1191 remaining (b = 0.00)
664.81/659.47	c INFO: running sat4j-pb-v20101225@0 for 91 with 1146 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482310-1307578979/watcher-3482310-1307578979 -o /tmp/evaluation-result-3482310-1307578979/solver-3482310-1307578979 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482310-1307578979.opb -seed 288235640 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 2.03 1.93 2/825 4310
/proc/meminfo: memFree=10802324/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=15760 CPUtime=0 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 845 0 0 0 0 0 0 0 25 0 1 0 869496725 16138240 727 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 3 0 0 0
/proc/4310/statm: 3941 728 334 364 0 428 0

[startup+0.112491 s]
/proc/loadavg: 1.92 2.03 1.93 2/825 4310
/proc/meminfo: memFree=10802324/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=96176 CPUtime=0.06 cores=1,3,5,7
/proc/4310/stat : 4310 (python) R 4308 4310 2544 0 -1 4202496 2980 465 1 0 5 1 0 0 18 0 1 0 869496725 98484224 2482 33554432000 4194304 5683644 140736133440208 18446744073709551615 251809316919 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/4310/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96176

[startup+0.200499 s]
/proc/loadavg: 1.92 2.03 1.93 2/825 4310
/proc/meminfo: memFree=10802324/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=119980 CPUtime=0.12 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 4928 929 1 0 9 3 0 0 17 0 1 0 869496725 122859520 3350 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 3 0 0 0
/proc/4310/statm: 29995 3350 919 364 0 2444 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 119980

[startup+0.300475 s]
/proc/loadavg: 1.92 2.03 1.93 2/825 4310
/proc/meminfo: memFree=10802324/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=123736 CPUtime=0.16 cores=1,3,5,7
/proc/4310/stat : 4310 (python) R 4308 4310 2544 0 -1 4202496 5357 929 1 0 12 4 0 0 16 0 1 0 869496725 126705664 3743 33554432000 4194304 5683644 140736133440208 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/4310/statm: 30934 3743 987 364 0 2766 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 123736

[startup+0.700391 s]
/proc/loadavg: 1.92 2.03 1.93 2/825 4310
/proc/meminfo: memFree=10802324/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=283764 CPUtime=0.43 cores=1,3,5,7
/proc/4310/stat : 4310 (python) R 4308 4310 2544 0 -1 4202496 9397 929 1 0 33 10 0 0 15 0 1 0 869496725 290574336 7259 33554432000 4194304 5683644 140736133440208 18446744073709551615 251813926611 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/4310/statm: 70941 7259 1781 364 0 5834 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 283764

[startup+1.50019 s]
/proc/loadavg: 1.92 2.03 1.93 3/826 4315
/proc/meminfo: memFree=10773424/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=297408 CPUtime=0.84 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 11597 929 1 0 74 10 0 0 18 0 2 0 869496725 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/4310/statm: 74352 8205 1872 364 0 9239 0
[pid=4310/tid=4317] ppid=4308 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 2 0 869496837 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.84
Current children cumulated vsize (KiB) 297408

[startup+3.12391 s]
/proc/loadavg: 1.92 2.03 1.93 3/830 4319
/proc/meminfo: memFree=10760880/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=297408 CPUtime=0.84 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 11597 929 1 0 74 10 0 0 18 0 2 0 869496725 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/4310/statm: 74352 8205 1872 364 0 9239 0
[pid=4316] ppid=4310 vsize=287164 CPUtime=0 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 869496837 294055936 6680 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260239 0 0 16781312 33554946 13618537797429199109 0 0 17 3 0 0 0
/proc/4316/statm: 71791 6680 351 364 0 6678 0
[pid=4318] ppid=4316 vsize=5620 CPUtime=2 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) R 4316 4318 4318 0 -1 4202496 1411 0 0 0 200 0 0 0 25 0 1 0 869496837 5754880 1146 33554432000 134512640 136139019 4289455504 18446744073709551615 135361700 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/4318/statm: 1405 1146 184 398 0 1005 0
[pid=4310/tid=4317] ppid=4308 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 2 0 869496837 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 590192

[startup+6.30044 s]
/proc/loadavg: 1.93 2.03 1.93 3/830 4320
/proc/meminfo: memFree=10762864/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=297408 CPUtime=0.84 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 11597 929 1 0 74 10 0 0 18 0 2 0 869496725 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/4310/statm: 74352 8205 1872 364 0 9239 0
[pid=4316] ppid=4310 vsize=287164 CPUtime=0.01 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 903 0 0 0 0 1 0 0 15 0 1 0 869496837 294055936 6703 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260239 0 0 16781312 33554946 15076225577155264773 0 0 17 7 0 0 0
/proc/4316/statm: 71791 6703 374 364 0 6678 0
[pid=4318] ppid=4316 vsize=5580 CPUtime=5.18 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) R 4316 4318 4318 0 -1 4202496 1420 0 0 0 518 0 0 0 25 0 1 0 869496837 5713920 1155 33554432000 134512640 136139019 4289455504 18446744073709551615 134875832 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/4318/statm: 1395 1155 184 398 0 995 0
[pid=4310/tid=4317] ppid=4308 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 2 0 869496837 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 590152

[startup+12.7004 s]
/proc/loadavg: 1.93 2.03 1.93 3/830 4320
/proc/meminfo: memFree=10761600/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=297408 CPUtime=0.84 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 11597 929 1 0 74 10 0 0 18 0 2 0 869496725 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/4310/statm: 74352 8205 1872 364 0 9239 0
[pid=4316] ppid=4310 vsize=287164 CPUtime=0.04 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 907 0 0 0 2 2 0 0 15 0 1 0 869496837 294055936 6704 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260239 0 0 16781312 33554946 5623753486446373765 0 0 17 7 0 0 0
/proc/4316/statm: 71791 6704 375 364 0 6678 0
[pid=4318] ppid=4316 vsize=5620 CPUtime=11.57 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) R 4316 4318 4318 0 -1 4202496 1433 0 0 0 1157 0 0 0 25 0 1 0 869496837 5754880 1168 33554432000 134512640 136139019 4289455504 18446744073709551615 134877207 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/4318/statm: 1405 1168 184 398 0 1005 0
[pid=4310/tid=4317] ppid=4308 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 2 0 869496837 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 590192

[startup+25.5012 s]
/proc/loadavg: 1.95 2.03 1.93 3/830 4320
/proc/meminfo: memFree=10762312/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=297408 CPUtime=0.84 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 11597 929 1 0 74 10 0 0 18 0 2 0 869496725 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/4310/statm: 74352 8205 1872 364 0 9239 0
[pid=4316] ppid=4310 vsize=287164 CPUtime=0.11 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 919 0 0 0 5 6 0 0 15 0 1 0 869496837 294055936 6704 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260239 0 0 16781312 33554946 5623753486446373765 0 0 17 7 0 0 0
/proc/4316/statm: 71791 6704 375 364 0 6678 0
[pid=4318] ppid=4316 vsize=5692 CPUtime=24.38 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) R 4316 4318 4318 0 -1 4202496 1447 0 0 0 2438 0 0 0 25 0 1 0 869496837 5828608 1182 33554432000 134512640 136139019 4289455504 18446744073709551615 134599813 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/4318/statm: 1423 1182 184 398 0 1023 0
[pid=4310/tid=4317] ppid=4308 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 2 0 869496837 304545792 8205 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.33
Current children cumulated vsize (KiB) 590264

[startup+51.1008 s]
/proc/loadavg: 1.96 2.02 1.93 3/834 4325
/proc/meminfo: memFree=10713256/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=307664 CPUtime=0.87 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 12485 929 1 0 76 11 0 0 19 0 3 0 869496725 315047936 8212 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/4310/statm: 76916 8212 1875 364 0 11800 0
[pid=4316] ppid=4310 vsize=297408 CPUtime=0.24 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 1097 0 0 0 11 13 0 0 16 0 2 0 869496837 304545792 6740 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4316/statm: 74352 6740 406 364 0 9239 0
[pid=4318] ppid=4316 vsize=5788 CPUtime=47.59 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) T 4316 4318 4318 0 -1 4202496 1501 0 0 0 4759 0 0 0 25 0 1 0 869496837 5926912 1205 33554432000 134512640 136139019 4289455504 18446744073709551615 134742383 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/4318/statm: 1447 1205 184 398 0 1047 0
[pid=4316/tid=4322] ppid=4310 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4316/task/4322/stat : 4322 (python) S 4310 4310 2544 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869501596 304545792 6740 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604459403998272 0 0 -1 7 0 0 0
[pid=4323] ppid=4310 vsize=297420 CPUtime=0 cores=1,3,5,7
/proc/4323/stat : 4323 (python) S 4310 4310 2544 0 -1 4202560 815 0 0 0 0 0 0 0 15 0 1 0 869501599 304558080 6681 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260294 0 0 16781312 33554946 4294934789 0 0 17 7 0 0 0
/proc/4323/statm: 74355 6681 348 364 0 9239 0
[pid=4325] ppid=4323 vsize=54828 CPUtime=2.35 cores=1,3,5,7
/proc/4325/stat : 4325 (wbo1.4a) R 4323 4325 4325 0 -1 4202496 13732 0 0 0 230 5 0 0 25 0 1 0 869501599 56143872 13284 33554432000 134512640 135751879 4288114416 18446744073709551615 135202521 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/4325/statm: 13707 13284 146 303 0 13402 0
[pid=4310/tid=4317] ppid=4308 vsize=307664 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 3 0 869496837 315047936 8212 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
[pid=4310/tid=4324] ppid=4308 vsize=307664 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4324/stat : 4324 (python) S 4308 4310 2544 0 -1 4202560 27 929 0 0 0 0 0 0 20 0 3 0 869501599 315047936 8212 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 963108

[startup+102.301 s]
/proc/loadavg: 1.98 2.02 1.93 3/856 4348
/proc/meminfo: memFree=10286484/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=317920 CPUtime=0.9 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 13327 929 1 0 79 11 0 0 20 0 4 0 869496725 325550080 8218 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/4310/statm: 79480 8218 1877 364 0 14361 0
[pid=4316] ppid=4310 vsize=297408 CPUtime=0.24 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 1097 0 0 0 11 13 0 0 16 0 2 0 869496837 304545792 6740 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4316/statm: 74352 6740 406 364 0 9239 0
[pid=4318] ppid=4316 vsize=5788 CPUtime=47.59 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) T 4316 4318 4318 0 -1 4202496 1501 0 0 0 4759 0 0 0 25 0 1 0 869496837 5926912 1205 33554432000 134512640 136139019 4289455504 18446744073709551615 134742383 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/4318/statm: 1447 1205 184 398 0 1047 0
[pid=4316/tid=4322] ppid=4310 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4316/task/4322/stat : 4322 (python) S 4310 4310 2544 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869501596 304545792 6740 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604459403998272 0 0 -1 7 0 0 0
[pid=4323] ppid=4310 vsize=297420 CPUtime=0.29 cores=1,3,5,7
/proc/4323/stat : 4323 (python) S 4310 4310 2544 0 -1 4202560 1141 0 0 0 13 16 0 0 16 0 2 0 869501599 304558080 6730 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4323/statm: 74355 6730 396 364 0 9239 0
[pid=4325] ppid=4323 vsize=100868 CPUtime=47.09 cores=1,3,5,7
/proc/4325/stat : 4325 (wbo1.4a) T 4323 4325 4325 0 -1 4202496 25267 0 0 0 4654 55 0 0 25 0 1 0 869501599 103288832 24793 33554432000 134512640 135751879 4288114416 18446744073709551615 134616786 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/4325/statm: 25217 24793 146 303 0 24912 0
[pid=4323/tid=4327] ppid=4310 vsize=297420 CPUtime=0 cores=1,3,5,7
/proc/4323/task/4327/stat : 4327 (python) S 4310 4310 2544 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869506309 304558080 6730 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604457688569728 0 0 -1 7 0 0 0
[pid=4328] ppid=4310 vsize=307676 CPUtime=0.02 cores=1,3,5,7
/proc/4328/stat : 4328 (python) S 4310 4310 2544 0 -1 4202560 953 0 0 0 1 1 0 0 15 0 1 0 869506311 315060224 6710 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260294 0 0 16781312 33554946 4294934789 0 0 17 3 0 0 0
/proc/4328/statm: 76919 6710 373 364 0 11800 0
[pid=4330] ppid=4328 vsize=8543696 CPUtime=8.01 cores=1,3,5,7
/proc/4330/stat : 4330 (java) S 4328 4330 4330 0 -1 4202496 97322 0 1 0 788 13 0 0 20 0 19 0 869506312 8748744704 91829 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826042853 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/4330/statm: 2135924 91829 2247 9 0 2126665 0
[pid=4330/tid=4331] ppid=4328 vsize=8543696 CPUtime=6.3 cores=1,3,5,7
/proc/4330/task/4331/stat : 4331 (java) R 4328 4330 4330 0 -1 4202560 64325 0 1 0 621 9 0 0 25 0 19 0 869506313 8748744704 91829 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 46912505776246 0 4 0 16800975 0 0 0 -1 5 0 0 0

################
# More data... #
################




Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+659.701 s]
/proc/loadavg: 1.02 1.37 1.67 5/888 4463
/proc/meminfo: memFree=7674084/32950928 swapFree=41528364/67111528
[pid=4310] ppid=4308 vsize=358944 CPUtime=1.08 cores=1,3,5,7
/proc/4310/stat : 4310 (python) S 4308 4310 2544 0 -1 4202496 17189 929 1 0 96 12 0 0 20 0 8 0 869496725 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/4310/statm: 89736 8242 1885 364 0 24605 0
[pid=4316] ppid=4310 vsize=297408 CPUtime=0.24 cores=1,3,5,7
/proc/4316/stat : 4316 (python) S 4310 4310 2544 0 -1 4202560 1097 0 0 0 11 13 0 0 16 0 2 0 869496837 304545792 6740 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4316/statm: 74352 6740 406 364 0 9239 0
[pid=4318] ppid=4316 vsize=5788 CPUtime=47.59 cores=1,3,5,7
/proc/4318/stat : 4318 (clasp-1.3.7-x86) T 4316 4318 4318 0 -1 4202496 1501 0 0 0 4759 0 0 0 25 0 1 0 869496837 5926912 1205 33554432000 134512640 136139019 4289455504 18446744073709551615 134742383 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/4318/statm: 1447 1205 184 398 0 1047 0
[pid=4316/tid=4322] ppid=4310 vsize=297408 CPUtime=0 cores=1,3,5,7
/proc/4316/task/4322/stat : 4322 (python) S 4310 4310 2544 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869501596 304545792 6740 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604459403998272 0 0 -1 7 0 0 0
[pid=4323] ppid=4310 vsize=297420 CPUtime=1.67 cores=1,3,5,7
/proc/4323/stat : 4323 (python) S 4310 4310 2544 0 -1 4202560 1222 0 0 0 78 89 0 0 16 0 2 0 869501599 304558080 6730 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4323/statm: 74355 6730 396 364 0 9239 0
[pid=4325] ppid=4323 vsize=380336 CPUtime=278.54 cores=1,3,5,7
/proc/4325/stat : 4325 (wbo1.4a) T 4323 4325 4325 0 -1 4202496 95123 0 0 0 27449 405 0 0 25 0 1 0 869501599 389464064 94621 33554432000 134512640 135751879 4288114416 18446744073709551615 134616492 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/4325/statm: 95084 94621 146 303 0 94779 0
[pid=4323/tid=4327] ppid=4310 vsize=297420 CPUtime=0 cores=1,3,5,7
/proc/4323/task/4327/stat : 4327 (python) S 4310 4310 2544 0 -1 4202560 53 0 0 0 0 0 0 0 15 0 2 0 869506309 304558080 6730 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604457688569728 0 0 -1 5 0 0 0
[pid=4328] ppid=4310 vsize=307676 CPUtime=0.26 cores=1,3,5,7
/proc/4328/stat : 4328 (python) S 4310 4310 2544 0 -1 4202560 1138 0 0 0 13 13 0 0 16 0 2 0 869506311 315060224 6735 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4328/statm: 76919 6735 397 364 0 11800 0
[pid=4330] ppid=4328 vsize=8543696 CPUtime=50.13 cores=1,3,5,7
/proc/4330/stat : 4330 (java) T 4328 4330 4330 0 -1 4202496 571693 0 1 0 4945 68 0 0 18 0 19 0 869506312 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826042853 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/4330/statm: 2135924 565718 2247 9 0 2126665 0
[pid=4330/tid=4331] ppid=4328 vsize=8543696 CPUtime=47.58 cores=1,3,5,7
/proc/4330/task/4331/stat : 4331 (java) T 4328 4330 4330 0 -1 4202560 466381 0 1 0 4702 56 0 0 25 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 46912505760543 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=4330/tid=4332] ppid=4328 vsize=8543696 CPUtime=0.12 cores=1,3,5,7
/proc/4330/task/4332/stat : 4332 (java) T 4328 4330 4330 0 -1 4202560 12234 0 0 0 11 1 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4330/tid=4333] ppid=4328 vsize=8543696 CPUtime=0.04 cores=1,3,5,7
/proc/4330/task/4333/stat : 4333 (java) T 4328 4330 4330 0 -1 4202560 5183 0 0 0 4 0 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4334] ppid=4328 vsize=8543696 CPUtime=0.15 cores=1,3,5,7
/proc/4330/task/4334/stat : 4334 (java) T 4328 4330 4330 0 -1 4202560 15490 0 0 0 14 1 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4335] ppid=4328 vsize=8543696 CPUtime=0.13 cores=1,3,5,7
/proc/4330/task/4335/stat : 4335 (java) T 4328 4330 4330 0 -1 4202560 12374 0 0 0 12 1 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=4330/tid=4336] ppid=4328 vsize=8543696 CPUtime=0.08 cores=1,3,5,7
/proc/4330/task/4336/stat : 4336 (java) T 4328 4330 4330 0 -1 4202560 8446 0 0 0 8 0 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=4330/tid=4337] ppid=4328 vsize=8543696 CPUtime=0.18 cores=1,3,5,7
/proc/4330/task/4337/stat : 4337 (java) T 4328 4330 4330 0 -1 4202560 18033 0 0 0 17 1 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4338] ppid=4328 vsize=8543696 CPUtime=0.11 cores=1,3,5,7
/proc/4330/task/4338/stat : 4338 (java) T 4328 4330 4330 0 -1 4202560 10436 0 0 0 10 1 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4330/tid=4339] ppid=4328 vsize=8543696 CPUtime=0.1 cores=1,3,5,7
/proc/4330/task/4339/stat : 4339 (java) T 4328 4330 4330 0 -1 4202560 9939 0 0 0 10 0 0 0 15 0 19 0 869506313 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=4330/tid=4340] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4340/stat : 4340 (java) T 4328 4330 4330 0 -1 4202560 1269 0 0 0 0 0 0 0 15 0 19 0 869506314 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056704 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4330/tid=4341] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4341/stat : 4341 (java) T 4328 4330 4330 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869506315 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4342] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4342/stat : 4342 (java) T 4328 4330 4330 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869506315 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4343] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4343/stat : 4343 (java) T 4328 4330 4330 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869506317 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826063793 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4344] ppid=4328 vsize=8543696 CPUtime=0.86 cores=1,3,5,7
/proc/4330/task/4344/stat : 4344 (java) T 4328 4330 4330 0 -1 4202560 5250 0 0 0 86 0 0 0 15 0 19 0 869506317 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4330/tid=4345] ppid=4328 vsize=8543696 CPUtime=0.66 cores=1,3,5,7
/proc/4330/task/4345/stat : 4345 (java) T 4328 4330 4330 0 -1 4202560 5267 0 0 0 66 0 0 0 15 0 19 0 869506317 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4346] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4346/stat : 4346 (java) T 4328 4330 4330 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869506317 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056089 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4347] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4347/stat : 4347 (java) T 4328 4330 4330 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869506317 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056704 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4330/tid=4348] ppid=4328 vsize=8543696 CPUtime=0 cores=1,3,5,7
/proc/4330/task/4348/stat : 4348 (java) T 4328 4330 4330 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869506362 8748744704 565718 33554432000 1073741824 1073778376 140736145391328 18446744073709551615 251826056704 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4328/tid=4371] ppid=4310 vsize=307676 CPUtime=0 cores=1,3,5,7
/proc/4328/task/4371/stat : 4371 (python) S 4310 4310 2544 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869511110 315060224 6735 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604455906848896 0 0 -1 7 0 0 0
[pid=4372] ppid=4310 vsize=317932 CPUtime=1.02 cores=1,3,5,7
/proc/4372/stat : 4372 (python) S 4310 4310 2544 0 -1 4202560 1231 0 0 0 49 53 0 0 15 0 2 0 869511113 325562368 6738 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4372/statm: 79483 6738 396 364 0 14361 0
[pid=4374] ppid=4372 vsize=27704 CPUtime=189.18 cores=1,3,5,7
/proc/4374/stat : 4374 (bsolo_pb10) T 4372 4374 4374 0 -1 4202496 2444842 0 0 0 18661 257 0 0 25 0 1 0 869511113 28368896 3198 33554432000 134512640 137138936 4288988720 18446744073709551615 136505150 0 0 16781312 16384 18446744071562691360 0 0 17 1 0 0 0
/proc/4374/statm: 6926 3198 292 642 0 6282 0
[pid=4372/tid=4384] ppid=4310 vsize=317932 CPUtime=0 cores=1,3,5,7
/proc/4372/task/4384/stat : 4384 (python) S 4310 4310 2544 0 -1 4202560 53 0 0 0 0 0 0 0 15 0 2 0 869525050 325562368 6738 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604458055440384 0 0 -1 7 0 0 0
[pid=4427] ppid=4310 vsize=328188 CPUtime=0.25 cores=1,3,5,7
/proc/4427/stat : 4427 (python) S 4310 4310 2544 0 -1 4202560 1169 0 0 0 10 15 0 0 16 0 2 0 869529650 336064512 6743 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4427/statm: 82047 6743 397 364 0 16922 0
[pid=4429] ppid=4427 vsize=124848 CPUtime=46.29 cores=1,3,5,7
/proc/4429/stat : 4429 (scip-2.0.1.linu) T 4427 4429 4429 0 -1 4202496 42584 0 0 0 4615 14 0 0 25 0 1 0 869529650 127844352 28793 33554432000 4194304 13684479 140735095548160 18446744073709551615 7430464 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/4429/statm: 31212 28793 788 2317 0 28890 0
[pid=4427/tid=4431] ppid=4310 vsize=328188 CPUtime=0 cores=1,3,5,7
/proc/4427/task/4431/stat : 4431 (python) S 4310 4310 2544 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 869534280 336064512 6743 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604470492749888 0 0 -1 7 0 0 0
[pid=4437] ppid=4310 vsize=338444 CPUtime=0.25 cores=1,3,5,7
/proc/4437/stat : 4437 (python) S 4310 4310 2544 0 -1 4202560 1205 0 0 0 11 14 0 0 16 0 2 0 869553222 346566656 6752 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4437/statm: 84611 6752 402 364 0 19483 0
[pid=4439] ppid=4437 vsize=111924 CPUtime=48.43 cores=1,3,5,7
/proc/4439/stat : 4439 (scip-2.0.1.linu) T 4437 4439 4439 0 -1 4202496 70399 0 0 0 4833 10 0 0 25 0 1 0 869553222 114610176 22949 33554432000 4194304 15243407 140735875101280 18446744073709551615 12374690 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/4439/statm: 27981 22949 899 2698 0 25276 0
[pid=4437/tid=4442] ppid=4310 vsize=338444 CPUtime=0 cores=1,3,5,7
/proc/4437/task/4442/stat : 4442 (python) S 4310 4310 2544 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869558072 346566656 6752 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554946 18446604466963113280 0 0 -1 7 0 0 0
[pid=4444] ppid=4310 vsize=348700 CPUtime=0 cores=1,3,5,7
/proc/4444/stat : 4444 (python) S 4310 4310 2544 0 -1 4202560 883 0 0 0 0 0 0 0 19 0 1 0 869562672 357068800 6708 33554432000 4194304 5683644 140736133440208 18446744073709551615 251814260294 0 0 16781312 33554946 1564819459682598912 0 0 17 5 0 0 0
/proc/4444/statm: 87175 6708 355 364 0 22044 0
[pid=4446] ppid=4444 vsize=8539500 CPUtime=0.44 cores=1,3,5,7
/proc/4446/stat : 4446 (java) S 4444 4446 4446 0 -1 4202496 11295 0 1 0 43 1 0 0 20 0 18 0 869562672 8744448000 9965 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826042853 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/4446/statm: 2134875 9965 2194 9 0 2125616 0
[pid=4446/tid=4447] ppid=4444 vsize=8539500 CPUtime=0.25 cores=1,3,5,7
/proc/4446/task/4447/stat : 4447 (java) R 4444 4446 4446 0 -1 4202560 5618 0 1 0 25 0 0 0 25 0 18 0 869562673 8744448000 10324 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 46912505365719 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=4446/tid=4448] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4448/stat : 4448 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869562674 8744448000 10325 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4449] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4449/stat : 4449 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869562674 8744448000 10325 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4450] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4450/stat : 4450 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869562674 8744448000 10326 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4451] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4451/stat : 4451 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869562674 8744448000 10326 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4452] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4452/stat : 4452 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869562674 8744448000 10327 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4453] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4453/stat : 4453 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869562674 8744448000 10329 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4454] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4454/stat : 4454 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869562674 8744448000 10329 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4455] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4455/stat : 4455 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869562674 8744448000 10329 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4456] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4456/stat : 4456 (java) S 4444 4446 4446 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869562675 8744448000 10330 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056704 0 0 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4457] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4457/stat : 4457 (java) S 4444 4446 4446 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869562675 8744448000 10331 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4458] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4458/stat : 4458 (java) S 4444 4446 4446 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 18 0 869562675 8744448000 10332 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 5 0 0 0
[pid=4446/tid=4459] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4459/stat : 4459 (java) S 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869562678 8744448000 10332 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826063793 0 4 0 16800975 18446604455986441024 0 0 -1 1 0 0 0
[pid=4446/tid=4460] ppid=4444 vsize=8539500 CPUtime=0.09 cores=1,3,5,7
/proc/4446/task/4460/stat : 4460 (java) R 4444 4446 4446 0 -1 4202560 2521 0 0 0 9 0 0 0 25 0 18 0 869562678 8744448000 10333 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 47786632344320 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=4446/tid=4461] ppid=4444 vsize=8539500 CPUtime=0.11 cores=1,3,5,7
/proc/4446/task/4461/stat : 4461 (java) R 4444 4446 4446 0 -1 4202560 2244 0 0 0 11 0 0 0 25 0 18 0 869562678 8744448000 10334 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 47786633884373 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=4446/tid=4462] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4462/stat : 4462 (java) S 4444 4446 4446 0 -1 4202560 3 0 0 0 0 0 0 0 25 0 18 0 869562678 8744448000 10334 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056089 0 4 0 16800975 18446604455986441024 0 0 -1 7 0 0 0
[pid=4446/tid=4463] ppid=4444 vsize=8539500 CPUtime=0 cores=1,3,5,7
/proc/4446/task/4463/stat : 4463 (java) R 4444 4446 4446 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869562678 8744448000 10335 33554432000 1073741824 1073778376 140737339241232 18446744073709551615 251826056704 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=4310/tid=4317] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4317/stat : 4317 (python) S 4308 4310 2544 0 -1 4202560 29 929 0 0 0 0 0 0 18 0 8 0 869496837 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
[pid=4310/tid=4324] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4324/stat : 4324 (python) S 4308 4310 2544 0 -1 4202560 43 929 0 0 0 0 0 0 18 0 8 0 869501599 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 3 0 0 0
[pid=4310/tid=4329] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4329/stat : 4329 (python) S 4308 4310 2544 0 -1 4202560 32 929 0 0 0 0 0 0 20 0 8 0 869506311 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 5 0 0 0
[pid=4310/tid=4373] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4373/stat : 4373 (python) S 4308 4310 2544 0 -1 4202560 32 929 0 0 0 0 0 0 18 0 8 0 869511113 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 1 0 0 0
[pid=4310/tid=4428] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4428/stat : 4428 (python) S 4308 4310 2544 0 -1 4202560 31 929 0 0 0 0 0 0 20 0 8 0 869529650 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 5 0 0 0
[pid=4310/tid=4438] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4438/stat : 4438 (python) S 4308 4310 2544 0 -1 4202560 26 929 0 0 0 0 0 0 20 0 8 0 869553222 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 5 0 0 0
[pid=4310/tid=4445] ppid=4308 vsize=358944 CPUtime=0 cores=1,3,5,7
/proc/4310/task/4445/stat : 4445 (python) S 4308 4310 2544 0 -1 4202560 27 929 0 0 0 0 0 0 20 0 8 0 869562672 367558656 8242 33554432000 4194304 5683644 140736133440208 18446744073709551615 251826063793 0 0 16781312 33554434 18446604466731906112 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 665.37
Current children cumulated vsize (KiB) 20328508

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4310 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=962853
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=123981
# CPU time returned by wait4() is 1.08683
# while last known CPU time is 665.37
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 659.803
CPU time (s): 665.37
CPU user time (s): 655.73
CPU system time (s): 9.64
CPU usage (%): 100.844
Max. virtual memory (cumulated for all children) (KiB): 20328508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.962853
system time used= 0.123981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18123
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2883
involuntary context switches= 22

runsolver used 5.72813 second user time and 12.4781 second system time

The end

Launcher Data 

Begin job on node126 at 2011-06-09 02:23:00
IDJOB=3482310
IDBENCH=89874
IDSOLVER=1970
FILE ID=node126/3482310-1307578979
RUNJOBID= node126-1307576357-2563
PBS_JOBID= 13547673
Free space on /tmp= 73444 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/heinz/normalized-queens-30.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482310-1307578979/watcher-3482310-1307578979 -o /tmp/evaluation-result-3482310-1307578979/solver-3482310-1307578979 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482310-1307578979.opb -seed 288235640 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac9944a86f58bd3c1af4c4c4a209f399
RANDOM SEED=288235640

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      10802604 kB
Buffers:        168340 kB
Cached:         875716 kB
SwapCached:      15344 kB
Active:       21596948 kB
Inactive:       185324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      10802604 kB
SwapTotal:    67111528 kB
SwapFree:     41528364 kB
Dirty:          102488 kB
Writeback:           0 kB
AnonPages:    20735380 kB
Mapped:         115424 kB
Slab:           147004 kB
PageTables:     144268 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 201877812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73396 MiB
End job on node126 at 2011-06-09 02:34:02