Trace number 3482799

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 1682.17 1673.11

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12016_4-sat.opb
MD5SUM142eb7aa6e3fc22a3161df6b33ced1a2
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables48642
Total number of constraints155800
Number of constraints which are clauses155000
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints800
Minimum length of a constraint1
Maximum length of a constraint120
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 22
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 684
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.30/0.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.30/0.49	c INFO: solving HOME/instance-3482799-1307578176.opb
1.17/1.33	c INFO: parsing took 0.83 s
2.68/2.83	c INFO: features took 1.49 CPU seconds
2.73/3.77	c INFO: running clasp-1.3.7@0 for 45 with 1797 remaining (b = 0.12)
51.15/51.10	c INFO: running scip-2.0.1-spx@0 for 45 with 1749 remaining (b = 0.03)
109.47/109.26	c INFO: wrote minion input file to HOME/tmpsIYNy6.minion
109.47/109.26	c INFO: running minion-0.12@0 for 45 with 1699 remaining (b = 0.02)
158.26/157.83	c INFO: running scip-2.0.1-clp@0 for 45 with 1643 remaining (b = 0.02)
209.62/209.03	c INFO: running clasp-1.3.7@48 for 45 with 1592 remaining (b = 0.01)
256.02/255.26	c INFO: running wbo1.4a@0 for 45 with 1546 remaining (b = 0.01)
306.11/305.18	c INFO: running scip-2.0.1-clp@50 for 45 with 1496 remaining (b = 0.01)
351.63/350.42	c INFO: running clasp-1.3.7@94 for 136 with 1451 remaining (b = 0.03)
488.70/487.00	c INFO: running scip-2.0.1-spx@49 for 45 with 1314 remaining (b = 0.01)
535.22/533.22	c INFO: running scip-2.0.1-spx@95 for 410 with 1268 remaining (b = 0.06)
947.85/944.17	c INFO: running bsolo_pb10-l1@0 for 91 with 858 remaining (b = 0.01)
1041.17/1037.18	c INFO: running scip-2.0.1-spx@506 for 547 with 765 remaining (b = 0.06)
1589.26/1582.84	c INFO: running wbo1.4b-fixed@0 for 45 with 220 remaining (b = 0.00)
1635.45/1628.85	c INFO: running sat4j-pb-v20101225@0 for 45 with 174 remaining (b = 0.00)
1682.02/1672.90	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 128 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482799-1307578176/watcher-3482799-1307578176 -o /tmp/evaluation-result-3482799-1307578176/solver-3482799-1307578176 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482799-1307578176.opb -seed 844034011 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.22 2.11 1.74 2/531 30968
/proc/meminfo: memFree=28301608/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 1051 0 0 0 0 0 0 0 17 0 1 0 869420083 16629760 922 33554432000 4194304 5683644 140735860773056 18446744073709551615 212436016896 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30968/statm: 4060 922 381 364 0 547 0

[startup+0.046568 s]
/proc/loadavg: 2.22 2.11 1.74 2/531 30968
/proc/meminfo: memFree=28301608/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=29784 CPUtime=0.02 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 1397 0 0 0 2 0 0 0 17 0 1 0 869420083 30498816 1241 33554432000 4194304 5683644 140735860773056 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30968/statm: 7446 1243 443 364 0 816 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29784

[startup+0.100555 s]
/proc/loadavg: 2.22 2.11 1.74 2/531 30968
/proc/meminfo: memFree=28301608/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=96124 CPUtime=0.06 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 3169 930 1 0 5 1 0 0 18 0 1 0 869420083 98430976 2483 33554432000 4194304 5683644 140735860773056 18446744073709551615 5178109 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30968/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 96124

[startup+0.300561 s]
/proc/loadavg: 2.22 2.11 1.74 2/531 30968
/proc/meminfo: memFree=28301608/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=182072 CPUtime=0.22 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 6279 930 1 0 16 6 0 0 17 0 1 0 869420083 186441728 4584 33554432000 4194304 5683644 140735860773056 18446744073709551615 212431093383 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/30968/statm: 45518 4584 1246 364 0 3566 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 182072

[startup+0.700435 s]
/proc/loadavg: 2.22 2.11 1.74 2/531 30968
/proc/meminfo: memFree=28301608/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=295292 CPUtime=0.57 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 12212 930 1 0 48 9 0 0 17 0 1 0 869420083 302379008 10074 33554432000 4194304 5683644 140735860773056 18446744073709551615 212435701659 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30968/statm: 73823 10074 1781 364 0 8716 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 295292

[startup+1.5003 s]
/proc/loadavg: 2.22 2.11 1.74 3/532 30973
/proc/meminfo: memFree=28254604/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=317100 CPUtime=1.38 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 23629 930 1 0 127 11 0 0 18 0 1 0 869420083 324710400 15622 33554432000 4194304 5683644 140735860773056 18446744073709551615 46955036573997 0 0 16781312 33554434 0 0 0 17 2 0 0 0
/proc/30968/statm: 79275 15622 1815 364 0 14168 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 317100

[startup+3.10098 s]
/proc/loadavg: 2.20 2.11 1.74 3/532 30973
/proc/meminfo: memFree=28241656/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=331020 CPUtime=2.73 cores=0,2,4,6
/proc/30968/stat : 30968 (python) S 30966 30968 29517 0 -1 4202496 24830 930 1 0 262 11 0 0 20 0 2 0 869420083 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30968/statm: 82755 16596 1872 364 0 17642 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 331020

[startup+6.30041 s]
/proc/loadavg: 2.20 2.11 1.74 3/535 30976
/proc/meminfo: memFree=28221772/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=331020 CPUtime=2.73 cores=0,2,4,6
/proc/30968/stat : 30968 (python) S 30966 30968 29517 0 -1 4202496 24830 930 1 0 262 11 0 0 20 0 2 0 869420083 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30968/statm: 82755 16596 1872 364 0 17642 0
[pid=30974] ppid=30968 vsize=320776 CPUtime=0.01 cores=0,2,4,6
/proc/30974/stat : 30974 (python) S 30968 30968 29517 0 -1 4202560 899 0 0 0 0 1 0 0 18 0 1 0 869420368 328474624 15094 33554432000 4194304 5683644 140735860773056 18446744073709551615 212436037135 0 0 16781312 33554946 1552969915495842051 0 0 17 2 0 0 0
/proc/30974/statm: 80194 15094 374 364 0 15081 0
[pid=30976] ppid=30974 vsize=18752 CPUtime=3.43 cores=0,2,4,6
/proc/30976/stat : 30976 (clasp-1.3.7-x86) R 30974 30976 30976 0 -1 4202496 6114 0 0 0 342 1 0 0 25 0 1 0 869420369 19202048 4403 33554432000 134512640 136139019 4290082640 18446744073709551615 134832307 0 0 16781312 16386 0 0 0 17 4 0 0 0
/proc/30976/statm: 4688 4403 184 398 0 4288 0
[pid=30968/tid=30975] ppid=30966 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30968/task/30975/stat : 30975 (python) S 30966 30968 29517 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 2 0 869420369 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 670548

[startup+12.7012 s]
/proc/loadavg: 2.17 2.11 1.74 3/535 30976
/proc/meminfo: memFree=28209020/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=331020 CPUtime=2.73 cores=0,2,4,6
/proc/30968/stat : 30968 (python) S 30966 30968 29517 0 -1 4202496 24830 930 1 0 262 11 0 0 20 0 2 0 869420083 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30968/statm: 82755 16596 1872 364 0 17642 0
[pid=30974] ppid=30968 vsize=320776 CPUtime=0.04 cores=0,2,4,6
/proc/30974/stat : 30974 (python) S 30968 30968 29517 0 -1 4202560 905 0 0 0 2 2 0 0 18 0 1 0 869420368 328474624 15095 33554432000 4194304 5683644 140735860773056 18446744073709551615 212436037135 0 0 16781312 33554946 72556772316949172 0 0 17 6 0 0 0
/proc/30974/statm: 80194 15095 375 364 0 15081 0
[pid=30976] ppid=30974 vsize=23376 CPUtime=9.83 cores=0,2,4,6
/proc/30976/stat : 30976 (clasp-1.3.7-x86) R 30974 30976 30976 0 -1 4202496 7259 0 0 0 982 1 0 0 25 0 1 0 869420369 23937024 5548 33554432000 134512640 136139019 4290082640 18446744073709551615 134832172 0 0 16781312 16386 0 0 0 17 4 0 0 0
/proc/30976/statm: 5844 5548 184 398 0 5444 0
[pid=30968/tid=30975] ppid=30966 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30968/task/30975/stat : 30975 (python) S 30966 30968 29517 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 2 0 869420369 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 675172

[startup+25.5008 s]
/proc/loadavg: 2.22 2.12 1.75 3/535 30976
/proc/meminfo: memFree=28187900/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=331020 CPUtime=2.73 cores=0,2,4,6
/proc/30968/stat : 30968 (python) S 30966 30968 29517 0 -1 4202496 24830 930 1 0 262 11 0 0 20 0 2 0 869420083 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30968/statm: 82755 16596 1872 364 0 17642 0
[pid=30974] ppid=30968 vsize=320776 CPUtime=0.08 cores=0,2,4,6
/proc/30974/stat : 30974 (python) S 30968 30968 29517 0 -1 4202560 911 0 0 0 4 4 0 0 18 0 1 0 869420368 328474624 15095 33554432000 4194304 5683644 140735860773056 18446744073709551615 212436037135 0 0 16781312 33554946 72556772316949172 0 0 17 6 0 0 0
/proc/30974/statm: 80194 15095 375 364 0 15081 0
[pid=30976] ppid=30974 vsize=29248 CPUtime=22.63 cores=0,2,4,6
/proc/30976/stat : 30976 (clasp-1.3.7-x86) R 30974 30976 30976 0 -1 4202496 8717 0 0 0 2262 1 0 0 25 0 1 0 869420369 29949952 7006 33554432000 134512640 136139019 4290082640 18446744073709551615 134876526 0 0 16781312 16386 0 0 0 17 4 0 0 0
/proc/30976/statm: 7312 7006 184 398 0 6912 0
[pid=30968/tid=30975] ppid=30966 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30968/task/30975/stat : 30975 (python) S 30966 30968 29517 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 2 0 869420369 338964480 16596 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 681044

[startup+51.1009 s]
/proc/loadavg: 2.14 2.11 1.75 3/511 31101
/proc/meminfo: memFree=28116836/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=331020 CPUtime=2.75 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 25295 930 1 0 264 11 0 0 18 0 2 0 869420083 338964480 16597 33554432000 4194304 5683644 140735860773056 18446744073709551615 212439455553 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30968/statm: 82755 16597 1873 364 0 17642 0
[pid=30974] ppid=30968 vsize=331020 CPUtime=0.2 cores=0,2,4,6
/proc/30974/stat : 30974 (python) S 30968 30968 29517 0 -1 4202560 1148 0 0 0 10 10 0 0 19 0 2 0 869420368 338964480 15136 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/30974/statm: 82755 15136 411 364 0 17642 0
[pid=30976] ppid=30974 vsize=45424 CPUtime=48.2 cores=0,2,4,6
/proc/30976/stat : 30976 (clasp-1.3.7-x86) T 30974 30976 30976 0 -1 4202496 12768 0 0 0 4818 2 0 0 25 0 1 0 869420369 46514176 11057 33554432000 134512640 136139019 4290082640 18446744073709551615 134832331 0 0 16781312 16386 18446744071562691360 0 0 17 4 0 0 0
/proc/30976/statm: 11356 11057 184 398 0 10956 0
[pid=30968/tid=30975] ppid=30966 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30968/task/30975/stat : 30975 (python) S 30966 30968 29517 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 2 0 869420369 338964480 16597 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.15
Current children cumulated vsize (KiB) 707464

[startup+102.318 s]
/proc/loadavg: 2.10 2.10 1.77 3/523 31114
/proc/meminfo: memFree=27229392/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=341280 CPUtime=3.67 cores=0,2,4,6
/proc/30968/stat : 30968 (python) R 30966 30968 29517 0 -1 4202496 26352 930 1 0 355 12 0 0 19 0 3 0 869420083 349470720 16604 33554432000 4194304 5683644 140735860773056 18446744073709551615 4540565 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/30968/statm: 85320 16604 1875 364 0 20204 0
[pid=30974] ppid=30968 vsize=331020 CPUtime=0.2 cores=0,2,4,6
/proc/30974/stat : 30974 (python) S 30968 30968 29517 0 -1 4202560 1148 0 0 0 10 10 0 0 19 0 2 0 869420368 338964480 15136 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/30974/statm: 82755 15136 411 364 0 17642 0
[pid=30976] ppid=30974 vsize=45424 CPUtime=48.2 cores=0,2,4,6
/proc/30976/stat : 30976 (clasp-1.3.7-x86) T 30974 30976 30976 0 -1 4202496 12768 0 0 0 4818 2 0 0 25 0 1 0 869420369 46514176 11057 33554432000 134512640 136139019 4290082640 18446744073709551615 134832331 0 0 16781312 16386 18446744071562691360 0 0 17 4 0 0 0
/proc/30976/statm: 11356 11057 184 398 0 10956 0
[pid=30974/tid=31102] ppid=30968 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30974/task/31102/stat : 31102 (python) S 30968 30968 29517 0 -1 4202560 40 0 0 0 0 0 0 0 19 0 2 0 869425191 338964480 15136 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450713080000 0 0 -1 0 0 0 0
[pid=31103] ppid=30968 vsize=331032 CPUtime=0.22 cores=0,2,4,6
/proc/31103/stat : 31103 (python) S 30968 30968 29517 0 -1 4202560 1115 0 0 0 11 11 0 0 17 0 2 0 869425193 338976768 15121 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31103/statm: 82758 15121 396 364 0 17642 0
[pid=31105] ppid=31103 vsize=763832 CPUtime=50.29 cores=0,2,4,6
/proc/31105/stat : 31105 (scip-2.0.1.linu) T 31103 31105 31105 0 -1 4202496 188706 0 0 0 4972 57 0 0 25 0 1 0 869425193 782163968 184590 33554432000 4194304 13684479 140736764414528 18446744073709551615 4880647 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/31105/statm: 190958 184590 658 2317 0 188636 0
[pid=31103/tid=31110] ppid=30968 vsize=331032 CPUtime=0 cores=0,2,4,6
/proc/31103/task/31110/stat : 31110 (python) S 30968 30968 29517 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869430224 338976768 15121 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604445173062592 0 0 -1 6 0 0 0
[pid=30968/tid=30975] ppid=30966 vsize=341280 CPUtime=0 cores=0,2,4,6
/proc/30968/task/30975/stat : 30975 (python) S 30966 30968 29517 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 3 0 869420369 349470720 16604 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
[pid=30968/tid=31104] ppid=30966 vsize=341280 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31104/stat : 31104 (python) S 30966 30968 29517 0 -1 4202560 30 930 0 0 0 0 0 0 20 0 3 0 869425193 349470720 16604 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 102.58
Current children cumulated vsize (KiB) 1812588

[startup+162.301 s]
/proc/loadavg: 2.11 2.11 1.79 3/534 31127
/proc/meminfo: memFree=25612444/32951124 swapFree=34789492/67111528
[pid=30968] ppid=30966 vsize=361788 CPUtime=10.64 cores=0,2,4,6
/proc/30968/stat : 30968 (python) S 30966 30968 29517 0 -1 4202496 27606 930 1 0 1050 14 0 0 20 0 5 0 869420083 370470912 16615 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30968/statm: 90447 16615 1879 364 0 25325 0
[pid=30974] ppid=30968 vsize=331020 CPUtime=0.2 cores=0,2,4,6
/proc/30974/stat : 30974 (python) S 30968 30968 29517 0 -1 4202560 1148 0 0 0 10 10 0 0 19 0 2 0 869420368 338964480 15136 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/30974/statm: 82755 15136 411 364 0 17642 0
[pid=30976] ppid=30974 vsize=45424 CPUtime=48.2 cores=0,2,4,6
/proc/30976/stat : 30976 (clasp-1.3.7-x86) T 30974 30976 30976 0 -1 4202496 12768 0 0 0 4818 2 0 0 25 0 1 0 869420369 46514176 11057 33554432000 134512640 136139019 4290082640 18446744073709551615 134832331 0 0 16781312 16386 18446744071562691360 0 0 17 4 0 0 0
/proc/30976/statm: 11356 11057 184 398 0 10956 0
[pid=30974/tid=31102] ppid=30968 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30974/task/31102/stat : 31102 (python) S 30968 30968 29517 0 -1 4202560 40 0 0 0 0 0 0 0 19 0 2 0 869425191 338964480 15136 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450713080000 0 0 -1 0 0 0 0
[pid=31103] ppid=30968 vsize=331032 CPUtime=0.22 cores=0,2,4,6
/proc/31103/stat : 31103 (python) S 30968 30968 29517 0 -1 4202560 1115 0 0 0 11 11 0 0 17 0 2 0 869425193 338976768 15121 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31103/statm: 82758 15121 396 364 0 17642 0
[pid=31105] ppid=31103 vsize=763832 CPUtime=50.29 cores=0,2,4,6
/proc/31105/stat : 31105 (scip-2.0.1.linu) T 31103 31105 31105 0 -1 4202496 188706 0 0 0 4972 57 0 0 25 0 1 0 869425193 782163968 184590 33554432000 4194304 13684479 140736764414528 18446744073709551615 4880647 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/31105/statm: 190958 184590 658 2317 0 188636 0
[pid=31103/tid=31110] ppid=30968 vsize=331032 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/30976/stat : 30976 (clasp-1.3.7-x86) T 30974 30976 30976 0 -1 4202496 17881 0 0 0 23094 3 0 0 25 0 1 0 869420369 67592192 16170 33554432000 134512640 136139019 4290082640 18446744073709551615 134883785 0 0 16781312 16386 18446744071562691360 0 0 17 4 0 0 0
/proc/30976/statm: 16502 16170 184 398 0 16102 0
[pid=30974/tid=31102] ppid=30968 vsize=331020 CPUtime=0 cores=0,2,4,6
/proc/30974/task/31102/stat : 31102 (python) S 30968 30968 29517 0 -1 4202560 41 0 0 0 0 0 0 0 18 0 2 0 869425191 338964480 15137 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450713080000 0 0 -1 0 0 0 0
[pid=31103] ppid=30968 vsize=331032 CPUtime=4.53 cores=0,2,4,6
/proc/31103/stat : 31103 (python) S 30968 30968 29517 0 -1 4202560 1192 0 0 0 222 231 0 0 15 0 2 0 869425193 338976768 15121 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31103/statm: 82758 15121 396 364 0 17642 0
[pid=31105] ppid=31103 vsize=2414820 CPUtime=1053.11 cores=0,2,4,6
/proc/31105/stat : 31105 (scip-2.0.1.linu) T 31103 31105 31105 0 -1 4202496 599605 0 0 0 105122 189 0 0 25 0 1 0 869425193 2472775680 595489 33554432000 4194304 13684479 140736764414528 18446744073709551615 5688624 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/31105/statm: 603705 595489 662 2317 0 601383 0
[pid=31103/tid=31110] ppid=30968 vsize=331032 CPUtime=0 cores=0,2,4,6
/proc/31103/task/31110/stat : 31110 (python) S 30968 30968 29517 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869430224 338976768 15121 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604445173062592 0 0 -1 6 0 0 0
[pid=31115] ppid=30968 vsize=341288 CPUtime=0.2 cores=0,2,4,6
/proc/31115/stat : 31115 (python) S 30968 30968 29517 0 -1 4202560 1109 0 0 0 11 9 0 0 16 0 2 0 869431009 349478912 15125 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/31115/statm: 85322 15125 396 364 0 20203 0
[pid=31117] ppid=31115 vsize=208316 CPUtime=48.53 cores=0,2,4,6
/proc/31117/stat : 31117 (minion) T 31115 31117 31117 0 -1 4202496 56535 0 0 0 4847 6 0 0 25 0 1 0 869431010 213315584 44496 33554432000 134512640 165565024 4294221536 18446744073709551615 158624694 0 0 16781312 8396802 18446744071562691360 0 0 17 0 0 0 0
/proc/31117/statm: 52079 44496 346 7582 0 44494 0
[pid=31115/tid=31121] ppid=30968 vsize=341288 CPUtime=0 cores=0,2,4,6
/proc/31115/task/31121/stat : 31121 (python) S 30968 30968 29517 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869435864 349478912 15125 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450580246976 0 0 -1 6 0 0 0
[pid=31122] ppid=30968 vsize=351544 CPUtime=0.45 cores=0,2,4,6
/proc/31122/stat : 31122 (python) S 30968 30968 29517 0 -1 4202560 1178 0 0 0 24 21 0 0 15 0 2 0 869435866 359981056 15129 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31122/statm: 87886 15129 396 364 0 22764 0
[pid=31124] ppid=31122 vsize=932272 CPUtime=96.31 cores=0,2,4,6
/proc/31124/stat : 31124 (scip-2.0.1.linu) T 31122 31124 31124 0 -1 4202496 229340 0 0 0 9570 61 0 0 25 0 1 0 869435867 954646528 225230 33554432000 4194304 15243407 140735288706688 18446744073709551615 4833138 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/31124/statm: 233068 225230 717 2698 0 230363 0
[pid=31122/tid=31133] ppid=30968 vsize=351544 CPUtime=0 cores=0,2,4,6
/proc/31122/task/31133/stat : 31133 (python) S 30968 30968 29517 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 869440984 359981056 15129 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604447130295360 0 0 -1 0 0 0 0
[pid=31136] ppid=30968 vsize=361800 CPUtime=0.22 cores=0,2,4,6
/proc/31136/stat : 31136 (python) S 30968 30968 29517 0 -1 4202560 1147 0 0 0 11 11 0 0 17 0 2 0 869445609 370483200 15133 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31136/statm: 90450 15133 396 364 0 25325 0
[pid=31138] ppid=31136 vsize=66500 CPUtime=49.87 cores=0,2,4,6
/proc/31138/stat : 31138 (wbo1.4a) T 31136 31138 31138 0 -1 4202496 17402 0 0 0 4967 20 0 0 25 0 1 0 869445609 68096000 15573 33554432000 134512640 135751879 4286654256 18446744073709551615 134605078 0 0 16781312 3 18446744071562691360 0 0 17 2 0 0 0
/proc/31138/statm: 16625 15573 143 303 0 16320 0
[pid=31136/tid=31144] ppid=30968 vsize=361800 CPUtime=0 cores=0,2,4,6
/proc/31136/task/31144/stat : 31144 (python) S 30968 30968 29517 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 869450599 370483200 15133 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450488445824 0 0 -1 6 0 0 0
[pid=31163] ppid=30968 vsize=372056 CPUtime=0.42 cores=0,2,4,6
/proc/31163/stat : 31163 (python) S 30968 30968 29517 0 -1 4202560 1168 0 0 0 23 19 0 0 16 0 2 0 869514500 380985344 15137 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31163/statm: 93014 15137 396 364 0 27886 0
[pid=31165] ppid=31163 vsize=67372 CPUtime=92.89 cores=0,2,4,6
/proc/31165/stat : 31165 (bsolo_pb10) T 31163 31165 31165 0 -1 4202496 18451 0 0 0 9275 14 0 0 25 0 1 0 869514501 68988928 14222 33554432000 134512640 137138936 4288728224 18446744073709551615 134542199 0 0 16781312 16384 18446744071562691360 0 0 17 4 0 0 0
/proc/31165/statm: 16843 14222 191 642 0 16199 0
[pid=31163/tid=31171] ppid=30968 vsize=372056 CPUtime=0 cores=0,2,4,6
/proc/31163/task/31171/stat : 31171 (python) S 30968 30968 29517 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869523799 380985344 15137 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604444540566272 0 0 -1 6 0 0 0
[pid=31188] ppid=30968 vsize=382312 CPUtime=0.21 cores=0,2,4,6
/proc/31188/stat : 31188 (python) S 30968 30968 29517 0 -1 4202560 1171 0 0 0 11 10 0 0 16 0 2 0 869578368 391487488 15141 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31188/statm: 95578 15141 396 364 0 30447 0
[pid=31190] ppid=31188 vsize=68084 CPUtime=45.98 cores=0,2,4,6
/proc/31190/stat : 31190 (wbo1.4b-fixed) T 31188 31190 31190 0 -1 4202496 17808 0 0 0 4581 17 0 0 25 0 1 0 869578368 69718016 15977 33554432000 134512640 135752315 4290945840 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/31190/statm: 17021 15977 146 303 0 16716 0
[pid=31188/tid=31192] ppid=30968 vsize=382312 CPUtime=0 cores=0,2,4,6
/proc/31188/task/31192/stat : 31192 (python) S 30968 30968 29517 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869582967 391487488 15141 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604443057502272 0 0 -1 6 0 0 0
[pid=31193] ppid=30968 vsize=392568 CPUtime=0.21 cores=0,2,4,6
/proc/31193/stat : 31193 (python) S 30968 30968 29517 0 -1 4202560 1206 0 0 0 11 10 0 0 17 0 2 0 869582968 401989632 15151 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/31193/statm: 98142 15151 402 364 0 33008 0
[pid=31195] ppid=31193 vsize=8616556 CPUtime=46.28 cores=0,2,4,6
/proc/31195/stat : 31195 (java) T 31193 31195 31195 0 -1 4202496 111297 0 1 0 4613 15 0 0 18 0 19 0 869582968 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/31195/statm: 2154139 97160 2254 9 0 2144880 0
[pid=31195/tid=31196] ppid=31193 vsize=8616556 CPUtime=43.09 cores=0,2,4,6
/proc/31195/task/31196/stat : 31196 (java) T 31193 31195 31195 0 -1 4202560 65252 0 1 0 4300 9 0 0 25 0 19 0 869582969 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 46912506030705 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31197] ppid=31193 vsize=8616556 CPUtime=0.02 cores=0,2,4,6
/proc/31195/task/31197/stat : 31197 (java) T 31193 31195 31195 0 -1 4202560 671 0 0 0 2 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31195/tid=31198] ppid=31193 vsize=8616556 CPUtime=0.05 cores=0,2,4,6
/proc/31195/task/31198/stat : 31198 (java) T 31193 31195 31195 0 -1 4202560 3311 0 0 0 5 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31199] ppid=31193 vsize=8616556 CPUtime=0.03 cores=0,2,4,6
/proc/31195/task/31199/stat : 31199 (java) T 31193 31195 31195 0 -1 4202560 957 0 0 0 3 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=31195/tid=31200] ppid=31193 vsize=8616556 CPUtime=0.04 cores=0,2,4,6
/proc/31195/task/31200/stat : 31200 (java) T 31193 31195 31195 0 -1 4202560 2840 0 0 0 4 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31195/tid=31201] ppid=31193 vsize=8616556 CPUtime=0.01 cores=0,2,4,6
/proc/31195/task/31201/stat : 31201 (java) T 31193 31195 31195 0 -1 4202560 1112 0 0 0 1 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31202] ppid=31193 vsize=8616556 CPUtime=0.04 cores=0,2,4,6
/proc/31195/task/31202/stat : 31202 (java) T 31193 31195 31195 0 -1 4202560 1551 0 0 0 4 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31203] ppid=31193 vsize=8616556 CPUtime=0.05 cores=0,2,4,6
/proc/31195/task/31203/stat : 31203 (java) T 31193 31195 31195 0 -1 4202560 2870 0 0 0 5 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31204] ppid=31193 vsize=8616556 CPUtime=0.01 cores=0,2,4,6
/proc/31195/task/31204/stat : 31204 (java) T 31193 31195 31195 0 -1 4202560 46 0 0 0 1 0 0 0 15 0 19 0 869582970 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31195/tid=31205] ppid=31193 vsize=8616556 CPUtime=0.76 cores=0,2,4,6
/proc/31195/task/31205/stat : 31205 (java) T 31193 31195 31195 0 -1 4202560 7729 0 0 0 76 0 0 0 15 0 19 0 869582971 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447833600 0 0 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=31195/tid=31206] ppid=31193 vsize=8616556 CPUtime=0 cores=0,2,4,6
/proc/31195/task/31206/stat : 31206 (java) T 31193 31195 31195 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869582971 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31207] ppid=31193 vsize=8616556 CPUtime=0 cores=0,2,4,6
/proc/31195/task/31207/stat : 31207 (java) T 31193 31195 31195 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869582971 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31195/tid=31208] ppid=31193 vsize=8616556 CPUtime=0 cores=0,2,4,6
/proc/31195/task/31208/stat : 31208 (java) T 31193 31195 31195 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869582974 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447840689 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31209] ppid=31193 vsize=8616556 CPUtime=1.31 cores=0,2,4,6
/proc/31195/task/31209/stat : 31209 (java) T 31193 31195 31195 0 -1 4202560 16173 0 0 0 128 3 0 0 15 0 19 0 869582974 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31210] ppid=31193 vsize=8616556 CPUtime=0.78 cores=0,2,4,6
/proc/31195/task/31210/stat : 31210 (java) T 31193 31195 31195 0 -1 4202560 7399 0 0 0 78 0 0 0 15 0 19 0 869582974 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31195/tid=31211] ppid=31193 vsize=8616556 CPUtime=0 cores=0,2,4,6
/proc/31195/task/31211/stat : 31211 (java) T 31193 31195 31195 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869582974 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=31195/tid=31212] ppid=31193 vsize=8616556 CPUtime=0 cores=0,2,4,6
/proc/31195/task/31212/stat : 31212 (java) T 31193 31195 31195 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869582974 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447833600 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31195/tid=31213] ppid=31193 vsize=8616556 CPUtime=0 cores=0,2,4,6
/proc/31195/task/31213/stat : 31213 (java) T 31193 31195 31195 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869583109 8823353344 97160 33554432000 1073741824 1073778376 140733408452912 18446744073709551615 212447833600 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=31193/tid=31218] ppid=30968 vsize=392568 CPUtime=0 cores=0,2,4,6
/proc/31193/task/31218/stat : 31218 (python) S 30968 30968 29517 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869587372 401989632 15151 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554946 18446604447130293568 0 0 -1 6 0 0 0
[pid=31219] ppid=30968 vsize=402824 CPUtime=0 cores=0,2,4,6
/proc/31219/stat : 31219 (python) S 30968 30968 29517 0 -1 4202560 868 0 0 0 0 0 0 0 17 0 1 0 869587373 412491776 15107 33554432000 4194304 5683644 140735860773056 18446744073709551615 212436037190 0 0 16781312 33554946 16879250992590192898 0 0 17 2 0 0 0
/proc/31219/statm: 100706 15107 355 364 0 35569 0
[pid=31221] ppid=31219 vsize=8532748 CPUtime=0.15 cores=0,2,4,6
/proc/31221/stat : 31221 (java) S 31219 31221 31221 0 -1 4202496 5949 0 1 0 14 1 0 0 20 0 18 0 869587374 8737533952 5407 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/31221/statm: 2133187 5407 2129 9 0 2123928 0
[pid=31221/tid=31222] ppid=31219 vsize=8532748 CPUtime=0.11 cores=0,2,4,6
/proc/31221/task/31222/stat : 31222 (java) R 31219 31221 31221 0 -1 4202560 3782 0 1 0 11 0 0 0 25 0 18 0 869587374 8737533952 5412 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 46912505219208 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=31221/tid=31223] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31223/stat : 31223 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869587375 8737533952 5412 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31224] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31224/stat : 31224 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869587375 8737533952 5412 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31225] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31225/stat : 31225 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869587375 8737533952 5412 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31226] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31226/stat : 31226 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587375 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 4 0 0 0
[pid=31221/tid=31227] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31227/stat : 31227 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587375 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 0 0 0 0
[pid=31221/tid=31228] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31228/stat : 31228 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587375 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 0 0 0 0
[pid=31221/tid=31229] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31229/stat : 31229 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587375 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 4 0 0 0
[pid=31221/tid=31230] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31230/stat : 31230 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587375 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 0 0 0 0
[pid=31221/tid=31231] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31231/stat : 31231 (java) S 31219 31221 31221 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869587376 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447833600 0 0 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31232] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31232/stat : 31232 (java) S 31219 31221 31221 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869587376 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31233] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31233/stat : 31233 (java) S 31219 31221 31221 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 869587376 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31234] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31234/stat : 31234 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587378 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447840689 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31235] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31235/stat : 31235 (java) R 31219 31221 31221 0 -1 4202560 125 0 0 0 0 0 0 0 25 0 18 0 869587378 8737533952 5413 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=31221/tid=31236] ppid=31219 vsize=8532748 CPUtime=0.02 cores=0,2,4,6
/proc/31221/task/31236/stat : 31236 (java) S 31219 31221 31221 0 -1 4202560 658 0 0 0 2 0 0 0 17 0 18 0 869587378 8737533952 5414 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31237] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31237/stat : 31237 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587378 8737533952 5414 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447832985 0 4 0 16800975 18446604450713082688 0 0 -1 2 0 0 0
[pid=31221/tid=31238] ppid=31219 vsize=8532748 CPUtime=0 cores=0,2,4,6
/proc/31221/task/31238/stat : 31238 (java) S 31219 31221 31221 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869587378 8737533952 5414 33554432000 1073741824 1073778376 140734461176192 18446744073709551615 212447833600 0 4 0 16800975 18446604450713082688 0 0 -1 4 0 0 0
[pid=30968/tid=30975] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/30975/stat : 30975 (python) S 30966 30968 29517 0 -1 4202560 38 930 0 0 0 0 0 0 18 0 10 0 869420369 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
[pid=30968/tid=31104] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31104/stat : 31104 (python) S 30966 30968 29517 0 -1 4202560 40 930 0 0 0 0 0 0 18 0 10 0 869425193 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 4 0 0 0
[pid=30968/tid=31116] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31116/stat : 31116 (python) S 30966 30968 29517 0 -1 4202560 30 930 0 0 0 0 0 0 25 0 10 0 869431010 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 4 0 0 0
[pid=30968/tid=31123] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31123/stat : 31123 (python) S 30966 30968 29517 0 -1 4202560 31 930 0 0 0 0 0 0 18 0 10 0 869435867 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
[pid=30968/tid=31137] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31137/stat : 31137 (python) S 30966 30968 29517 0 -1 4202560 30 930 0 0 0 0 0 0 20 0 10 0 869445609 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
[pid=30968/tid=31164] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31164/stat : 31164 (python) S 30966 30968 29517 0 -1 4202560 29 930 0 0 0 0 0 0 20 0 10 0 869514500 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
[pid=30968/tid=31189] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31189/stat : 31189 (python) S 30966 30968 29517 0 -1 4202560 31 930 0 0 0 0 0 0 20 0 10 0 869578368 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 0 0 0 0
[pid=30968/tid=31194] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31194/stat : 31194 (python) S 30966 30968 29517 0 -1 4202560 30 930 0 0 0 0 0 0 20 0 10 0 869582968 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 6 0 0 0
[pid=30968/tid=31220] ppid=30966 vsize=413068 CPUtime=0 cores=0,2,4,6
/proc/30968/task/31220/stat : 31220 (python) S 30966 30968 29517 0 -1 4202560 24 930 0 0 0 0 0 0 20 0 10 0 869587373 422981632 16645 33554432000 4194304 5683644 140735860773056 18446744073709551615 212447840689 0 0 16781312 33554434 18446604446324019392 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1682.17
Current children cumulated vsize (KiB) 24652188

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30968 and gives
#  childrusage.ru_utime.tv_sec=10
#  childrusage.ru_utime.tv_usec=693374
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=167974
# CPU time returned by wait4() is 10.8613
# while last known CPU time is 1682.17
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1673.11
CPU time (s): 1682.17
CPU user time (s): 1675.14
CPU system time (s): 7.03
CPU usage (%): 100.542
Max. virtual memory (cumulated for all children) (KiB): 24652188

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10.6934
system time used= 0.167974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33513
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1036
involuntary context switches= 33

runsolver used 10.6684 second user time and 19.702 second system time

The end

Launcher Data 

Begin job on node102 at 2011-06-09 02:09:37
IDJOB=3482799
IDBENCH=73562
IDSOLVER=1971
FILE ID=node102/3482799-1307578176
RUNJOBID= node102-1307576441-29535
PBS_JOBID= 13547703
Free space on /tmp= 73916 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12016_4-sat.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482799-1307578176/watcher-3482799-1307578176 -o /tmp/evaluation-result-3482799-1307578176/solver-3482799-1307578176 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482799-1307578176.opb -seed 844034011 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 142eb7aa6e3fc22a3161df6b33ced1a2
RANDOM SEED=844034011

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28301888 kB
Buffers:        175328 kB
Cached:         497572 kB
SwapCached:      25580 kB
Active:        4133020 kB
Inactive:       179804 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28301888 kB
SwapTotal:    67111528 kB
SwapFree:     34789492 kB
Dirty:          109948 kB
Writeback:           0 kB
AnonPages:     3637452 kB
Mapped:          32488 kB
Slab:           152572 kB
PageTables:     113212 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 140491508 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73720 MiB
End job on node102 at 2011-06-09 02:37:32