Trace number 3482888

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 440.84 458.212

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-164.opb
MD5SUM81ec1ddcd163131a26e4e6f9286dd205
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark108.393
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables26339
Total number of constraints612374
Number of constraints which are clauses549666
Number of constraints which are cardinality constraints (but not clauses)2270
Number of constraints which are nor clauses,nor cardinality constraints60438
Minimum length of a constraint1
Maximum length of a constraint1485
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 1486
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.36/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.36/0.69	c INFO: solving HOME/instance-3482888-1307578581.opb
4.73/5.01	c INFO: parsing took 4.23 s
6.03/18.93	c INFO: features took 8.03 CPU seconds
51.02/51.36	c INFO: wrote minion input file to HOME/tmppddOg3.minion
51.02/51.36	c INFO: running minion-0.12@0 for 45 with 1787 remaining (b = 0.74)
68.83/75.32	c INFO: running pbct-0.1.2-linear@0 for 45 with 1738 remaining (b = 0.91)
99.27/123.38	c INFO: running clasp-1.3.7@0 for 45 with 1691 remaining (b = 0.91)
147.74/171.62	c INFO: running wbo1.4b-fixed@0 for 45 with 1643 remaining (b = 0.91)
199.33/223.00	c INFO: running sat4j-pb-v20101225@0 for 45 with 1596 remaining (b = 0.55)
247.44/271.08	c INFO: running wbo1.4a@0 for 45 with 1549 remaining (b = 0.41)
299.79/323.29	c INFO: running pbct-0.1.2-linear@46 for 45 with 1500 remaining (b = 0.41)
346.27/369.53	c INFO: running wbo1.4b-fixed@46 for 45 with 1454 remaining (b = 0.34)
395.31/418.32	c INFO: running scip-2.0.1-clp@0 for 45 with 1408 remaining (b = 0.60)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482888-1307578581/watcher-3482888-1307578581 -o /tmp/evaluation-result-3482888-1307578581/solver-3482888-1307578581 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482888-1307578581.opb -seed 58639514 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.11 2.63 2.22 2/528 17481
/proc/meminfo: memFree=26187516/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=15908 CPUtime=0 cores=1,3,5,7
/proc/17481/stat : 17481 (python) S 17479 17481 16517 0 -1 4202496 945 0 0 0 0 0 0 0 20 0 1 0 869457888 16289792 821 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647144448 0 2147483391 16781312 2 18446744071699109054 0 0 17 5 0 0 0
/proc/17481/statm: 3977 821 357 364 0 464 0

[startup+0.101788 s]
/proc/loadavg: 3.11 2.63 2.22 2/528 17481
/proc/meminfo: memFree=26187516/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=85620 CPUtime=0.07 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 2664 0 0 0 4 3 0 0 17 0 1 0 869457888 87674880 2382 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647144448 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/17481/statm: 21405 2382 715 364 0 1622 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 85620

[startup+0.200846 s]
/proc/loadavg: 3.11 2.63 2.22 2/528 17481
/proc/meminfo: memFree=26187516/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=117904 CPUtime=0.13 cores=1,3,5,7
/proc/17481/stat : 17481 (python) S 17479 17481 16517 0 -1 4202496 4920 930 1 0 9 4 0 0 17 0 1 0 869457888 120733696 3346 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647144448 0 2147483391 16781312 2 18446744071699109054 0 0 17 5 0 0 0
/proc/17481/statm: 29476 3346 916 364 0 2446 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 117904

[startup+0.300765 s]
/proc/loadavg: 3.11 2.63 2.22 2/528 17481
/proc/meminfo: memFree=26187516/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=123744 CPUtime=0.17 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 5358 930 1 0 10 7 0 0 16 0 1 0 869457888 126713856 3745 33554432000 4194304 5683644 140736305434672 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17481/statm: 30936 3745 987 364 0 2768 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123744

[startup+0.700647 s]
/proc/loadavg: 3.11 2.63 2.22 2/528 17481
/proc/meminfo: memFree=26187516/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=308608 CPUtime=0.43 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 9434 930 1 0 27 16 0 0 15 0 1 0 869457888 316014592 7297 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647146240 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17481/statm: 77152 7338 1776 364 0 12045 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 308608

[startup+1.50051 s]
/proc/loadavg: 3.11 2.63 2.22 3/529 17486
/proc/meminfo: memFree=26123524/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=335200 CPUtime=1.23 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 22122 930 1 0 104 19 0 0 16 0 1 0 869457888 343244800 19985 33554432000 4194304 5683644 140736305434672 18446744073709551615 210646807237 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17481/statm: 83800 19985 1781 364 0 18693 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 335200

[startup+3.10026 s]
/proc/loadavg: 3.11 2.63 2.22 3/529 17486
/proc/meminfo: memFree=26085324/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=391060 CPUtime=2.83 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 35402 930 1 0 262 21 0 0 18 0 1 0 869457888 400445440 33265 33554432000 4194304 5683644 140736305434672 18446744073709551615 210646807237 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17481/statm: 97765 33265 1781 364 0 32658 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 391060

[startup+6.30071 s]
/proc/loadavg: 3.34 2.69 2.24 4/529 17486
/proc/meminfo: memFree=25992944/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=446712 CPUtime=6.03 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 79949 930 1 0 577 26 0 0 25 0 1 0 869457888 457433088 48025 33554432000 4194304 5683644 140736305434672 18446744073709551615 210650555049 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/17481/statm: 111678 48025 1815 364 0 46571 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 446712

[startup+19.5495 s]
/proc/loadavg: 3.34 2.69 2.24 4/529 17486
/proc/meminfo: memFree=25992944/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=461080 CPUtime=19.28 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 83605 930 1 0 1900 28 0 0 25 0 1 0 869457888 472145920 51664 33554432000 4194304 5683644 140736305434672 18446744073709551615 4891196 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/17481/statm: 115270 51664 1865 364 0 50160 0
Current children cumulated CPU time (s) 19.28
Current children cumulated vsize (KiB) 461080

[startup+25.5005 s]
/proc/loadavg: 4.29 2.95 2.33 4/533 17490
/proc/meminfo: memFree=25909952/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=461080 CPUtime=25.22 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 83605 930 1 0 2493 29 0 0 25 0 1 0 869457888 472145920 51664 33554432000 4194304 5683644 140736305434672 18446744073709551615 4639680 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/17481/statm: 115270 51664 1865 364 0 50160 0
Current children cumulated CPU time (s) 25.22
Current children cumulated vsize (KiB) 461080

[startup+51.1001 s]
/proc/loadavg: 4.65 3.15 2.41 4/533 17490
/proc/meminfo: memFree=22233988/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=461080 CPUtime=50.83 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 83605 930 1 0 5047 36 0 0 25 0 1 0 869457888 472145920 51664 33554432000 4194304 5683644 140736305434672 18446744073709551615 4864570 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/17481/statm: 115270 51664 1865 364 0 50160 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 461080

############
# WARNING:
# current cumulated CPU time (51.21 s) is less than in the last sample (68.83 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (17.62 s) to the 'lost time'.

[startup+75.3011 s]
/proc/loadavg: 4.34 3.20 2.45 3/540 17499
/proc/meminfo: memFree=14017840/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=471332 CPUtime=51.1 cores=1,3,5,7
/proc/17481/stat : 17481 (python) R 17479 17481 16517 0 -1 4202496 83829 930 1 0 5073 37 0 0 18 0 2 0 869457888 482643968 51674 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17481/statm: 117833 51674 1872 364 0 52720 0
[pid=17491] ppid=17481 vsize=0 CPUtime=0.08 cores=1,3,5,7
/proc/17491/stat : 17491 (python) Z 17481 17481 16517 0 -1 4202588 1206 0 0 0 3 5 0 0 15 0 2 0 869463025 0 0 33554432000 0 0 0 0 0 0 0 16781824 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17491/statm: 0 0 0 0 0 0 0
[pid=17493] ppid=17491 vsize=0 CPUtime=17.65 cores=1,3,5,7
/proc/17493/stat : 17493 (minion) R 17491 17493 17493 0 -1 4204036 1081120 0 0 0 1107 658 0 0 19 0 1 0 869463025 0 0 33554432000 0 0 0 0 0 0 0 16781312 8396802 18446744073709551615 0 0 17 5 0 0 625
/proc/17493/statm: 0 0 0 0 0 0 0
[pid=17481/tid=17492] ppid=17479 vsize=471332 CPUtime=0 cores=1,3,5,7
/proc/17481/task/17492/stat : 17492 (python) S 17479 17481 16517 0 -1 4202560 27 930 0 0 0 0 0 0 25 0 2 0 869463025 482643968 51674 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 68.83
Current children cumulated vsize (KiB) 471332

[startup+75.4011 s]
/proc/loadavg: 4.34 3.20 2.45 3/540 17499
/proc/meminfo: memFree=14017840/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=481588 CPUtime=51.21 cores=1,3,5,7
/proc/17481/stat : 17481 (python) S 17479 17481 16517 0 -1 4202496 84692 2136 1 0 5075 37 3 6 20 0 3 0 869457888 493146112 51681 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17481/statm: 120397 51681 1875 364 0 55281 0
[pid=17481/tid=17492] ppid=17479 vsize=481588 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17492/stat : 17492 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 25 0 3 0 869463025 493146112 51681 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 51.21
Current children cumulated vsize (KiB) 481588
#
############


[startup+102.32 s]
/proc/loadavg: 4.90 3.42 2.54 3/541 17503
/proc/meminfo: memFree=15443456/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=481588 CPUtime=51.21 cores=1,3,5,7
/proc/17481/stat : 17481 (python) S 17479 17481 16517 0 -1 4202496 84692 2136 1 0 5075 37 3 6 20 0 3 0 869457888 493146112 51681 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17481/statm: 120397 51681 1875 364 0 55281 0
[pid=17501] ppid=17481 vsize=471344 CPUtime=0.1 cores=1,3,5,7
/proc/17501/stat : 17501 (python) S 17481 17481 16517 0 -1 4202560 936 0 0 0 5 5 0 0 15 0 1 0 869465420 482656256 50174 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647166534 0 0 16781312 33554946 5623606151888251627 0 0 17 5 0 0 0
/proc/17501/statm: 117836 50174 372 364 0 52720 0
[pid=17503] ppid=17501 vsize=2443528 CPUtime=26.93 cores=1,3,5,7
/proc/17503/stat : 17503 (pbct-0.1.2-linu) R 17501 17503 17503 0 -1 4202496 648331 0 0 0 2602 91 0 0 25 0 1 0 869465421 2502172672 580416 33554432000 134512640 136422188 4289973968 18446744073709551615 135874785 0 0 16781312 16387 0 0 0 17 5 0 0 0
/proc/17503/statm: 610882 580416 215 467 0 610413 0
[pid=17481/tid=17492] ppid=17479 vsize=481588 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17492/stat : 17492 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 25 0 3 0 869463025 493146112 51681 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17502] ppid=17479 vsize=481588 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17502/stat : 17502 (python) S 17479 17481 16517 0 -1 4202560 29 2136 0 0 0 0 3 6 20 0 3 0 869465421 493146112 51681 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 78.24
Current children cumulated vsize (KiB) 3396460
heavy processes:

[startup+162.301 s]
/proc/loadavg: 5.76 3.94 2.78 3/549 17513
/proc/meminfo: memFree=13973208/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=491844 CPUtime=51.25 cores=1,3,5,7
/proc/17481/stat : 17481 (python) S 17479 17481 16517 0 -1 4202496 85517 2136 1 0 5078 38 3 6 20 0 4 0 869457888 503648256 51687 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17481/statm: 122961 51687 1877 364 0 57842 0
[pid=17501] ppid=17481 vsize=471344 CPUtime=0.2 cores=1,3,5,7
/proc/17501/stat : 17501 (python) S 17481 17481 16517 0 -1 4202560 1106 0 0 0 10 10 0 0 16 0 2 0 869465420 482656256 50199 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/17501/statm: 117836 50199 396 364 0 52720 0
[pid=17503] ppid=17501 vsize=2447788 CPUtime=47.94 cores=1,3,5,7
/proc/17503/stat : 17503 (pbct-0.1.2-linu) T 17501 17503 17503 0 -1 4202496 649606 0 0 0 4695 99 0 0 25 0 1 0 869465421 2506534912 580920 33554432000 134512640 136422188 4289973968 18446744073709551615 135006571 0 0 16781312 16387 18446744071562691360 0 0 17 7 0 0 0
/proc/17503/statm: 611947 580920 215 467 0 611478 0
[pid=17501/tid=17508] ppid=17481 vsize=471344 CPUtime=0 cores=1,3,5,7
/proc/17501/task/17508/stat : 17508 (python) S 17481 17481 16517 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869470224 482656256 50199 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604462433606400 0 0 -1 5 0 0 0
[pid=17509] ppid=17481 vsize=481600 CPUtime=0.17 cores=1,3,5,7
/proc/17509/stat : 17509 (python) S 17481 17481 16517 0 -1 4202560 952 0 0 0 8 9 0 0 18 0 1 0 869470226 493158400 50178 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647166534 0 0 16781312 33554946 5623606151888251627 0 0 17 5 0 0 0
/proc/17509/statm: 120400 50178 372 364 0 55281 0
[pid=17511] ppid=17509 vsize=45280 CPUtime=38.83 cores=1,3,5,7
/proc/17511/stat : 17511 (clasp-1.3.7-x86) R 17509 17511 17511 0 -1 4202496 14342 0 0 0 3881 2 0 0 25 0 1 0 869470227 46366720 10822 33554432000 134512640 136139019 4291137744 18446744073709551615 134867632 0 0 16781312 16386 0 0 0 17 1 0 0 0
/proc/17511/statm: 11320 10822 184 398 0 10920 0
[pid=17481/tid=17492] ppid=17479 vsize=491844 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17492/stat : 17492 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 25 0 4 0 869463025 503648256 51687 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17502] ppid=17479 vsize=491844 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17502/stat : 17502 (python) S 17479 17481 16517 0 -1 4202560 29 2136 0 0 0 0 3 6 20 0 4 0 869465421 503648256 51687 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/17528/task/17544/stat : 17544 (java) T 17525 17528 17528 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17545] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17545/stat : 17545 (java) T 17525 17528 17528 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962944 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17546] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17546/stat : 17546 (java) T 17525 17528 17528 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869480777 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962944 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17525/tid=17547] ppid=17481 vsize=502112 CPUtime=0 cores=1,3,5,7
/proc/17525/task/17547/stat : 17547 (python) S 17481 17481 16517 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869484994 514162688 50211 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604463668687168 0 0 -1 3 0 0 0
[pid=17548] ppid=17481 vsize=512368 CPUtime=0.24 cores=1,3,5,7
/proc/17548/stat : 17548 (python) S 17481 17481 16517 0 -1 4202560 1173 0 0 0 11 13 0 0 16 0 2 0 869484997 524664832 50215 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/17548/statm: 128092 50215 396 364 0 62964 0
[pid=17550] ppid=17548 vsize=56264 CPUtime=52.07 cores=1,3,5,7
/proc/17550/stat : 17550 (wbo1.4a) T 17548 17550 17550 0 -1 4202496 20806 0 0 0 4866 341 0 0 25 0 1 0 869484997 57614336 12993 33554432000 134512640 135751879 4288210432 18446744073709551615 134616412 0 0 16781312 3 18446744071562691360 0 0 17 7 0 0 0
/proc/17550/statm: 14066 12993 143 303 0 13761 0
[pid=17548/tid=17556] ppid=17481 vsize=512368 CPUtime=0 cores=1,3,5,7
/proc/17548/task/17556/stat : 17556 (python) S 17481 17481 16517 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869490215 524664832 50215 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604456911074624 0 0 -1 5 0 0 0
[pid=17559] ppid=17481 vsize=522624 CPUtime=0.13 cores=1,3,5,7
/proc/17559/stat : 17559 (python) S 17481 17481 16517 0 -1 4202560 988 0 0 0 5 8 0 0 15 0 1 0 869499720 535166976 50194 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647166534 0 0 16781312 33554946 5623753486446373611 0 0 17 7 0 0 0
/proc/17559/statm: 130656 50194 372 364 0 65525 0
[pid=17561] ppid=17559 vsize=1258980 CPUtime=27.75 cores=1,3,5,7
/proc/17561/stat : 17561 (scip-2.0.1.linu) R 17559 17561 17561 0 -1 4202496 282855 0 0 0 2252 523 0 0 25 0 1 0 869499721 1289195520 273339 33554432000 4194304 15243407 140736073020688 18446744073709551615 8131360 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17561/statm: 314745 273339 912 2698 0 312040 0
[pid=17481/tid=17492] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17492/stat : 17492 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 25 0 8 0 869463025 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17502] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17502/stat : 17502 (python) S 17479 17481 16517 0 -1 4202560 34 2136 0 0 0 0 3 6 18 0 8 0 869465421 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17510] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17510/stat : 17510 (python) S 17479 17481 16517 0 -1 4202560 31 2136 0 0 0 0 3 6 20 0 8 0 869470227 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 7 0 0 0
[pid=17481/tid=17516] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17516/stat : 17516 (python) S 17479 17481 16517 0 -1 4202560 37 2136 0 0 0 0 3 6 18 0 8 0 869475051 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 7 0 0 0
[pid=17481/tid=17526] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17526/stat : 17526 (python) S 17479 17481 16517 0 -1 4202560 29 2136 0 0 0 0 3 6 20 0 8 0 869480189 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17549] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17549/stat : 17549 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 20 0 8 0 869484997 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 7 0 0 0
[pid=17481/tid=17560] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17560/stat : 17560 (python) S 17479 17481 16517 0 -1 4202560 32 2136 0 0 0 0 3 6 20 0 8 0 869499721 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 423.22
Current children cumulated vsize (KiB) 15962436

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+446.102 s]
/proc/loadavg: 7.63 5.98 3.92 2/591 17563
/proc/meminfo: memFree=1686448/32951132 swapFree=57925100/67111528
[pid=17481] ppid=17479 vsize=532868 CPUtime=51.4 cores=1,3,5,7
/proc/17481/stat : 17481 (python) S 17479 17481 16517 0 -1 4202496 89170 2136 1 0 5091 40 3 6 20 0 8 0 869457888 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/17481/statm: 133217 51711 1885 364 0 68086 0
[pid=17501] ppid=17481 vsize=471344 CPUtime=0.42 cores=1,3,5,7
/proc/17501/stat : 17501 (python) S 17481 17481 16517 0 -1 4202560 1145 0 0 0 21 21 0 0 16 0 2 0 869465420 482656256 50199 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/17501/statm: 117836 50199 396 364 0 52720 0
[pid=17503] ppid=17501 vsize=2448844 CPUtime=94.1 cores=1,3,5,7
/proc/17503/stat : 17503 (pbct-0.1.2-linu) T 17501 17503 17503 0 -1 4202496 649992 0 0 0 9283 127 0 0 25 0 1 0 869465421 2507616256 581306 33554432000 134512640 136422188 4289973968 18446744073709551615 134862210 0 0 16781312 16387 18446744071562691360 0 0 17 5 0 0 0
/proc/17503/statm: 612211 581306 215 467 0 611742 0
[pid=17501/tid=17508] ppid=17481 vsize=471344 CPUtime=0 cores=1,3,5,7
/proc/17501/task/17508/stat : 17508 (python) S 17481 17481 16517 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869470224 482656256 50199 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604462433606400 0 0 -1 5 0 0 0
[pid=17509] ppid=17481 vsize=481600 CPUtime=0.2 cores=1,3,5,7
/proc/17509/stat : 17509 (python) S 17481 17481 16517 0 -1 4202560 1114 0 0 0 9 11 0 0 19 0 2 0 869470226 493158400 50203 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/17509/statm: 120400 50203 396 364 0 55281 0
[pid=17511] ppid=17509 vsize=45676 CPUtime=48.13 cores=1,3,5,7
/proc/17511/stat : 17511 (clasp-1.3.7-x86) T 17509 17511 17511 0 -1 4202496 14461 0 0 0 4811 2 0 0 25 0 1 0 869470227 46772224 10941 33554432000 134512640 136139019 4291137744 18446744073709551615 134867653 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/17511/statm: 11419 10941 184 398 0 11019 0
[pid=17509/tid=17514] ppid=17481 vsize=481600 CPUtime=0 cores=1,3,5,7
/proc/17509/task/17514/stat : 17514 (python) S 17481 17481 16517 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 869475048 493158400 50203 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604469935028160 0 0 -1 7 0 0 0
[pid=17515] ppid=17481 vsize=491856 CPUtime=0.48 cores=1,3,5,7
/proc/17515/stat : 17515 (python) S 17481 17481 16517 0 -1 4202560 1192 0 0 0 21 27 0 0 15 0 2 0 869475050 503660544 50207 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/17515/statm: 122964 50207 396 364 0 57842 0
[pid=17517] ppid=17515 vsize=100888 CPUtime=100.11 cores=1,3,5,7
/proc/17517/stat : 17517 (wbo1.4b-fixed) T 17515 17517 17517 0 -1 4202496 31927 0 0 0 9286 725 0 0 25 0 1 0 869475051 103309312 24122 33554432000 134512640 135752315 4288377024 18446744073709551615 134611380 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/17517/statm: 25222 24122 146 303 0 24917 0
[pid=17515/tid=17524] ppid=17481 vsize=491856 CPUtime=0 cores=1,3,5,7
/proc/17515/task/17524/stat : 17524 (python) S 17481 17481 16517 0 -1 4202560 52 0 0 0 0 0 0 0 15 0 2 0 869480186 503660544 50207 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604463552259968 0 0 -1 7 0 0 0
[pid=17525] ppid=17481 vsize=502112 CPUtime=0.22 cores=1,3,5,7
/proc/17525/stat : 17525 (python) S 17481 17481 16517 0 -1 4202560 1150 0 0 0 10 12 0 0 16 0 2 0 869480189 514162688 50211 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/17525/statm: 125528 50211 396 364 0 60403 0
[pid=17528] ppid=17525 vsize=8537012 CPUtime=47.97 cores=1,3,5,7
/proc/17528/stat : 17528 (java) T 17525 17528 17528 0 -1 4202496 686706 0 1 0 4721 76 0 0 15 0 19 0 869480266 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658949093 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/17528/statm: 2134253 683629 2237 9 0 2124994 0
[pid=17528/tid=17529] ppid=17525 vsize=8537012 CPUtime=45.72 cores=1,3,5,7
/proc/17528/task/17529/stat : 17529 (java) T 17525 17528 17528 0 -1 4202560 597618 0 1 0 4508 64 0 0 25 0 19 0 869480312 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 46912505829212 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=17528/tid=17530] ppid=17525 vsize=8537012 CPUtime=0.15 cores=1,3,5,7
/proc/17528/task/17530/stat : 17530 (java) T 17525 17528 17528 0 -1 4202560 12461 0 0 0 14 1 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17528/tid=17531] ppid=17525 vsize=8537012 CPUtime=0.15 cores=1,3,5,7
/proc/17528/task/17531/stat : 17531 (java) T 17525 17528 17528 0 -1 4202560 10132 0 0 0 15 0 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17528/tid=17532] ppid=17525 vsize=8537012 CPUtime=0.14 cores=1,3,5,7
/proc/17528/task/17532/stat : 17532 (java) T 17525 17528 17528 0 -1 4202560 8896 0 0 0 14 0 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17533] ppid=17525 vsize=8537012 CPUtime=0.15 cores=1,3,5,7
/proc/17528/task/17533/stat : 17533 (java) T 17525 17528 17528 0 -1 4202560 8984 0 0 0 14 1 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17528/tid=17534] ppid=17525 vsize=8537012 CPUtime=0.16 cores=1,3,5,7
/proc/17528/task/17534/stat : 17534 (java) T 17525 17528 17528 0 -1 4202560 10388 0 0 0 15 1 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17535] ppid=17525 vsize=8537012 CPUtime=0.25 cores=1,3,5,7
/proc/17528/task/17535/stat : 17535 (java) T 17525 17528 17528 0 -1 4202560 16616 0 0 0 23 2 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17528/tid=17536] ppid=17525 vsize=8537012 CPUtime=0.11 cores=1,3,5,7
/proc/17528/task/17536/stat : 17536 (java) T 17525 17528 17528 0 -1 4202560 8195 0 0 0 11 0 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17528/tid=17537] ppid=17525 vsize=8537012 CPUtime=0.11 cores=1,3,5,7
/proc/17528/task/17537/stat : 17537 (java) T 17525 17528 17528 0 -1 4202560 6102 0 0 0 11 0 0 0 15 0 19 0 869480373 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=17528/tid=17538] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17538/stat : 17538 (java) T 17525 17528 17528 0 -1 4202560 1267 0 0 0 0 0 0 0 15 0 19 0 869480374 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962944 0 0 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17539] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17539/stat : 17539 (java) T 17525 17528 17528 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 19 0 869480374 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17540] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17540/stat : 17540 (java) T 17525 17528 17528 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 19 0 869480375 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17541] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17541/stat : 17541 (java) T 17525 17528 17528 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658970033 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17542] ppid=17525 vsize=8537012 CPUtime=0.49 cores=1,3,5,7
/proc/17528/task/17542/stat : 17542 (java) T 17525 17528 17528 0 -1 4202560 3061 0 0 0 49 0 0 0 15 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=17528/tid=17543] ppid=17525 vsize=8537012 CPUtime=0.4 cores=1,3,5,7
/proc/17528/task/17543/stat : 17543 (java) T 17525 17528 17528 0 -1 4202560 1601 0 0 0 40 0 0 0 15 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17544] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17544/stat : 17544 (java) T 17525 17528 17528 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962329 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17545] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17545/stat : 17545 (java) T 17525 17528 17528 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869480377 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962944 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17528/tid=17546] ppid=17525 vsize=8537012 CPUtime=0 cores=1,3,5,7
/proc/17528/task/17546/stat : 17546 (java) T 17525 17528 17528 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869480777 8741900288 683629 33554432000 1073741824 1073778376 140733919350016 18446744073709551615 210658962944 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17525/tid=17547] ppid=17481 vsize=502112 CPUtime=0 cores=1,3,5,7
/proc/17525/task/17547/stat : 17547 (python) S 17481 17481 16517 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869484994 514162688 50211 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604463668687168 0 0 -1 3 0 0 0
[pid=17548] ppid=17481 vsize=512368 CPUtime=0.24 cores=1,3,5,7
/proc/17548/stat : 17548 (python) S 17481 17481 16517 0 -1 4202560 1173 0 0 0 11 13 0 0 16 0 2 0 869484997 524664832 50215 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658973131 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/17548/statm: 128092 50215 396 364 0 62964 0
[pid=17550] ppid=17548 vsize=56264 CPUtime=52.07 cores=1,3,5,7
/proc/17550/stat : 17550 (wbo1.4a) T 17548 17550 17550 0 -1 4202496 20806 0 0 0 4866 341 0 0 25 0 1 0 869484997 57614336 12993 33554432000 134512640 135751879 4288210432 18446744073709551615 134616412 0 0 16781312 3 18446744071562691360 0 0 17 7 0 0 0
/proc/17550/statm: 14066 12993 143 303 0 13761 0
[pid=17548/tid=17556] ppid=17481 vsize=512368 CPUtime=0 cores=1,3,5,7
/proc/17548/task/17556/stat : 17556 (python) S 17481 17481 16517 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869490215 524664832 50215 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554946 18446604456911074624 0 0 -1 5 0 0 0
[pid=17559] ppid=17481 vsize=522624 CPUtime=0.13 cores=1,3,5,7
/proc/17559/stat : 17559 (python) S 17481 17481 16517 0 -1 4202560 988 0 0 0 5 8 0 0 15 0 1 0 869499720 535166976 50194 33554432000 4194304 5683644 140736305434672 18446744073709551615 210647166534 0 0 16781312 33554946 5623753486446373611 0 0 17 7 0 0 0
/proc/17559/statm: 130656 50194 372 364 0 65525 0
[pid=17561] ppid=17559 vsize=1258980 CPUtime=27.75 cores=1,3,5,7
/proc/17561/stat : 17561 (scip-2.0.1.linu) R 17559 17561 17561 0 -1 4202496 282855 0 0 0 2252 523 0 0 25 0 1 0 869499721 1289195520 273339 33554432000 4194304 15243407 140736073020688 18446744073709551615 8131360 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/17561/statm: 314745 273339 912 2698 0 312040 0
[pid=17481/tid=17492] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17492/stat : 17492 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 25 0 8 0 869463025 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17502] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17502/stat : 17502 (python) S 17479 17481 16517 0 -1 4202560 34 2136 0 0 0 0 3 6 18 0 8 0 869465421 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17510] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17510/stat : 17510 (python) S 17479 17481 16517 0 -1 4202560 31 2136 0 0 0 0 3 6 20 0 8 0 869470227 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 7 0 0 0
[pid=17481/tid=17516] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17516/stat : 17516 (python) S 17479 17481 16517 0 -1 4202560 37 2136 0 0 0 0 3 6 18 0 8 0 869475051 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 7 0 0 0
[pid=17481/tid=17526] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17526/stat : 17526 (python) S 17479 17481 16517 0 -1 4202560 29 2136 0 0 0 0 3 6 20 0 8 0 869480189 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
[pid=17481/tid=17549] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17549/stat : 17549 (python) S 17479 17481 16517 0 -1 4202560 27 2136 0 0 0 0 3 6 20 0 8 0 869484997 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 7 0 0 0
[pid=17481/tid=17560] ppid=17479 vsize=532868 CPUtime=0.09 cores=1,3,5,7
/proc/17481/task/17560/stat : 17560 (python) S 17479 17481 16517 0 -1 4202560 32 2136 0 0 0 0 3 6 20 0 8 0 869499721 545656832 51711 33554432000 4194304 5683644 140736305434672 18446744073709551615 210658970033 0 0 16781312 33554434 18446604466200402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 423.22
Current children cumulated vsize (KiB) 15962436

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 17481 and gives
#  childrusage.ru_utime.tv_sec=50
#  childrusage.ru_utime.tv_usec=957253
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=476927
# CPU time returned by wait4() is 51.4342
# while last known CPU time is 423.22
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 17.62
#  lost CPU user time (s): 11.05
#  lost CPU system time (s): 6.57

Real time (s): 458.212
CPU time (s): 440.84
CPU user time (s): 414.95
CPU system time (s): 25.89
CPU usage (%): 96.2087
Max. virtual memory (cumulated for all children) (KiB): 15962436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 50.9573
system time used= 0.476927
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 91311
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2907
involuntary context switches= 59

runsolver used 2.77858 second user time and 6.64899 second system time

The end

Launcher Data 

Begin job on node129 at 2011-06-09 02:16:22
IDJOB=3482888
IDBENCH=89748
IDSOLVER=1971
FILE ID=node129/3482888-1307578581
RUNJOBID= node129-1307576356-16536
PBS_JOBID= 13547670
Free space on /tmp= 73728 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-164.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482888-1307578581/watcher-3482888-1307578581 -o /tmp/evaluation-result-3482888-1307578581/solver-3482888-1307578581 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482888-1307578581.opb -seed 58639514 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 81ec1ddcd163131a26e4e6f9286dd205
RANDOM SEED=58639514

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      26187796 kB
Buffers:        369956 kB
Cached:        2773676 kB
SwapCached:      49344 kB
Active:        3202536 kB
Inactive:      3234276 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      26187796 kB
SwapTotal:    67111528 kB
SwapFree:     57925100 kB
Dirty:          215916 kB
Writeback:           0 kB
AnonPages:     3255116 kB
Mapped:          45592 kB
Slab:           191764 kB
PageTables:      65584 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 150672692 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66984 MiB
End job on node129 at 2011-06-09 02:24:03