Trace number 3317832

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrialUNSAT 265.023 97.6566

General information on the benchmark

Nameapplication/jarvisalo/AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-12-step15.cnf
MD5SUM86980f7370ece00291f2970256db731a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark63.2044
Satisfiable
(Un)Satisfiability was proved
Number of variables63349
Number of clauses943492
Sum of the clauses size2149412
Maximum clause length541
Minimum clause length1
Number of clauses of size 1202
Number of clauses of size 2908736
Number of clauses of size 32676
Number of clauses of size 41261
Number of clauses of size 54705
Number of clauses of size over 525912

Solver Data 

0.38/0.62	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.38/0.63	c INFO: solving HOME/instance-3317832-1304269050.cnf
0.38/0.63	c INFO: computing task features
2.97/3.30	c INFO: computed variable-clause graph statistics
3.15/3.41	c INFO: computed clause balance statistics
14.95/15.29	c INFO: computed variable balance statistics
24.75/25.04	c INFO: computed small-clause counts
24.85/25.11	c INFO: computed Horn-clause counts
30.06/30.30	c INFO: computed variable graph statistics
30.06/30.30	c INFO: collected features for HOME/instance-3317832-1304269050.cnf in 29.59 s
30.06/30.33	c INFO: running lingeling-276@0 for 97 with 4770 remaining (b = 0.20)
30.06/30.36	c INFO: running cryptominisat-2.9.0@0 for 485 with 4770 remaining (b = 0.16)
30.06/30.38	c INFO: running lingeling-276@0 for 1261 with 4770 remaining (b = 0.31)
30.15/30.41	c INFO: running SApperloT@0 for 97 with 4770 remaining (b = 0.02)
264.90/97.60	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317832-1304269050/watcher-3317832-1304269050 -o /tmp/evaluation-result-3317832-1304269050/solver-3317832-1304269050 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317832-1304269050.cnf -seed 966247080 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.10 7.07 5.88 6/205 21024
/proc/meminfo: memFree=12604252/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 727 0 0 0 0 0 0 0 22 0 1 0 538503876 15548416 616 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 3 0 0 0
/proc/21024/statm: 3796 616 322 364 0 283 0

[startup+0.072538 s]
/proc/loadavg: 7.10 7.07 5.88 6/205 21024
/proc/meminfo: memFree=12604252/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=38900 CPUtime=0.03 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 1658 0 0 0 3 0 0 0 22 0 1 0 538503876 39833600 1485 33554432000 4194304 5683644 140733857152784 18446744073709551615 5114122 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 9725 1485 455 364 0 1025 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 38900

[startup+0.100533 s]
/proc/loadavg: 7.10 7.07 5.88 6/205 21024
/proc/meminfo: memFree=12604252/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=93956 CPUtime=0.05 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 2692 0 0 0 4 1 0 0 22 0 1 0 538503876 96210944 2406 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594862437 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 23489 2406 764 364 0 1621 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93956

[startup+0.300499 s]
/proc/loadavg: 7.10 7.07 5.88 6/205 21024
/proc/meminfo: memFree=12604252/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=135748 CPUtime=0.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 5963 934 1 0 13 4 0 0 22 0 1 0 538503876 139005952 4150 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594862597 0 2147483391 16781312 2 18446744071699215550 0 0 17 3 0 0 0
/proc/21024/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.700428 s]
/proc/loadavg: 7.10 7.07 5.88 6/205 21024
/proc/meminfo: memFree=12604252/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=297564 CPUtime=0.46 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 13996 934 1 0 35 11 0 0 22 0 1 0 538503876 304705536 11677 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594527429 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 74391 11677 1761 364 0 10315 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 297564

[startup+1.50029 s]
/proc/loadavg: 7.10 7.07 5.88 6/206 21029
/proc/meminfo: memFree=12545428/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=348676 CPUtime=1.26 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 26678 934 1 0 113 13 0 0 25 0 1 0 538503876 357044224 24359 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594527429 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 87169 24359 1761 364 0 23093 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 348676

[startup+3.10101 s]
/proc/loadavg: 6.93 7.04 5.88 6/206 21029
/proc/meminfo: memFree=12471648/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=419112 CPUtime=2.86 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 64490 934 1 0 268 18 0 0 25 0 1 0 538503876 429170688 41527 33554432000 4194304 5683644 140733857152784 18446744073709551615 46989600226089 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 104778 41541 1776 364 0 40702 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 419112

[startup+6.30044 s]
/proc/loadavg: 6.93 7.04 5.88 6/206 21029
/proc/meminfo: memFree=12410016/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=449096 CPUtime=6.05 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 81814 934 1 0 586 19 0 0 25 0 1 0 538503876 459874304 49659 33554432000 4194304 5683644 140733857152784 18446744073709551615 5003942 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 112274 49659 1826 364 0 48198 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 449096

[startup+12.7003 s]
/proc/loadavg: 6.78 7.00 5.87 6/206 21029
/proc/meminfo: memFree=12410544/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=449096 CPUtime=12.45 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 81814 934 1 0 1226 19 0 0 25 0 1 0 538503876 459874304 49659 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594525428 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 112274 49659 1826 364 0 48198 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 449096

[startup+25.5011 s]
/proc/loadavg: 6.38 6.90 5.86 6/206 21029
/proc/meminfo: memFree=12402440/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=456468 CPUtime=25.26 cores=1,3,5,7
/proc/21024/stat : 21024 (python) R 21022 21024 20569 0 -1 4202496 83664 934 1 0 2506 20 0 0 25 0 1 0 538503876 467423232 51509 33554432000 4194304 5683644 140733857152784 18446744073709551615 46989554649228 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21024/statm: 114117 51509 1833 364 0 50041 0
Current children cumulated CPU time (s) 25.26
Current children cumulated vsize (KiB) 456468

[startup+51.1006 s]
/proc/loadavg: 6.76 6.94 5.90 9/218 21042
/proc/meminfo: memFree=11862076/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=30.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86369 934 1 0 2995 22 0 0 23 0 5 0 538503876 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21024/statm: 120829 48026 1881 364 0 56738 0
[pid=21031] ppid=21024 vsize=442304 CPUtime=0.02 cores=1,3,5,7
/proc/21031/stat : 21031 (python) S 21024 21024 20569 0 -1 4202560 985 0 0 0 1 1 0 0 18 0 1 0 538506909 452919296 46510 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886671 0 0 16781312 514 11001467056922001668 0 0 17 1 0 0 0
/proc/21031/statm: 110576 46510 381 364 0 46494 0
[pid=21033] ppid=21031 vsize=54008 CPUtime=20.56 cores=1,3,5,7
/proc/21033/stat : 21033 (lingeling) R 21031 21033 21033 0 -1 4202496 20136 0 0 0 2052 4 0 0 25 0 1 0 538506910 55304192 12672 33554432000 4194304 4352236 140736724909456 18446744073709551615 4207755 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/21033/statm: 13502 12672 129 39 0 12582 0
[pid=21034] ppid=21024 vsize=452560 CPUtime=0.02 cores=1,3,5,7
/proc/21034/stat : 21034 (python) S 21024 21024 20569 0 -1 4202560 924 0 0 0 1 1 0 0 15 0 1 0 538506912 463421440 46503 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 4382591779958915336 0 0 17 5 0 0 0
/proc/21034/statm: 113140 46503 370 364 0 49055 0
[pid=21036] ppid=21034 vsize=458080 CPUtime=20.69 cores=1,3,5,7
/proc/21036/stat : 21036 (cryptominisat-2) R 21034 21036 21036 0 -1 4202496 100229 0 0 0 2052 17 0 0 25 0 1 0 538506912 469073920 95621 33554432000 4194304 4677096 140735207746528 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21036/statm: 114520 95621 387 118 0 109479 0
[pid=21037] ppid=21024 vsize=462816 CPUtime=0.02 cores=1,3,5,7
/proc/21037/stat : 21037 (python) S 21024 21024 20569 0 -1 4202560 912 0 0 0 1 1 0 0 18 0 1 0 538506915 473923584 46507 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001670 0 0 17 7 0 0 0
/proc/21037/statm: 115704 46507 370 364 0 51616 0
[pid=21041] ppid=21037 vsize=55552 CPUtime=20.63 cores=1,3,5,7
/proc/21041/stat : 21041 (lingeling) R 21037 21041 21041 0 -1 4202496 20388 0 0 0 2060 3 0 0 25 0 1 0 538506918 56885248 13058 33554432000 4194304 4352236 140735634449648 18446744073709551615 4281293 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21041/statm: 13888 13058 129 39 0 12968 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.02 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 931 0 0 0 1 1 0 0 18 0 1 0 538506917 484425728 46511 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001669 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46511 370 364 0 54177 0
[pid=21042] ppid=21039 vsize=62396 CPUtime=10.31 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4202496 15046 0 0 0 1028 3 0 0 25 0 1 0 538506918 63893504 14298 33554432000 134512640 135674940 4290515424 18446744073709551615 134564580 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21042/statm: 15599 14298 99 284 0 15313 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538506910 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538506912 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 934 0 0 0 0 0 0 22 0 5 0 538506915 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 934 0 0 0 0 0 0 24 0 5 0 538506918 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 102.44
Current children cumulated vsize (KiB) 2944104

Solver just ended. Dumping a history of the last processes samples

[startup+76.701 s]
/proc/loadavg: 7.18 7.03 5.95 9/218 21043
/proc/meminfo: memFree=11567692/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=30.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86369 934 1 0 2995 22 0 0 23 0 5 0 538503876 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21024/statm: 120829 48026 1881 364 0 56738 0
[pid=21031] ppid=21024 vsize=442304 CPUtime=0.07 cores=1,3,5,7
/proc/21031/stat : 21031 (python) S 21024 21024 20569 0 -1 4202560 1001 0 0 0 3 4 0 0 18 0 1 0 538506909 452919296 46510 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886671 0 0 16781312 514 11001467056922001668 0 0 17 1 0 0 0
/proc/21031/statm: 110576 46510 381 364 0 46494 0
[pid=21033] ppid=21031 vsize=79564 CPUtime=45.9 cores=1,3,5,7
/proc/21033/stat : 21033 (lingeling) R 21031 21033 21033 0 -1 4202496 26536 0 0 0 4586 4 0 0 25 0 1 0 538506910 81473536 19060 33554432000 4194304 4352236 140736724909456 18446744073709551615 4207597 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/21033/statm: 19891 19060 129 39 0 18971 0
[pid=21034] ppid=21024 vsize=452560 CPUtime=0.07 cores=1,3,5,7
/proc/21034/stat : 21034 (python) S 21024 21024 20569 0 -1 4202560 935 0 0 0 3 4 0 0 15 0 1 0 538506912 463421440 46503 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 4382591779958915336 0 0 17 5 0 0 0
/proc/21034/statm: 113140 46503 370 364 0 49055 0
[pid=21036] ppid=21034 vsize=713168 CPUtime=46.24 cores=1,3,5,7
/proc/21036/stat : 21036 (cryptominisat-2) R 21034 21036 21036 0 -1 4202496 159080 0 0 0 4597 27 0 0 25 0 1 0 538506912 730284032 147822 33554432000 4194304 4677096 140735207746528 18446744073709551615 4339098 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21036/statm: 178292 147822 391 118 0 173251 0
[pid=21037] ppid=21024 vsize=462816 CPUtime=0.06 cores=1,3,5,7
/proc/21037/stat : 21037 (python) S 21024 21024 20569 0 -1 4202560 922 0 0 0 3 3 0 0 18 0 1 0 538506915 473923584 46507 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001670 0 0 17 7 0 0 0
/proc/21037/statm: 115704 46507 370 364 0 51616 0
[pid=21041] ppid=21037 vsize=80652 CPUtime=46.19 cores=1,3,5,7
/proc/21041/stat : 21041 (lingeling) R 21037 21041 21041 0 -1 4202496 26788 0 0 0 4615 4 0 0 25 0 1 0 538506918 82587648 19333 33554432000 4194304 4352236 140735634449648 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21041/statm: 20163 19333 129 39 0 19243 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.07 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 944 0 0 0 3 4 0 0 18 0 1 0 538506917 484425728 46511 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001669 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46511 370 364 0 54177 0
[pid=21042] ppid=21039 vsize=98780 CPUtime=23.1 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4202496 24393 0 0 0 2305 5 0 0 25 0 1 0 538506918 101150720 23132 33554432000 134512640 135674940 4290515424 18446744073709551615 134564665 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21042/statm: 24695 23132 99 284 0 24409 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538506910 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538506912 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 934 0 0 0 0 0 0 22 0 5 0 538506915 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 934 0 0 0 0 0 0 24 0 5 0 538506918 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 191.87
Current children cumulated vsize (KiB) 3286232

[startup+89.5008 s]
/proc/loadavg: 7.36 7.07 5.99 9/218 21043
/proc/meminfo: memFree=11501720/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=30.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86369 934 1 0 2995 22 0 0 23 0 5 0 538503876 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21024/statm: 120829 48026 1881 364 0 56738 0
[pid=21031] ppid=21024 vsize=442304 CPUtime=0.08 cores=1,3,5,7

################
# More data... #
################

/proc/21037/stat : 21037 (python) S 21024 21024 20569 0 -1 4202560 929 0 0 0 5 5 0 0 18 0 1 0 538506915 473923584 46507 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001670 0 0 17 7 0 0 0
/proc/21037/statm: 115704 46507 370 364 0 51616 0
[pid=21041] ppid=21037 vsize=83308 CPUtime=65.36 cores=1,3,5,7
/proc/21041/stat : 21041 (lingeling) R 21037 21041 21041 0 -1 4202496 27556 0 0 0 6532 4 0 0 25 0 1 0 538506918 85307392 19997 33554432000 4194304 4352236 140735634449648 18446744073709551615 4278697 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21041/statm: 20827 19997 129 39 0 19907 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.09 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 949 0 0 0 4 5 0 0 18 0 1 0 538506917 484425728 46511 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001669 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46511 370 364 0 54177 0
[pid=21042] ppid=21039 vsize=125416 CPUtime=32.71 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4202496 31052 0 0 0 3264 7 0 0 25 0 1 0 538506918 128425984 29791 33554432000 134512640 135674940 4290515424 18446744073709551615 134551937 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21042/statm: 31354 29791 99 284 0 31068 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538506910 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538506912 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 934 0 0 0 0 0 0 22 0 5 0 538506915 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 934 0 0 0 0 0 0 24 0 5 0 538506918 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 258.97
Current children cumulated vsize (KiB) 3401276

[startup+96.7015 s]
/proc/loadavg: 7.41 7.09 6.00 10/218 21043
/proc/meminfo: memFree=11458924/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=30.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86369 934 1 0 2995 22 0 0 23 0 5 0 538503876 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21024/statm: 120829 48026 1881 364 0 56738 0
[pid=21031] ppid=21024 vsize=442304 CPUtime=0.1 cores=1,3,5,7
/proc/21031/stat : 21031 (python) S 21024 21024 20569 0 -1 4202560 1009 0 0 0 5 5 0 0 18 0 1 0 538506909 452919296 46510 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886671 0 0 16781312 514 11001467056922001668 0 0 17 1 0 0 0
/proc/21031/statm: 110576 46510 381 364 0 46494 0
[pid=21033] ppid=21031 vsize=62696 CPUtime=65.72 cores=1,3,5,7
/proc/21033/stat : 21033 (lingeling) R 21031 21033 21033 0 -1 4202496 26536 0 0 0 6568 4 0 0 25 0 1 0 538506910 64200704 14843 33554432000 4194304 4352236 140736724909456 18446744073709551615 4234447 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/21033/statm: 15674 14843 129 39 0 14754 0
[pid=21034] ppid=21024 vsize=452560 CPUtime=0.1 cores=1,3,5,7
/proc/21034/stat : 21034 (python) S 21024 21024 20569 0 -1 4202560 944 0 0 0 5 5 0 0 15 0 1 0 538506912 463421440 46503 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001672 0 0 17 5 0 0 0
/proc/21034/statm: 113140 46503 370 364 0 49055 0
[pid=21036] ppid=21034 vsize=815948 CPUtime=66.22 cores=1,3,5,7
/proc/21036/stat : 21036 (cryptominisat-2) R 21034 21036 21036 0 -1 4202496 185915 0 0 0 6589 33 0 0 25 0 1 0 538506912 835530752 170208 33554432000 4194304 4677096 140735207746528 18446744073709551615 4320112 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21036/statm: 203987 170208 391 118 0 198946 0
[pid=21037] ppid=21024 vsize=462816 CPUtime=0.1 cores=1,3,5,7
/proc/21037/stat : 21037 (python) S 21024 21024 20569 0 -1 4202560 929 0 0 0 5 5 0 0 18 0 1 0 538506915 473923584 46507 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001670 0 0 17 7 0 0 0
/proc/21037/statm: 115704 46507 370 364 0 51616 0
[pid=21041] ppid=21037 vsize=83296 CPUtime=66.17 cores=1,3,5,7
/proc/21041/stat : 21041 (lingeling) R 21037 21041 21041 0 -1 4202496 27556 0 0 0 6613 4 0 0 25 0 1 0 538506918 85295104 19994 33554432000 4194304 4352236 140735634449648 18446744073709551615 4281227 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21041/statm: 20824 19994 129 39 0 19904 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.09 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 949 0 0 0 4 5 0 0 18 0 1 0 538506917 484425728 46511 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001669 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46511 370 364 0 54177 0
[pid=21042] ppid=21039 vsize=126368 CPUtime=33.11 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4202496 31308 0 0 0 3304 7 0 0 25 0 1 0 538506918 129400832 30047 33554432000 134512640 135674940 4290515424 18446744073709551615 134551752 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21042/statm: 31592 30047 99 284 0 31306 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538506910 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538506912 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 934 0 0 0 0 0 0 22 0 5 0 538506915 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 934 0 0 0 0 0 0 24 0 5 0 538506918 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 261.78
Current children cumulated vsize (KiB) 3402376

[startup+97.1014 s]
/proc/loadavg: 7.41 7.09 6.00 10/218 21043
/proc/meminfo: memFree=11458924/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=30.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86369 934 1 0 2995 22 0 0 23 0 5 0 538503876 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21024/statm: 120829 48026 1881 364 0 56738 0
[pid=21031] ppid=21024 vsize=442304 CPUtime=0.1 cores=1,3,5,7
/proc/21031/stat : 21031 (python) S 21024 21024 20569 0 -1 4202560 1009 0 0 0 5 5 0 0 18 0 1 0 538506909 452919296 46510 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886671 0 0 16781312 514 11001467056922001668 0 0 17 1 0 0 0
/proc/21031/statm: 110576 46510 381 364 0 46494 0
[pid=21033] ppid=21031 vsize=62696 CPUtime=66.12 cores=1,3,5,7
/proc/21033/stat : 21033 (lingeling) R 21031 21033 21033 0 -1 4202496 26536 0 0 0 6608 4 0 0 25 0 1 0 538506910 64200704 14843 33554432000 4194304 4352236 140736724909456 18446744073709551615 4233981 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/21033/statm: 15674 14843 129 39 0 14754 0
[pid=21034] ppid=21024 vsize=452560 CPUtime=0.11 cores=1,3,5,7
/proc/21034/stat : 21034 (python) S 21024 21024 20569 0 -1 4202560 944 0 0 0 6 5 0 0 15 0 1 0 538506912 463421440 46503 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 4382591779958915336 0 0 17 5 0 0 0
/proc/21034/statm: 113140 46503 370 364 0 49055 0
[pid=21036] ppid=21034 vsize=818056 CPUtime=66.61 cores=1,3,5,7
/proc/21036/stat : 21036 (cryptominisat-2) R 21034 21036 21036 0 -1 4202496 186415 0 0 0 6628 33 0 0 25 0 1 0 538506912 837689344 170708 33554432000 4194304 4677096 140735207746528 18446744073709551615 4557975 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21036/statm: 204514 170708 391 118 0 199473 0
[pid=21037] ppid=21024 vsize=462816 CPUtime=0.1 cores=1,3,5,7
/proc/21037/stat : 21037 (python) S 21024 21024 20569 0 -1 4202560 929 0 0 0 5 5 0 0 18 0 1 0 538506915 473923584 46507 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001670 0 0 17 7 0 0 0
/proc/21037/statm: 115704 46507 370 364 0 51616 0
[pid=21041] ppid=21037 vsize=83296 CPUtime=66.56 cores=1,3,5,7
/proc/21041/stat : 21041 (lingeling) R 21037 21041 21041 0 -1 4202496 27556 0 0 0 6652 4 0 0 25 0 1 0 538506918 85295104 19994 33554432000 4194304 4352236 140735634449648 18446744073709551615 4278813 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21041/statm: 20824 19994 129 39 0 19904 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.09 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 949 0 0 0 4 5 0 0 18 0 1 0 538506917 484425728 46511 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001669 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46511 370 364 0 54177 0
[pid=21042] ppid=21039 vsize=127048 CPUtime=33.31 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4202496 31453 0 0 0 3324 7 0 0 25 0 1 0 538506918 130097152 30192 33554432000 134512640 135674940 4290515424 18446744073709551615 134556772 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21042/statm: 31762 30192 99 284 0 31476 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538506910 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538506912 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 934 0 0 0 0 0 0 22 0 5 0 538506915 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 934 0 0 0 0 0 0 24 0 5 0 538506918 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 263.17
Current children cumulated vsize (KiB) 3405164

[startup+97.5014 s]
/proc/loadavg: 7.41 7.09 6.00 10/218 21043
/proc/meminfo: memFree=11458924/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=30.17 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86369 934 1 0 2995 22 0 0 23 0 5 0 538503876 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21024/statm: 120829 48026 1881 364 0 56738 0
[pid=21031] ppid=21024 vsize=442304 CPUtime=0.1 cores=1,3,5,7
/proc/21031/stat : 21031 (python) S 21024 21024 20569 0 -1 4202560 1009 0 0 0 5 5 0 0 18 0 1 0 538506909 452919296 46510 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886671 0 0 16781312 514 11001467056922001668 0 0 17 1 0 0 0
/proc/21031/statm: 110576 46510 381 364 0 46494 0
[pid=21033] ppid=21031 vsize=62696 CPUtime=66.52 cores=1,3,5,7
/proc/21033/stat : 21033 (lingeling) R 21031 21033 21033 0 -1 4202496 26536 0 0 0 6648 4 0 0 25 0 1 0 538506910 64200704 14843 33554432000 4194304 4352236 140736724909456 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/21033/statm: 15674 14843 129 39 0 14754 0
[pid=21034] ppid=21024 vsize=452560 CPUtime=0.11 cores=1,3,5,7
/proc/21034/stat : 21034 (python) S 21024 21024 20569 0 -1 4202560 944 0 0 0 6 5 0 0 15 0 1 0 538506912 463421440 46503 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 4382591779958915336 0 0 17 5 0 0 0
/proc/21034/statm: 113140 46503 370 364 0 49055 0
[pid=21036] ppid=21034 vsize=822936 CPUtime=67.01 cores=1,3,5,7
/proc/21036/stat : 21036 (cryptominisat-2) R 21034 21036 21036 0 -1 4202496 187650 0 0 0 6668 33 0 0 25 0 1 0 538506912 842686464 171943 33554432000 4194304 4677096 140735207746528 18446744073709551615 4462744 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21036/statm: 205734 171943 391 118 0 200693 0
[pid=21037] ppid=21024 vsize=462816 CPUtime=0.1 cores=1,3,5,7
/proc/21037/stat : 21037 (python) S 21024 21024 20569 0 -1 4202560 929 0 0 0 5 5 0 0 18 0 1 0 538506915 473923584 46507 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001670 0 0 17 7 0 0 0
/proc/21037/statm: 115704 46507 370 364 0 51616 0
[pid=21041] ppid=21037 vsize=83296 CPUtime=66.96 cores=1,3,5,7
/proc/21041/stat : 21041 (lingeling) R 21037 21041 21041 0 -1 4202496 27556 0 0 0 6692 4 0 0 25 0 1 0 538506918 85295104 19994 33554432000 4194304 4352236 140735634449648 18446744073709551615 4233914 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21041/statm: 20824 19994 129 39 0 19904 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.09 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 949 0 0 0 4 5 0 0 18 0 1 0 538506917 484425728 46511 33554432000 4194304 5683644 140733857152784 18446744073709551615 235594886726 0 0 16781312 514 11001467056922001669 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46511 370 364 0 54177 0
[pid=21042] ppid=21039 vsize=127468 CPUtime=33.51 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4202496 31577 0 0 0 3344 7 0 0 25 0 1 0 538506918 130527232 30316 33554432000 134512640 135674940 4290515424 18446744073709551615 134564660 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/21042/statm: 31867 30316 99 284 0 31581 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538506910 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538506912 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 934 0 0 0 0 0 0 22 0 5 0 538506915 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=0 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 934 0 0 0 0 0 0 24 0 5 0 538506918 494915584 48026 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 264.57
Current children cumulated vsize (KiB) 3410464

[startup+97.6014 s]
/proc/loadavg: 7.41 7.09 6.00 10/218 21043
/proc/meminfo: memFree=11458924/32950928 swapFree=67111404/67111528
[pid=21024] ppid=21022 vsize=483316 CPUtime=164.56 cores=1,3,5,7
/proc/21024/stat : 21024 (python) S 21022 21024 20569 0 -1 4202496 86411 218110 1 0 2995 22 13387 52 17 0 5 0 538503876 494915584 48027 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606696767 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/21024/statm: 120829 48027 1882 364 0 56738 0
[pid=21031] ppid=21024 vsize=0 CPUtime=66.68 cores=1,3,5,7
/proc/21031/stat : 21031 (python) Z 21024 21024 20569 0 -1 4202588 1235 26539 0 0 5 5 6653 5 17 0 1 0 538506909 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21031/statm: 0 0 0 0 0 0 0
[pid=21039] ppid=21024 vsize=473072 CPUtime=0.09 cores=1,3,5,7
/proc/21039/stat : 21039 (python) S 21024 21024 20569 0 -1 4202560 967 0 0 0 4 5 0 0 17 0 1 0 538506917 484425728 46516 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606696767 0 0 16781824 2 18446744071562232103 0 0 17 7 0 0 0
/proc/21039/statm: 118268 46516 375 364 0 54177 0
[pid=21042] ppid=21039 vsize=0 CPUtime=33.57 cores=1,3,5,7
/proc/21042/stat : 21042 (SApperloT-base) R 21039 21042 21042 0 -1 4203524 31618 0 0 0 3350 7 0 0 25 0 1 0 538506918 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/21042/statm: 0 0 0 0 0 0 0
[pid=21024/tid=21032] ppid=21022 vsize=483316 CPUtime=134.39 cores=1,3,5,7
/proc/21024/task/21032/stat : 21032 (python) S 21022 21024 20569 0 -1 4202560 25 218110 0 0 0 0 13387 52 25 0 5 0 538506910 494915584 48027 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 1 0 0 0
[pid=21024/tid=21035] ppid=21022 vsize=483316 CPUtime=134.39 cores=1,3,5,7
/proc/21024/task/21035/stat : 21035 (python) S 21022 21024 20569 0 -1 4202560 20 218110 0 0 0 0 13387 52 20 0 5 0 538506912 494915584 48027 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21038] ppid=21022 vsize=483316 CPUtime=134.39 cores=1,3,5,7
/proc/21024/task/21038/stat : 21038 (python) S 21022 21024 20569 0 -1 4202560 39 218110 0 0 0 0 13387 52 22 0 5 0 538506915 494915584 48027 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
[pid=21024/tid=21040] ppid=21022 vsize=483316 CPUtime=134.39 cores=1,3,5,7
/proc/21024/task/21040/stat : 21040 (python) S 21022 21024 20569 0 -1 4202560 19 218110 0 0 0 0 13387 52 24 0 5 0 538506918 494915584 48027 33554432000 4194304 5683644 140733857152784 18446744073709551615 235606690225 0 0 16781312 2 18446604471101205440 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 264.9
Current children cumulated vsize (KiB) 956388

Child status: 0
Real time (s): 97.6566
CPU time (s): 265.023
CPU user time (s): 264.008
CPU system time (s): 1.01484
CPU usage (%): 271.382
Max. virtual memory (cumulated for all children) (KiB): 3414504

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 264.008
system time used= 1.01484
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 387717
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3303
involuntary context switches= 1836

runsolver used 0.19197 second user time and 0.412937 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-01 18:57:31
IDJOB=3317832
IDBENCH=82420
IDSOLVER=1706
FILE ID=node120/3317832-1304269050
RUNJOBID= node120-1304267283-20588
PBS_JOBID= 13173959
Free space on /tmp= 72564 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/jarvisalo/AAAI2010-SATPlanning/aaai10-planning-ipc5-pipesworld-12-step15.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317832-1304269050/watcher-3317832-1304269050 -o /tmp/evaluation-result-3317832-1304269050/solver-3317832-1304269050 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317832-1304269050.cnf -seed 966247080 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 86980f7370ece00291f2970256db731a
RANDOM SEED=966247080

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12604284 kB
Buffers:        567784 kB
Cached:        1944916 kB
SwapCached:          8 kB
Active:       19006932 kB
Inactive:       937180 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12604284 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           47048 kB
Writeback:           0 kB
AnonPages:    17431540 kB
Mapped:          22084 kB
Slab:           303280 kB
PageTables:      39840 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 18036808 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72532 MiB
End job on node120 at 2011-05-01 18:59:09