Trace number 3321356

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrialUNSAT 2813.47 575.033

General information on the benchmark

Namemanol-pipe-c10nidw.cnf
MD5SUM943fd86d922b13236c21a74c4f82b6d0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark132.277
Satisfiable
(Un)Satisfiability was proved
Number of variables433601
Number of clauses1291714
Sum of the clauses size3013998
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2861142
Number of clauses of size 3430571
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.31/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.31/0.46	c INFO: solving HOME/instance-3321356-1304337449.cnf
0.31/0.46	c INFO: computing task features
4.91/5.07	c INFO: computed variable-clause graph statistics
5.11/5.23	c INFO: computed clause balance statistics
24.71/24.90	c INFO: computed variable balance statistics
39.41/39.54	c INFO: computed small-clause counts
40.00/40.12	c INFO: computed Horn-clause counts
254.02/254.18	c INFO: computed variable graph statistics
254.02/254.18	c INFO: collected features for HOME/instance-3321356-1304337449.cnf in 253.59 s
254.12/254.22	c INFO: running lingeling-276@0 for 194 with 39746 remaining (b = 0.88)
254.12/254.25	c INFO: running lingeling-276@0 for 97 with 39746 remaining (b = 0.75)
254.12/254.29	c INFO: running cryptominisat-2.9.0@0 for 485 with 39746 remaining (b = 0.49)
254.21/254.32	c INFO: running cryptominisat-2.9.0@0 for 679 with 39746 remaining (b = 0.49)
254.21/254.36	c INFO: running lingeling-276@0 for 970 with 39746 remaining (b = 0.50)
254.21/254.39	c INFO: running cryptominisat-2.9.0@0 for 97 with 39746 remaining (b = 0.11)
254.31/254.43	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39746 remaining (b = 0.58)
254.31/254.47	c INFO: running precosat-570@0 for 388 with 39746 remaining (b = 0.25)
1053.62/354.47	c INFO: running lingeling-276@0 for 97 with 39646 remaining (b = 0.07)
1064.79/355.90	c INFO: running lingeling-276@0 for 873 with 39644 remaining (b = 0.29)
1813.47/449.67	c INFO: running cryptominisat-2.9.0@0 for 1552 with 39550 remaining (b = 0.44)
1821.42/450.61	c INFO: running precosat-570@0 for 776 with 39549 remaining (b = 0.34)
2813.15/574.96	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321356-1304337449/watcher-3321356-1304337449 -o /tmp/evaluation-result-3321356-1304337449/solver-3321356-1304337449 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321356-1304337449.cnf -seed 1309344315 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.23 7.49 7.70 2/248 1953
/proc/meminfo: memFree=28177208/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=15080 CPUtime=0 cores=0-7
/proc/1953/stat : 1953 (python) S 1951 1953 1495 0 -1 4202496 650 0 0 0 0 0 0 0 21 0 1 0 526160361 15441920 545 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/1953/statm: 3770 545 312 364 0 257 0

[startup+0.0272191 s]
/proc/loadavg: 6.23 7.49 7.70 2/248 1953
/proc/meminfo: memFree=28177208/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=16812 CPUtime=0.01 cores=0-7
/proc/1953/stat : 1953 (python) S 1951 1953 1495 0 -1 4202496 1229 0 0 0 1 0 0 0 20 0 1 0 526160361 17215488 1086 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/1953/statm: 4203 1087 418 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16812

[startup+0.101209 s]
/proc/loadavg: 6.23 7.49 7.70 2/248 1953
/proc/meminfo: memFree=28177208/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=104232 CPUtime=0.07 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 3088 0 0 0 5 2 0 0 17 0 1 0 526160361 106733568 2768 33554432000 4194304 5683644 140734115374016 18446744073709551615 5114052 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 26058 2768 847 364 0 1806 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.301162 s]
/proc/loadavg: 6.23 7.49 7.70 2/248 1953
/proc/meminfo: memFree=28177208/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=187688 CPUtime=0.22 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 6824 938 1 0 16 6 0 0 17 0 1 0 526160361 192192512 4882 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261614592 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 46922 4882 1399 364 0 3723 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 187688

[startup+0.701082 s]
/proc/loadavg: 6.23 7.49 7.70 2/248 1953
/proc/meminfo: memFree=28177208/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=316360 CPUtime=0.61 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 18658 938 1 0 50 11 0 0 17 0 1 0 526160361 323952640 16341 33554432000 4194304 5683644 140734115374016 18446744073709551615 47589135516986 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 79090 16343 1761 364 0 15014 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 316360

[startup+1.50094 s]
/proc/loadavg: 6.23 7.49 7.70 2/249 1958
/proc/meminfo: memFree=28098852/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=370348 CPUtime=1.41 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 31767 938 1 0 129 12 0 0 19 0 1 0 526160361 379236352 29450 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261277381 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 92587 29450 1761 364 0 28511 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 370348

[startup+3.10062 s]
/proc/loadavg: 6.23 7.49 7.70 2/249 1958
/proc/meminfo: memFree=28026932/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=464636 CPUtime=3.01 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 55122 938 1 0 285 16 0 0 22 0 1 0 526160361 475787264 52805 33554432000 4194304 5683644 140734115374016 18446744073709551615 47588964903410 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 116159 52805 1761 364 0 52083 0
Current children cumulated CPU time (s) 3.01
Current children cumulated vsize (KiB) 464636

[startup+6.30106 s]
/proc/loadavg: 5.81 7.39 7.66 2/249 1958
/proc/meminfo: memFree=27913852/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=521616 CPUtime=6.21 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 112053 938 1 0 599 22 0 0 25 0 1 0 526160361 534134784 67789 33554432000 4194304 5683644 140734115374016 18446744073709551615 47588964719968 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 130404 67789 1826 364 0 66328 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 521616

[startup+12.7009 s]
/proc/loadavg: 5.43 7.28 7.63 2/249 1959
/proc/meminfo: memFree=27914548/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=521616 CPUtime=12.61 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 112053 938 1 0 1239 22 0 0 25 0 1 0 526160361 534134784 67789 33554432000 4194304 5683644 140734115374016 18446744073709551615 4539653 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 130404 67789 1826 364 0 66328 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 521616

[startup+25.5007 s]
/proc/loadavg: 4.45 6.97 7.52 2/249 1959
/proc/meminfo: memFree=27916232/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=521616 CPUtime=25.41 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 112054 938 1 0 2519 22 0 0 25 0 1 0 526160361 534134784 67790 33554432000 4194304 5683644 140734115374016 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 130404 67790 1827 364 0 66328 0
Current children cumulated CPU time (s) 25.41
Current children cumulated vsize (KiB) 521616

[startup+51.1011 s]
/proc/loadavg: 3.27 6.49 7.35 2/249 1959
/proc/meminfo: memFree=27906108/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=531704 CPUtime=51.01 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 114582 938 1 0 5079 22 0 0 25 0 1 0 526160361 544464896 70318 33554432000 4194304 5683644 140734115374016 18446744073709551615 47588964665484 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 132926 70318 1833 364 0 68850 0
Current children cumulated CPU time (s) 51.01
Current children cumulated vsize (KiB) 531704

[startup+102.309 s]
/proc/loadavg: 2.06 5.66 7.02 2/249 1961
/proc/meminfo: memFree=27905636/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=531704 CPUtime=102.21 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 114582 938 1 0 10199 22 0 0 25 0 1 0 526160361 544464896 70318 33554432000 4194304 5683644 140734115374016 18446744073709551615 47588964665484 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 132926 70318 1833 364 0 68850 0
Current children cumulated CPU time (s) 102.21
Current children cumulated vsize (KiB) 531704

[startup+162.3 s]
/proc/loadavg: 1.39 4.81 6.64 2/249 1963
/proc/meminfo: memFree=27905744/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=531704 CPUtime=162.21 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 114582 938 1 0 16199 22 0 0 25 0 1 0 526160361 544464896 70318 33554432000 4194304 5683644 140734115374016 18446744073709551615 47588964665484 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 132926 70318 1833 364 0 68850 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 531704

[startup+222.301 s]
/proc/loadavg: 1.14 4.11 6.28 2/249 1973
/proc/meminfo: memFree=27906364/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=531704 CPUtime=222.21 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 114582 938 1 0 22199 22 0 0 25 0 1 0 526160361 544464896 70318 33554432000 4194304 5683644 140734115374016 18446744073709551615 47588964665484 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1953/statm: 132926 70318 1833 364 0 68850 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 531704

[startup+282.302 s]
/proc/loadavg: 3.44 4.10 6.13 9/273 1999
/proc/meminfo: memFree=23938660/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=659532 CPUtime=254.39 cores=0-7
/proc/1953/stat : 1953 (python) S 1951 1953 1495 0 -1 4202496 120517 938 1 0 25410 29 0 0 20 0 9 0 526160361 675360768 65466 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/1953/statm: 164883 65466 1889 364 0 100780 0
[pid=1975] ppid=1953 vsize=511960 CPUtime=0.06 cores=0-7
/proc/1975/stat : 1975 (python) S 1953 1953 1495 0 -1 4202560 923 0 0 0 3 3 0 0 18 0 1 0 526185784 524247040 63919 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636623 0 0 16781312 514 2903713451933139204 0 0 17 1 0 0 0
/proc/1975/statm: 127990 63919 376 364 0 63908 0
[pid=1977] ppid=1975 vsize=148560 CPUtime=28.06 cores=0-7
/proc/1977/stat : 1977 (lingeling) R 1975 1977 1977 0 -1 4202496 57769 0 0 0 2797 9 0 0 25 0 1 0 526185784 152125440 36310 33554432000 4194304 4352236 140736132684896 18446744073709551615 4273940 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/1977/statm: 37140 36310 129 39 0 36220 0
[pid=1978] ppid=1953 vsize=522216 CPUtime=0.04 cores=0-7
/proc/1978/stat : 1978 (python) S 1953 1953 1495 0 -1 4202560 922 0 0 0 1 3 0 0 18 0 1 0 526185787 534749184 63917 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139203 0 0 17 6 0 0 0
/proc/1978/statm: 130554 63917 370 364 0 66469 0
[pid=1980] ppid=1978 vsize=149948 CPUtime=28.02 cores=0-7
/proc/1980/stat : 1980 (lingeling) R 1978 1980 1980 0 -1 4202496 68961 0 0 0 2794 8 0 0 25 0 1 0 526185788 153546752 36657 33554432000 4194304 4352236 140734655543904 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/1980/statm: 37487 36657 129 39 0 36567 0
[pid=1981] ppid=1953 vsize=532472 CPUtime=0.06 cores=0-7
/proc/1981/stat : 1981 (python) S 1953 1953 1495 0 -1 4202560 942 0 0 0 3 3 0 0 15 0 1 0 526185791 545251328 63921 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 3408380497284268292 0 0 17 1 0 0 0
/proc/1981/statm: 133118 63921 370 364 0 69030 0
[pid=1983] ppid=1981 vsize=871420 CPUtime=27.93 cores=0-7
/proc/1983/stat : 1983 (cryptominisat-2) R 1981 1983 1983 0 -1 4202496 204274 0 0 0 2768 25 0 0 25 0 1 0 526185791 892334080 195001 33554432000 4194304 4677096 140736175586336 18446744073709551615 4334804 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/1983/statm: 217855 195001 390 118 0 212814 0
[pid=1984] ppid=1953 vsize=542728 CPUtime=0.06 cores=0-7
/proc/1984/stat : 1984 (python) S 1953 1953 1495 0 -1 4202560 946 0 0 0 3 3 0 0 15 0 1 0 526185794 555753472 63925 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139201 0 0 17 1 0 0 0
/proc/1984/statm: 135682 63925 370 364 0 71591 0
[pid=1986] ppid=1984 vsize=874016 CPUtime=27.95 cores=0-7
/proc/1986/stat : 1986 (cryptominisat-2) R 1984 1986 1986 0 -1 4202496 204589 0 0 0 2766 29 0 0 25 0 1 0 526185795 894992384 195317 33554432000 4194304 4677096 140733546564496 18446744073709551615 4338016 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/1986/statm: 218504 195317 390 118 0 213463 0
[pid=1987] ppid=1953 vsize=618520 CPUtime=0.04 cores=0-7
/proc/1987/stat : 1987 (python) S 1953 1953 1495 0 -1 4202560 933 0 0 0 2 2 0 0 18 0 1 0 526185798 633364480 63931 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139201 0 0 17 1 0 0 0
/proc/1987/statm: 154630 63931 370 364 0 90536 0
[pid=1989] ppid=1987 vsize=150160 CPUtime=27.91 cores=0-7
/proc/1989/stat : 1989 (lingeling) R 1987 1989 1989 0 -1 4202496 69018 0 0 0 2783 8 0 0 25 0 1 0 526185799 153763840 36710 33554432000 4194304 4352236 140736704738704 18446744073709551615 4331500 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/1989/statm: 37540 36710 129 39 0 36620 0
[pid=1990] ppid=1953 vsize=628776 CPUtime=0.06 cores=0-7
/proc/1990/stat : 1990 (python) S 1953 1953 1495 0 -1 4202560 953 0 0 0 3 3 0 0 15 0 1 0 526185801 643866624 63935 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139204 0 0 17 1 0 0 0
/proc/1990/statm: 157194 63935 370 364 0 93097 0
[pid=1992] ppid=1990 vsize=871424 CPUtime=27.63 cores=0-7
/proc/1992/stat : 1992 (cryptominisat-2) R 1990 1992 1992 0 -1 4202496 204265 0 0 0 2731 32 0 0 25 0 1 0 526185802 892338176 194987 33554432000 4194304 4677096 140734939579344 18446744073709551615 4317747 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/1992/statm: 217856 194987 390 118 0 212815 0
[pid=1993] ppid=1953 vsize=639032 CPUtime=0.06 cores=0-7
/proc/1993/stat : 1993 (python) S 1953 1953 1495 0 -1 4202560 954 0 0 0 2 4 0 0 15 0 1 0 526185805 654368768 63939 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 18174650134502015235 0 0 17 1 0 0 0
/proc/1993/statm: 159758 63939 370 364 0 95658 0
[pid=1995] ppid=1993 vsize=872860 CPUtime=27.82 cores=0-7
/proc/1995/stat : 1995 (cryptominisat-2) R 1993 1995 1995 0 -1 4202496 204585 0 0 0 2755 27 0 0 25 0 1 0 526185808 893808640 195307 33554432000 4194304 4677096 140737358986736 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/1995/statm: 218215 195307 390 118 0 213174 0
[pid=1996] ppid=1953 vsize=649288 CPUtime=0.05 cores=0-7
/proc/1996/stat : 1996 (python) S 1953 1953 1495 0 -1 4202560 999 0 0 0 2 3 0 0 18 0 1 0 526185809 664870912 63949 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139204 0 0 17 1 0 0 0
/proc/1996/statm: 162322 63949 376 364 0 98219 0
[pid=1998] ppid=1996 vsize=402744 CPUtime=27.42 cores=0-7
/proc/1998/stat : 1998 (precosat) R 1996 1998 1998 0 -1 4202496 104333 0 0 0 2729 13 0 0 25 0 1 0 526185810 412409856 97281 33554432000 4194304 4890832 140733546546688 18446744073709551615 4235063 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/1998/statm: 100686 97281 86 171 0 100513 0
[pid=1953/tid=1976] ppid=1951 vsize=659532 CPUtime=0 cores=0-7

################
# More data... #
################

/proc/2012/statm: 100957 97594 86 171 0 100784 0
[pid=1953/tid=1976] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1976/stat : 1976 (python) S 1951 1953 1495 0 -1 4202560 27 938 0 0 0 0 0 0 25 0 11 0 526185784 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1979] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1979/stat : 1979 (python) S 1951 1953 1495 0 -1 4202560 26 938 0 0 0 0 0 0 18 0 11 0 526185788 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 2 0 0 0
[pid=1953/tid=1982] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1982/stat : 1982 (python) S 1951 1953 1495 0 -1 4202560 25 938 0 0 0 0 0 0 19 0 11 0 526185791 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 6 0 0 0
[pid=1953/tid=1985] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1985/stat : 1985 (python) S 1951 1953 1495 0 -1 4202560 19 938 0 0 0 0 0 0 18 0 11 0 526185795 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 5 0 0 0
[pid=1953/tid=1988] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1988/stat : 1988 (python) S 1951 1953 1495 0 -1 4202560 24 938 0 0 0 0 0 0 19 0 11 0 526185798 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1991] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1991/stat : 1991 (python) S 1951 1953 1495 0 -1 4202560 24 938 0 0 0 0 0 0 18 0 11 0 526185802 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 7 0 0 0
[pid=1953/tid=1994] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1994/stat : 1994 (python) S 1951 1953 1495 0 -1 4202560 23 938 0 0 0 0 0 0 19 0 11 0 526185806 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 4 0 0 0
[pid=1953/tid=1997] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/1997/stat : 1997 (python) S 1951 1953 1495 0 -1 4202560 28 938 0 0 0 0 0 0 20 0 11 0 526185809 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
[pid=1953/tid=2005] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/2005/stat : 2005 (python) S 1951 1953 1495 0 -1 4202560 33 938 0 0 0 0 0 0 19 0 11 0 526195952 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
[pid=1953/tid=2011] ppid=1951 vsize=680044 CPUtime=0 cores=0-7
/proc/1953/task/2011/stat : 2011 (python) S 1951 1953 1495 0 -1 4202560 29 938 0 0 0 0 0 0 20 0 11 0 526205424 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2808.76
Current children cumulated vsize (KiB) 12264856

[startup+574.702 s]
/proc/loadavg: 8.16 6.63 6.66 9/282 2015
/proc/meminfo: memFree=22645928/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=680044 CPUtime=450.01 cores=0-7
/proc/1953/stat : 1953 (python) S 1951 1953 1495 0 -1 4202496 122353 71075 1 0 25423 31 19518 29 17 0 11 0 526160361 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273446719 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/1953/statm: 170011 65563 1894 364 0 105902 0
[pid=1975] ppid=1953 vsize=0 CPUtime=196.71 cores=0-7
/proc/1975/stat : 1975 (python) Z 1953 1953 1495 0 -1 4202588 1149 57769 0 0 19 18 19624 10 17 0 2 0 526185784 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1975/statm: 0 0 0 0 0 0 0
[pid=1975/tid=2009] ppid=1953 vsize=0 CPUtime=196.34 cores=0-7
/proc/1975/task/2009/stat : 2009 (python) R 1953 1953 1495 0 -1 4203588 47 57769 0 0 0 0 19624 10 18 0 2 0 526205419 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 -1 1 0 0 0
[pid=1981] ppid=1953 vsize=532472 CPUtime=0.65 cores=0-7
/proc/1981/stat : 1981 (python) S 1953 1953 1495 0 -1 4202560 1005 0 0 0 32 33 0 0 15 0 1 0 526185791 545251328 63921 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 3408380497284268292 0 0 17 6 0 0 0
/proc/1981/statm: 133118 63921 370 364 0 69030 0
[pid=1983] ppid=1981 vsize=1050052 CPUtime=320.07 cores=0-7
/proc/1983/stat : 1983 (cryptominisat-2) R 1981 1983 1983 0 -1 4202496 277380 0 0 0 31968 39 0 0 25 0 1 0 526185791 1075253248 241920 33554432000 4194304 4677096 140736175586336 18446744073709551615 4317747 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1983/statm: 262513 241920 392 118 0 257472 0
[pid=1984] ppid=1953 vsize=542728 CPUtime=0.68 cores=0-7
/proc/1984/stat : 1984 (python) S 1953 1953 1495 0 -1 4202560 1011 0 0 0 37 31 0 0 15 0 1 0 526185794 555753472 63925 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 11524790615573233921 0 0 17 5 0 0 0
/proc/1984/statm: 135682 63925 370 364 0 71591 0
[pid=1986] ppid=1984 vsize=1052756 CPUtime=319.87 cores=0-7
/proc/1986/stat : 1986 (cryptominisat-2) R 1984 1986 1986 0 -1 4202496 278021 0 0 0 31941 46 0 0 25 0 1 0 526185795 1078022144 242936 33554432000 4194304 4677096 140733546564496 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/1986/statm: 263189 242936 392 118 0 258148 0
[pid=1987] ppid=1953 vsize=0 CPUtime=320.91 cores=0-7
/proc/1987/stat : 1987 (python) Z 1953 1953 1495 0 -1 4202588 1219 69021 0 0 30 32 32019 10 15 0 1 0 526185798 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1987/statm: 0 0 0 0 0 0 0
[pid=1990] ppid=1953 vsize=628776 CPUtime=0.5 cores=0-7
/proc/1990/stat : 1990 (python) S 1953 1953 1495 0 -1 4202560 1174 0 0 0 24 26 0 0 15 0 2 0 526185801 643866624 63965 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/1990/statm: 157194 63965 399 364 0 93097 0
[pid=1992] ppid=1990 vsize=1034596 CPUtime=222.95 cores=0-7
/proc/1992/stat : 1992 (cryptominisat-2) R 1990 1992 1992 0 -1 4202496 268450 0 0 0 22249 46 0 0 25 0 1 0 526185802 1059426304 237603 33554432000 4194304 4677096 140734939579344 18446744073709551615 4320052 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/1992/statm: 258649 237603 392 118 0 253608 0
[pid=1990/tid=2003] ppid=1953 vsize=628776 CPUtime=0 cores=0-7
/proc/1990/task/2003/stat : 2003 (python) S 1953 1953 1495 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 526195948 643866624 63965 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 514 18446604453924301504 0 0 -1 7 0 0 0
[pid=1993] ppid=1953 vsize=639032 CPUtime=0.66 cores=0-7
/proc/1993/stat : 1993 (python) S 1953 1953 1495 0 -1 4202560 1017 0 0 0 33 33 0 0 15 0 1 0 526185805 654368768 63939 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139203 0 0 17 4 0 0 0
/proc/1993/statm: 159758 63939 370 364 0 95658 0
[pid=1995] ppid=1993 vsize=1059028 CPUtime=319.5 cores=0-7
/proc/1995/stat : 1995 (cryptominisat-2) R 1993 1995 1995 0 -1 4202496 279267 0 0 0 31909 41 0 0 25 0 1 0 526185808 1084444672 243750 33554432000 4194304 4677096 140737358986736 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/1995/statm: 264757 243750 392 118 0 259716 0
[pid=1996] ppid=1953 vsize=649288 CPUtime=0.62 cores=0-7
/proc/1996/stat : 1996 (python) S 1953 1953 1495 0 -1 4202560 1059 0 0 0 29 33 0 0 18 0 1 0 526185809 664870912 63949 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139204 0 0 17 1 0 0 0
/proc/1996/statm: 162322 63949 376 364 0 98219 0
[pid=1998] ppid=1996 vsize=402744 CPUtime=318.48 cores=0-7
/proc/1998/stat : 1998 (precosat) R 1996 1998 1998 0 -1 4202496 104430 0 0 0 31834 14 0 0 25 0 1 0 526185810 412409856 97378 33554432000 4194304 4890832 140733546546688 18446744073709551615 4238565 0 0 16781312 17442 0 0 0 17 3 0 0 0
/proc/1998/statm: 100686 97378 86 171 0 100513 0
[pid=2004] ppid=1953 vsize=659544 CPUtime=0.43 cores=0-7
/proc/2004/stat : 2004 (python) S 1953 1953 1495 0 -1 4202560 1020 0 0 0 21 22 0 0 18 0 1 0 526195952 675373056 63947 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139201 0 0 17 7 0 0 0
/proc/2004/statm: 164886 63947 370 364 0 100780 0
[pid=2006] ppid=2004 vsize=148712 CPUtime=216.1 cores=0-7
/proc/2006/stat : 2006 (lingeling) R 2004 2006 2006 0 -1 4202496 68833 0 0 0 21600 10 0 0 25 0 1 0 526195953 152281088 36348 33554432000 4194304 4352236 140735381600352 18446744073709551615 4328122 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/2006/statm: 37178 36348 129 39 0 36258 0
[pid=2010] ppid=1953 vsize=669800 CPUtime=0.24 cores=0-7
/proc/2010/stat : 2010 (python) S 1953 1953 1495 0 -1 4202560 971 0 0 0 12 12 0 0 18 0 1 0 526205423 685875200 64035 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139204 0 0 17 4 0 0 0
/proc/2010/statm: 167450 64035 370 364 0 103341 0
[pid=2012] ppid=2010 vsize=403828 CPUtime=123.58 cores=0-7
/proc/2012/stat : 2012 (precosat) R 2010 2012 2012 0 -1 4202496 104641 0 0 0 12345 13 0 0 25 0 1 0 526205424 413519872 97594 33554432000 4194304 4890832 140735165517344 18446744073709551615 4236618 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/2012/statm: 100957 97594 86 171 0 100784 0
[pid=1953/tid=1976] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1976/stat : 1976 (python) S 1951 1953 1495 0 -1 4202560 27 71075 0 0 0 0 19518 29 25 0 11 0 526185784 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1979] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1979/stat : 1979 (python) S 1951 1953 1495 0 -1 4202560 26 71075 0 0 0 0 19518 29 18 0 11 0 526185788 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 2 0 0 0
[pid=1953/tid=1982] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1982/stat : 1982 (python) S 1951 1953 1495 0 -1 4202560 25 71075 0 0 0 0 19518 29 19 0 11 0 526185791 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 6 0 0 0
[pid=1953/tid=1985] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1985/stat : 1985 (python) S 1951 1953 1495 0 -1 4202560 19 71075 0 0 0 0 19518 29 18 0 11 0 526185795 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 5 0 0 0
[pid=1953/tid=1988] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1988/stat : 1988 (python) S 1951 1953 1495 0 -1 4202560 24 71075 0 0 0 0 19518 29 19 0 11 0 526185798 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1991] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1991/stat : 1991 (python) S 1951 1953 1495 0 -1 4202560 24 71075 0 0 0 0 19518 29 18 0 11 0 526185802 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 7 0 0 0
[pid=1953/tid=1994] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1994/stat : 1994 (python) S 1951 1953 1495 0 -1 4202560 23 71075 0 0 0 0 19518 29 19 0 11 0 526185806 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 4 0 0 0
[pid=1953/tid=1997] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/1997/stat : 1997 (python) S 1951 1953 1495 0 -1 4202560 28 71075 0 0 0 0 19518 29 20 0 11 0 526185809 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
[pid=1953/tid=2005] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/2005/stat : 2005 (python) S 1951 1953 1495 0 -1 4202560 33 71075 0 0 0 0 19518 29 19 0 11 0 526195952 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
[pid=1953/tid=2011] ppid=1951 vsize=680044 CPUtime=195.47 cores=0-7
/proc/1953/task/2011/stat : 2011 (python) S 1951 1953 1495 0 -1 4202560 29 71075 0 0 0 0 19518 29 20 0 11 0 526205424 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2811.96
Current children cumulated vsize (KiB) 10153400

[startup+574.902 s]
/proc/loadavg: 8.16 6.63 6.66 9/282 2015
/proc/meminfo: memFree=22645928/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=680044 CPUtime=1511.27 cores=0-7
/proc/1953/stat : 1953 (python) S 1951 1953 1495 0 -1 4202496 122360 959059 1 0 25423 31 125375 298 16 0 11 0 526160361 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273446719 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1953/statm: 170011 65563 1894 364 0 105902 0
[pid=1981] ppid=1953 vsize=0 CPUtime=320.92 cores=0-7
/proc/1981/stat : 1981 (python) R 1953 1953 1495 0 -1 4202564 1056 277384 0 0 32 33 31983 44 15 0 1 0 526185791 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1981/statm: 0 0 0 0 0 0 0
[pid=1987] ppid=1953 vsize=0 CPUtime=320.91 cores=0-7
/proc/1987/stat : 1987 (python) Z 1953 1953 1495 0 -1 4202588 1219 69021 0 0 30 32 32019 10 15 0 1 0 526185798 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1987/statm: 0 0 0 0 0 0 0
[pid=1996] ppid=1953 vsize=649288 CPUtime=0.62 cores=0-7
/proc/1996/stat : 1996 (python) S 1953 1953 1495 0 -1 4202560 1059 0 0 0 29 33 0 0 18 0 1 0 526185809 664870912 63949 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139204 0 0 17 1 0 0 0
/proc/1996/statm: 162322 63949 376 364 0 98219 0
[pid=1998] ppid=1996 vsize=402744 CPUtime=318.68 cores=0-7
/proc/1998/stat : 1998 (precosat) R 1996 1998 1998 0 -1 4202496 104430 0 0 0 31854 14 0 0 25 0 1 0 526185810 412409856 97378 33554432000 4194304 4890832 140733546546688 18446744073709551615 4236618 0 0 16781312 17442 0 0 0 17 3 0 0 0
/proc/1998/statm: 100686 97378 86 171 0 100513 0
[pid=2004] ppid=1953 vsize=659544 CPUtime=0.43 cores=0-7
/proc/2004/stat : 2004 (python) S 1953 1953 1495 0 -1 4202560 1020 0 0 0 21 22 0 0 18 0 1 0 526195952 675373056 63947 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139201 0 0 17 7 0 0 0
/proc/2004/statm: 164886 63947 370 364 0 100780 0
[pid=2006] ppid=2004 vsize=148712 CPUtime=216.3 cores=0-7
/proc/2006/stat : 2006 (lingeling) R 2004 2006 2006 0 -1 4202496 68833 0 0 0 21620 10 0 0 25 0 1 0 526195953 152281088 36348 33554432000 4194304 4352236 140735381600352 18446744073709551615 4207874 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/2006/statm: 37178 36348 129 39 0 36258 0
[pid=2010] ppid=1953 vsize=669800 CPUtime=0.24 cores=0-7
/proc/2010/stat : 2010 (python) S 1953 1953 1495 0 -1 4202560 971 0 0 0 12 12 0 0 18 0 1 0 526205423 685875200 64035 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261636678 0 0 16781312 514 2903713451933139204 0 0 17 4 0 0 0
/proc/2010/statm: 167450 64035 370 364 0 103341 0
[pid=2012] ppid=2010 vsize=403828 CPUtime=123.78 cores=0-7
/proc/2012/stat : 2012 (precosat) R 2010 2012 2012 0 -1 4202496 104641 0 0 0 12365 13 0 0 25 0 1 0 526205424 413519872 97594 33554432000 4194304 4890832 140735165517344 18446744073709551615 4452645 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/2012/statm: 100957 97594 86 171 0 100784 0
[pid=1953/tid=1976] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1976/stat : 1976 (python) S 1951 1953 1495 0 -1 4202560 27 959059 0 0 0 0 125375 298 25 0 11 0 526185784 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1979] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1979/stat : 1979 (python) S 1951 1953 1495 0 -1 4202560 26 959059 0 0 0 0 125375 298 18 0 11 0 526185788 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 2 0 0 0
[pid=1953/tid=1982] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1982/stat : 1982 (python) S 1951 1953 1495 0 -1 4202560 25 959059 0 0 0 0 125375 298 19 0 11 0 526185791 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 6 0 0 0
[pid=1953/tid=1985] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1985/stat : 1985 (python) S 1951 1953 1495 0 -1 4202560 19 959059 0 0 0 0 125375 298 18 0 11 0 526185795 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 5 0 0 0
[pid=1953/tid=1988] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1988/stat : 1988 (python) S 1951 1953 1495 0 -1 4202560 24 959059 0 0 0 0 125375 298 19 0 11 0 526185798 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1991] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1991/stat : 1991 (python) S 1951 1953 1495 0 -1 4202560 24 959059 0 0 0 0 125375 298 18 0 11 0 526185802 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 7 0 0 0
[pid=1953/tid=1994] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1994/stat : 1994 (python) S 1951 1953 1495 0 -1 4202560 23 959059 0 0 0 0 125375 298 19 0 11 0 526185806 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 4 0 0 0
[pid=1953/tid=1997] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/1997/stat : 1997 (python) S 1951 1953 1495 0 -1 4202560 28 959059 0 0 0 0 125375 298 20 0 11 0 526185809 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
[pid=1953/tid=2005] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/2005/stat : 2005 (python) S 1951 1953 1495 0 -1 4202560 33 959059 0 0 0 0 125375 298 19 0 11 0 526195952 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
[pid=1953/tid=2011] ppid=1951 vsize=680044 CPUtime=1256.73 cores=0-7
/proc/1953/task/2011/stat : 2011 (python) S 1951 1953 1495 0 -1 4202560 29 959059 0 0 0 0 125375 298 20 0 11 0 526205424 696365056 65563 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 2 18446604453956682944 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2813.15
Current children cumulated vsize (KiB) 3613960

[startup+575.002 s]
/proc/loadavg: 8.16 6.63 6.66 9/282 2015
/proc/meminfo: memFree=22645928/32951124 swapFree=67111348/67111528
[pid=1953] ppid=1951 vsize=628692 CPUtime=2813.4 cores=0-7
/proc/1953/stat : 1953 (python) R 1951 1953 1495 0 -1 4202496 144503 1588837 1 0 25425 32 255351 532 16 0 3 0 526160361 643780608 65522 33554432000 4194304 5683644 140734115374016 18446744073709551615 254261271991 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/1953/statm: 157173 65522 1873 364 0 93097 0
[pid=1953/tid=1988] ppid=1951 vsize=628692 CPUtime=2558.83 cores=0-7
/proc/1953/task/1988/stat : 1988 (python) S 1951 1953 1495 0 -1 4202560 25 1588837 0 0 0 0 255351 532 18 0 3 0 526185798 643780608 65522 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 0 18446604453956682944 0 0 -1 0 0 0 0
[pid=1953/tid=1994] ppid=1951 vsize=628692 CPUtime=2558.83 cores=0-7
/proc/1953/task/1994/stat : 1994 (python) S 1951 1953 1495 0 -1 4202560 27 1588837 0 0 0 0 255351 532 17 0 3 0 526185806 643780608 65522 33554432000 4194304 5683644 140734115374016 18446744073709551615 254273440177 0 0 16781312 0 18446604453956682944 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2813.4
Current children cumulated vsize (KiB) 628692

Child status: 0
Real time (s): 575.033
CPU time (s): 2813.47
CPU user time (s): 2807.79
CPU system time (s): 5.67814
CPU usage (%): 489.27
Max. virtual memory (cumulated for all children) (KiB): 12283044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2807.79
system time used= 5.67814
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1741335
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4644
involuntary context switches= 15315

runsolver used 1.9797 second user time and 4.81627 second system time

The end

Launcher Data 

Begin job on node140 at 2011-05-02 13:57:30
IDJOB=3321356
IDBENCH=69591
IDSOLVER=1710
FILE ID=node140/3321356-1304337449
RUNJOBID= node140-1304332543-1509
PBS_JOBID= 13177701
Free space on /tmp= 73560 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT_RACE08/cnf/manol-pipe-c10nidw.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321356-1304337449/watcher-3321356-1304337449 -o /tmp/evaluation-result-3321356-1304337449/solver-3321356-1304337449 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321356-1304337449.cnf -seed 1309344315 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 943fd86d922b13236c21a74c4f82b6d0
RANDOM SEED=1309344315

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28177364 kB
Buffers:        998640 kB
Cached:        1957072 kB
SwapCached:        176 kB
Active:        1570364 kB
Inactive:      2685428 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28177364 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           55472 kB
Writeback:          12 kB
AnonPages:     1299996 kB
Mapped:          21432 kB
Slab:           436880 kB
PageTables:      16144 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 37397752 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73528 MiB
End job on node140 at 2011-05-02 14:07:06