Trace number 3317925

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.43 1203.86

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_4_keyfind_1.cnf
MD5SUM07ea67092ce3fd4529e72f69434e3f99
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1808
Number of clauses9968
Sum of the clauses size39152
Maximum clause length5
Minimum clause length1
Number of clauses of size 1144
Number of clauses of size 2320
Number of clauses of size 33904
Number of clauses of size 41344
Number of clauses of size 54256
Number of clauses of size over 50

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.68	c INFO: solving HOME/instance-3317925-1304270227.cnf
0.35/0.68	c INFO: computing task features
0.43/0.72	c INFO: computed variable-clause graph statistics
0.43/0.72	c INFO: computed clause balance statistics
0.63/0.93	c INFO: computed variable balance statistics
0.73/1.07	c INFO: computed small-clause counts
0.73/1.07	c INFO: computed Horn-clause counts
0.73/1.08	c INFO: computed variable graph statistics
0.73/1.08	c INFO: collected features for HOME/instance-3317925-1304270227.cnf in 0.41 s
0.83/1.10	c INFO: running lingeling-276@0 for 97 with 4799 remaining (b = 0.28)
0.83/1.13	c INFO: running cryptominisat-2.9.0@0 for 485 with 4799 remaining (b = 0.35)
0.83/1.15	c INFO: running lingeling-276@0 for 873 with 4799 remaining (b = 0.45)
0.83/1.18	c INFO: running lingeling-276@0 for 1261 with 4799 remaining (b = 0.47)
396.42/100.26	c INFO: running cryptominisat-2.9.0@0 for 485 with 4700 remaining (b = 0.26)
1953.52/490.15	c INFO: running lingeling-276@0 for 1164 with 4310 remaining (b = 0.37)
2356.87/591.19	c INFO: running SApperloT@0 for 97 with 4209 remaining (b = 0.12)
2756.99/691.35	c INFO: running precosat-570@0 for 388 with 4109 remaining (b = 0.25)
3495.74/876.31	c INFO: running lingeling-276@0 for 97 with 3924 remaining (b = 0.07)
3894.55/976.48	c INFO: running cryptominisat-2.9.0@487 for 873 with 3824 remaining (b = 0.29)
4326.74/1084.97	c INFO: running precosat-570@873 for 388 with 3715 remaining (b = 0.17)
4800.43/1203.83	c INFO: running SApperloT@0 for 97 with 3596 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317925-1304270227/watcher-3317925-1304270227 -o /tmp/evaluation-result-3317925-1304270227/solver-3317925-1304270227 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317925-1304270227.cnf -seed 13984815 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 7.36 5.82 5/203 26030
/proc/meminfo: memFree=18801092/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=15380 CPUtime=0 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 792 0 0 0 0 0 0 0 25 0 1 0 538622458 15749120 680 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/26030/statm: 3846 680 322 364 0 333 0

[startup+0.0989899 s]
/proc/loadavg: 8.12 7.36 5.82 5/203 26030
/proc/meminfo: memFree=18801092/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=85620 CPUtime=0.06 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 2629 0 0 0 4 2 0 0 25 0 1 0 538622458 87674880 2348 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/26030/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.100523 s]
/proc/loadavg: 8.12 7.36 5.82 5/203 26030
/proc/meminfo: memFree=18801092/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=87704 CPUtime=0.06 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 2637 0 0 0 4 2 0 0 25 0 1 0 538622458 89808896 2354 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/26030/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300545 s]
/proc/loadavg: 8.12 7.36 5.82 5/203 26030
/proc/meminfo: memFree=18801092/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=135752 CPUtime=0.2 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 5961 935 1 0 13 7 0 0 18 0 1 0 538622458 139010048 4150 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278875653 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/26030/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 135752

[startup+0.707383 s]
/proc/loadavg: 8.12 7.36 5.82 5/203 26030
/proc/meminfo: memFree=18801092/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=280172 CPUtime=0.43 cores=0,2,4,6
/proc/26030/stat : 26030 (python) R 26028 26030 25339 0 -1 4202496 9686 935 1 0 30 13 0 0 17 0 1 0 538622458 286896128 7371 33554432000 4194304 5683644 140736021356048 18446744073709551615 4425442 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/26030/statm: 70043 7371 1761 364 0 5967 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 280172

[startup+1.50024 s]
/proc/loadavg: 7.95 7.34 5.82 6/204 26035
/proc/meminfo: memFree=18776904/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=320928 CPUtime=0.91 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 12712 935 1 0 77 14 0 0 25 0 5 0 538622458 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26030/statm: 80232 7461 1881 364 0 16141 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 320928

[startup+3.10095 s]
/proc/loadavg: 7.95 7.34 5.82 9/216 26047
/proc/meminfo: memFree=18749648/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=320928 CPUtime=0.91 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 12712 935 1 0 77 14 0 0 25 0 5 0 538622458 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26030/statm: 80232 7461 1881 364 0 16141 0
[pid=26036] ppid=26030 vsize=279916 CPUtime=0 cores=0,2,4,6
/proc/26036/stat : 26036 (python) S 26030 26030 25339 0 -1 4202560 813 0 0 0 0 0 0 0 18 0 1 0 538622569 286633984 5923 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899727 0 0 16781312 514 4475999415907123199 0 0 17 6 0 0 0
/proc/26036/statm: 69979 5923 359 364 0 5897 0
[pid=26038] ppid=26036 vsize=6416 CPUtime=1.98 cores=0,2,4,6
/proc/26038/stat : 26038 (lingeling) R 26036 26038 26038 0 -1 4202496 1122 0 0 0 198 0 0 0 25 0 1 0 538622569 6569984 804 33554432000 4194304 4352236 140735668903280 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/26038/statm: 1604 804 128 39 0 684 0
[pid=26039] ppid=26030 vsize=290172 CPUtime=0 cores=0,2,4,6
/proc/26039/stat : 26039 (python) S 26030 26030 25339 0 -1 4202560 745 0 0 0 0 0 0 0 15 0 1 0 538622572 297136128 5916 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18020076391822754052 0 0 17 6 0 0 0
/proc/26039/statm: 72543 5916 348 364 0 8458 0
[pid=26041] ppid=26039 vsize=33728 CPUtime=1.94 cores=0,2,4,6
/proc/26041/stat : 26041 (cryptominisat-2) R 26039 26041 26041 0 -1 4202496 3485 0 0 0 194 0 0 0 25 0 1 0 538622572 34537472 1632 33554432000 4194304 4677096 140735952186816 18446744073709551615 4320188 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26041/statm: 8432 1632 391 118 0 3391 0
[pid=26042] ppid=26030 vsize=300428 CPUtime=0 cores=0,2,4,6
/proc/26042/stat : 26042 (python) S 26030 26030 25339 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 538622574 307638272 5920 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 4392083039207817215 0 0 17 4 0 0 0
/proc/26042/statm: 75107 5920 348 364 0 11019 0
[pid=26044] ppid=26042 vsize=6368 CPUtime=1.93 cores=0,2,4,6
/proc/26044/stat : 26044 (lingeling) R 26042 26044 26044 0 -1 4202496 1116 0 0 0 193 0 0 0 25 0 1 0 538622574 6520832 792 33554432000 4194304 4352236 140737336578928 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/26044/statm: 1592 792 128 39 0 672 0
[pid=26045] ppid=26030 vsize=310684 CPUtime=0 cores=0,2,4,6
/proc/26045/stat : 26045 (python) S 26030 26030 25339 0 -1 4202560 752 0 0 0 0 0 0 0 18 0 1 0 538622576 318140416 5924 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 4231438892831604735 0 0 17 2 0 0 0
/proc/26045/statm: 77671 5924 348 364 0 13580 0
[pid=26047] ppid=26045 vsize=6796 CPUtime=1.91 cores=0,2,4,6
/proc/26047/stat : 26047 (lingeling) R 26045 26047 26047 0 -1 4202496 1316 0 0 0 191 0 0 0 25 0 1 0 538622577 6959104 898 33554432000 4194304 4352236 140734027333696 18446744073709551615 4328771 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/26047/statm: 1699 898 128 39 0 779 0
[pid=26030/tid=26037] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26037/stat : 26037 (python) S 26028 26030 25339 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 5 0 538622569 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 0 0 0 0
[pid=26030/tid=26040] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26040/stat : 26040 (python) S 26028 26030 25339 0 -1 4202560 21 935 0 0 0 0 0 0 22 0 5 0 538622572 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26043] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26043/stat : 26043 (python) S 26028 26030 25339 0 -1 4202560 37 935 0 0 0 0 0 0 24 0 5 0 538622574 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26046] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26046/stat : 26046 (python) S 26028 26030 25339 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 5 0 538622576 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 8.67
Current children cumulated vsize (KiB) 1555436

[startup+6.30138 s]
/proc/loadavg: 7.95 7.35 5.83 9/216 26047
/proc/meminfo: memFree=18740720/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=320928 CPUtime=0.91 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 12712 935 1 0 77 14 0 0 25 0 5 0 538622458 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26030/statm: 80232 7461 1881 364 0 16141 0
[pid=26036] ppid=26030 vsize=279916 CPUtime=0 cores=0,2,4,6
/proc/26036/stat : 26036 (python) S 26030 26030 25339 0 -1 4202560 985 0 0 0 0 0 0 0 18 0 1 0 538622569 286633984 5945 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899727 0 0 16781312 514 4475999415907090689 0 0 17 6 0 0 0
/proc/26036/statm: 69979 5945 381 364 0 5897 0
[pid=26038] ppid=26036 vsize=6964 CPUtime=5.18 cores=0,2,4,6
/proc/26038/stat : 26038 (lingeling) R 26036 26038 26038 0 -1 4202496 1251 0 0 0 518 0 0 0 25 0 1 0 538622569 7131136 933 33554432000 4194304 4352236 140735668903280 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/26038/statm: 1741 933 128 39 0 821 0
[pid=26039] ppid=26030 vsize=290172 CPUtime=0 cores=0,2,4,6
/proc/26039/stat : 26039 (python) S 26030 26030 25339 0 -1 4202560 905 0 0 0 0 0 0 0 15 0 1 0 538622572 297136128 5939 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18020076391822754052 0 0 17 6 0 0 0
/proc/26039/statm: 72543 5939 371 364 0 8458 0
[pid=26041] ppid=26039 vsize=36576 CPUtime=5.1 cores=0,2,4,6
/proc/26041/stat : 26041 (cryptominisat-2) R 26039 26041 26041 0 -1 4202496 6365 0 0 0 509 1 0 0 25 0 1 0 538622572 37453824 2680 33554432000 4194304 4677096 140735952186816 18446744073709551615 4318983 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26041/statm: 9144 2680 393 118 0 4103 0
[pid=26042] ppid=26030 vsize=300428 CPUtime=0 cores=0,2,4,6
/proc/26042/stat : 26042 (python) S 26030 26030 25339 0 -1 4202560 907 0 0 0 0 0 0 0 18 0 1 0 538622574 307638272 5943 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 4392083039207784706 0 0 17 4 0 0 0
/proc/26042/statm: 75107 5943 371 364 0 11019 0
[pid=26044] ppid=26042 vsize=8068 CPUtime=5.12 cores=0,2,4,6
/proc/26044/stat : 26044 (lingeling) R 26042 26044 26044 0 -1 4202496 1573 0 0 0 512 0 0 0 25 0 1 0 538622574 8261632 1185 33554432000 4194304 4352236 140737336578928 18446744073709551615 4328116 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/26044/statm: 2017 1185 128 39 0 1097 0
[pid=26045] ppid=26030 vsize=310684 CPUtime=0 cores=0,2,4,6
/proc/26045/stat : 26045 (python) S 26030 26030 25339 0 -1 4202560 934 0 0 0 0 0 0 0 18 0 1 0 538622576 318140416 5947 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 4231438892831572226 0 0 17 2 0 0 0
/proc/26045/statm: 77671 5947 371 364 0 13580 0
[pid=26047] ppid=26045 vsize=6928 CPUtime=5.1 cores=0,2,4,6
/proc/26047/stat : 26047 (lingeling) R 26045 26047 26047 0 -1 4202496 1669 0 0 0 510 0 0 0 25 0 1 0 538622577 7094272 931 33554432000 4194304 4352236 140734027333696 18446744073709551615 4329024 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/26047/statm: 1732 931 128 39 0 812 0
[pid=26030/tid=26037] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26037/stat : 26037 (python) S 26028 26030 25339 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 5 0 538622569 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 0 0 0 0
[pid=26030/tid=26040] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26040/stat : 26040 (python) S 26028 26030 25339 0 -1 4202560 21 935 0 0 0 0 0 0 22 0 5 0 538622572 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26043] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26043/stat : 26043 (python) S 26028 26030 25339 0 -1 4202560 37 935 0 0 0 0 0 0 24 0 5 0 538622574 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26046] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26046/stat : 26046 (python) S 26028 26030 25339 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 5 0 538622576 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 21.41
Current children cumulated vsize (KiB) 1560664

[startup+12.7012 s]
/proc/loadavg: 7.96 7.36 5.84 9/216 26047
/proc/meminfo: memFree=18722520/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=320928 CPUtime=0.91 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 12712 935 1 0 77 14 0 0 25 0 5 0 538622458 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26030/statm: 80232 7461 1881 364 0 16141 0
[pid=26036] ppid=26030 vsize=279916 CPUtime=0.01 cores=0,2,4,6
/proc/26036/stat : 26036 (python) S 26030 26030 25339 0 -1 4202560 989 0 0 0 0 1 0 0 18 0 1 0 538622569 286633984 5946 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899727 0 0 16781312 514 10397615270947422465 0 0 17 6 0 0 0
/proc/26036/statm: 69979 5946 382 364 0 5897 0
[pid=26038] ppid=26036 vsize=7860 CPUtime=11.58 cores=0,2,4,6
/proc/26038/stat : 26038 (lingeling) R 26036 26038 26038 0 -1 4202496 1515 0 0 0 1158 0 0 0 25 0 1 0 538622569 8048640 1165 33554432000 4194304 4352236 140735668903280 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/26038/statm: 1965 1165 128 39 0 1045 0
[pid=26039] ppid=26030 vsize=290172 CPUtime=0.01 cores=0,2,4,6
/proc/26039/stat : 26039 (python) S 26030 26030 25339 0 -1 4202560 909 0 0 0 0 1 0 0 15 0 1 0 538622572 297136128 5939 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 5601798021651071236 0 0 17 6 0 0 0
/proc/26039/statm: 72543 5939 371 364 0 8458 0
[pid=26041] ppid=26039 vsize=55304 CPUtime=11.44 cores=0,2,4,6
/proc/26041/stat : 26041 (cryptominisat-2) R 26039 26041 26041 0 -1 4202496 10303 0 0 0 1141 3 0 0 25 0 1 0 538622572 56631296 5399 33554432000 4194304 4677096 140735952186816 18446744073709551615 4358708 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26041/statm: 13826 5399 393 118 0 8785 0
[pid=26042] ppid=26030 vsize=300428 CPUtime=0 cores=0,2,4,6
/proc/26042/stat : 26042 (python) S 26030 26030 25339 0 -1 4202560 910 0 0 0 0 0 0 0 18 0 1 0 538622574 307638272 5943 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 10397615270947422466 0 0 17 4 0 0 0
/proc/26042/statm: 75107 5943 371 364 0 11019 0
[pid=26044] ppid=26042 vsize=7044 CPUtime=11.51 cores=0,2,4,6
/proc/26044/stat : 26044 (lingeling) R 26042 26044 26044 0 -1 4202496 1605 0 0 0 1151 0 0 0 25 0 1 0 538622574 7213056 929 33554432000 4194304 4352236 140737336578928 18446744073709551615 4328114 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/26044/statm: 1761 929 128 39 0 841 0
[pid=26045] ppid=26030 vsize=310684 CPUtime=0.01 cores=0,2,4,6
/proc/26045/stat : 26045 (python) S 26030 26030 25339 0 -1 4202560 936 0 0 0 1 0 0 0 18 0 1 0 538622576 318140416 5947 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 10397615270947422466 0 0 17 2 0 0 0
/proc/26045/statm: 77671 5947 371 364 0 13580 0
[pid=26047] ppid=26045 vsize=8112 CPUtime=11.49 cores=0,2,4,6
/proc/26047/stat : 26047 (lingeling) R 26045 26047 26047 0 -1 4202496 2253 0 0 0 1149 0 0 0 25 0 1 0 538622577 8306688 1195 33554432000 4194304 4352236 140734027333696 18446744073709551615 4328146 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/26047/statm: 2028 1195 128 39 0 1108 0
[pid=26030/tid=26037] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26037/stat : 26037 (python) S 26028 26030 25339 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 5 0 538622569 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 0 0 0 0
[pid=26030/tid=26040] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26040/stat : 26040 (python) S 26028 26030 25339 0 -1 4202560 21 935 0 0 0 0 0 0 22 0 5 0 538622572 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26043] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26043/stat : 26043 (python) S 26028 26030 25339 0 -1 4202560 37 935 0 0 0 0 0 0 24 0 5 0 538622574 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26046] ppid=26028 vsize=320928 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26046/stat : 26046 (python) S 26028 26030 25339 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 5 0 538622576 328630272 7461 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 46.96
Current children cumulated vsize (KiB) 1580448

[startup+25.501 s]
/proc/loadavg: 8.04 7.40 5.87 9/216 26047
/proc/meminfo: memFree=18716204/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=320928 CPUtime=0.91 cores=0,2,4,6

################
# More data... #
################

/proc/26044/stat : 26044 (lingeling) T 26042 26044 26044 0 -1 4202496 26823 0 0 0 87353 4 0 0 25 0 1 0 538622574 19800064 4035 33554432000 4194304 4352236 140737336578928 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/26044/statm: 4834 4035 129 39 0 3914 0
[pid=26042/tid=26153] ppid=26030 vsize=300428 CPUtime=0 cores=0,2,4,6
/proc/26042/task/26153/stat : 26153 (python) S 26030 26030 25339 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538710087 307638272 5973 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453935304768 0 0 -1 4 0 0 0
[pid=26045] ppid=26030 vsize=310684 CPUtime=1.65 cores=0,2,4,6
/proc/26045/stat : 26045 (python) S 26030 26030 25339 0 -1 4202560 995 0 0 0 89 76 0 0 18 0 1 0 538622576 318140416 5947 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 10397615270947422466 0 0 17 4 0 0 0
/proc/26045/statm: 77671 5947 371 364 0 13580 0
[pid=26047] ppid=26045 vsize=22220 CPUtime=1170.12 cores=0,2,4,6
/proc/26047/stat : 26047 (lingeling) R 26045 26047 26047 0 -1 4202496 32821 0 0 0 117006 6 0 0 25 0 1 0 538622577 22753280 4747 33554432000 4194304 4352236 140734027333696 18446744073709551615 4280925 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/26047/statm: 5555 4747 129 39 0 4635 0
[pid=26055] ppid=26030 vsize=320940 CPUtime=1.05 cores=0,2,4,6
/proc/26055/stat : 26055 (python) S 26030 26030 25339 0 -1 4202560 1175 0 0 0 58 47 0 0 15 0 2 0 538632484 328642560 5981 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26055/statm: 80235 5981 400 364 0 16141 0
[pid=26057] ppid=26055 vsize=271224 CPUtime=694.85 cores=0,2,4,6
/proc/26057/stat : 26057 (cryptominisat-2) R 26055 26057 26057 0 -1 4202496 217507 0 0 0 69433 52 0 0 25 0 1 0 538632485 277733376 47268 33554432000 4194304 4677096 140736781031296 18446744073709551615 4454526 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/26057/statm: 67806 47268 393 118 0 62765 0
[pid=26055/tid=26082] ppid=26030 vsize=320940 CPUtime=0 cores=0,2,4,6
/proc/26055/task/26082/stat : 26082 (python) S 26030 26030 25339 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 538681575 328642560 5981 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453954845760 0 0 -1 2 0 0 0
[pid=26083] ppid=26030 vsize=331556 CPUtime=0.14 cores=0,2,4,6
/proc/26083/stat : 26083 (python) S 26030 26030 25339 0 -1 4202560 1139 0 0 0 8 6 0 0 19 0 2 0 538681578 339513344 6043 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/26083/statm: 82889 6043 400 364 0 18792 0
[pid=26085] ppid=26083 vsize=11700 CPUtime=99.2 cores=0,2,4,6
/proc/26085/stat : 26085 (SApperloT-base) T 26083 26085 26085 0 -1 4202496 2829 0 0 0 9918 2 0 0 25 0 1 0 538681578 11980800 2565 33554432000 134512640 135674940 4290036832 18446744073709551615 134564628 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26085/statm: 2925 2565 100 284 0 2639 0
[pid=26083/tid=26128] ppid=26030 vsize=331556 CPUtime=0 cores=0,2,4,6
/proc/26083/task/26128/stat : 26128 (python) S 26030 26030 25339 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538691591 339513344 6043 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453897748672 0 0 -1 6 0 0 0
[pid=26129] ppid=26030 vsize=341812 CPUtime=0.73 cores=0,2,4,6
/proc/26129/stat : 26129 (python) S 26030 26030 25339 0 -1 4202560 1174 0 0 0 37 36 0 0 18 0 2 0 538691594 350015488 6047 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26129/statm: 85453 6047 400 364 0 21353 0
[pid=26131] ppid=26129 vsize=38588 CPUtime=490.03 cores=0,2,4,6
/proc/26131/stat : 26131 (precosat) R 26129 26131 26131 0 -1 4202496 10118 0 0 0 49000 3 0 0 25 0 1 0 538691594 39514112 9500 33554432000 4194304 4890832 140736195187856 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/26131/statm: 9647 9500 86 171 0 9474 0
[pid=26129/tid=26164] ppid=26030 vsize=341812 CPUtime=0 cores=0,2,4,6
/proc/26129/task/26164/stat : 26164 (python) S 26030 26030 25339 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538730953 350015488 6047 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604449353990592 0 0 -1 4 0 0 0
[pid=26154] ppid=26030 vsize=352068 CPUtime=0.14 cores=0,2,4,6
/proc/26154/stat : 26154 (python) S 26030 26030 25339 0 -1 4202560 1185 0 0 0 7 7 0 0 19 0 2 0 538710090 360517632 6068 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26154/statm: 88017 6068 406 364 0 23914 0
[pid=26156] ppid=26154 vsize=9840 CPUtime=99.83 cores=0,2,4,6
/proc/26156/stat : 26156 (lingeling) T 26154 26156 26156 0 -1 4202496 5213 0 0 0 9982 1 0 0 25 0 1 0 538710090 10076160 1650 33554432000 4194304 4352236 140737253933504 18446744073709551615 4328166 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/26156/statm: 2460 1650 128 39 0 1540 0
[pid=26154/tid=26160] ppid=26030 vsize=352068 CPUtime=0 cores=0,2,4,6
/proc/26154/task/26160/stat : 26160 (python) S 26030 26030 25339 0 -1 4202560 54 0 0 0 0 0 0 0 19 0 2 0 538720104 360517632 6068 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453960973056 0 0 -1 0 0 0 0
[pid=26030/tid=26037] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26037/stat : 26037 (python) S 26028 26030 25339 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 9 0 538622569 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 0 0 0 0
[pid=26030/tid=26040] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26040/stat : 26040 (python) S 26028 26030 25339 0 -1 4202560 21 935 0 0 0 0 0 0 22 0 9 0 538622572 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26043] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26043/stat : 26043 (python) S 26028 26030 25339 0 -1 4202560 37 935 0 0 0 0 0 0 24 0 9 0 538622574 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26046] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26046/stat : 26046 (python) S 26028 26030 25339 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 9 0 538622576 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26056] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26056/stat : 26056 (python) S 26028 26030 25339 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 9 0 538632484 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26084] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26084/stat : 26084 (python) S 26028 26030 25339 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 9 0 538681578 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26130] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26130/stat : 26130 (python) S 26028 26030 25339 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 9 0 538691594 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26155] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26155/stat : 26155 (python) S 26028 26030 25339 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 9 0 538710090 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4714.76
Current children cumulated vsize (KiB) 3473580



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.8 s]
/proc/loadavg: 8.19 8.11 7.46 10/243 26171
/proc/meminfo: memFree=17368256/32950904 swapFree=67082284/67111528
[pid=26030] ppid=26028 vsize=362312 CPUtime=1.07 cores=0,2,4,6
/proc/26030/stat : 26030 (python) S 26028 26030 25339 0 -1 4202496 16600 935 1 0 92 15 0 0 18 0 9 0 538622458 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26030/statm: 90578 7555 1890 364 0 26475 0
[pid=26036] ppid=26030 vsize=290160 CPUtime=1.15 cores=0,2,4,6
/proc/26036/stat : 26036 (python) S 26030 26030 25339 0 -1 4202560 1218 0 0 0 60 55 0 0 18 0 2 0 538622569 297123840 5985 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/26036/statm: 72540 5985 416 364 0 8458 0
[pid=26038] ppid=26036 vsize=21208 CPUtime=812.77 cores=0,2,4,6
/proc/26038/stat : 26038 (lingeling) R 26036 26038 26038 0 -1 4202496 23380 0 0 0 81273 4 0 0 25 0 1 0 538622569 21716992 4502 33554432000 4194304 4352236 140735668903280 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/26038/statm: 5302 4502 128 39 0 4382 0
[pid=26036/tid=26054] ppid=26030 vsize=290160 CPUtime=0 cores=0,2,4,6
/proc/26036/task/26054/stat : 26054 (python) S 26030 26030 25339 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538632482 297123840 5985 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453954843072 0 0 -1 6 0 0 0
[pid=26039] ppid=26030 vsize=290172 CPUtime=0.71 cores=0,2,4,6
/proc/26039/stat : 26039 (python) S 26030 26030 25339 0 -1 4202560 1133 0 0 0 39 32 0 0 17 0 2 0 538622572 297136128 5969 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/26039/statm: 72543 5969 400 364 0 8458 0
[pid=26041] ppid=26039 vsize=180868 CPUtime=488.06 cores=0,2,4,6
/proc/26041/stat : 26041 (cryptominisat-2) T 26039 26041 26041 0 -1 4202496 198181 0 0 0 48757 49 0 0 25 0 1 0 538622572 185208832 36822 33554432000 4194304 4677096 140735952186816 18446744073709551615 4320776 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/26041/statm: 45217 36822 393 118 0 40176 0
[pid=26039/tid=26078] ppid=26030 vsize=290172 CPUtime=0 cores=0,2,4,6
/proc/26039/task/26078/stat : 26078 (python) S 26030 26030 25339 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 538671471 297136128 5969 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453902960704 0 0 -1 6 0 0 0
[pid=26042] ppid=26030 vsize=300428 CPUtime=1.23 cores=0,2,4,6
/proc/26042/stat : 26042 (python) S 26030 26030 25339 0 -1 4202560 1130 0 0 0 64 59 0 0 19 0 2 0 538622574 307638272 5973 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/26042/statm: 75107 5973 400 364 0 11019 0
[pid=26044] ppid=26042 vsize=19336 CPUtime=873.57 cores=0,2,4,6
/proc/26044/stat : 26044 (lingeling) T 26042 26044 26044 0 -1 4202496 26823 0 0 0 87353 4 0 0 25 0 1 0 538622574 19800064 4035 33554432000 4194304 4352236 140737336578928 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/26044/statm: 4834 4035 129 39 0 3914 0
[pid=26042/tid=26153] ppid=26030 vsize=300428 CPUtime=0 cores=0,2,4,6
/proc/26042/task/26153/stat : 26153 (python) S 26030 26030 25339 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538710087 307638272 5973 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453935304768 0 0 -1 4 0 0 0
[pid=26045] ppid=26030 vsize=310684 CPUtime=1.68 cores=0,2,4,6
/proc/26045/stat : 26045 (python) S 26030 26030 25339 0 -1 4202560 995 0 0 0 90 78 0 0 18 0 1 0 538622576 318140416 5947 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 10397615270947422466 0 0 17 4 0 0 0
/proc/26045/statm: 77671 5947 371 364 0 13580 0
[pid=26047] ppid=26045 vsize=25036 CPUtime=1191.23 cores=0,2,4,6
/proc/26047/stat : 26047 (lingeling) R 26045 26047 26047 0 -1 4202496 33525 0 0 0 119117 6 0 0 25 0 1 0 538622577 25636864 5451 33554432000 4194304 4352236 140734027333696 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/26047/statm: 6259 5451 129 39 0 5339 0
[pid=26055] ppid=26030 vsize=320940 CPUtime=1.09 cores=0,2,4,6
/proc/26055/stat : 26055 (python) S 26030 26030 25339 0 -1 4202560 1175 0 0 0 60 49 0 0 15 0 2 0 538632484 328642560 5981 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26055/statm: 80235 5981 400 364 0 16141 0
[pid=26057] ppid=26055 vsize=271224 CPUtime=716.32 cores=0,2,4,6
/proc/26057/stat : 26057 (cryptominisat-2) R 26055 26057 26057 0 -1 4202496 219160 0 0 0 71579 53 0 0 25 0 1 0 538632485 277733376 48921 33554432000 4194304 4677096 140736781031296 18446744073709551615 4320065 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/26057/statm: 67806 48921 393 118 0 62765 0
[pid=26055/tid=26082] ppid=26030 vsize=320940 CPUtime=0 cores=0,2,4,6
/proc/26055/task/26082/stat : 26082 (python) S 26030 26030 25339 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 538681575 328642560 5981 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453954845760 0 0 -1 2 0 0 0
[pid=26083] ppid=26030 vsize=331556 CPUtime=0.14 cores=0,2,4,6
/proc/26083/stat : 26083 (python) S 26030 26030 25339 0 -1 4202560 1139 0 0 0 8 6 0 0 19 0 2 0 538681578 339513344 6043 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/26083/statm: 82889 6043 400 364 0 18792 0
[pid=26085] ppid=26083 vsize=11700 CPUtime=99.2 cores=0,2,4,6
/proc/26085/stat : 26085 (SApperloT-base) T 26083 26085 26085 0 -1 4202496 2829 0 0 0 9918 2 0 0 25 0 1 0 538681578 11980800 2565 33554432000 134512640 135674940 4290036832 18446744073709551615 134564628 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26085/statm: 2925 2565 100 284 0 2639 0
[pid=26083/tid=26128] ppid=26030 vsize=331556 CPUtime=0 cores=0,2,4,6
/proc/26083/task/26128/stat : 26128 (python) S 26030 26030 25339 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538691591 339513344 6043 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453897748672 0 0 -1 6 0 0 0
[pid=26129] ppid=26030 vsize=341812 CPUtime=0.76 cores=0,2,4,6
/proc/26129/stat : 26129 (python) S 26030 26030 25339 0 -1 4202560 1174 0 0 0 38 38 0 0 18 0 2 0 538691594 350015488 6047 33554432000 4194304 5683644 140736021356048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26129/statm: 85453 6047 400 364 0 21353 0
[pid=26131] ppid=26129 vsize=41328 CPUtime=511.48 cores=0,2,4,6
/proc/26131/stat : 26131 (precosat) R 26129 26131 26131 0 -1 4202496 10779 0 0 0 51145 3 0 0 25 0 1 0 538691594 42319872 10154 33554432000 4194304 4890832 140736195187856 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/26131/statm: 10332 10154 86 171 0 10159 0
[pid=26129/tid=26164] ppid=26030 vsize=341812 CPUtime=0 cores=0,2,4,6
/proc/26129/task/26164/stat : 26164 (python) S 26030 26030 25339 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538730953 350015488 6047 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604449353990592 0 0 -1 4 0 0 0
[pid=26154] ppid=26030 vsize=352068 CPUtime=0.14 cores=0,2,4,6
/proc/26154/stat : 26154 (python) S 26030 26030 25339 0 -1 4202560 1185 0 0 0 7 7 0 0 19 0 2 0 538710090 360517632 6068 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26154/statm: 88017 6068 406 364 0 23914 0
[pid=26156] ppid=26154 vsize=9840 CPUtime=99.83 cores=0,2,4,6
/proc/26156/stat : 26156 (lingeling) T 26154 26156 26156 0 -1 4202496 5213 0 0 0 9982 1 0 0 25 0 1 0 538710090 10076160 1650 33554432000 4194304 4352236 140737253933504 18446744073709551615 4328166 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/26156/statm: 2460 1650 128 39 0 1540 0
[pid=26154/tid=26160] ppid=26030 vsize=352068 CPUtime=0 cores=0,2,4,6
/proc/26154/task/26160/stat : 26160 (python) S 26030 26030 25339 0 -1 4202560 54 0 0 0 0 0 0 0 19 0 2 0 538720104 360517632 6068 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 514 18446604453960973056 0 0 -1 0 0 0 0
[pid=26030/tid=26037] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26037/stat : 26037 (python) S 26028 26030 25339 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 9 0 538622569 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 0 0 0 0
[pid=26030/tid=26040] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26040/stat : 26040 (python) S 26028 26030 25339 0 -1 4202560 21 935 0 0 0 0 0 0 22 0 9 0 538622572 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26043] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26043/stat : 26043 (python) S 26028 26030 25339 0 -1 4202560 37 935 0 0 0 0 0 0 24 0 9 0 538622574 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26046] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26046/stat : 26046 (python) S 26028 26030 25339 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 9 0 538622576 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26056] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26056/stat : 26056 (python) S 26028 26030 25339 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 9 0 538632484 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26084] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26084/stat : 26084 (python) S 26028 26030 25339 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 9 0 538681578 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26130] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26130/stat : 26130 (python) S 26028 26030 25339 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 9 0 538691594 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
[pid=26030/tid=26155] ppid=26028 vsize=362312 CPUtime=0 cores=0,2,4,6
/proc/26030/task/26155/stat : 26155 (python) S 26028 26030 25339 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 9 0 538710090 371007488 7555 33554432000 4194304 5683644 140736021356048 18446744073709551615 237290703281 0 0 16781312 2 18446604453922484352 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.43
Current children cumulated vsize (KiB) 3480672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26030 and gives
#  childrusage.ru_utime.tv_sec=2007
#  childrusage.ru_utime.tv_usec=447821
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=531615
# CPU time returned by wait4() is 2009.98
# while last known CPU time is 4800.43
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1203.86
CPU time (s): 4800.43
CPU user time (s): 4795.82
CPU system time (s): 4.61
CPU usage (%): 398.754
Max. virtual memory (cumulated for all children) (KiB): 3480672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2007.45
system time used= 2.53161
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 79947
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7048
involuntary context switches= 25755

runsolver used 3.19751 second user time and 7.71683 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-01 19:17:07
IDJOB=3317925
IDBENCH=83416
IDSOLVER=1706
FILE ID=node121/3317925-1304270227
RUNJOBID= node121-1304267283-25357
PBS_JOBID= 13173958
Free space on /tmp= 73572 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_4_keyfind_1.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317925-1304270227/watcher-3317925-1304270227 -o /tmp/evaluation-result-3317925-1304270227/solver-3317925-1304270227 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317925-1304270227.cnf -seed 13984815 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 07ea67092ce3fd4529e72f69434e3f99
RANDOM SEED=13984815

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      18801380 kB
Buffers:       2193732 kB
Cached:        9524836 kB
SwapCached:       2776 kB
Active:       10575392 kB
Inactive:      3049848 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      18801380 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           31868 kB
Writeback:          32 kB
AnonPages:     1904752 kB
Mapped:          22132 kB
Slab:           452376 kB
PageTables:      13132 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:  2935272 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73540 MiB
End job on node121 at 2011-05-01 19:37:13