Trace number 3386595

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 3552.61 3542.03

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S69399346-065-UNKNOWN.cnf
MD5SUM98486271f2f72889c040eabfd36ebd13
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.31/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.46	c INFO: solving HOME/instance-3386595-1305589057.cnf
0.31/0.46	c INFO: computing task features
0.50/0.64	c INFO: computed variable-clause graph statistics
0.50/0.64	c INFO: computed clause balance statistics
1.41/1.58	c INFO: computed variable balance statistics
1.81/1.95	c INFO: computed small-clause counts
1.81/1.95	c INFO: computed Horn-clause counts
1.81/1.98	c INFO: computed variable graph statistics
1.81/1.98	c INFO: collected features for HOME/instance-3386595-1305589057.cnf in 1.51 s
1.91/2.01	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.37)
102.49/102.38	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.13)
202.17/201.78	c INFO: running adaptg2wsat2009++@0 for 97 with 4798 remaining (b = 0.08)
300.89/300.13	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.07)
401.50/400.49	c INFO: running adaptg2wsat2009++@0 for 97 with 4600 remaining (b = 0.05)
501.19/499.84	c INFO: running gnovelty+2@0 for 97 with 4500 remaining (b = 0.04)
601.89/600.25	c INFO: running FH@0 for 97 with 4400 remaining (b = 0.03)
702.50/700.60	c INFO: running adaptg2wsat2009++@0 for 97 with 4300 remaining (b = 0.03)
803.24/800.97	c INFO: running adaptg2wsat2009++@0 for 97 with 4199 remaining (b = 0.02)
903.84/901.32	c INFO: running FH@0 for 97 with 4099 remaining (b = 0.02)
1004.33/1001.67	c INFO: running hybridGM3@0 for 194 with 3999 remaining (b = 0.04)
1199.72/1196.41	c INFO: running gnovelty+2@0 for 97 with 3804 remaining (b = 0.02)
1300.30/1296.80	c INFO: running hybridGM3@0 for 194 with 3704 remaining (b = 0.03)
1496.72/1492.54	c INFO: running adaptg2wsat2009++@0 for 97 with 3508 remaining (b = 0.01)
1597.31/1592.89	c INFO: running hybridGM3@0 for 194 with 3408 remaining (b = 0.03)
1792.74/1787.62	c INFO: running hybridGM3@0 for 194 with 3213 remaining (b = 0.02)
1989.87/1984.32	c INFO: running TNM@0 for 1552 with 3016 remaining (b = 0.19)
3552.20/3541.51	c INFO: running FH@0 for 97 with 1459 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386595-1305589057/watcher-3386595-1305589057 -o /tmp/evaluation-result-3386595-1305589057/solver-3386595-1305589057 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386595-1305589057.cnf -seed 679681468 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.03 3.04 3.04 4/456 8454
/proc/meminfo: memFree=23049336/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=15772 CPUtime=0 cores=0,2,4,6
/proc/8454/stat : 8454 (python) R 8452 8454 7922 0 -1 4202496 857 0 0 0 0 0 0 0 25 0 1 0 749136412 16150528 740 33554432000 4194304 5683644 140735397294832 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8454/statm: 3943 740 335 364 0 430 0

[startup+0.074044 s]
/proc/loadavg: 3.03 3.04 3.04 4/456 8454
/proc/meminfo: memFree=23049336/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=84520 CPUtime=0.05 cores=0,2,4,6
/proc/8454/stat : 8454 (python) R 8452 8454 7922 0 -1 4202496 2176 0 0 0 4 1 0 0 25 0 1 0 749136412 86548480 1928 33554432000 4194304 5683644 140735397294832 18446744073709551615 231890527720 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8454/statm: 21130 1940 564 364 0 1334 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84520

[startup+0.10104 s]
/proc/loadavg: 3.03 3.04 3.04 4/456 8454
/proc/meminfo: memFree=23049336/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=104220 CPUtime=0.07 cores=0,2,4,6
/proc/8454/stat : 8454 (python) R 8452 8454 7922 0 -1 4202496 3056 0 0 0 6 1 0 0 17 0 1 0 749136412 106721280 2740 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895488512 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8454/statm: 26055 2740 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.300998 s]
/proc/loadavg: 3.03 3.04 3.04 4/456 8454
/proc/meminfo: memFree=23049336/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=187736 CPUtime=0.24 cores=0,2,4,6
/proc/8454/stat : 8454 (python) R 8452 8454 7922 0 -1 4202496 6808 934 1 0 17 7 0 0 17 0 1 0 749136412 192241664 4863 33554432000 4194304 5683644 140735397294832 18446744073709551615 231890527720 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8454/statm: 46934 4864 1384 364 0 3722 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 187736

[startup+0.700935 s]
/proc/loadavg: 3.03 3.04 3.04 4/456 8454
/proc/meminfo: memFree=23049336/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=285632 CPUtime=0.61 cores=0,2,4,6
/proc/8454/stat : 8454 (python) R 8452 8454 7922 0 -1 4202496 12515 934 1 0 51 10 0 0 17 0 1 0 749136412 292487168 8793 33554432000 4194304 5683644 140735397294832 18446744073709551615 4623607 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8454/statm: 71408 8793 1826 364 0 7332 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 285632

[startup+1.50078 s]
/proc/loadavg: 3.03 3.04 3.04 4/457 8459
/proc/meminfo: memFree=23019320/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=285632 CPUtime=1.41 cores=0,2,4,6
/proc/8454/stat : 8454 (python) R 8452 8454 7922 0 -1 4202496 12515 934 1 0 131 10 0 0 18 0 1 0 749136412 292487168 8793 33554432000 4194304 5683644 140735397294832 18446744073709551615 47162083550923 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/8454/statm: 71408 8793 1826 364 0 7332 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 285632

[startup+3.10048 s]
/proc/loadavg: 3.03 3.04 3.04 4/460 8462
/proc/meminfo: memFree=23020040/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=290516 CPUtime=1.92 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 12846 934 1 0 182 10 0 0 22 0 2 0 749136412 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8454/statm: 72629 7494 1869 364 0 8547 0
[pid=8460] ppid=8454 vsize=280756 CPUtime=0 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 749136614 287494144 5977 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510543 0 0 16781312 514 18426623290094092547 0 0 17 2 0 0 0
/proc/8460/statm: 70189 5977 355 364 0 6107 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=1.08 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) R 8460 8462 8462 0 -1 4202496 949 0 0 0 108 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134525339 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=290516 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 2 0 749136614 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 1590980

[startup+6.30088 s]
/proc/loadavg: 3.02 3.04 3.04 4/460 8462
/proc/meminfo: memFree=23019324/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=290516 CPUtime=1.92 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 12846 934 1 0 182 10 0 0 22 0 2 0 749136412 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8454/statm: 72629 7494 1869 364 0 8547 0
[pid=8460] ppid=8454 vsize=280756 CPUtime=0.01 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 877 0 0 0 0 1 0 0 18 0 1 0 749136614 287494144 6000 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510543 0 0 16781312 514 18426623290094092547 0 0 17 2 0 0 0
/proc/8460/statm: 70189 6000 378 364 0 6107 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=4.28 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) R 8460 8462 8462 0 -1 4202496 949 0 0 0 428 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=290516 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 2 0 749136614 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 1590980

[startup+12.7007 s]
/proc/loadavg: 3.02 3.04 3.04 4/460 8462
/proc/meminfo: memFree=23019168/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=290516 CPUtime=1.92 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 12846 934 1 0 182 10 0 0 22 0 2 0 749136412 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8454/statm: 72629 7494 1869 364 0 8547 0
[pid=8460] ppid=8454 vsize=280756 CPUtime=0.03 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 878 0 0 0 1 2 0 0 18 0 1 0 749136614 287494144 6000 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510543 0 0 16781312 514 14125768929666105603 0 0 17 6 0 0 0
/proc/8460/statm: 70189 6000 378 364 0 6107 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=10.68 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) R 8460 8462 8462 0 -1 4202496 949 0 0 0 1068 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=290516 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 2 0 749136614 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.63
Current children cumulated vsize (KiB) 1590980

[startup+25.5013 s]
/proc/loadavg: 3.02 3.04 3.04 4/460 8462
/proc/meminfo: memFree=23019900/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=290516 CPUtime=1.92 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 12846 934 1 0 182 10 0 0 22 0 2 0 749136412 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8454/statm: 72629 7494 1869 364 0 8547 0
[pid=8460] ppid=8454 vsize=280756 CPUtime=0.06 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 883 0 0 0 3 3 0 0 18 0 1 0 749136614 287494144 6000 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510543 0 0 16781312 514 14125768929666105603 0 0 17 6 0 0 0
/proc/8460/statm: 70189 6000 378 364 0 6107 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=23.48 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) R 8460 8462 8462 0 -1 4202496 949 0 0 0 2348 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=290516 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 2 0 749136614 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 1590980

[startup+51.1004 s]
/proc/loadavg: 3.01 3.03 3.03 4/460 8463
/proc/meminfo: memFree=23018796/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=290516 CPUtime=1.92 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 12846 934 1 0 182 10 0 0 22 0 2 0 749136412 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8454/statm: 72629 7494 1869 364 0 8547 0
[pid=8460] ppid=8454 vsize=280756 CPUtime=0.14 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 892 0 0 0 8 6 0 0 18 0 1 0 749136614 287494144 6000 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510543 0 0 16781312 514 14125768929666105603 0 0 17 6 0 0 0
/proc/8460/statm: 70189 6000 378 364 0 6107 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=49.08 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) R 8460 8462 8462 0 -1 4202496 949 0 0 0 4908 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=290516 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 2 0 749136614 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.14
Current children cumulated vsize (KiB) 1590980

[startup+102.315 s]
/proc/loadavg: 3.00 3.03 3.03 4/460 8467
/proc/meminfo: memFree=23017836/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=290516 CPUtime=1.92 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 12846 934 1 0 182 10 0 0 22 0 2 0 749136412 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8454/statm: 72629 7494 1869 364 0 8547 0
[pid=8460] ppid=8454 vsize=280756 CPUtime=0.28 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 909 0 0 0 15 13 0 0 18 0 1 0 749136614 287494144 6000 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510543 0 0 16781312 514 14125768929666105603 0 0 17 6 0 0 0
/proc/8460/statm: 70189 6000 378 364 0 6107 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=100.29 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) R 8460 8462 8462 0 -1 4202496 949 0 0 0 10029 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=290516 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 2 0 749136614 297488384 7494 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 102.49
Current children cumulated vsize (KiB) 1590980

[startup+162.301 s]
/proc/loadavg: 3.03 3.03 3.03 4/464 8473
/proc/meminfo: memFree=23011292/32950928 swapFree=60044328/67111528
[pid=8454] ppid=8452 vsize=300772 CPUtime=1.95 cores=0,2,4,6
/proc/8454/stat : 8454 (python) S 8452 8454 7922 0 -1 4202496 13696 934 1 0 185 10 0 0 20 0 3 0 749136412 307990528 7509 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/8454/statm: 75193 7509 1880 364 0 11108 0
[pid=8460] ppid=8454 vsize=291000 CPUtime=0.3 cores=0,2,4,6
/proc/8460/stat : 8460 (python) S 8454 8454 7922 0 -1 4202560 1065 0 0 0 16 14 0 0 19 0 2 0 749136614 297984000 6037 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8460/statm: 72750 6037 410 364 0 8668 0
[pid=8462] ppid=8460 vsize=1019708 CPUtime=100.33 cores=0,2,4,6
/proc/8462/stat : 8462 (gnovelty+2) T 8460 8462 8462 0 -1 4202496 949 0 0 0 10033 0 0 0 25 0 1 0 749136614 1044180992 690 33554432000 134512640 135663704 4289007312 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8462/statm: 254927 690 113 282 0 254643 0
[pid=8460/tid=8468] ppid=8454 vsize=291000 CPUtime=0 cores=0,2,4,6
/proc/8460/task/8468/stat : 8468 (python) S 8454 8454 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749146648 297984000 6037 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604452908008512 0 0 -1 4 0 0 0
[pid=8469] ppid=8454 vsize=291088 CPUtime=0.17 cores=0,2,4,6
/proc/8469/stat : 8469 (python) S 8454 8454 7922 0 -1 4202560 908 0 0 0 8 9 0 0 18 0 1 0 749146651 298074112 5998 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510598 0 0 16781312 514 14125768929666105602 0 0 17 6 0 0 0
/proc/8469/statm: 72772 5998 372 364 0 8687 0
[pid=8471] ppid=8469 vsize=1019708 CPUtime=59.91 cores=0,2,4,6
/proc/8471/stat : 8471 (gnovelty+2) R 8469 8471 8471 0 -1 4202496 954 0 0 0 5991 0 0 0 25 0 1 0 749146651 1044180992 690 33554432000 134512640 135663704 4287476096 18446744073709551615 134544186 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8471/statm: 254927 690 113 282 0 254643 0
[pid=8454/tid=8461] ppid=8452 vsize=300772 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 3 0 749136614 307990528 7509 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
[pid=8454/tid=8470] ppid=8452 vsize=300772 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8470/stat : 8470 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 3 0 749146651 307990528 7509 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 162.66

################
# More data... #
################

[pid=8483] ppid=8454 vsize=311788 CPUtime=0.32 cores=0,2,4,6
/proc/8483/stat : 8483 (python) S 8454 8454 7922 0 -1 4202560 1114 0 0 0 17 15 0 0 19 0 2 0 749166426 319270912 6056 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8483/statm: 77947 6056 400 364 0 13856 0
[pid=8485] ppid=8483 vsize=420220 CPUtime=100.31 cores=0,2,4,6
/proc/8485/stat : 8485 (adaptg2wsat2009) T 8483 8485 8485 0 -1 4202496 1666 0 0 0 10031 0 0 0 25 0 1 0 749166426 430305280 1401 33554432000 134512640 135107411 4291649632 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8485/statm: 105055 1401 59 146 0 103931 0
[pid=8483/tid=8488] ppid=8454 vsize=311788 CPUtime=0 cores=0,2,4,6
/proc/8483/task/8488/stat : 8488 (python) S 8454 8454 7922 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 749176458 319270912 6056 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604446266432384 0 0 -1 6 0 0 0
[pid=8489] ppid=8454 vsize=321880 CPUtime=0.32 cores=0,2,4,6
/proc/8489/stat : 8489 (python) S 8454 8454 7922 0 -1 4202560 1115 0 0 0 17 15 0 0 19 0 2 0 749176462 329605120 6105 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8489/statm: 80470 6105 400 364 0 16376 0
[pid=8491] ppid=8489 vsize=420220 CPUtime=99.31 cores=0,2,4,6
/proc/8491/stat : 8491 (adaptg2wsat2009) T 8489 8491 8491 0 -1 4202496 1667 0 0 0 9931 0 0 0 25 0 1 0 749176462 430305280 1400 33554432000 134512640 135107411 4293990272 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8491/statm: 105055 1400 59 146 0 103931 0
[pid=8489/tid=8495] ppid=8454 vsize=321880 CPUtime=0 cores=0,2,4,6
/proc/8489/task/8495/stat : 8495 (python) S 8454 8454 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749186394 329605120 6105 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604449267196160 0 0 -1 4 0 0 0
[pid=8496] ppid=8454 vsize=332744 CPUtime=0.32 cores=0,2,4,6
/proc/8496/stat : 8496 (python) S 8454 8454 7922 0 -1 4202560 1129 0 0 0 19 13 0 0 19 0 2 0 749186397 340729856 6109 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8496/statm: 83186 6109 400 364 0 19089 0
[pid=8498] ppid=8496 vsize=1019708 CPUtime=100.36 cores=0,2,4,6
/proc/8498/stat : 8498 (gnovelty+2) T 8496 8498 8498 0 -1 4202496 954 0 0 0 10036 0 0 0 25 0 1 0 749186398 1044180992 689 33554432000 134512640 135663704 4286573376 18446744073709551615 134525083 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8498/statm: 254927 689 113 282 0 254643 0
[pid=8496/tid=8502] ppid=8454 vsize=332744 CPUtime=0 cores=0,2,4,6
/proc/8496/task/8502/stat : 8502 (python) S 8454 8454 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749196434 340729856 6109 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604446266431488 0 0 -1 6 0 0 0
[pid=8503] ppid=8454 vsize=342516 CPUtime=0.32 cores=0,2,4,6
/proc/8503/stat : 8503 (python) S 8454 8454 7922 0 -1 4202560 1167 0 0 0 17 15 0 0 19 0 2 0 749196438 350736384 6229 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8503/statm: 85629 6229 405 364 0 21529 0
[pid=8505] ppid=8503 vsize=249872 CPUtime=100.31 cores=0,2,4,6
/proc/8505/stat : 8505 (FH) T 8503 8505 8505 0 -1 4202496 1531 0 0 0 10031 0 0 0 25 0 1 0 749196438 255868928 1264 33554432000 134512640 134936988 4288929712 18446744073709551615 134553534 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8505/statm: 62468 1264 41 104 0 61972 0
[pid=8503/tid=8508] ppid=8454 vsize=342516 CPUtime=0 cores=0,2,4,6
/proc/8503/task/8508/stat : 8508 (python) S 8454 8454 7922 0 -1 4202560 98 0 0 0 0 0 0 0 19 0 2 0 749206470 350736384 6229 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604441896240384 0 0 -1 6 0 0 0
[pid=8509] ppid=8454 vsize=352984 CPUtime=0.32 cores=0,2,4,6
/proc/8509/stat : 8509 (python) S 8454 8454 7922 0 -1 4202560 1176 0 0 0 17 15 0 0 19 0 2 0 749206473 361455616 6234 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8509/statm: 88246 6234 406 364 0 24143 0
[pid=8511] ppid=8509 vsize=420220 CPUtime=100.32 cores=0,2,4,6
/proc/8511/stat : 8511 (adaptg2wsat2009) T 8509 8511 8511 0 -1 4202496 1674 0 0 0 10032 0 0 0 25 0 1 0 749206474 430305280 1399 33554432000 134512640 135107411 4290084032 18446744073709551615 134531411 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8511/statm: 105055 1399 59 146 0 103931 0
[pid=8509/tid=8515] ppid=8454 vsize=352984 CPUtime=0 cores=0,2,4,6
/proc/8509/task/8515/stat : 8515 (python) S 8454 8454 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749216506 361455616 6234 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604442906652800 0 0 -1 6 0 0 0
[pid=8516] ppid=8454 vsize=363496 CPUtime=0.32 cores=0,2,4,6
/proc/8516/stat : 8516 (python) S 8454 8454 7922 0 -1 4202560 1132 0 0 0 19 13 0 0 19 0 2 0 749216510 372219904 6232 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8516/statm: 90874 6232 400 364 0 26768 0
[pid=8518] ppid=8516 vsize=420220 CPUtime=100.19 cores=0,2,4,6
/proc/8518/stat : 8518 (adaptg2wsat2009) T 8516 8518 8518 0 -1 4202496 1670 0 0 0 10019 0 0 0 25 0 1 0 749216510 430305280 1400 33554432000 134512640 135107411 4289463680 18446744073709551615 134531709 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8518/statm: 105055 1400 59 146 0 103931 0
[pid=8516/tid=8522] ppid=8454 vsize=363496 CPUtime=0 cores=0,2,4,6
/proc/8516/task/8522/stat : 8522 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749226541 372219904 6232 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604452908010304 0 0 -1 6 0 0 0
[pid=8523] ppid=8454 vsize=373444 CPUtime=0.31 cores=0,2,4,6
/proc/8523/stat : 8523 (python) S 8454 8454 7922 0 -1 4202560 1133 0 0 0 17 14 0 0 19 0 2 0 749226545 382406656 6236 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8523/statm: 93361 6236 400 364 0 29252 0
[pid=8525] ppid=8523 vsize=249868 CPUtime=100.21 cores=0,2,4,6
/proc/8525/stat : 8525 (FH) T 8523 8525 8525 0 -1 4202496 1533 0 0 0 10021 0 0 0 25 0 1 0 749226545 255864832 1263 33554432000 134512640 134936988 4288238368 18446744073709551615 134552400 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8525/statm: 62467 1263 41 104 0 61971 0
[pid=8523/tid=8528] ppid=8454 vsize=373444 CPUtime=0 cores=0,2,4,6
/proc/8523/task/8528/stat : 8528 (python) S 8454 8454 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 749236576 382406656 6236 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604445921304896 0 0 -1 6 0 0 0
[pid=8529] ppid=8454 vsize=383844 CPUtime=0.63 cores=0,2,4,6
/proc/8529/stat : 8529 (python) S 8454 8454 7922 0 -1 4202560 1145 0 0 0 32 31 0 0 19 0 2 0 749236580 393056256 6240 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8529/statm: 95961 6240 400 364 0 31849 0
[pid=8531] ppid=8529 vsize=268420 CPUtime=194.65 cores=0,2,4,6
/proc/8531/stat : 8531 (hybridGM3) T 8529 8531 8531 0 -1 4202496 5395 0 0 0 19465 0 0 0 25 0 1 0 749236580 274862080 5125 33554432000 134512640 135204385 4291726480 18446744073709551615 134538000 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8531/statm: 67105 5125 63 169 0 66935 0
[pid=8529/tid=8538] ppid=8454 vsize=383844 CPUtime=0 cores=0,2,4,6
/proc/8529/task/8538/stat : 8538 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749256051 393056256 6240 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604450464482368 0 0 -1 6 0 0 0
[pid=8539] ppid=8454 vsize=394400 CPUtime=0.3 cores=0,2,4,6
/proc/8539/stat : 8539 (python) S 8454 8454 7922 0 -1 4202560 1127 0 0 0 16 14 0 0 19 0 2 0 749256054 403865600 6244 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8539/statm: 98600 6244 400 364 0 34485 0
[pid=8541] ppid=8539 vsize=1019708 CPUtime=100.34 cores=0,2,4,6
/proc/8541/stat : 8541 (gnovelty+2) T 8539 8541 8541 0 -1 4202496 964 0 0 0 10034 0 0 0 25 0 1 0 749256055 1044180992 690 33554432000 134512640 135663704 4294710368 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8541/statm: 254927 690 113 282 0 254643 0
[pid=8539/tid=8584] ppid=8454 vsize=394400 CPUtime=0 cores=0,2,4,6
/proc/8539/task/8584/stat : 8584 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749266090 403865600 6244 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604442123748608 0 0 -1 6 0 0 0
[pid=8585] ppid=8454 vsize=404280 CPUtime=0.62 cores=0,2,4,6
/proc/8585/stat : 8585 (python) S 8454 8454 7922 0 -1 4202560 1154 0 0 0 35 27 0 0 19 0 2 0 749266093 413982720 6278 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8585/statm: 101070 6278 400 364 0 36952 0
[pid=8587] ppid=8585 vsize=268428 CPUtime=195.7 cores=0,2,4,6
/proc/8587/stat : 8587 (hybridGM3) T 8585 8587 8587 0 -1 4202496 5398 0 0 0 19569 1 0 0 25 0 1 0 749266094 274870272 5127 33554432000 134512640 135204385 4290197280 18446744073709551615 134538480 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8587/statm: 67107 5127 63 169 0 66937 0
[pid=8585/tid=8611] ppid=8454 vsize=404280 CPUtime=0 cores=0,2,4,6
/proc/8585/task/8611/stat : 8611 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749285663 413982720 6278 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604453749196928 0 0 -1 6 0 0 0
[pid=8612] ppid=8454 vsize=414864 CPUtime=0.32 cores=0,2,4,6
/proc/8612/stat : 8612 (python) S 8454 8454 7922 0 -1 4202560 1154 0 0 0 17 15 0 0 19 0 2 0 749285667 424820736 6282 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8612/statm: 103716 6282 400 364 0 39595 0
[pid=8614] ppid=8612 vsize=420220 CPUtime=100.28 cores=0,2,4,6
/proc/8614/stat : 8614 (adaptg2wsat2009) T 8612 8614 8614 0 -1 4202496 1676 0 0 0 10028 0 0 0 25 0 1 0 749285667 430305280 1401 33554432000 134512640 135107411 4294099632 18446744073709551615 134531428 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/8614/statm: 105055 1401 59 146 0 103931 0
[pid=8612/tid=8617] ppid=8454 vsize=414864 CPUtime=0 cores=0,2,4,6
/proc/8612/task/8617/stat : 8617 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749295698 424820736 6282 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604453749195136 0 0 -1 2 0 0 0
[pid=8618] ppid=8454 vsize=425296 CPUtime=0.63 cores=0,2,4,6
/proc/8618/stat : 8618 (python) S 8454 8454 7922 0 -1 4202560 1201 0 0 0 31 32 0 0 19 0 2 0 749295702 435503104 6293 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8618/statm: 106324 6293 407 364 0 42200 0
[pid=8620] ppid=8618 vsize=268420 CPUtime=194.69 cores=0,2,4,6
/proc/8620/stat : 8620 (hybridGM3) T 8618 8620 8620 0 -1 4202496 5400 0 0 0 19469 0 0 0 25 0 1 0 749295702 274862080 5126 33554432000 134512640 135204385 4294702224 18446744073709551615 134537724 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8620/statm: 67105 5126 63 169 0 66935 0
[pid=8618/tid=8626] ppid=8454 vsize=425296 CPUtime=0 cores=0,2,4,6
/proc/8618/task/8626/stat : 8626 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749315172 435503104 6293 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604445921305792 0 0 -1 6 0 0 0
[pid=8627] ppid=8454 vsize=435340 CPUtime=0.62 cores=0,2,4,6
/proc/8627/stat : 8627 (python) S 8454 8454 7922 0 -1 4202560 1205 0 0 0 37 25 0 0 19 0 2 0 749315175 445788160 6329 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/8627/statm: 108835 6329 407 364 0 44708 0
[pid=8629] ppid=8627 vsize=268420 CPUtime=196.46 cores=0,2,4,6
/proc/8629/stat : 8629 (hybridGM3) T 8627 8629 8629 0 -1 4202496 5401 0 0 0 19646 0 0 0 25 0 1 0 749315176 274862080 5125 33554432000 134512640 135204385 4287286848 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/8629/statm: 67105 5125 63 169 0 66935 0
[pid=8627/tid=8637] ppid=8454 vsize=435340 CPUtime=0 cores=0,2,4,6
/proc/8627/task/8637/stat : 8637 (python) S 8454 8454 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749334842 445788160 6329 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604442958803392 0 0 -1 6 0 0 0
[pid=8638] ppid=8454 vsize=445784 CPUtime=5.09 cores=0,2,4,6
/proc/8638/stat : 8638 (python) S 8454 8454 7922 0 -1 4202560 1202 0 0 0 282 227 0 0 19 0 2 0 749334845 456482816 6327 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/8638/statm: 111446 6327 401 364 0 47316 0
[pid=8640] ppid=8638 vsize=458348 CPUtime=1557.21 cores=0,2,4,6
/proc/8640/stat : 8640 (TNM) T 8638 8640 8640 0 -1 4202496 1515 0 0 0 155720 1 0 0 25 0 1 0 749334846 469348352 1240 33554432000 134512640 135008748 4287370512 18446744073709551615 134527809 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/8640/statm: 114587 1240 46 122 0 113487 0
[pid=8638/tid=8690] ppid=8454 vsize=445784 CPUtime=0 cores=0,2,4,6
/proc/8638/task/8690/stat : 8690 (python) S 8454 8454 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749490562 456482816 6327 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 514 18446604447089311872 0 0 -1 6 0 0 0
[pid=8691] ppid=8454 vsize=456192 CPUtime=0 cores=0,2,4,6
/proc/8691/stat : 8691 (python) S 8454 8454 7922 0 -1 4202560 815 0 0 0 0 0 0 0 19 0 1 0 749490564 467140608 6275 33554432000 4194304 5683644 140735397294832 18446744073709551615 231895510598 0 0 16781312 514 16238810929976836095 0 0 17 4 0 0 0
/proc/8691/statm: 114048 6275 346 364 0 49915 0
[pid=8693] ppid=8691 vsize=247956 CPUtime=0.4 cores=0,2,4,6
/proc/8693/stat : 8693 (FH) R 8691 8693 8693 0 -1 4202496 1260 0 0 0 40 0 0 0 21 0 1 0 749490564 253906944 987 33554432000 134512640 134936988 4291113440 18446744073709551615 134523678 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/8693/statm: 61989 987 37 104 0 61493 0
[pid=8454/tid=8461] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8461/stat : 8461 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 22 0 19 0 749136614 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
[pid=8454/tid=8470] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8470/stat : 8470 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 749146651 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8477] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8477/stat : 8477 (python) S 8452 8454 7922 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 19 0 749156591 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8484] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8484/stat : 8484 (python) S 8452 8454 7922 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 19 0 749166426 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8490] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8490/stat : 8490 (python) S 8452 8454 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 749176462 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
[pid=8454/tid=8497] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8497/stat : 8497 (python) S 8452 8454 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749186398 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
[pid=8454/tid=8504] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8504/stat : 8504 (python) S 8452 8454 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 749196438 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8510] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8510/stat : 8510 (python) S 8452 8454 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749206473 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8517] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8517/stat : 8517 (python) S 8452 8454 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749216510 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8524] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8524/stat : 8524 (python) S 8452 8454 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749226545 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8530] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8530/stat : 8530 (python) S 8452 8454 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 749236580 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8540] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8540/stat : 8540 (python) S 8452 8454 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 749256055 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8586] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8586/stat : 8586 (python) S 8452 8454 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749266094 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8613] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8613/stat : 8613 (python) S 8452 8454 7922 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 19 0 749285667 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 6 0 0 0
[pid=8454/tid=8619] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8619/stat : 8619 (python) S 8452 8454 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 749295702 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 2 0 0 0
[pid=8454/tid=8628] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8628/stat : 8628 (python) S 8452 8454 7922 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 19 0 749315175 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8639] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8639/stat : 8639 (python) S 8452 8454 7922 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 19 0 749334845 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
[pid=8454/tid=8692] ppid=8452 vsize=465824 CPUtime=0 cores=0,2,4,6
/proc/8454/task/8692/stat : 8692 (python) S 8452 8454 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749490564 477003776 7844 33554432000 4194304 5683644 140735397294832 18446744073709551615 231907314097 0 0 16781312 2 18446604445921307584 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3552.61
Current children cumulated vsize (KiB) 15988000

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8454 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=394635
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=147977
# CPU time returned by wait4() is 2.54261
# while last known CPU time is 3552.61
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3542.03
CPU time (s): 3552.61
CPU user time (s): 3547.31
CPU system time (s): 5.3
CPU usage (%): 100.299
Max. virtual memory (cumulated for all children) (KiB): 15988000

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.39464
system time used= 0.147977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30045
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1065
involuntary context switches= 46

runsolver used 29.9045 second user time and 60.5688 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-17 01:37:37
IDJOB=3386595
IDBENCH=82660
IDSOLVER=1872
FILE ID=node114/3386595-1305589057
RUNJOBID= node114-1305586148-7940
PBS_JOBID= 13350364
Free space on /tmp= 72912 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S69399346-065-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386595-1305589057/watcher-3386595-1305589057 -o /tmp/evaluation-result-3386595-1305589057/solver-3386595-1305589057 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386595-1305589057.cnf -seed 679681468 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 98486271f2f72889c040eabfd36ebd13
RANDOM SEED=679681468

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23049492 kB
Buffers:         83116 kB
Cached:         572332 kB
SwapCached:      48552 kB
Active:        1434720 kB
Inactive:      8250468 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23049492 kB
SwapTotal:    67111528 kB
SwapFree:     60044328 kB
Dirty:           32656 kB
Writeback:           0 kB
AnonPages:     8987160 kB
Mapped:          29872 kB
Slab:            81476 kB
PageTables:      67484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 91848336 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72868 MiB
End job on node114 at 2011-05-17 02:36:41