Trace number 3386560

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 3548.33 3537.63

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S680524168-083-UNKNOWN.cnf
MD5SUMebf03c9c6463f3682b7e09274cee8655
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.32/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.46	c INFO: solving HOME/instance-3386560-1305586767.cnf
0.32/0.46	c INFO: computing task features
0.50/0.64	c INFO: computed variable-clause graph statistics
0.50/0.65	c INFO: computed clause balance statistics
1.41/1.55	c INFO: computed variable balance statistics
1.71/1.90	c INFO: computed small-clause counts
1.81/1.90	c INFO: computed Horn-clause counts
1.81/1.93	c INFO: computed variable graph statistics
1.81/1.93	c INFO: collected features for HOME/instance-3386560-1305586767.cnf in 1.46 s
1.81/1.96	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.37)
102.36/102.31	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.13)
203.00/202.67	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.08)
303.59/302.99	c INFO: running adaptg2wsat2009++@0 for 97 with 4697 remaining (b = 0.07)
403.30/402.33	c INFO: running adaptg2wsat2009++@0 for 97 with 4598 remaining (b = 0.05)
503.87/502.66	c INFO: running gnovelty+2@0 for 97 with 4497 remaining (b = 0.04)
603.56/602.05	c INFO: running FH@0 for 97 with 4398 remaining (b = 0.03)
704.15/702.39	c INFO: running adaptg2wsat2009++@0 for 97 with 4298 remaining (b = 0.03)
803.85/801.74	c INFO: running adaptg2wsat2009++@0 for 97 with 4198 remaining (b = 0.02)
904.45/902.09	c INFO: running FH@0 for 97 with 4098 remaining (b = 0.02)
1004.17/1001.45	c INFO: running hybridGM3@0 for 194 with 3999 remaining (b = 0.04)
1199.45/1196.19	c INFO: running gnovelty+2@0 for 97 with 3804 remaining (b = 0.02)
1300.06/1296.58	c INFO: running hybridGM3@0 for 194 with 3704 remaining (b = 0.03)
1496.49/1492.31	c INFO: running adaptg2wsat2009++@0 for 97 with 3508 remaining (b = 0.01)
1597.09/1592.69	c INFO: running hybridGM3@0 for 194 with 3408 remaining (b = 0.03)
1793.48/1788.41	c INFO: running hybridGM3@0 for 194 with 3212 remaining (b = 0.02)
1988.81/1983.14	c INFO: running TNM@0 for 1552 with 3017 remaining (b = 0.19)
3547.99/3537.23	c INFO: running FH@0 for 97 with 1463 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386560-1305586767/watcher-3386560-1305586767 -o /tmp/evaluation-result-3386560-1305586767/solver-3386560-1305586767 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386560-1305586767.cnf -seed 647316550 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.93 2.81 3.28 4/405 8184
/proc/meminfo: memFree=23141076/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/8184/stat : 8184 (python) R 8182 8184 7922 0 -1 4202496 883 0 0 0 0 0 0 0 25 0 1 0 748907398 16154624 765 33554432000 4194304 5683644 140737262561600 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/8184/statm: 3944 766 343 364 0 431 0

[startup+0.0313011 s]
/proc/loadavg: 2.93 2.81 3.28 4/405 8184
/proc/meminfo: memFree=23141076/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=18884 CPUtime=0.01 cores=1,3,5,7
/proc/8184/stat : 8184 (python) R 8182 8184 7922 0 -1 4202496 1281 0 0 0 1 0 0 0 17 0 1 0 748907398 19337216 1134 33554432000 4194304 5683644 140737262561600 18446744073709551615 4522512 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/8184/statm: 4721 1135 421 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18884

[startup+0.10028 s]
/proc/loadavg: 2.93 2.81 3.28 4/405 8184
/proc/meminfo: memFree=23141076/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=104228 CPUtime=0.07 cores=1,3,5,7
/proc/8184/stat : 8184 (python) R 8182 8184 7922 0 -1 4202496 3086 0 0 0 5 2 0 0 17 0 1 0 748907398 106729472 2767 33554432000 4194304 5683644 140737262561600 18446744073709551615 5116756 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/8184/statm: 26057 2767 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300241 s]
/proc/loadavg: 2.93 2.81 3.28 4/405 8184
/proc/meminfo: memFree=23141076/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=194548 CPUtime=0.23 cores=1,3,5,7
/proc/8184/stat : 8184 (python) R 8182 8184 7922 0 -1 4202496 6914 934 1 0 17 6 0 0 17 0 1 0 748907398 199217152 4964 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895490192 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/8184/statm: 48637 4965 1431 364 0 3756 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 194548

[startup+0.700166 s]
/proc/loadavg: 2.93 2.81 3.28 4/405 8184
/proc/meminfo: memFree=23141076/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=285628 CPUtime=0.61 cores=1,3,5,7
/proc/8184/stat : 8184 (python) R 8182 8184 7922 0 -1 4202496 12506 934 1 0 51 10 0 0 17 0 1 0 748907398 292483072 8792 33554432000 4194304 5683644 140737262561600 18446744073709551615 4418259 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/8184/statm: 71407 8792 1826 364 0 7331 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 285628

[startup+1.50101 s]
/proc/loadavg: 2.93 2.81 3.28 4/406 8189
/proc/meminfo: memFree=23111432/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=285628 CPUtime=1.41 cores=1,3,5,7
/proc/8184/stat : 8184 (python) R 8182 8184 7922 0 -1 4202496 12506 934 1 0 131 10 0 0 18 0 1 0 748907398 292483072 8792 33554432000 4194304 5683644 140737262561600 18446744073709551615 47258117506923 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/8184/statm: 71407 8792 1826 364 0 7331 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 285628

[startup+3.10071 s]
/proc/loadavg: 2.93 2.81 3.28 4/409 8192
/proc/meminfo: memFree=23112524/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=290512 CPUtime=1.86 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 12844 934 1 0 176 10 0 0 21 0 2 0 748907398 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8184/statm: 72628 7501 1877 364 0 8546 0
[pid=8190] ppid=8184 vsize=280752 CPUtime=0 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 748907594 287490048 5976 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510543 0 0 16781312 514 12697049780933591301 0 0 17 7 0 0 0
/proc/8190/statm: 70188 5976 355 364 0 6106 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=1.13 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) R 8190 8192 8192 0 -1 4202496 956 0 0 0 113 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=290512 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 2 0 748907595 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 1590972

[startup+6.30111 s]
/proc/loadavg: 2.93 2.82 3.28 4/409 8192
/proc/meminfo: memFree=23112896/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=290512 CPUtime=1.86 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 12844 934 1 0 176 10 0 0 21 0 2 0 748907398 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8184/statm: 72628 7501 1877 364 0 8546 0
[pid=8190] ppid=8184 vsize=280752 CPUtime=0.01 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 870 0 0 0 0 1 0 0 18 0 1 0 748907594 287490048 5999 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510543 0 0 16781312 514 12697049780933591301 0 0 17 7 0 0 0
/proc/8190/statm: 70188 5999 378 364 0 6106 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=4.33 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) R 8190 8192 8192 0 -1 4202496 956 0 0 0 433 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=290512 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 2 0 748907595 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 1590972

[startup+12.7009 s]
/proc/loadavg: 2.94 2.82 3.28 4/409 8192
/proc/meminfo: memFree=23112224/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=290512 CPUtime=1.86 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 12844 934 1 0 176 10 0 0 21 0 2 0 748907398 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8184/statm: 72628 7501 1877 364 0 8546 0
[pid=8190] ppid=8184 vsize=280752 CPUtime=0.02 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 873 0 0 0 1 1 0 0 18 0 1 0 748907594 287490048 5999 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510543 0 0 16781312 514 2313407649212760325 0 0 17 7 0 0 0
/proc/8190/statm: 70188 5999 378 364 0 6106 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=10.73 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) R 8190 8192 8192 0 -1 4202496 956 0 0 0 1073 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=290512 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 2 0 748907595 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 1590972

[startup+25.5005 s]
/proc/loadavg: 3.09 2.86 3.28 4/409 8192
/proc/meminfo: memFree=23112608/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=290512 CPUtime=1.86 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 12844 934 1 0 176 10 0 0 21 0 2 0 748907398 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8184/statm: 72628 7501 1877 364 0 8546 0
[pid=8190] ppid=8184 vsize=280752 CPUtime=0.06 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 878 0 0 0 3 3 0 0 18 0 1 0 748907594 287490048 5999 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510543 0 0 16781312 514 2313407649212760325 0 0 17 7 0 0 0
/proc/8190/statm: 70188 5999 378 364 0 6106 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=23.53 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) R 8190 8192 8192 0 -1 4202496 956 0 0 0 2353 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134524916 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=290512 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 2 0 748907595 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 1590972

[startup+51.1007 s]
/proc/loadavg: 3.06 2.87 3.27 4/409 8193
/proc/meminfo: memFree=23112432/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=290512 CPUtime=1.86 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 12844 934 1 0 176 10 0 0 21 0 2 0 748907398 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8184/statm: 72628 7501 1877 364 0 8546 0
[pid=8190] ppid=8184 vsize=280752 CPUtime=0.12 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 888 0 0 0 6 6 0 0 18 0 1 0 748907594 287490048 5999 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510543 0 0 16781312 514 2313407649212760325 0 0 17 7 0 0 0
/proc/8190/statm: 70188 5999 378 364 0 6106 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=49.13 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) R 8190 8192 8192 0 -1 4202496 956 0 0 0 4913 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=290512 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 2 0 748907595 297484288 7501 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 51.11
Current children cumulated vsize (KiB) 1590972

[startup+102.315 s]
/proc/loadavg: 3.02 2.89 3.26 4/412 8206
/proc/meminfo: memFree=23080736/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=300768 CPUtime=1.89 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 13689 934 1 0 179 10 0 0 20 0 3 0 748907398 307986432 7508 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8184/statm: 75192 7508 1880 364 0 11107 0
[pid=8190] ppid=8184 vsize=290996 CPUtime=0.28 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 1061 0 0 0 14 14 0 0 19 0 2 0 748907594 297979904 6036 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8190/statm: 72749 6036 410 364 0 8667 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=100.31 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) T 8190 8192 8192 0 -1 4202496 956 0 0 0 10031 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=300768 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 3 0 748907595 307986432 7508 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 102.48
Current children cumulated vsize (KiB) 1611472

[startup+162.301 s]
/proc/loadavg: 3.01 2.90 3.24 4/416 8212
/proc/meminfo: memFree=23074184/32950928 swapFree=60044328/67111528
[pid=8184] ppid=8182 vsize=300768 CPUtime=1.89 cores=1,3,5,7
/proc/8184/stat : 8184 (python) S 8182 8184 7922 0 -1 4202496 13689 934 1 0 179 10 0 0 20 0 3 0 748907398 307986432 7508 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8184/statm: 75192 7508 1880 364 0 11107 0
[pid=8190] ppid=8184 vsize=290996 CPUtime=0.28 cores=1,3,5,7
/proc/8190/stat : 8190 (python) S 8184 8184 7922 0 -1 4202560 1061 0 0 0 14 14 0 0 19 0 2 0 748907594 297979904 6036 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8190/statm: 72749 6036 410 364 0 8667 0
[pid=8192] ppid=8190 vsize=1019708 CPUtime=100.31 cores=1,3,5,7
/proc/8192/stat : 8192 (gnovelty+2) T 8190 8192 8192 0 -1 4202496 956 0 0 0 10031 0 0 0 25 0 1 0 748907595 1044180992 690 33554432000 134512640 135663704 4290504272 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8192/statm: 254927 690 113 282 0 254643 0
[pid=8190/tid=8207] ppid=8184 vsize=290996 CPUtime=0 cores=1,3,5,7
/proc/8190/task/8207/stat : 8207 (python) S 8184 8184 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 748917626 297979904 6036 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604464458890112 0 0 -1 7 0 0 0
[pid=8208] ppid=8184 vsize=291084 CPUtime=0.17 cores=1,3,5,7
/proc/8208/stat : 8208 (python) S 8184 8184 7922 0 -1 4202560 902 0 0 0 8 9 0 0 18 0 1 0 748917629 298070016 5997 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510598 0 0 16781312 514 2313407649212760325 0 0 17 3 0 0 0
/proc/8208/statm: 72771 5997 372 364 0 8686 0
[pid=8210] ppid=8208 vsize=1019708 CPUtime=59.95 cores=1,3,5,7
/proc/8210/stat : 8210 (gnovelty+2) R 8208 8210 8210 0 -1 4202496 954 0 0 0 5995 0 0 0 25 0 1 0 748917630 1044180992 690 33554432000 134512640 135663704 4292993824 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/8210/statm: 254927 690 113 282 0 254643 0
[pid=8184/tid=8191] ppid=8182 vsize=300768 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 3 0 748907595 307986432 7508 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8209] ppid=8182 vsize=300768 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8209/stat : 8209 (python) S 8182 8184 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 3 0 748917630 307986432 7508 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 162.6

################
# More data... #
################

[pid=8226] ppid=8184 vsize=311860 CPUtime=0.3 cores=1,3,5,7
/proc/8226/stat : 8226 (python) S 8184 8184 7922 0 -1 4202560 1116 0 0 0 15 15 0 0 19 0 2 0 748937698 319344640 6074 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8226/statm: 77965 6074 400 364 0 13874 0
[pid=8228] ppid=8226 vsize=420220 CPUtime=99.29 cores=1,3,5,7
/proc/8228/stat : 8228 (adaptg2wsat2009) T 8226 8228 8228 0 -1 4202496 1668 0 0 0 9929 0 0 0 25 0 1 0 748937698 430305280 1401 33554432000 134512640 135107411 4289204848 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8228/statm: 105055 1401 59 146 0 103931 0
[pid=8226/tid=8231] ppid=8184 vsize=311860 CPUtime=0 cores=1,3,5,7
/proc/8226/task/8231/stat : 8231 (python) S 8184 8184 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 748947629 319344640 6074 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604460955857344 0 0 -1 1 0 0 0
[pid=8232] ppid=8184 vsize=322212 CPUtime=0.3 cores=1,3,5,7
/proc/8232/stat : 8232 (python) S 8184 8184 7922 0 -1 4202560 1109 0 0 0 15 15 0 0 19 0 2 0 748947632 329945088 6123 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8232/statm: 80553 6123 400 364 0 16459 0
[pid=8234] ppid=8232 vsize=420220 CPUtime=100.29 cores=1,3,5,7
/proc/8234/stat : 8234 (adaptg2wsat2009) T 8232 8234 8234 0 -1 4202496 1666 0 0 0 10029 0 0 0 25 0 1 0 748947632 430305280 1400 33554432000 134512640 135107411 4293969152 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8234/statm: 105055 1400 59 146 0 103931 0
[pid=8232/tid=8242] ppid=8184 vsize=322212 CPUtime=0 cores=1,3,5,7
/proc/8232/task/8242/stat : 8242 (python) S 8184 8184 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 748957662 329945088 6123 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604457512536192 0 0 -1 1 0 0 0
[pid=8243] ppid=8184 vsize=332320 CPUtime=0.3 cores=1,3,5,7
/proc/8243/stat : 8243 (python) S 8184 8184 7922 0 -1 4202560 1122 0 0 0 17 13 0 0 19 0 2 0 748957665 340295680 6151 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8243/statm: 83080 6151 400 364 0 18983 0
[pid=8245] ppid=8243 vsize=1019708 CPUtime=99.34 cores=1,3,5,7
/proc/8245/stat : 8245 (gnovelty+2) T 8243 8245 8245 0 -1 4202496 955 0 0 0 9934 0 0 0 25 0 1 0 748957666 1044180992 689 33554432000 134512640 135663704 4289454880 18446744073709551615 134524744 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8245/statm: 254927 689 113 282 0 254643 0
[pid=8243/tid=8249] ppid=8184 vsize=332320 CPUtime=0 cores=1,3,5,7
/proc/8243/task/8249/stat : 8249 (python) S 8184 8184 7922 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 748967600 340295680 6151 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604460955860032 0 0 -1 3 0 0 0
[pid=8250] ppid=8184 vsize=342800 CPUtime=0.3 cores=1,3,5,7
/proc/8250/stat : 8250 (python) S 8184 8184 7922 0 -1 4202560 1176 0 0 0 16 14 0 0 16 0 2 0 748967604 351027200 6161 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/8250/statm: 85700 6161 406 364 0 21600 0
[pid=8252] ppid=8250 vsize=249872 CPUtime=100.29 cores=1,3,5,7
/proc/8252/stat : 8252 (FH) T 8250 8252 8252 0 -1 4202496 1531 0 0 0 10029 0 0 0 25 0 1 0 748967604 255868928 1264 33554432000 134512640 134936988 4287263744 18446744073709551615 134553297 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8252/statm: 62468 1264 41 104 0 61972 0
[pid=8250/tid=8259] ppid=8184 vsize=342800 CPUtime=0 cores=1,3,5,7
/proc/8250/task/8259/stat : 8259 (python) S 8184 8184 7922 0 -1 4202560 95 0 0 0 0 0 0 0 16 0 2 0 748977634 351027200 6161 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604466855520256 0 0 -1 3 0 0 0
[pid=8260] ppid=8184 vsize=352860 CPUtime=0.32 cores=1,3,5,7
/proc/8260/stat : 8260 (python) S 8184 8184 7922 0 -1 4202560 1161 0 0 0 16 16 0 0 19 0 2 0 748977638 361328640 6184 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8260/statm: 88215 6184 406 364 0 24112 0
[pid=8262] ppid=8260 vsize=420220 CPUtime=99.28 cores=1,3,5,7
/proc/8262/stat : 8262 (adaptg2wsat2009) T 8260 8262 8262 0 -1 4202496 1674 0 0 0 9928 0 0 0 25 0 1 0 748977638 430305280 1400 33554432000 134512640 135107411 4291344336 18446744073709551615 134531848 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8262/statm: 105055 1400 59 146 0 103931 0
[pid=8260/tid=8266] ppid=8184 vsize=352860 CPUtime=0 cores=1,3,5,7
/proc/8260/task/8266/stat : 8266 (python) S 8184 8184 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 748987569 361328640 6184 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604462811941568 0 0 -1 1 0 0 0
[pid=8267] ppid=8184 vsize=363372 CPUtime=0.31 cores=1,3,5,7
/proc/8267/stat : 8267 (python) S 8184 8184 7922 0 -1 4202560 1137 0 0 0 16 15 0 0 19 0 2 0 748987573 372092928 6182 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8267/statm: 90843 6182 400 364 0 26737 0
[pid=8269] ppid=8267 vsize=420220 CPUtime=100.3 cores=1,3,5,7
/proc/8269/stat : 8269 (adaptg2wsat2009) T 8267 8269 8269 0 -1 4202496 1672 0 0 0 10030 0 0 0 25 0 1 0 748987573 430305280 1399 33554432000 134512640 135107411 4294495632 18446744073709551615 134532326 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8269/statm: 105055 1399 59 146 0 103931 0
[pid=8267/tid=8277] ppid=8184 vsize=363372 CPUtime=0 cores=1,3,5,7
/proc/8267/task/8277/stat : 8277 (python) S 8184 8184 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 748997604 372092928 6182 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604470849802432 0 0 -1 7 0 0 0
[pid=8278] ppid=8184 vsize=373404 CPUtime=0.31 cores=1,3,5,7
/proc/8278/stat : 8278 (python) S 8184 8184 7922 0 -1 4202560 1133 0 0 0 17 14 0 0 17 0 2 0 748997608 382365696 6201 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8278/statm: 93351 6201 400 364 0 29242 0
[pid=8280] ppid=8278 vsize=249872 CPUtime=99.31 cores=1,3,5,7
/proc/8280/stat : 8280 (FH) T 8278 8280 8280 0 -1 4202496 1533 0 0 0 9931 0 0 0 25 0 1 0 748997608 255868928 1264 33554432000 134512640 134936988 4289274272 18446744073709551615 134553288 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8280/statm: 62468 1264 41 104 0 61972 0
[pid=8278/tid=8283] ppid=8184 vsize=373404 CPUtime=0 cores=1,3,5,7
/proc/8278/task/8283/stat : 8283 (python) S 8184 8184 7922 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 749007540 382365696 6201 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604471133747328 0 0 -1 7 0 0 0
[pid=8284] ppid=8184 vsize=383944 CPUtime=0.62 cores=1,3,5,7
/proc/8284/stat : 8284 (python) S 8184 8184 7922 0 -1 4202560 1150 0 0 0 32 30 0 0 19 0 2 0 749007544 393158656 6205 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8284/statm: 95986 6205 400 364 0 31874 0
[pid=8286] ppid=8284 vsize=268424 CPUtime=194.69 cores=1,3,5,7
/proc/8286/stat : 8286 (hybridGM3) T 8284 8286 8286 0 -1 4202496 5399 0 0 0 19469 0 0 0 25 0 1 0 749007544 274866176 5127 33554432000 134512640 135204385 4292572080 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8286/statm: 67106 5127 63 169 0 66936 0
[pid=8284/tid=8297] ppid=8184 vsize=383944 CPUtime=0 cores=1,3,5,7
/proc/8284/task/8297/stat : 8297 (python) S 8184 8184 7922 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 749027014 393158656 6205 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604462811938880 0 0 -1 7 0 0 0
[pid=8298] ppid=8184 vsize=393944 CPUtime=0.31 cores=1,3,5,7
/proc/8298/stat : 8298 (python) S 8184 8184 7922 0 -1 4202560 1146 0 0 0 15 16 0 0 19 0 2 0 749027018 403398656 6224 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/8298/statm: 98486 6224 400 364 0 34371 0
[pid=8300] ppid=8298 vsize=1019708 CPUtime=100.25 cores=1,3,5,7
/proc/8300/stat : 8300 (gnovelty+2) T 8298 8300 8300 0 -1 4202496 966 0 0 0 10025 0 0 0 25 0 1 0 749027018 1044180992 690 33554432000 134512640 135663704 4292415264 18446744073709551615 134525002 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/8300/statm: 254927 690 113 282 0 254643 0
[pid=8298/tid=8307] ppid=8184 vsize=393944 CPUtime=0 cores=1,3,5,7
/proc/8298/task/8307/stat : 8307 (python) S 8184 8184 7922 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 749037053 403398656 6224 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604463653996480 0 0 -1 3 0 0 0
[pid=8308] ppid=8184 vsize=404540 CPUtime=0.62 cores=1,3,5,7
/proc/8308/stat : 8308 (python) S 8184 8184 7922 0 -1 4202560 1159 0 0 0 32 30 0 0 19 0 2 0 749037057 414248960 6228 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8308/statm: 101135 6228 400 364 0 37017 0
[pid=8310] ppid=8308 vsize=268424 CPUtime=195.69 cores=1,3,5,7
/proc/8310/stat : 8310 (hybridGM3) T 8308 8310 8310 0 -1 4202496 5404 0 0 0 19569 0 0 0 25 0 1 0 749037057 274866176 5127 33554432000 134512640 135204385 4291872560 18446744073709551615 134538375 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8310/statm: 67106 5127 63 169 0 66936 0
[pid=8308/tid=8316] ppid=8184 vsize=404540 CPUtime=0 cores=1,3,5,7
/proc/8308/task/8316/stat : 8316 (python) S 8184 8184 7922 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 749056627 414248960 6228 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604466855519360 0 0 -1 7 0 0 0
[pid=8317] ppid=8184 vsize=414636 CPUtime=0.33 cores=1,3,5,7
/proc/8317/stat : 8317 (python) S 8184 8184 7922 0 -1 4202560 1147 0 0 0 16 17 0 0 19 0 2 0 749056630 424587264 6253 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8317/statm: 103659 6253 400 364 0 39538 0
[pid=8319] ppid=8317 vsize=420220 CPUtime=100.32 cores=1,3,5,7
/proc/8319/stat : 8319 (adaptg2wsat2009) T 8317 8319 8319 0 -1 4202496 1674 0 0 0 10032 0 0 0 25 0 1 0 749056631 430305280 1399 33554432000 134512640 135107411 4293396512 18446744073709551615 134531232 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/8319/statm: 105055 1399 59 146 0 103931 0
[pid=8317/tid=8323] ppid=8184 vsize=414636 CPUtime=0 cores=1,3,5,7
/proc/8317/task/8323/stat : 8323 (python) S 8184 8184 7922 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 749066664 424587264 6253 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604469069111552 0 0 -1 7 0 0 0
[pid=8324] ppid=8184 vsize=425064 CPUtime=0.63 cores=1,3,5,7
/proc/8324/stat : 8324 (python) S 8184 8184 7922 0 -1 4202560 1198 0 0 0 32 31 0 0 19 0 2 0 749066668 435265536 6264 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/8324/statm: 106266 6264 407 364 0 42142 0
[pid=8326] ppid=8324 vsize=268420 CPUtime=195.63 cores=1,3,5,7
/proc/8326/stat : 8326 (hybridGM3) T 8324 8326 8326 0 -1 4202496 5399 0 0 0 19563 0 0 0 25 0 1 0 749066668 274862080 5126 33554432000 134512640 135204385 4292859040 18446744073709551615 134538432 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8326/statm: 67105 5126 63 169 0 66935 0
[pid=8324/tid=8332] ppid=8184 vsize=425064 CPUtime=0 cores=1,3,5,7
/proc/8324/task/8332/stat : 8332 (python) S 8184 8184 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749086236 435265536 6264 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604462362755392 0 0 -1 1 0 0 0
[pid=8333] ppid=8184 vsize=435316 CPUtime=0.63 cores=1,3,5,7
/proc/8333/stat : 8333 (python) S 8184 8184 7922 0 -1 4202560 1212 0 0 0 33 30 0 0 17 0 2 0 749086240 445763584 6271 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/8333/statm: 108829 6271 407 364 0 44702 0
[pid=8335] ppid=8333 vsize=268424 CPUtime=194.69 cores=1,3,5,7
/proc/8335/stat : 8335 (hybridGM3) T 8333 8335 8335 0 -1 4202496 5402 0 0 0 19469 0 0 0 25 0 1 0 749086240 274866176 5127 33554432000 134512640 135204385 4292536320 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8335/statm: 67106 5127 63 169 0 66936 0
[pid=8333/tid=8342] ppid=8184 vsize=435316 CPUtime=0 cores=1,3,5,7
/proc/8333/task/8342/stat : 8342 (python) S 8184 8184 7922 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 749105709 445763584 6271 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604464373624896 0 0 -1 1 0 0 0
[pid=8343] ppid=8184 vsize=445760 CPUtime=5.07 cores=1,3,5,7
/proc/8343/stat : 8343 (python) S 8184 8184 7922 0 -1 4202560 1202 0 0 0 263 244 0 0 19 0 2 0 749105713 456458240 6269 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/8343/statm: 111440 6269 401 364 0 47310 0
[pid=8345] ppid=8343 vsize=458348 CPUtime=1554.11 cores=1,3,5,7
/proc/8345/stat : 8345 (TNM) T 8343 8345 8345 0 -1 4202496 1513 0 0 0 155409 2 0 0 25 0 1 0 749105713 469348352 1240 33554432000 134512640 135008748 4288290608 18446744073709551615 134529176 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/8345/statm: 114587 1240 46 122 0 113487 0
[pid=8343/tid=8543] ppid=8184 vsize=445760 CPUtime=0 cores=1,3,5,7
/proc/8343/task/8543/stat : 8543 (python) S 8184 8184 7922 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 749261120 456458240 6269 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 514 18446604463741720768 0 0 -1 7 0 0 0
[pid=8544] ppid=8184 vsize=455928 CPUtime=0 cores=1,3,5,7
/proc/8544/stat : 8544 (python) S 8184 8184 7922 0 -1 4202560 827 0 0 0 0 0 0 0 20 0 1 0 749261122 466870272 6263 33554432000 4194304 5683644 140737262561600 18446744073709551615 231895510598 0 0 16781312 514 9032850590434066431 0 0 17 1 0 0 0
/proc/8544/statm: 113982 6263 346 364 0 49849 0
[pid=8546] ppid=8544 vsize=247956 CPUtime=0.28 cores=1,3,5,7
/proc/8546/stat : 8546 (FH) R 8544 8546 8546 0 -1 4202496 1262 0 0 0 28 0 0 0 22 0 1 0 749261122 253906944 987 33554432000 134512640 134936988 4288026768 18446744073709551615 134523630 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/8546/statm: 61989 987 37 104 0 61493 0
[pid=8184/tid=8191] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8191/stat : 8191 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 21 0 19 0 748907595 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8209] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8209/stat : 8209 (python) S 8182 8184 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 748917630 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 3 0 0 0
[pid=8184/tid=8216] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8216/stat : 8216 (python) S 8182 8184 7922 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 19 0 748927666 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 3 0 0 0
[pid=8184/tid=8227] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8227/stat : 8227 (python) S 8182 8184 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 748937698 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8233] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8233/stat : 8233 (python) S 8182 8184 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 748947632 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8244] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8244/stat : 8244 (python) S 8182 8184 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 748957665 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8251] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8251/stat : 8251 (python) S 8182 8184 7922 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 19 0 748967604 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 3 0 0 0
[pid=8184/tid=8261] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8261/stat : 8261 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 19 0 748977638 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8268] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8268/stat : 8268 (python) S 8182 8184 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 748987573 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 1 0 0 0
[pid=8184/tid=8279] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8279/stat : 8279 (python) S 8182 8184 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 748997608 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8285] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8285/stat : 8285 (python) S 8182 8184 7922 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 19 0 749007544 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 1 0 0 0
[pid=8184/tid=8299] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8299/stat : 8299 (python) S 8182 8184 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 749027018 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 1 0 0 0
[pid=8184/tid=8309] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8309/stat : 8309 (python) S 8182 8184 7922 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 749037057 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 1 0 0 0
[pid=8184/tid=8318] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8318/stat : 8318 (python) S 8182 8184 7922 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 749056630 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 3 0 0 0
[pid=8184/tid=8325] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8325/stat : 8325 (python) S 8182 8184 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749066668 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 3 0 0 0
[pid=8184/tid=8334] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8334/stat : 8334 (python) S 8182 8184 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 749086240 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 7 0 0 0
[pid=8184/tid=8344] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8344/stat : 8344 (python) S 8182 8184 7922 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 749105713 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 1 0 0 0
[pid=8184/tid=8545] ppid=8182 vsize=465776 CPUtime=0 cores=1,3,5,7
/proc/8184/task/8545/stat : 8545 (python) S 8182 8184 7922 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 749261122 476954624 7832 33554432000 4194304 5683644 140737262561600 18446744073709551615 231907314097 0 0 16781312 2 18446604460955859136 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3548.33
Current children cumulated vsize (KiB) 15987132

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8184 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=334645
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=156976
# CPU time returned by wait4() is 2.49162
# while last known CPU time is 3548.33
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3537.63
CPU time (s): 3548.33
CPU user time (s): 3542.72
CPU system time (s): 5.61
CPU usage (%): 100.302
Max. virtual memory (cumulated for all children) (KiB): 15987132

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.33465
system time used= 0.156976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30281
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1065
involuntary context switches= 46

runsolver used 29.6145 second user time and 63.4324 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-17 00:59:27
IDJOB=3386560
IDBENCH=82625
IDSOLVER=1872
FILE ID=node114/3386560-1305586767
RUNJOBID= node114-1305586148-7941
PBS_JOBID= 13350364
Free space on /tmp= 72908 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S680524168-083-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386560-1305586767/watcher-3386560-1305586767 -o /tmp/evaluation-result-3386560-1305586767/solver-3386560-1305586767 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386560-1305586767.cnf -seed 647316550 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ebf03c9c6463f3682b7e09274cee8655
RANDOM SEED=647316550

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23141108 kB
Buffers:         80024 kB
Cached:         571580 kB
SwapCached:      48552 kB
Active:        1358012 kB
Inactive:      8246444 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23141108 kB
SwapTotal:    67111528 kB
SwapFree:     60044328 kB
Dirty:           33032 kB
Writeback:           8 kB
AnonPages:     8911156 kB
Mapped:          28756 kB
Slab:            80144 kB
PageTables:      57648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 82773024 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72880 MiB
End job on node114 at 2011-05-17 01:58:27