Trace number 3378459

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 4792.25 1202.29

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v650-c2769-S960948361-055.UNKNOWN.cnf
MD5SUMb51753a48e6efd66554e7afe4efc3b19
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables650
Number of clauses2769
Sum of the clauses size8307
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32769
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.32/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.68	c INFO: solving HOME/instance-3378459-1305465715.cnf
0.32/0.68	c INFO: computing task features
0.32/0.69	c INFO: computed variable-clause graph statistics
0.32/0.69	c INFO: computed clause balance statistics
0.40/0.74	c INFO: computed variable balance statistics
0.40/0.78	c INFO: computed small-clause counts
0.40/0.78	c INFO: computed Horn-clause counts
0.40/0.78	c INFO: computed variable graph statistics
0.40/0.78	c INFO: collected features for HOME/instance-3378459-1305465715.cnf in 0.10 s
0.40/0.79	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.58)
0.49/0.80	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.28)
0.49/0.81	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.07)
0.49/0.82	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.27)
400.05/101.06	c INFO: running march_hi@0 for 679 with 1099 remaining (b = 0.33)
400.05/101.09	c INFO: running march_hi@0 for 679 with 1099 remaining (b = 0.30)
1562.90/392.70	c INFO: running march_hi@0 for 97 with 807 remaining (b = 0.06)
1564.87/393.17	c INFO: running march_hi@100 for 291 with 807 remaining (b = 0.17)
1965.72/493.63	c INFO: running march_hi@392 for 97 with 707 remaining (b = 0.07)
2351.44/590.34	c INFO: running kcnfs-2006@0 for 610 with 610 remaining (b = 0.25)
2733.55/686.15	c INFO: running march_hi@199 for 194 with 514 remaining (b = 0.11)
3134.48/786.69	c INFO: running march_hi@0 for 413 with 413 remaining (b = 0.18)
3149.59/790.48	c INFO: running march_hi@99 for 291 with 410 remaining (b = 0.12)
3500.93/878.57	c INFO: running march_hi@390 for 97 with 322 remaining (b = 0.05)
3879.82/973.53	c INFO: running march_hi@488 for 227 with 227 remaining (b = 0.09)
4296.95/1078.13	c INFO: running march_hi@485 for 122 with 122 remaining (b = 0.05)
4791.82/1202.27	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378459-1305465715/watcher-3378459-1305465715 -o /tmp/evaluation-result-3378459-1305465715/solver-3378459-1305465715 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378459-1305465715.cnf -seed 1087263410 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.20 8.24 7.86 6/396 19177
/proc/meminfo: memFree=19963472/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 901 0 0 0 0 0 0 0 25 0 1 0 658169698 16154624 783 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/19177/statm: 3944 783 346 364 0 431 0

[startup+0.106473 s]
/proc/loadavg: 8.20 8.24 7.86 6/396 19177
/proc/meminfo: memFree=19963472/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=94180 CPUtime=0.06 cores=0,2,4,6
/proc/19177/stat : 19177 (python) R 19175 19177 18093 0 -1 4202496 2699 0 0 0 4 2 0 0 17 0 1 0 658169698 96440320 2411 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335892224 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19177/statm: 23545 2431 764 364 0 1677 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 94180

[startup+0.200444 s]
/proc/loadavg: 8.20 8.24 7.86 6/396 19177
/proc/meminfo: memFree=19963472/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=124072 CPUtime=0.11 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 4240 0 1 0 7 4 0 0 17 0 1 0 658169698 127049728 3850 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/19177/statm: 31018 3850 991 364 0 2829 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 124072

[startup+0.300438 s]
/proc/loadavg: 8.20 8.24 7.86 6/396 19177
/proc/meminfo: memFree=19963472/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=135752 CPUtime=0.17 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 5961 933 1 0 12 5 0 0 18 0 1 0 658169698 139010048 4151 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335888389 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/19177/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.70035 s]
/proc/loadavg: 8.20 8.24 7.86 6/396 19177
/proc/meminfo: memFree=19963472/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=278476 CPUtime=0.4 cores=0,2,4,6
/proc/19177/stat : 19177 (python) R 19175 19177 18093 0 -1 4202496 9356 933 1 0 29 11 0 0 17 0 1 0 658169698 285159424 7028 33554432000 4194304 5683644 140736326048592 18446744073709551615 4963016 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19177/statm: 69619 7028 1826 364 0 5543 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 278476

[startup+1.50114 s]
/proc/loadavg: 8.20 8.24 7.86 9/409 19194
/proc/meminfo: memFree=19923068/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=320180 CPUtime=0.52 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 12194 933 1 0 40 12 0 0 19 0 5 0 658169698 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19177/statm: 80045 7258 1881 364 0 15954 0
[pid=19183] ppid=19177 vsize=278500 CPUtime=0 cores=0,2,4,6
/proc/19183/stat : 19183 (python) S 19177 19177 18093 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 658169778 285184000 5563 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912463 0 0 16781312 514 3861463125689630719 0 0 17 0 0 0 0
/proc/19183/statm: 69625 5563 354 364 0 5543 0
[pid=19185] ppid=19183 vsize=1017940 CPUtime=0.7 cores=0,2,4,6
/proc/19185/stat : 19185 (gnovelty+2) R 19183 19185 19185 0 -1 4202496 458 0 0 0 70 0 0 0 21 0 1 0 658169778 1042370560 192 33554432000 134512640 135663704 4291051744 18446744073709551615 134544288 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19185/statm: 254485 192 113 282 0 254201 0
[pid=19186] ppid=19177 vsize=289424 CPUtime=0 cores=0,2,4,6
/proc/19186/stat : 19186 (python) S 19177 19177 18093 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 658169779 296370176 5713 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 4914223244174655748 0 0 17 4 0 0 0
/proc/19186/statm: 72356 5713 348 364 0 8271 0
[pid=19188] ppid=19186 vsize=2704 CPUtime=0.68 cores=0,2,4,6
/proc/19188/stat : 19188 (march_hi) R 19186 19188 19188 0 -1 4202496 730 0 0 0 68 0 0 0 22 0 1 0 658169779 2768896 464 33554432000 4194304 4955518 140736117772784 18446744073709551615 4224687 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19188/statm: 676 464 104 186 0 489 0
[pid=19189] ppid=19177 vsize=299680 CPUtime=0 cores=0,2,4,6
/proc/19189/stat : 19189 (python) S 19177 19177 18093 0 -1 4202560 740 0 0 0 0 0 0 0 21 0 1 0 658169780 306872320 5717 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 11792750120477392895 0 0 17 4 0 0 0
/proc/19189/statm: 74920 5717 348 364 0 10832 0
[pid=19191] ppid=19189 vsize=1017940 CPUtime=0.66 cores=0,2,4,6
/proc/19191/stat : 19191 (gnovelty+2) R 19189 19191 19191 0 -1 4202496 450 0 0 0 66 0 0 0 25 0 1 0 658169780 1042370560 192 33554432000 134512640 135663704 4287330080 18446744073709551615 134525253 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19191/statm: 254485 192 113 282 0 254201 0
[pid=19192] ppid=19177 vsize=309936 CPUtime=0 cores=0,2,4,6
/proc/19192/stat : 19192 (python) S 19177 19177 18093 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 658169781 317374464 5721 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 4302199887782445314 0 0 17 4 0 0 0
/proc/19192/statm: 77484 5721 348 364 0 13393 0
[pid=19194] ppid=19192 vsize=2704 CPUtime=0.67 cores=0,2,4,6
/proc/19194/stat : 19194 (march_hi) R 19192 19194 19194 0 -1 4202496 720 0 0 0 67 0 0 0 22 0 1 0 658169781 2768896 461 33554432000 4194304 4955518 140735086593696 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19194/statm: 676 461 104 186 0 489 0
[pid=19177/tid=19184] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19184/stat : 19184 (python) S 19175 19177 18093 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 5 0 658169778 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 0 0 0 0
[pid=19177/tid=19187] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19187/stat : 19187 (python) S 19175 19177 18093 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658169779 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19190] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19190/stat : 19190 (python) S 19175 19177 18093 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 5 0 658169780 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19193] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19193/stat : 19193 (python) S 19175 19177 18093 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 5 0 658169781 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.23
Current children cumulated vsize (KiB) 3539008

[startup+3.10085 s]
/proc/loadavg: 8.18 8.23 7.86 9/409 19194
/proc/meminfo: memFree=19921456/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=320180 CPUtime=0.52 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 12194 933 1 0 40 12 0 0 19 0 5 0 658169698 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19177/statm: 80045 7258 1881 364 0 15954 0
[pid=19183] ppid=19177 vsize=278500 CPUtime=0 cores=0,2,4,6
/proc/19183/stat : 19183 (python) S 19177 19177 18093 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 658169778 285184000 5563 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912463 0 0 16781312 514 3861463125689598209 0 0 17 0 0 0 0
/proc/19183/statm: 69625 5563 354 364 0 5543 0
[pid=19185] ppid=19183 vsize=1017940 CPUtime=2.3 cores=0,2,4,6
/proc/19185/stat : 19185 (gnovelty+2) R 19183 19185 19185 0 -1 4202496 458 0 0 0 230 0 0 0 25 0 1 0 658169778 1042370560 192 33554432000 134512640 135663704 4291051744 18446744073709551615 134525722 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19185/statm: 254485 192 113 282 0 254201 0
[pid=19186] ppid=19177 vsize=289424 CPUtime=0 cores=0,2,4,6
/proc/19186/stat : 19186 (python) S 19177 19177 18093 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 658169779 296370176 5713 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 4914223244174655748 0 0 17 4 0 0 0
/proc/19186/statm: 72356 5713 348 364 0 8271 0
[pid=19188] ppid=19186 vsize=3068 CPUtime=2.28 cores=0,2,4,6
/proc/19188/stat : 19188 (march_hi) R 19186 19188 19188 0 -1 4202496 841 0 0 0 228 0 0 0 25 0 1 0 658169779 3141632 556 33554432000 4194304 4955518 140736117772784 18446744073709551615 4227827 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19188/statm: 767 556 104 186 0 580 0
[pid=19189] ppid=19177 vsize=299680 CPUtime=0 cores=0,2,4,6
/proc/19189/stat : 19189 (python) S 19177 19177 18093 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 658169780 306872320 5717 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 11792750120477360385 0 0 17 4 0 0 0
/proc/19189/statm: 74920 5717 348 364 0 10832 0
[pid=19191] ppid=19189 vsize=1017940 CPUtime=2.25 cores=0,2,4,6
/proc/19191/stat : 19191 (gnovelty+2) R 19189 19191 19191 0 -1 4202496 450 0 0 0 225 0 0 0 25 0 1 0 658169780 1042370560 192 33554432000 134512640 135663704 4287330080 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19191/statm: 254485 192 113 282 0 254201 0
[pid=19192] ppid=19177 vsize=309936 CPUtime=0 cores=0,2,4,6
/proc/19192/stat : 19192 (python) S 19177 19177 18093 0 -1 4202560 764 0 0 0 0 0 0 0 15 0 1 0 658169781 317374464 5721 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 4302199887782445314 0 0 17 4 0 0 0
/proc/19192/statm: 77484 5721 348 364 0 13393 0
[pid=19194] ppid=19192 vsize=3068 CPUtime=2.27 cores=0,2,4,6
/proc/19194/stat : 19194 (march_hi) R 19192 19194 19194 0 -1 4202496 834 0 0 0 227 0 0 0 25 0 1 0 658169781 3141632 556 33554432000 4194304 4955518 140735086593696 18446744073709551615 4227571 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19194/statm: 767 556 104 186 0 580 0
[pid=19177/tid=19184] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19184/stat : 19184 (python) S 19175 19177 18093 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 5 0 658169778 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 0 0 0 0
[pid=19177/tid=19187] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19187/stat : 19187 (python) S 19175 19177 18093 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658169779 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19190] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19190/stat : 19190 (python) S 19175 19177 18093 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 5 0 658169780 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19193] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19193/stat : 19193 (python) S 19175 19177 18093 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 5 0 658169781 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.62
Current children cumulated vsize (KiB) 3539736

[startup+6.30129 s]
/proc/loadavg: 8.18 8.23 7.86 9/409 19194
/proc/meminfo: memFree=19916496/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=320180 CPUtime=0.52 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 12194 933 1 0 40 12 0 0 19 0 5 0 658169698 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19177/statm: 80045 7258 1881 364 0 15954 0
[pid=19183] ppid=19177 vsize=278500 CPUtime=0 cores=0,2,4,6
/proc/19183/stat : 19183 (python) S 19177 19177 18093 0 -1 4202560 896 0 0 0 0 0 0 0 18 0 1 0 658169778 285184000 5586 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912463 0 0 16781312 514 3861463125689598209 0 0 17 0 0 0 0
/proc/19183/statm: 69625 5586 377 364 0 5543 0
[pid=19185] ppid=19183 vsize=1017940 CPUtime=5.5 cores=0,2,4,6
/proc/19185/stat : 19185 (gnovelty+2) R 19183 19185 19185 0 -1 4202496 458 0 0 0 550 0 0 0 25 0 1 0 658169778 1042370560 192 33554432000 134512640 135663704 4291051744 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19185/statm: 254485 192 113 282 0 254201 0
[pid=19186] ppid=19177 vsize=289424 CPUtime=0.01 cores=0,2,4,6
/proc/19186/stat : 19186 (python) S 19177 19177 18093 0 -1 4202560 915 0 0 0 1 0 0 0 15 0 1 0 658169779 296370176 5736 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 4914223244174655748 0 0 17 4 0 0 0
/proc/19186/statm: 72356 5736 371 364 0 8271 0
[pid=19188] ppid=19186 vsize=3784 CPUtime=5.44 cores=0,2,4,6
/proc/19188/stat : 19188 (march_hi) R 19186 19188 19188 0 -1 4202496 981 0 0 0 544 0 0 0 25 0 1 0 658169779 3874816 696 33554432000 4194304 4955518 140736117772784 18446744073709551615 4227679 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19188/statm: 946 696 104 186 0 759 0
[pid=19189] ppid=19177 vsize=299680 CPUtime=0.01 cores=0,2,4,6
/proc/19189/stat : 19189 (python) S 19177 19177 18093 0 -1 4202560 899 0 0 0 1 0 0 0 18 0 1 0 658169780 306872320 5740 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 11792750120477360385 0 0 17 4 0 0 0
/proc/19189/statm: 74920 5740 371 364 0 10832 0
[pid=19191] ppid=19189 vsize=1017940 CPUtime=5.41 cores=0,2,4,6
/proc/19191/stat : 19191 (gnovelty+2) R 19189 19191 19191 0 -1 4202496 450 0 0 0 541 0 0 0 25 0 1 0 658169780 1042370560 192 33554432000 134512640 135663704 4287330080 18446744073709551615 134524594 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19191/statm: 254485 192 113 282 0 254201 0
[pid=19192] ppid=19177 vsize=309936 CPUtime=0 cores=0,2,4,6
/proc/19192/stat : 19192 (python) S 19177 19177 18093 0 -1 4202560 919 0 0 0 0 0 0 0 15 0 1 0 658169781 317374464 5744 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 4302199887782445314 0 0 17 4 0 0 0
/proc/19192/statm: 77484 5744 371 364 0 13393 0
[pid=19194] ppid=19192 vsize=3784 CPUtime=5.45 cores=0,2,4,6
/proc/19194/stat : 19194 (march_hi) R 19192 19194 19194 0 -1 4202496 975 0 0 0 545 0 0 0 25 0 1 0 658169781 3874816 697 33554432000 4194304 4955518 140735086593696 18446744073709551615 4261360 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19194/statm: 946 697 104 186 0 759 0
[pid=19177/tid=19184] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19184/stat : 19184 (python) S 19175 19177 18093 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 5 0 658169778 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 0 0 0 0
[pid=19177/tid=19187] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19187/stat : 19187 (python) S 19175 19177 18093 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658169779 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19190] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19190/stat : 19190 (python) S 19175 19177 18093 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 5 0 658169780 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19193] ppid=19175 vsize=320180 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19193/stat : 19193 (python) S 19175 19177 18093 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 5 0 658169781 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 22.34
Current children cumulated vsize (KiB) 3541168

[startup+12.7011 s]
/proc/loadavg: 8.15 8.23 7.86 9/409 19194
/proc/meminfo: memFree=19912124/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=320180 CPUtime=0.52 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 12194 933 1 0 40 12 0 0 19 0 5 0 658169698 327864320 7258 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19177/statm: 80045 7258 1881 364 0 15954 0
[pid=19183] ppid=19177 vsize=278500 CPUtime=0.02 cores=0,2,4,6
/proc/19183/stat : 19183 (python) S 19177 19177 18093 0 -1 4202560 899 0 0 0 1 1 0 0 18 0 1 0 658169778 285184000 5586 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912463 0 0 16781312 514 5245356559747219713 0 0 17 0 0 0 0
/proc/19183/statm: 69625 5586 377 364 0 5543 0
[pid=19185] ppid=19183 vsize=1017940 CPUtime=11.9 cores=0,2,4,6
/proc/19185/stat : 19185 (gnovelty+2) R 19183 19185 19185 0 -1 4202496 458 0 0 0 1190 0 0 0 25 0 1 0 658169778 1042370560 192 33554432000 134512640 135663704 4291051744 18446744073709551615 134545772 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19185/statm: 254485 192 113 282 0 254201 0
[pid=19186] ppid=19177 vsize=289424 CPUtime=0.03 cores=0,2,4,6

################
# More data... #
################


[startup+1202 s]
/proc/loadavg: 8.37 8.30 8.14 9/390 19437
/proc/meminfo: memFree=19228168/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=360944 CPUtime=0.61 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 16850 933 1 0 48 13 0 0 18 0 9 0 658169698 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19177/statm: 90236 7233 1890 364 0 26133 0
[pid=19183] ppid=19177 vsize=288744 CPUtime=0.26 cores=0,2,4,6
/proc/19183/stat : 19183 (python) S 19177 19177 18093 0 -1 4202560 1166 0 0 0 14 12 0 0 19 0 2 0 658169778 295673856 5630 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19183/statm: 72186 5630 416 364 0 8104 0
[pid=19185] ppid=19183 vsize=1017940 CPUtime=100.24 cores=0,2,4,6
/proc/19185/stat : 19185 (gnovelty+2) T 19183 19185 19185 0 -1 4202496 459 0 0 0 10024 0 0 0 25 0 1 0 658169778 1042370560 193 33554432000 134512640 135663704 4291051744 18446744073709551615 134547274 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/19185/statm: 254485 193 113 282 0 254201 0
[pid=19183/tid=19202] ppid=19177 vsize=288744 CPUtime=0 cores=0,2,4,6
/proc/19183/task/19202/stat : 19202 (python) S 19177 19177 18093 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658179804 295673856 5630 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604453811760192 0 0 -1 0 0 0 0
[pid=19186] ppid=19177 vsize=289424 CPUtime=2.2 cores=0,2,4,6
/proc/19186/stat : 19186 (python) S 19177 19177 18093 0 -1 4202560 1146 0 0 0 125 95 0 0 15 0 2 0 658169779 296370176 5766 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19186/statm: 72356 5766 400 364 0 8271 0
[pid=19188] ppid=19186 vsize=173280 CPUtime=813.99 cores=0,2,4,6
/proc/19188/stat : 19188 (march_hi) R 19186 19188 19188 0 -1 4202496 28388 0 0 0 81390 9 0 0 25 0 1 0 658169779 177438720 28103 33554432000 4194304 4955518 140736117772784 18446744073709551615 4227819 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19188/statm: 43320 28103 104 186 0 43133 0
[pid=19186/tid=19220] ppid=19177 vsize=289424 CPUtime=0 cores=0,2,4,6
/proc/19186/task/19220/stat : 19220 (python) S 19177 19177 18093 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 658208968 296370176 5766 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604440904372480 0 0 -1 0 0 0 0
[pid=19189] ppid=19177 vsize=299680 CPUtime=0.27 cores=0,2,4,6
/proc/19189/stat : 19189 (python) S 19177 19177 18093 0 -1 4202560 1084 0 0 0 13 14 0 0 19 0 2 0 658169780 306872320 5770 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19189/statm: 74920 5770 400 364 0 10832 0
[pid=19191] ppid=19189 vsize=1017940 CPUtime=99.11 cores=0,2,4,6
/proc/19191/stat : 19191 (gnovelty+2) T 19189 19191 19191 0 -1 4202496 450 0 0 0 9911 0 0 0 25 0 1 0 658169780 1042370560 192 33554432000 134512640 135663704 4287330080 18446744073709551615 134545786 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/19191/statm: 254485 192 113 282 0 254201 0
[pid=19189/tid=19205] ppid=19177 vsize=299680 CPUtime=0 cores=0,2,4,6
/proc/19189/task/19205/stat : 19205 (python) S 19177 19177 18093 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 658179807 306872320 5770 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604451363439552 0 0 -1 4 0 0 0
[pid=19192] ppid=19177 vsize=309936 CPUtime=2.34 cores=0,2,4,6
/proc/19192/stat : 19192 (python) S 19177 19177 18093 0 -1 4202560 1167 0 0 0 125 109 0 0 15 0 2 0 658169781 317374464 5774 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19192/statm: 77484 5774 400 364 0 13393 0
[pid=19194] ppid=19192 vsize=173280 CPUtime=873.58 cores=0,2,4,6
/proc/19194/stat : 19194 (march_hi) T 19192 19194 19194 0 -1 4202496 30248 0 0 0 87351 7 0 0 25 0 1 0 658169781 177438720 29970 33554432000 4194304 4955518 140735086593696 18446744073709551615 4224758 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/19194/statm: 43320 29970 104 186 0 43133 0
[pid=19192/tid=19221] ppid=19177 vsize=309936 CPUtime=0 cores=0,2,4,6
/proc/19192/task/19221/stat : 19221 (python) S 19177 19177 18093 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658209015 317374464 5774 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604445691776000 0 0 -1 4 0 0 0
[pid=19203] ppid=19177 vsize=320192 CPUtime=2.61 cores=0,2,4,6
/proc/19203/stat : 19203 (python) S 19177 19177 18093 0 -1 4202560 1155 0 0 0 137 124 0 0 16 0 2 0 658179805 327876608 5778 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/19203/statm: 80048 5778 400 364 0 15954 0
[pid=19206] ppid=19203 vsize=173280 CPUtime=971.63 cores=0,2,4,6
/proc/19206/stat : 19206 (march_hi) T 19203 19206 19206 0 -1 4202496 33673 0 0 0 97151 12 0 0 25 0 1 0 658179807 177438720 33396 33554432000 4194304 4955518 140733954631632 18446744073709551615 4346411 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/19206/statm: 43320 33396 104 186 0 43133 0
[pid=19203/tid=19421] ppid=19177 vsize=320192 CPUtime=0 cores=0,2,4,6
/proc/19203/task/19421/stat : 19421 (python) S 19177 19177 18093 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 658248746 327876608 5778 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604453865500800 0 0 -1 6 0 0 0
[pid=19207] ppid=19177 vsize=330156 CPUtime=2.42 cores=0,2,4,6
/proc/19207/stat : 19207 (python) S 19177 19177 18093 0 -1 4202560 1149 0 0 0 133 109 0 0 15 0 2 0 658179808 338079744 5692 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19207/statm: 82539 5692 400 364 0 18442 0
[pid=19209] ppid=19207 vsize=173280 CPUtime=901.14 cores=0,2,4,6
/proc/19209/stat : 19209 (march_hi) R 19207 19209 19209 0 -1 4202496 31305 0 0 0 90104 10 0 0 25 0 1 0 658179808 177438720 31025 33554432000 4194304 4955518 140735023825744 18446744073709551615 4227565 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19209/statm: 43320 31025 104 186 0 43133 0
[pid=19207/tid=19417] ppid=19177 vsize=330156 CPUtime=0 cores=0,2,4,6
/proc/19207/task/19417/stat : 19417 (python) S 19177 19177 18093 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 658248367 338079744 5692 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604449460672640 0 0 -1 0 0 0 0
[pid=19409] ppid=19177 vsize=341004 CPUtime=1.53 cores=0,2,4,6
/proc/19409/stat : 19409 (python) S 19177 19177 18093 0 -1 4202560 991 0 0 0 77 76 0 0 18 0 1 0 658228733 349188096 5814 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 5245356559747219714 0 0 17 4 0 0 0
/proc/19409/statm: 85251 5814 371 364 0 21151 0
[pid=19411] ppid=19409 vsize=182584 CPUtime=609.46 cores=0,2,4,6
/proc/19411/stat : 19411 (kcnfs-2006) R 19409 19411 19411 0 -1 4202496 651 0 0 0 60946 0 0 0 25 0 1 0 658228733 186966016 389 33554432000 134512640 135163436 4292795120 18446744073709551615 134675104 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19411/statm: 45646 389 77 159 0 45486 0
[pid=19418] ppid=19177 vsize=351260 CPUtime=1.09 cores=0,2,4,6
/proc/19418/stat : 19418 (python) S 19177 19177 18093 0 -1 4202560 1053 0 0 0 56 53 0 0 15 0 1 0 658248368 359690240 5833 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 5245356559747219714 0 0 17 6 0 0 0
/proc/19418/statm: 87815 5833 377 364 0 23712 0
[pid=19420] ppid=19418 vsize=80780 CPUtime=408.54 cores=0,2,4,6
/proc/19420/stat : 19420 (march_hi) R 19418 19420 19420 0 -1 4202496 15104 0 0 0 40850 4 0 0 25 0 1 0 658248368 82718720 14817 33554432000 4194304 4955518 140737363062416 18446744073709551615 4228014 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19420/statm: 20195 14817 104 186 0 20008 0
[pid=19177/tid=19184] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19184/stat : 19184 (python) S 19175 19177 18093 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 9 0 658169778 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 0 0 0 0
[pid=19177/tid=19187] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19187/stat : 19187 (python) S 19175 19177 18093 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 658169779 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19190] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19190/stat : 19190 (python) S 19175 19177 18093 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 9 0 658169780 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19193] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19193/stat : 19193 (python) S 19175 19177 18093 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 9 0 658169781 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19204] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19204/stat : 19204 (python) S 19175 19177 18093 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 9 0 658179805 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19208] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19208/stat : 19208 (python) S 19175 19177 18093 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 658179808 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19410] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19410/stat : 19410 (python) S 19175 19177 18093 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 9 0 658228733 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19419] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19419/stat : 19419 (python) S 19175 19177 18093 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 658248368 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4791.02
Current children cumulated vsize (KiB) 5883704

[startup+1202.2 s]
/proc/loadavg: 8.37 8.30 8.14 9/390 19437
/proc/meminfo: memFree=19228168/32951124 swapFree=66457188/67111528
[pid=19177] ppid=19175 vsize=360944 CPUtime=0.61 cores=0,2,4,6
/proc/19177/stat : 19177 (python) S 19175 19177 18093 0 -1 4202496 16850 933 1 0 48 13 0 0 18 0 9 0 658169698 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19177/statm: 90236 7233 1890 364 0 26133 0
[pid=19183] ppid=19177 vsize=288744 CPUtime=0.26 cores=0,2,4,6
/proc/19183/stat : 19183 (python) S 19177 19177 18093 0 -1 4202560 1166 0 0 0 14 12 0 0 19 0 2 0 658169778 295673856 5630 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19183/statm: 72186 5630 416 364 0 8104 0
[pid=19185] ppid=19183 vsize=1017940 CPUtime=100.24 cores=0,2,4,6
/proc/19185/stat : 19185 (gnovelty+2) T 19183 19185 19185 0 -1 4202496 459 0 0 0 10024 0 0 0 25 0 1 0 658169778 1042370560 193 33554432000 134512640 135663704 4291051744 18446744073709551615 134547274 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/19185/statm: 254485 193 113 282 0 254201 0
[pid=19183/tid=19202] ppid=19177 vsize=288744 CPUtime=0 cores=0,2,4,6
/proc/19183/task/19202/stat : 19202 (python) S 19177 19177 18093 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658179804 295673856 5630 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604453811760192 0 0 -1 0 0 0 0
[pid=19186] ppid=19177 vsize=289424 CPUtime=2.2 cores=0,2,4,6
/proc/19186/stat : 19186 (python) S 19177 19177 18093 0 -1 4202560 1146 0 0 0 125 95 0 0 15 0 2 0 658169779 296370176 5766 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19186/statm: 72356 5766 400 364 0 8271 0
[pid=19188] ppid=19186 vsize=173280 CPUtime=814.19 cores=0,2,4,6
/proc/19188/stat : 19188 (march_hi) R 19186 19188 19188 0 -1 4202496 28395 0 0 0 81410 9 0 0 25 0 1 0 658169779 177438720 28110 33554432000 4194304 4955518 140736117772784 18446744073709551615 4227576 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/19188/statm: 43320 28110 104 186 0 43133 0
[pid=19186/tid=19220] ppid=19177 vsize=289424 CPUtime=0 cores=0,2,4,6
/proc/19186/task/19220/stat : 19220 (python) S 19177 19177 18093 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 658208968 296370176 5766 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604440904372480 0 0 -1 0 0 0 0
[pid=19189] ppid=19177 vsize=299680 CPUtime=0.27 cores=0,2,4,6
/proc/19189/stat : 19189 (python) S 19177 19177 18093 0 -1 4202560 1084 0 0 0 13 14 0 0 19 0 2 0 658169780 306872320 5770 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19189/statm: 74920 5770 400 364 0 10832 0
[pid=19191] ppid=19189 vsize=1017940 CPUtime=99.11 cores=0,2,4,6
/proc/19191/stat : 19191 (gnovelty+2) T 19189 19191 19191 0 -1 4202496 450 0 0 0 9911 0 0 0 25 0 1 0 658169780 1042370560 192 33554432000 134512640 135663704 4287330080 18446744073709551615 134545786 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/19191/statm: 254485 192 113 282 0 254201 0
[pid=19189/tid=19205] ppid=19177 vsize=299680 CPUtime=0 cores=0,2,4,6
/proc/19189/task/19205/stat : 19205 (python) S 19177 19177 18093 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 658179807 306872320 5770 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604451363439552 0 0 -1 4 0 0 0
[pid=19192] ppid=19177 vsize=309936 CPUtime=2.34 cores=0,2,4,6
/proc/19192/stat : 19192 (python) S 19177 19177 18093 0 -1 4202560 1167 0 0 0 125 109 0 0 15 0 2 0 658169781 317374464 5774 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19192/statm: 77484 5774 400 364 0 13393 0
[pid=19194] ppid=19192 vsize=173280 CPUtime=873.58 cores=0,2,4,6
/proc/19194/stat : 19194 (march_hi) T 19192 19194 19194 0 -1 4202496 30248 0 0 0 87351 7 0 0 25 0 1 0 658169781 177438720 29970 33554432000 4194304 4955518 140735086593696 18446744073709551615 4224758 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/19194/statm: 43320 29970 104 186 0 43133 0
[pid=19192/tid=19221] ppid=19177 vsize=309936 CPUtime=0 cores=0,2,4,6
/proc/19192/task/19221/stat : 19221 (python) S 19177 19177 18093 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658209015 317374464 5774 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604445691776000 0 0 -1 4 0 0 0
[pid=19203] ppid=19177 vsize=320192 CPUtime=2.61 cores=0,2,4,6
/proc/19203/stat : 19203 (python) S 19177 19177 18093 0 -1 4202560 1155 0 0 0 137 124 0 0 16 0 2 0 658179805 327876608 5778 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/19203/statm: 80048 5778 400 364 0 15954 0
[pid=19206] ppid=19203 vsize=173280 CPUtime=971.63 cores=0,2,4,6
/proc/19206/stat : 19206 (march_hi) T 19203 19206 19206 0 -1 4202496 33673 0 0 0 97151 12 0 0 25 0 1 0 658179807 177438720 33396 33554432000 4194304 4955518 140733954631632 18446744073709551615 4346411 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/19206/statm: 43320 33396 104 186 0 43133 0
[pid=19203/tid=19421] ppid=19177 vsize=320192 CPUtime=0 cores=0,2,4,6
/proc/19203/task/19421/stat : 19421 (python) S 19177 19177 18093 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 658248746 327876608 5778 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604453865500800 0 0 -1 6 0 0 0
[pid=19207] ppid=19177 vsize=330156 CPUtime=2.42 cores=0,2,4,6
/proc/19207/stat : 19207 (python) S 19177 19177 18093 0 -1 4202560 1149 0 0 0 133 109 0 0 15 0 2 0 658179808 338079744 5692 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19207/statm: 82539 5692 400 364 0 18442 0
[pid=19209] ppid=19207 vsize=173280 CPUtime=901.34 cores=0,2,4,6
/proc/19209/stat : 19209 (march_hi) R 19207 19209 19209 0 -1 4202496 31312 0 0 0 90124 10 0 0 25 0 1 0 658179808 177438720 31032 33554432000 4194304 4955518 140735023825744 18446744073709551615 4298080 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19209/statm: 43320 31032 104 186 0 43133 0
[pid=19207/tid=19417] ppid=19177 vsize=330156 CPUtime=0 cores=0,2,4,6
/proc/19207/task/19417/stat : 19417 (python) S 19177 19177 18093 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 658248367 338079744 5692 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 514 18446604449460672640 0 0 -1 0 0 0 0
[pid=19409] ppid=19177 vsize=341004 CPUtime=1.53 cores=0,2,4,6
/proc/19409/stat : 19409 (python) S 19177 19177 18093 0 -1 4202560 991 0 0 0 77 76 0 0 18 0 1 0 658228733 349188096 5814 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 5245356559747219714 0 0 17 4 0 0 0
/proc/19409/statm: 85251 5814 371 364 0 21151 0
[pid=19411] ppid=19409 vsize=182584 CPUtime=609.66 cores=0,2,4,6
/proc/19411/stat : 19411 (kcnfs-2006) R 19409 19411 19411 0 -1 4202496 651 0 0 0 60966 0 0 0 25 0 1 0 658228733 186966016 389 33554432000 134512640 135163436 4292795120 18446744073709551615 134675110 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/19411/statm: 45646 389 77 159 0 45486 0
[pid=19418] ppid=19177 vsize=351260 CPUtime=1.09 cores=0,2,4,6
/proc/19418/stat : 19418 (python) S 19177 19177 18093 0 -1 4202560 1053 0 0 0 56 53 0 0 15 0 1 0 658248368 359690240 5833 33554432000 4194304 5683644 140736326048592 18446744073709551615 232335912518 0 0 16781312 514 5245356559747219714 0 0 17 6 0 0 0
/proc/19418/statm: 87815 5833 377 364 0 23712 0
[pid=19420] ppid=19418 vsize=80780 CPUtime=408.74 cores=0,2,4,6
/proc/19420/stat : 19420 (march_hi) R 19418 19420 19420 0 -1 4202496 15110 0 0 0 40870 4 0 0 25 0 1 0 658248368 82718720 14823 33554432000 4194304 4955518 140737363062416 18446744073709551615 4244774 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/19420/statm: 20195 14823 104 186 0 20008 0
[pid=19177/tid=19184] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19184/stat : 19184 (python) S 19175 19177 18093 0 -1 4202560 27 933 0 0 0 0 0 0 19 0 9 0 658169778 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 0 0 0 0
[pid=19177/tid=19187] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19187/stat : 19187 (python) S 19175 19177 18093 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 658169779 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19190] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19190/stat : 19190 (python) S 19175 19177 18093 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 9 0 658169780 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19193] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19193/stat : 19193 (python) S 19175 19177 18093 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 9 0 658169781 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19204] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19204/stat : 19204 (python) S 19175 19177 18093 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 9 0 658179805 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 6 0 0 0
[pid=19177/tid=19208] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19208/stat : 19208 (python) S 19175 19177 18093 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 658179808 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19410] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19410/stat : 19410 (python) S 19175 19177 18093 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 9 0 658228733 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
[pid=19177/tid=19419] ppid=19175 vsize=360944 CPUtime=0 cores=0,2,4,6
/proc/19177/task/19419/stat : 19419 (python) S 19175 19177 18093 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 658248368 369606656 7233 33554432000 4194304 5683644 140736326048592 18446744073709551615 232347716017 0 0 16781312 2 18446604447970030784 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4791.82
Current children cumulated vsize (KiB) 5883704

Child status: 0
Real time (s): 1202.29
CPU time (s): 4792.25
CPU user time (s): 4785.66
CPU system time (s): 6.592
CPU usage (%): 398.593
Max. virtual memory (cumulated for all children) (KiB): 5883704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4785.66
system time used= 6.592
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 171448
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9414
involuntary context switches= 77203

runsolver used 4.55031 second user time and 9.41157 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-15 15:21:55
IDJOB=3378459
IDBENCH=82868
IDSOLVER=1859
FILE ID=node132/3378459-1305465715
RUNJOBID= node132-1305463312-18111
PBS_JOBID= 13324991
Free space on /tmp= 73312 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v650-c2769-S960948361-055.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378459-1305465715/watcher-3378459-1305465715 -o /tmp/evaluation-result-3378459-1305465715/solver-3378459-1305465715 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378459-1305465715.cnf -seed 1087263410 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b51753a48e6efd66554e7afe4efc3b19
RANDOM SEED=1087263410

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19963628 kB
Buffers:        305612 kB
Cached:        5997640 kB
SwapCached:       6904 kB
Active:        6220516 kB
Inactive:      6431564 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19963628 kB
SwapTotal:    67111528 kB
SwapFree:     66457188 kB
Dirty:           31516 kB
Writeback:           0 kB
AnonPages:     6346696 kB
Mapped:          30252 kB
Slab:           228164 kB
PageTables:      43144 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 67340712 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73280 MiB
End job on node132 at 2011-05-15 15:41:58