Trace number 3386499

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 3450.98 3440.84

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S1348818483-020-UNKNOWN.cnf
MD5SUM112b17aaf1cede32f350e11f6333fc88
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.38/0.97	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.38/0.97	c INFO: solving HOME/instance-3386499-1305586150.cnf
0.38/0.97	c INFO: computing task features
0.44/1.08	c INFO: computed variable-clause graph statistics
0.44/1.08	c INFO: computed clause balance statistics
1.04/1.69	c INFO: computed variable balance statistics
1.34/1.93	c INFO: computed small-clause counts
1.34/1.93	c INFO: computed Horn-clause counts
1.34/1.95	c INFO: computed variable graph statistics
1.34/1.95	c INFO: collected features for HOME/instance-3386499-1305586150.cnf in 0.98 s
1.34/1.98	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.35)
101.89/102.31	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.12)
200.57/200.66	c INFO: running adaptg2wsat2009++@0 for 97 with 4800 remaining (b = 0.08)
300.14/299.99	c INFO: running adaptg2wsat2009++@0 for 97 with 4701 remaining (b = 0.06)
400.85/400.32	c INFO: running adaptg2wsat2009++@0 for 97 with 4600 remaining (b = 0.05)
501.34/500.64	c INFO: running gnovelty+2@0 for 97 with 4500 remaining (b = 0.04)
602.04/601.02	c INFO: running FH@0 for 97 with 4400 remaining (b = 0.03)
702.65/701.35	c INFO: running adaptg2wsat2009++@0 for 97 with 4299 remaining (b = 0.03)
802.21/800.69	c INFO: running adaptg2wsat2009++@0 for 97 with 4200 remaining (b = 0.02)
901.92/900.06	c INFO: running FH@0 for 97 with 4101 remaining (b = 0.02)
1001.64/999.41	c INFO: running hybridGM3@0 for 194 with 4001 remaining (b = 0.04)
1198.83/1196.09	c INFO: running gnovelty+2@0 for 97 with 3805 remaining (b = 0.02)
1299.55/1296.49	c INFO: running hybridGM3@0 for 194 with 3704 remaining (b = 0.03)
1494.99/1491.20	c INFO: running hybridGM3@0 for 194 with 3510 remaining (b = 0.03)
1690.30/1685.95	c INFO: running TNM@0 for 1552 with 3315 remaining (b = 0.20)
3249.63/3240.09	c INFO: running adaptg2wsat2009++@0 for 97 with 1761 remaining (b = 0.01)
3350.34/3340.46	c INFO: running FH@0 for 97 with 1660 remaining (b = 0.01)
3450.08/3439.82	c INFO: running hybridGM3@0 for 194 with 1561 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386499-1305586150/watcher-3386499-1305586150 -o /tmp/evaluation-result-3386499-1305586150/solver-3386499-1305586150 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386499-1305586150.cnf -seed 865129503 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.08 0.02 0.81 1/393 2540
/proc/meminfo: memFree=12585880/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 616 0 0 0 0 0 0 0 20 0 1 0 670214687 15441920 513 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 0
/proc/2540/statm: 3770 513 300 364 0 257 0

[startup+0.053673 s]
/proc/loadavg: 0.08 0.02 0.81 1/393 2540
/proc/meminfo: memFree=12585880/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=18888 CPUtime=0.02 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 1250 0 0 0 1 1 0 0 20 0 1 0 670214687 19341312 1105 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 0
/proc/2540/statm: 4722 1105 421 364 0 691 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18888

[startup+0.100664 s]
/proc/loadavg: 0.08 0.02 0.81 1/393 2540
/proc/meminfo: memFree=12585880/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=43624 CPUtime=0.04 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 1879 0 0 0 3 1 0 0 20 0 1 0 670214687 44670976 1654 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 0
/proc/2540/statm: 10906 1654 467 364 0 1171 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 43624

[startup+0.300626 s]
/proc/loadavg: 0.08 0.02 0.81 1/393 2540
/proc/meminfo: memFree=12585880/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=121648 CPUtime=0.11 cores=1,3,5,7
/proc/2540/stat : 2540 (python) R 2538 2540 2509 0 -1 4202496 4123 0 1 0 8 3 0 0 19 0 1 0 670214687 124567552 3741 33554432000 4194304 5683644 140737003317488 18446744073709551615 4286571 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2540/statm: 30412 3741 986 364 0 2742 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 121648

[startup+0.700612 s]
/proc/loadavg: 0.08 0.02 0.81 1/393 2540
/proc/meminfo: memFree=12585880/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=190256 CPUtime=0.27 cores=1,3,5,7
/proc/2540/stat : 2540 (python) R 2538 2540 2509 0 -1 4202496 6896 934 1 0 17 10 0 0 16 0 1 0 670214687 194822144 4942 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080228197 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2540/statm: 47564 4942 1422 364 0 3724 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 190256

[startup+1.5004 s]
/proc/loadavg: 0.08 0.02 0.81 3/399 2554
/proc/meminfo: memFree=12514848/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=282560 CPUtime=0.94 cores=1,3,5,7
/proc/2540/stat : 2540 (python) R 2538 2540 2509 0 -1 4202496 11219 934 1 0 81 13 0 0 16 0 1 0 670214687 289341440 8052 33554432000 4194304 5683644 140737003317488 18446744073709551615 4509181 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2540/statm: 70640 8052 1826 364 0 6564 0
Current children cumulated CPU time (s) 0.94
Current children cumulated vsize (KiB) 282560

[startup+3.10109 s]
/proc/loadavg: 0.08 0.02 0.81 3/402 2561
/proc/meminfo: memFree=12485932/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=289440 CPUtime=1.42 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 11593 934 1 0 128 14 0 0 19 0 2 0 670214687 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2540/statm: 72360 7232 1877 364 0 8278 0
[pid=2559] ppid=2540 vsize=279196 CPUtime=0 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 670214885 285896704 5705 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252431 0 0 16781312 514 4701793474519728392 0 0 17 1 0 0 0
/proc/2559/statm: 69799 5705 354 364 0 5717 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=1.11 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) R 2559 2561 2561 0 -1 4202496 764 0 0 0 111 0 0 0 22 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=289440 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 670214886 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.53
Current children cumulated vsize (KiB) 1587252

[startup+6.30048 s]
/proc/loadavg: 0.23 0.05 0.81 3/405 2564
/proc/meminfo: memFree=12468052/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=289440 CPUtime=1.42 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 11593 934 1 0 128 14 0 0 19 0 2 0 670214687 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2540/statm: 72360 7232 1877 364 0 8278 0
[pid=2559] ppid=2540 vsize=279196 CPUtime=0 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 876 0 0 0 0 0 0 0 18 0 1 0 670214885 285896704 5728 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252431 0 0 16781312 514 4701793474519728392 0 0 17 1 0 0 0
/proc/2559/statm: 69799 5728 377 364 0 5717 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=4.31 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) R 2559 2561 2561 0 -1 4202496 764 0 0 0 431 0 0 0 25 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134545776 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=289440 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 670214886 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.73
Current children cumulated vsize (KiB) 1587252

[startup+12.7003 s]
/proc/loadavg: 0.37 0.08 0.82 3/405 2564
/proc/meminfo: memFree=12467796/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=289440 CPUtime=1.42 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 11593 934 1 0 128 14 0 0 19 0 2 0 670214687 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2540/statm: 72360 7232 1877 364 0 8278 0
[pid=2559] ppid=2540 vsize=279196 CPUtime=0.02 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 878 0 0 0 1 1 0 0 18 0 1 0 670214885 285896704 5728 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252431 0 0 16781312 514 12026757251776610568 0 0 17 1 0 0 0
/proc/2559/statm: 69799 5728 377 364 0 5717 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=10.71 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) R 2559 2561 2561 0 -1 4202496 764 0 0 0 1071 0 0 0 25 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134525213 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=289440 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 670214886 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.15
Current children cumulated vsize (KiB) 1587252

[startup+25.5008 s]
/proc/loadavg: 0.73 0.18 0.84 3/405 2564
/proc/meminfo: memFree=12468676/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=289440 CPUtime=1.42 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 11593 934 1 0 128 14 0 0 19 0 2 0 670214687 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2540/statm: 72360 7232 1877 364 0 8278 0
[pid=2559] ppid=2540 vsize=279196 CPUtime=0.06 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 885 0 0 0 3 3 0 0 18 0 1 0 670214885 285896704 5728 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252431 0 0 16781312 514 12026757251776610568 0 0 17 1 0 0 0
/proc/2559/statm: 69799 5728 377 364 0 5717 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=23.51 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) R 2559 2561 2561 0 -1 4202496 764 0 0 0 2351 0 0 0 25 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=289440 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 670214886 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.99
Current children cumulated vsize (KiB) 1587252

[startup+51.1009 s]
/proc/loadavg: 1.16 0.32 0.87 3/405 2600
/proc/meminfo: memFree=12495464/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=289440 CPUtime=1.42 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 11593 934 1 0 128 14 0 0 19 0 2 0 670214687 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2540/statm: 72360 7232 1877 364 0 8278 0
[pid=2559] ppid=2540 vsize=279196 CPUtime=0.13 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 897 0 0 0 7 6 0 0 18 0 1 0 670214885 285896704 5728 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252431 0 0 16781312 514 12026757251776610568 0 0 17 7 0 0 0
/proc/2559/statm: 69799 5728 377 364 0 5717 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=49.11 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) R 2559 2561 2561 0 -1 4202496 764 0 0 0 4911 0 0 0 25 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134525229 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=289440 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 670214886 296386560 7232 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 1587252

[startup+102.314 s]
/proc/loadavg: 1.69 0.59 0.93 3/405 2601
/proc/meminfo: memFree=12494028/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=289656 CPUtime=1.45 cores=1,3,5,7
/proc/2540/stat : 2540 (python) R 2538 2540 2509 0 -1 4202496 12215 934 1 0 131 14 0 0 18 0 2 0 670214687 296607744 7301 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080052629 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2540/statm: 72414 7301 1878 364 0 8329 0
[pid=2559] ppid=2540 vsize=289440 CPUtime=0.28 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 1071 0 0 0 15 13 0 0 19 0 2 0 670214885 296386560 5766 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2559/statm: 72360 5766 410 364 0 8278 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=100.29 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) T 2559 2561 2561 0 -1 4202496 764 0 0 0 10029 0 0 0 25 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134525278 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=289656 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 2 0 670214886 296607744 7301 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 102.02
Current children cumulated vsize (KiB) 1597712

[startup+162.301 s]
/proc/loadavg: 1.89 0.85 0.99 3/413 2611
/proc/meminfo: memFree=12481404/32950928 swapFree=57376972/67111528
[pid=2540] ppid=2538 vsize=299900 CPUtime=1.45 cores=1,3,5,7
/proc/2540/stat : 2540 (python) S 2538 2540 2509 0 -1 4202496 12434 934 1 0 131 14 0 0 20 0 3 0 670214687 307097600 7307 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/2540/statm: 74975 7307 1880 364 0 10890 0
[pid=2559] ppid=2540 vsize=289440 CPUtime=0.28 cores=1,3,5,7
/proc/2559/stat : 2559 (python) S 2540 2540 2509 0 -1 4202560 1071 0 0 0 15 13 0 0 19 0 2 0 670214885 296386560 5766 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2559/statm: 72360 5766 410 364 0 8278 0
[pid=2561] ppid=2559 vsize=1018616 CPUtime=100.29 cores=1,3,5,7
/proc/2561/stat : 2561 (gnovelty+2) T 2559 2561 2561 0 -1 4202496 764 0 0 0 10029 0 0 0 25 0 1 0 670214886 1043062784 501 33554432000 134512640 135663704 4287111728 18446744073709551615 134525278 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2561/statm: 254654 501 113 282 0 254370 0
[pid=2559/tid=2602] ppid=2540 vsize=289440 CPUtime=0 cores=1,3,5,7
/proc/2559/task/2602/stat : 2602 (python) S 2540 2540 2509 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670224916 296386560 5766 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604466892316736 0 0 -1 7 0 0 0
[pid=2603] ppid=2540 vsize=289656 CPUtime=0.17 cores=1,3,5,7
/proc/2603/stat : 2603 (python) S 2540 2540 2509 0 -1 4202560 910 0 0 0 8 9 0 0 18 0 1 0 670224919 296607744 5794 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252486 0 0 16781312 514 12026757251776610568 0 0 17 7 0 0 0
/proc/2603/statm: 72414 5794 371 364 0 8329 0
[pid=2605] ppid=2603 vsize=1018616 CPUtime=59.98 cores=1,3,5,7
/proc/2605/stat : 2605 (gnovelty+2) R 2603 2605 2605 0 -1 4202496 765 0 0 0 5998 0 0 0 25 0 1 0 670224919 1043062784 500 33554432000 134512640 135663704 4290468208 18446744073709551615 134545187 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2605/statm: 254654 500 113 282 0 254370 0
[pid=2540/tid=2560] ppid=2538 vsize=299900 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 3 0 670214886 307097600 7307 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2604] ppid=2538 vsize=299900 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2604/stat : 2604 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 3 0 670224919 307097600 7307 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 162.17

################
# More data... #
################

[pid=2625] ppid=2540 vsize=310776 CPUtime=0.29 cores=1,3,5,7
/proc/2625/stat : 2625 (python) S 2540 2540 2509 0 -1 4202560 1094 0 0 0 16 13 0 0 19 0 2 0 670244687 318234624 5967 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2625/statm: 77694 5967 400 364 0 13603 0
[pid=2627] ppid=2625 vsize=418636 CPUtime=100.28 cores=1,3,5,7
/proc/2627/stat : 2627 (adaptg2wsat2009) T 2625 2627 2627 0 -1 4202496 1222 0 0 0 10028 0 0 0 25 0 1 0 670244687 428683264 956 33554432000 134512640 135107411 4287140912 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/2627/statm: 104659 956 59 146 0 103535 0
[pid=2625/tid=2634] ppid=2540 vsize=310776 CPUtime=0 cores=1,3,5,7
/proc/2625/task/2634/stat : 2634 (python) S 2540 2540 2509 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670254716 318234624 5967 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604460714695424 0 0 -1 7 0 0 0
[pid=2635] ppid=2540 vsize=321032 CPUtime=0.3 cores=1,3,5,7
/proc/2635/stat : 2635 (python) S 2540 2540 2509 0 -1 4202560 1100 0 0 0 16 14 0 0 19 0 2 0 670254720 328736768 5971 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/2635/statm: 80258 5971 400 364 0 16164 0
[pid=2637] ppid=2635 vsize=418636 CPUtime=100.19 cores=1,3,5,7
/proc/2637/stat : 2637 (adaptg2wsat2009) T 2635 2637 2637 0 -1 4202496 1223 0 0 0 10019 0 0 0 25 0 1 0 670254720 428683264 956 33554432000 134512640 135107411 4287633296 18446744073709551615 134532017 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/2637/statm: 104659 956 59 146 0 103535 0
[pid=2635/tid=2645] ppid=2540 vsize=321032 CPUtime=0 cores=1,3,5,7
/proc/2635/task/2645/stat : 2645 (python) S 2540 2540 2509 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 670264749 328736768 5971 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604467037742144 0 0 -1 7 0 0 0
[pid=2646] ppid=2540 vsize=331288 CPUtime=0.3 cores=1,3,5,7
/proc/2646/stat : 2646 (python) S 2540 2540 2509 0 -1 4202560 1127 0 0 0 16 14 0 0 19 0 2 0 670264752 339238912 5975 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2646/statm: 82822 5975 400 364 0 18725 0
[pid=2648] ppid=2646 vsize=1018616 CPUtime=100.33 cores=1,3,5,7
/proc/2648/stat : 2648 (gnovelty+2) T 2646 2648 2648 0 -1 4202496 765 0 0 0 10033 0 0 0 25 0 1 0 670264753 1043062784 500 33554432000 134512640 135663704 4294044608 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2648/statm: 254654 500 113 282 0 254370 0
[pid=2646/tid=2656] ppid=2540 vsize=331288 CPUtime=0 cores=1,3,5,7
/proc/2646/task/2656/stat : 2656 (python) S 2540 2540 2509 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670274786 339238912 5975 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604464758493632 0 0 -1 1 0 0 0
[pid=2657] ppid=2540 vsize=341544 CPUtime=0.3 cores=1,3,5,7
/proc/2657/stat : 2657 (python) S 2540 2540 2509 0 -1 4202560 1174 0 0 0 16 14 0 0 16 0 2 0 670274789 349741056 5985 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2657/statm: 85386 5985 406 364 0 21286 0
[pid=2659] ppid=2657 vsize=248652 CPUtime=100.29 cores=1,3,5,7
/proc/2659/stat : 2659 (FH) T 2657 2659 2659 0 -1 4202496 1126 0 0 0 10029 0 0 0 25 0 1 0 670274790 254619648 857 33554432000 134512640 134936988 4291904832 18446744073709551615 134554229 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2659/statm: 62163 857 41 104 0 61667 0
[pid=2657/tid=2666] ppid=2540 vsize=341544 CPUtime=0 cores=1,3,5,7
/proc/2657/task/2666/stat : 2666 (python) S 2540 2540 2509 0 -1 4202560 97 0 0 0 0 0 0 0 16 0 2 0 670284819 349741056 5985 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604460714693632 0 0 -1 7 0 0 0
[pid=2667] ppid=2540 vsize=351800 CPUtime=0.3 cores=1,3,5,7
/proc/2667/stat : 2667 (python) S 2540 2540 2509 0 -1 4202560 1164 0 0 0 15 15 0 0 19 0 2 0 670284823 360243200 5989 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2667/statm: 87950 5989 406 364 0 23847 0
[pid=2669] ppid=2667 vsize=418636 CPUtime=99.29 cores=1,3,5,7
/proc/2669/stat : 2669 (adaptg2wsat2009) T 2667 2669 2669 0 -1 4202496 1231 0 0 0 9929 0 0 0 25 0 1 0 670284823 428683264 955 33554432000 134512640 135107411 4292577088 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2669/statm: 104659 955 59 146 0 103535 0
[pid=2667/tid=2686] ppid=2540 vsize=351800 CPUtime=0 cores=1,3,5,7
/proc/2667/task/2686/stat : 2686 (python) S 2540 2540 2509 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670294753 360243200 5989 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604468767897792 0 0 -1 1 0 0 0
[pid=2687] ppid=2540 vsize=362056 CPUtime=0.32 cores=1,3,5,7
/proc/2687/stat : 2687 (python) S 2540 2540 2509 0 -1 4202560 1142 0 0 0 16 16 0 0 19 0 2 0 670294757 370745344 5987 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2687/statm: 90514 5987 400 364 0 26408 0
[pid=2689] ppid=2687 vsize=418636 CPUtime=99.32 cores=1,3,5,7
/proc/2689/stat : 2689 (adaptg2wsat2009) T 2687 2689 2689 0 -1 4202496 1230 0 0 0 9932 0 0 0 25 0 1 0 670294757 428683264 956 33554432000 134512640 135107411 4291188304 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2689/statm: 104659 956 59 146 0 103535 0
[pid=2687/tid=2700] ppid=2540 vsize=362056 CPUtime=0 cores=1,3,5,7
/proc/2687/task/2700/stat : 2700 (python) S 2540 2540 2509 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 670304690 370745344 5987 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604457251451968 0 0 -1 7 0 0 0
[pid=2701] ppid=2540 vsize=372588 CPUtime=0.31 cores=1,3,5,7
/proc/2701/stat : 2701 (python) S 2540 2540 2509 0 -1 4202560 1119 0 0 0 16 15 0 0 17 0 2 0 670304694 381530112 6060 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2701/statm: 93147 6060 400 364 0 29038 0
[pid=2703] ppid=2701 vsize=248652 CPUtime=99.31 cores=1,3,5,7
/proc/2703/stat : 2703 (FH) T 2701 2703 2703 0 -1 4202496 1127 0 0 0 9931 0 0 0 25 0 1 0 670304694 254619648 857 33554432000 134512640 134936988 4288724176 18446744073709551615 134552080 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2703/statm: 62163 857 41 104 0 61667 0
[pid=2701/tid=2710] ppid=2540 vsize=372588 CPUtime=0 cores=1,3,5,7
/proc/2701/task/2710/stat : 2710 (python) S 2540 2540 2509 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 670314625 381530112 6060 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604464758494528 0 0 -1 7 0 0 0
[pid=2711] ppid=2540 vsize=382844 CPUtime=0.62 cores=1,3,5,7
/proc/2711/stat : 2711 (python) S 2540 2540 2509 0 -1 4202560 1152 0 0 0 31 31 0 0 17 0 2 0 670314629 392032256 6064 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2711/statm: 95711 6064 400 364 0 31599 0
[pid=2713] ppid=2711 vsize=268424 CPUtime=196.64 cores=1,3,5,7
/proc/2713/stat : 2713 (hybridGM3) T 2711 2713 2713 0 -1 4202496 5166 0 0 0 19664 0 0 0 25 0 1 0 670314629 274866176 4897 33554432000 134512640 135204385 4294146432 18446744073709551615 134537891 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2713/statm: 67106 4897 63 169 0 66936 0
[pid=2711/tid=2723] ppid=2540 vsize=382844 CPUtime=0 cores=1,3,5,7
/proc/2711/task/2723/stat : 2723 (python) S 2540 2540 2509 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 670334294 392032256 6064 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604457050417216 0 0 -1 7 0 0 0
[pid=2724] ppid=2540 vsize=393100 CPUtime=0.32 cores=1,3,5,7
/proc/2724/stat : 2724 (python) S 2540 2540 2509 0 -1 4202560 1135 0 0 0 15 17 0 0 19 0 2 0 670334297 402534400 6068 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2724/statm: 98275 6068 400 364 0 34160 0
[pid=2726] ppid=2724 vsize=1018616 CPUtime=100.35 cores=1,3,5,7
/proc/2726/stat : 2726 (gnovelty+2) T 2724 2726 2726 0 -1 4202496 772 0 0 0 10035 0 0 0 25 0 1 0 670334298 1043062784 500 33554432000 134512640 135663704 4291568416 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2726/statm: 254654 500 113 282 0 254370 0
[pid=2724/tid=2734] ppid=2540 vsize=393100 CPUtime=0 cores=1,3,5,7
/proc/2724/task/2734/stat : 2734 (python) S 2540 2540 2509 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670344333 402534400 6068 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604463653611392 0 0 -1 7 0 0 0
[pid=2735] ppid=2540 vsize=403356 CPUtime=0.63 cores=1,3,5,7
/proc/2735/stat : 2735 (python) S 2540 2540 2509 0 -1 4202560 1162 0 0 0 32 31 0 0 19 0 2 0 670344337 413036544 6091 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2735/statm: 100839 6091 400 364 0 36721 0
[pid=2737] ppid=2735 vsize=268428 CPUtime=194.67 cores=1,3,5,7
/proc/2737/stat : 2737 (hybridGM3) T 2735 2737 2737 0 -1 4202496 5169 0 0 0 19467 0 0 0 25 0 1 0 670344337 274870272 4897 33554432000 134512640 135204385 4293539248 18446744073709551615 134537776 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2737/statm: 67107 4897 63 169 0 66937 0
[pid=2735/tid=2751] ppid=2540 vsize=403356 CPUtime=0 cores=1,3,5,7
/proc/2735/task/2751/stat : 2751 (python) S 2540 2540 2509 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670363805 413036544 6091 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604469655327104 0 0 -1 7 0 0 0
[pid=2752] ppid=2540 vsize=413612 CPUtime=0.64 cores=1,3,5,7
/proc/2752/stat : 2752 (python) S 2540 2540 2509 0 -1 4202560 1169 0 0 0 33 31 0 0 19 0 2 0 670363808 423538688 6095 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2752/statm: 103403 6095 400 364 0 39282 0
[pid=2754] ppid=2752 vsize=268424 CPUtime=194.69 cores=1,3,5,7
/proc/2754/stat : 2754 (hybridGM3) T 2752 2754 2754 0 -1 4202496 5169 0 0 0 19469 0 0 0 25 0 1 0 670363809 274866176 4897 33554432000 134512640 135204385 4291615296 18446744073709551615 134538284 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2754/statm: 67106 4897 63 169 0 66936 0
[pid=2752/tid=2765] ppid=2540 vsize=413612 CPUtime=0 cores=1,3,5,7
/proc/2752/task/2765/stat : 2765 (python) S 2540 2540 2509 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670383279 423538688 6095 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604471078502784 0 0 -1 7 0 0 0
[pid=2766] ppid=2540 vsize=423868 CPUtime=5.25 cores=1,3,5,7
/proc/2766/stat : 2766 (python) S 2540 2540 2509 0 -1 4202560 1231 0 0 0 285 240 0 0 19 0 2 0 670383282 434040832 6107 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2766/statm: 105967 6107 408 364 0 41843 0
[pid=2768] ppid=2766 vsize=457128 CPUtime=1554.11 cores=1,3,5,7
/proc/2768/stat : 2768 (TNM) T 2766 2768 2768 0 -1 4202496 1112 0 0 0 155411 0 0 0 25 0 1 0 670383283 468099072 837 33554432000 134512640 135008748 4291070080 18446744073709551615 134529367 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/2768/statm: 114282 837 46 122 0 113182 0
[pid=2766/tid=2819] ppid=2540 vsize=423868 CPUtime=0 cores=1,3,5,7
/proc/2766/task/2819/stat : 2819 (python) S 2540 2540 2509 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670538695 434040832 6107 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604471078504576 0 0 -1 7 0 0 0
[pid=2820] ppid=2540 vsize=434124 CPUtime=0.33 cores=1,3,5,7
/proc/2820/stat : 2820 (python) S 2540 2540 2509 0 -1 4202560 1177 0 0 0 17 16 0 0 19 0 2 0 670538697 444542976 6110 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2820/statm: 108531 6110 407 364 0 44404 0
[pid=2822] ppid=2820 vsize=418636 CPUtime=100.34 cores=1,3,5,7
/proc/2822/stat : 2822 (adaptg2wsat2009) T 2820 2822 2822 0 -1 4202496 1231 0 0 0 10034 0 0 0 25 0 1 0 670538697 428683264 956 33554432000 134512640 135107411 4293097536 18446744073709551615 134531950 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/2822/statm: 104659 956 59 146 0 103535 0
[pid=2820/tid=2830] ppid=2540 vsize=434124 CPUtime=0 cores=1,3,5,7
/proc/2820/task/2830/stat : 2830 (python) S 2540 2540 2509 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670548732 444542976 6110 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604457050415424 0 0 -1 7 0 0 0
[pid=2831] ppid=2540 vsize=444552 CPUtime=0.33 cores=1,3,5,7
/proc/2831/stat : 2831 (python) S 2540 2540 2509 0 -1 4202560 1172 0 0 0 19 14 0 0 19 0 2 0 670548734 455221248 6132 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/2831/statm: 111138 6132 401 364 0 47008 0
[pid=2833] ppid=2831 vsize=248648 CPUtime=99.32 cores=1,3,5,7
/proc/2833/stat : 2833 (FH) T 2831 2833 2833 0 -1 4202496 1132 0 0 0 9932 0 0 0 25 0 1 0 670548735 254615552 857 33554432000 134512640 134936988 4289442256 18446744073709551615 134544749 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2833/statm: 62162 857 41 104 0 61666 0
[pid=2831/tid=2840] ppid=2540 vsize=444552 CPUtime=0 cores=1,3,5,7
/proc/2831/task/2840/stat : 2840 (python) S 2540 2540 2509 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670558668 455221248 6132 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 514 18446604469840537792 0 0 -1 3 0 0 0
[pid=2841] ppid=2540 vsize=454996 CPUtime=0 cores=1,3,5,7
/proc/2841/stat : 2841 (python) S 2540 2540 2509 0 -1 4202560 842 0 0 0 0 0 0 0 19 0 1 0 670558670 465915904 6130 33554432000 4194304 5683644 140737003317488 18446744073709551615 208080252486 0 0 16781312 514 3566763223120084991 0 0 17 5 0 0 0
/proc/2841/statm: 113749 6130 349 364 0 49616 0
[pid=2843] ppid=2841 vsize=268420 CPUtime=0.88 cores=1,3,5,7
/proc/2843/stat : 2843 (hybridGM3) R 2841 2843 2843 0 -1 4202496 5169 0 0 0 88 0 0 0 23 0 1 0 670558670 274862080 4895 33554432000 134512640 135204385 4292862096 18446744073709551615 134537776 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2843/statm: 67105 4895 63 169 0 66935 0
[pid=2540/tid=2560] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2560/stat : 2560 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 19 0 19 0 670214886 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2604] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2604/stat : 2604 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670224919 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 3 0 0 0
[pid=2540/tid=2615] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2615/stat : 2615 (python) S 2538 2540 2509 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 670234754 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 3 0 0 0
[pid=2540/tid=2626] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2626/stat : 2626 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670244687 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 5 0 0 0
[pid=2540/tid=2636] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2636/stat : 2636 (python) S 2538 2540 2509 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 19 0 670254720 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 5 0 0 0
[pid=2540/tid=2647] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2647/stat : 2647 (python) S 2538 2540 2509 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 670264752 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 7 0 0 0
[pid=2540/tid=2658] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2658/stat : 2658 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 670274790 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 7 0 0 0
[pid=2540/tid=2668] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2668/stat : 2668 (python) S 2538 2540 2509 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 19 0 670284823 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 7 0 0 0
[pid=2540/tid=2688] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2688/stat : 2688 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 670294757 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2702] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2702/stat : 2702 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670304694 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2712] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2712/stat : 2712 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670314629 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 7 0 0 0
[pid=2540/tid=2725] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2725/stat : 2725 (python) S 2538 2540 2509 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 670334297 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2736] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2736/stat : 2736 (python) S 2538 2540 2509 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 670344337 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2753] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2753/stat : 2753 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670363809 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 1 0 0 0
[pid=2540/tid=2767] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2767/stat : 2767 (python) S 2538 2540 2509 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 19 0 670383283 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 3 0 0 0
[pid=2540/tid=2821] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2821/stat : 2821 (python) S 2538 2540 2509 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 670538697 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 3 0 0 0
[pid=2540/tid=2832] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2832/stat : 2832 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670548734 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 5 0 0 0
[pid=2540/tid=2842] ppid=2538 vsize=465240 CPUtime=0 cores=1,3,5,7
/proc/2540/task/2842/stat : 2842 (python) S 2538 2540 2509 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 670558670 476405760 7697 33554432000 4194304 5683644 140737003317488 18446744073709551615 208092055985 0 0 16781312 2 18446604466892319424 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3450.98
Current children cumulated vsize (KiB) 15949448

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2540 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=818723
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=191970
# CPU time returned by wait4() is 2.01069
# while last known CPU time is 3450.98
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3440.84
CPU time (s): 3450.98
CPU user time (s): 3445.57
CPU system time (s): 5.41
CPU usage (%): 100.295
Max. virtual memory (cumulated for all children) (KiB): 15949448

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.81872
system time used= 0.19197
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29158
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3764
involuntary context switches= 44

runsolver used 24.0783 second user time and 49.3565 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-17 00:49:10
IDJOB=3386499
IDBENCH=82564
IDSOLVER=1872
FILE ID=node127/3386499-1305586150
RUNJOBID= node127-1305586146-2528
PBS_JOBID= 13350351
Free space on /tmp= 73384 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S1348818483-020-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386499-1305586150/watcher-3386499-1305586150 -o /tmp/evaluation-result-3386499-1305586150/solver-3386499-1305586150 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386499-1305586150.cnf -seed 865129503 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 112b17aaf1cede32f350e11f6333fc88
RANDOM SEED=865129503

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12586160 kB
Buffers:         86752 kB
Cached:         505444 kB
SwapCached:     117904 kB
Active:        5582480 kB
Inactive:     14559324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12586160 kB
SwapTotal:    67111528 kB
SwapFree:     57376972 kB
Dirty:           32456 kB
Writeback:           0 kB
AnonPages:    19438288 kB
Mapped:          25988 kB
Slab:            74372 kB
PageTables:      80788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 84613052 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73320 MiB
End job on node127 at 2011-05-17 01:46:33