Trace number 3321947

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 1669.49 213.11

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v450-c1917-S367251957-028.UNKNOWN.cnf
MD5SUM6ae9d83c80bad27a7e5f57fa7d9ee7b1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark207.124
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1917
Sum of the clauses size5751
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31917
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.41/3.97	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.41/3.97	c INFO: solving HOME/instance-3321947-1307741596.cnf
0.41/3.97	c INFO: computing task features
0.41/3.98	c INFO: computed variable-clause graph statistics
0.41/3.98	c INFO: computed clause balance statistics
0.47/4.01	c INFO: computed variable balance statistics
0.47/4.04	c INFO: computed small-clause counts
0.47/4.04	c INFO: computed Horn-clause counts
0.47/4.04	c INFO: computed variable graph statistics
0.47/4.04	c INFO: collected features for HOME/instance-3321947-1307741596.cnf in 0.07 s
0.47/4.09	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.57)
0.55/4.12	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.36)
0.55/4.16	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.32)
0.65/4.20	c INFO: running march_hi@0 for 97 with 39999 remaining (b = 0.11)
0.65/4.24	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.65/4.28	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.26)
1.41/4.32	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.23)
1.41/4.36	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.21)
799.88/104.24	c INFO: running march_hi@0 for 485 with 39899 remaining (b = 0.18)
800.62/104.39	c INFO: running kcnfs-2006@0 for 582 with 39899 remaining (b = 0.19)
806.21/105.08	c INFO: running march_hi@0 for 97 with 39898 remaining (b = 0.04)
1599.98/204.49	c INFO: running march_hi@97 for 97 with 39799 remaining (b = 0.04)
1668.68/213.08	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321947-1307741596/watcher-3321947-1307741596 -o /tmp/evaluation-result-3321947-1307741596/solver-3321947-1307741596 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321947-1307741596.cnf -seed 960148277 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.08 0.02 0.01 1/170 32201
/proc/meminfo: memFree=31424324/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=11804 CPUtime=0 cores=0-7
/proc/32201/stat : 32201 (runsolver) S 32199 32201 32171 0 -1 4202560 46 0 0 0 0 0 0 0 23 0 1 0 964390572 12087296 55 33554432000 4194304 5436572 140734605563168 18446744073709551615 5057063 0 2147483391 4096 24578 18446744071699215550 0 0 17 4 0 0 0
/proc/32201/statm: 2951 55 36 304 0 2643 0

[startup+0.0575749 s]
/proc/loadavg: 0.08 0.02 0.01 1/170 32201
/proc/meminfo: memFree=31424324/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=15384 CPUtime=0 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 821 0 0 0 0 0 0 0 23 0 1 0 964390572 15753216 705 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/32201/statm: 3846 705 334 364 0 333 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15384

[startup+0.100559 s]
/proc/loadavg: 0.08 0.02 0.01 1/170 32201
/proc/meminfo: memFree=31424324/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=16400 CPUtime=0.01 cores=0-7
/proc/32201/stat : 32201 (python) R 32199 32201 32171 0 -1 4202496 1112 0 0 0 1 0 0 0 23 0 1 0 964390572 16793600 980 33554432000 4194304 5683644 140733435522928 18446744073709551615 4901760 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32201/statm: 4100 980 407 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16400

[startup+0.30052 s]
/proc/loadavg: 0.08 0.02 0.01 1/170 32201
/proc/meminfo: memFree=31424324/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=29788 CPUtime=0.04 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 1461 0 0 0 3 1 0 0 21 0 1 0 964390572 30502912 1300 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/32201/statm: 7447 1300 443 364 0 817 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29788

[startup+0.700448 s]
/proc/loadavg: 0.08 0.02 0.01 1/170 32201
/proc/meminfo: memFree=31424324/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=94184 CPUtime=0.07 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 2772 0 0 0 5 2 0 0 16 0 1 0 964390572 96444416 2478 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 4 0 0 0
/proc/32201/statm: 23546 2478 765 364 0 1678 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 94184

[startup+1.50031 s]
/proc/loadavg: 0.08 0.02 0.01 1/171 32202
/proc/meminfo: memFree=31412784/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=135752 CPUtime=0.21 cores=0-7
/proc/32201/stat : 32201 (python) R 32199 32201 32171 0 -1 4202496 5965 935 1 0 15 6 0 0 15 0 1 0 964390572 139010048 4152 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895490192 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32201/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 135752

[startup+3.10098 s]
/proc/loadavg: 0.08 0.02 0.01 1/171 32206
/proc/meminfo: memFree=31410184/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=135900 CPUtime=0.27 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 6069 935 1 0 18 9 0 0 15 0 1 0 964390572 139161600 4204 33554432000 4194304 5683644 140733435522928 18446744073709551615 231890566791 0 2147483391 16781312 2 18446744071699215550 0 0 17 7 0 0 0
/proc/32201/statm: 33975 4204 1032 364 0 3161 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 135900
heavy processes:

[startup+6.30129 s]
/proc/loadavg: 0.63 0.13 0.04 9/195 32230
/proc/meminfo: memFree=31360516/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=426864 CPUtime=0.81 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 15788 935 1 0 66 15 0 0 21 0 9 0 964390572 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32201/statm: 106716 7299 1889 364 0 42613 0
[pid=32207] ppid=32201 vsize=278604 CPUtime=0 cores=0-7
/proc/32207/stat : 32207 (python) S 32201 32201 32171 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 964390981 285290496 5574 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510543 0 0 16781312 514 5629757648862675208 0 0 17 6 0 0 0
/proc/32207/statm: 69651 5574 354 364 0 5569 0
[pid=32209] ppid=32207 vsize=1017800 CPUtime=2.2 cores=0-7
/proc/32209/stat : 32209 (gnovelty+2) R 32207 32209 32209 0 -1 4202496 435 0 0 0 220 0 0 0 25 0 1 0 964390982 1042227200 173 33554432000 134512640 135663704 4287478592 18446744073709551615 134525247 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32209/statm: 254450 173 113 282 0 254166 0
[pid=32210] ppid=32201 vsize=289300 CPUtime=0 cores=0-7
/proc/32210/stat : 32210 (python) S 32201 32201 32171 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 964390985 296243200 5683 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 9426328693497626888 0 0 17 3 0 0 0
/proc/32210/statm: 72325 5683 348 364 0 8240 0
[pid=32212] ppid=32210 vsize=2748 CPUtime=2.15 cores=0-7
/proc/32212/stat : 32212 (march_hi) R 32210 32212 32212 0 -1 4202496 701 0 0 0 215 0 0 0 25 0 1 0 964390985 2813952 440 33554432000 4194304 4955518 140734840986208 18446744073709551615 4224642 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32212/statm: 687 440 104 186 0 500 0
[pid=32213] ppid=32201 vsize=299180 CPUtime=0 cores=0-7
/proc/32213/stat : 32213 (python) S 32201 32201 32171 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 964390988 306360320 5592 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 12544750378056384776 0 0 17 5 0 0 0
/proc/32213/statm: 74795 5592 348 364 0 10707 0
[pid=32215] ppid=32213 vsize=2748 CPUtime=2.12 cores=0-7
/proc/32215/stat : 32215 (march_hi) R 32213 32215 32215 0 -1 4202496 701 0 0 0 212 0 0 0 25 0 1 0 964390989 2813952 439 33554432000 4194304 4955518 140734273709296 18446744073709551615 4209727 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32215/statm: 687 439 104 186 0 500 0
[pid=32216] ppid=32201 vsize=309912 CPUtime=0 cores=0-7
/proc/32216/stat : 32216 (python) S 32201 32201 32171 0 -1 4202560 766 0 0 0 0 0 0 0 15 0 1 0 964390992 317349888 5699 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 17420613856266256648 0 0 17 4 0 0 0
/proc/32216/statm: 77478 5699 348 364 0 13387 0
[pid=32218] ppid=32216 vsize=2616 CPUtime=2.08 cores=0-7
/proc/32218/stat : 32218 (march_hi) R 32216 32218 32218 0 -1 4202496 697 0 0 0 208 0 0 0 25 0 1 0 964390992 2678784 436 33554432000 4194304 4955518 140734807769408 18446744073709551615 4315398 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32218/statm: 654 436 104 186 0 467 0
[pid=32219] ppid=32201 vsize=320168 CPUtime=0 cores=0-7
/proc/32219/stat : 32219 (python) S 32201 32201 32171 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 964390996 327852032 5715 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 4586788681422962952 0 0 17 0 0 0 0
/proc/32219/statm: 80042 5715 348 364 0 15948 0
[pid=32221] ppid=32219 vsize=1017800 CPUtime=2.05 cores=0-7
/proc/32221/stat : 32221 (gnovelty+2) R 32219 32221 32221 0 -1 4202496 437 0 0 0 205 0 0 0 25 0 1 0 964390997 1042227200 173 33554432000 134512640 135663704 4286577344 18446744073709551615 135007736 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32221/statm: 254450 173 113 282 0 254166 0
[pid=32222] ppid=32201 vsize=330424 CPUtime=0 cores=0-7
/proc/32222/stat : 32222 (python) S 32201 32201 32171 0 -1 4202560 788 0 0 0 0 0 0 0 15 0 1 0 964391000 338354176 5736 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452956241889296648 0 0 17 6 0 0 0
/proc/32222/statm: 82606 5736 348 364 0 18509 0
[pid=32224] ppid=32222 vsize=2464 CPUtime=2.01 cores=0-7
/proc/32224/stat : 32224 (march_hi) R 32222 32224 32224 0 -1 4202496 698 0 0 0 201 0 0 0 25 0 1 0 964391000 2523136 433 33554432000 4194304 4955518 140734136339120 18446744073709551615 4227679 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32224/statm: 616 433 104 186 0 429 0
[pid=32225] ppid=32201 vsize=406216 CPUtime=0 cores=0-7
/proc/32225/stat : 32225 (python) S 32201 32201 32171 0 -1 4202560 787 0 0 0 0 0 0 0 15 0 1 0 964391005 415965184 5742 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452960639935807752 0 0 17 0 0 0 0
/proc/32225/statm: 101554 5742 348 364 0 37454 0
[pid=32227] ppid=32225 vsize=2464 CPUtime=1.94 cores=0-7
/proc/32227/stat : 32227 (march_hi) R 32225 32227 32227 0 -1 4202496 696 0 0 0 194 0 0 0 25 0 1 0 964391007 2523136 429 33554432000 4194304 4955518 140734894339408 18446744073709551615 4238776 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32227/statm: 616 429 104 186 0 429 0
[pid=32228] ppid=32201 vsize=416620 CPUtime=0 cores=0-7
/proc/32228/stat : 32228 (python) S 32201 32201 32171 0 -1 4202560 823 0 0 0 0 0 0 0 15 0 1 0 964391009 426618880 5760 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 4220756862489821448 0 0 17 7 0 0 0
/proc/32228/statm: 104155 5760 354 364 0 40052 0
[pid=32230] ppid=32228 vsize=2464 CPUtime=1.91 cores=0-7
/proc/32230/stat : 32230 (march_hi) R 32228 32230 32230 0 -1 4202496 698 0 0 0 191 0 0 0 25 0 1 0 964391009 2523136 427 33554432000 4194304 4955518 140734020939808 18446744073709551615 4238462 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32230/statm: 616 427 104 186 0 429 0
[pid=32201/tid=32208] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32208/stat : 32208 (python) S 32199 32201 32171 0 -1 4202560 27 935 0 0 0 0 0 0 17 0 9 0 964390981 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32211] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32211/stat : 32211 (python) S 32199 32201 32171 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 9 0 964390985 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32214] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32214/stat : 32214 (python) S 32199 32201 32171 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 9 0 964390989 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 5 0 0 0
[pid=32201/tid=32217] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32217/stat : 32217 (python) S 32199 32201 32171 0 -1 4202560 20 935 0 0 0 0 0 0 19 0 9 0 964390992 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 4 0 0 0
[pid=32201/tid=32220] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32220/stat : 32220 (python) S 32199 32201 32171 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 9 0 964390996 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32223] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32223/stat : 32223 (python) S 32199 32201 32171 0 -1 4202560 21 935 0 0 0 0 0 0 20 0 9 0 964391000 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 6 0 0 0
[pid=32201/tid=32226] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32226/stat : 32226 (python) S 32199 32201 32171 0 -1 4202560 28 935 0 0 0 0 0 0 19 0 9 0 964391005 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32229] ppid=32199 vsize=426864 CPUtime=0 cores=0-7
/proc/32201/task/32229/stat : 32229 (python) S 32199 32201 32171 0 -1 4202560 70 935 0 0 0 0 0 0 21 0 9 0 964391009 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 17.27
Current children cumulated vsize (KiB) 5128392

[startup+12.7011 s]
/proc/loadavg: 1.22 0.26 0.08 9/195 32230
/proc/meminfo: memFree=31351696/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=426864 CPUtime=0.81 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 15788 935 1 0 66 15 0 0 21 0 9 0 964390572 437108736 7299 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32201/statm: 106716 7299 1889 364 0 42613 0
[pid=32207] ppid=32201 vsize=278604 CPUtime=0 cores=0-7
/proc/32207/stat : 32207 (python) S 32201 32201 32171 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 964390981 285290496 5596 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510543 0 0 16781312 514 5629757648862675208 0 0 17 6 0 0 0
/proc/32207/statm: 69651 5596 376 364 0 5569 0
[pid=32209] ppid=32207 vsize=1017800 CPUtime=8.6 cores=0-7
/proc/32209/stat : 32209 (gnovelty+2) R 32207 32209 32209 0 -1 4202496 435 0 0 0 860 0 0 0 25 0 1 0 964390982 1042227200 173 33554432000 134512640 135663704 4287478592 18446744073709551615 134524518 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32209/statm: 254450 173 113 282 0 254166 0
[pid=32210] ppid=32201 vsize=289300 CPUtime=0.01 cores=0-7
/proc/32210/stat : 32210 (python) S 32201 32201 32171 0 -1 4202560 916 0 0 0 1 0 0 0 15 0 1 0 964390985 296243200 5705 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 9426328693497626888 0 0 17 3 0 0 0
/proc/32210/statm: 72325 5705 370 364 0 8240 0
[pid=32212] ppid=32210 vsize=4252 CPUtime=8.54 cores=0-7
/proc/32212/stat : 32212 (march_hi) R 32210 32212 32212 0 -1 4202496 997 0 0 0 854 0 0 0 25 0 1 0 964390985 4354048 736 33554432000 4194304 4955518 140734840986208 18446744073709551615 4227671 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32212/statm: 1063 736 104 186 0 876 0
[pid=32213] ppid=32201 vsize=299180 CPUtime=0.01 cores=0-7
/proc/32213/stat : 32213 (python) S 32201 32201 32171 0 -1 4202560 934 0 0 0 1 0 0 0 15 0 1 0 964390988 306360320 5615 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 12544750378056384776 0 0 17 5 0 0 0
/proc/32213/statm: 74795 5615 371 364 0 10707 0
[pid=32215] ppid=32213 vsize=4252 CPUtime=8.51 cores=0-7
/proc/32215/stat : 32215 (march_hi) R 32213 32215 32215 0 -1 4202496 997 0 0 0 851 0 0 0 25 0 1 0 964390989 4354048 735 33554432000 4194304 4955518 140734273709296 18446744073709551615 4227859 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32215/statm: 1063 735 104 186 0 876 0
[pid=32216] ppid=32201 vsize=309912 CPUtime=0.01 cores=0-7
/proc/32216/stat : 32216 (python) S 32201 32201 32171 0 -1 4202560 912 0 0 0 1 0 0 0 15 0 1 0 964390992 317349888 5722 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 17420613856266256648 0 0 17 4 0 0 0
/proc/32216/statm: 77478 5722 371 364 0 13387 0
[pid=32218] ppid=32216 vsize=4252 CPUtime=8.47 cores=0-7
/proc/32218/stat : 32218 (march_hi) R 32216 32218 32218 0 -1 4202496 995 0 0 0 847 0 0 0 25 0 1 0 964390992 4354048 734 33554432000 4194304 4955518 140734807769408 18446744073709551615 4290401 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32218/statm: 1063 734 104 186 0 876 0
[pid=32219] ppid=32201 vsize=320168 CPUtime=0 cores=0-7
/proc/32219/stat : 32219 (python) S 32201 32201 32171 0 -1 4202560 938 0 0 0 0 0 0 0 18 0 1 0 964390996 327852032 5737 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 4586788681422962952 0 0 17 0 0 0 0
/proc/32219/statm: 80042 5737 370 364 0 15948 0
[pid=32221] ppid=32219 vsize=1017800 CPUtime=8.45 cores=0-7
/proc/32221/stat : 32221 (gnovelty+2) R 32219 32221 32221 0 -1 4202496 437 0 0 0 845 0 0 0 25 0 1 0 964390997 1042227200 173 33554432000 134512640 135663704 4286577344 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32221/statm: 254450 173 113 282 0 254166 0
[pid=32222] ppid=32201 vsize=330424 CPUtime=0 cores=0-7
/proc/32222/stat : 32222 (python) S 32201 32201 32171 0 -1 4202560 963 0 0 0 0 0 0 0 15 0 1 0 964391000 338354176 5759 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452956241889296648 0 0 17 6 0 0 0
/proc/32222/statm: 82606 5759 371 364 0 18509 0
[pid=32224] ppid=32222 vsize=4252 CPUtime=8.39 cores=0-7
/proc/32224/stat : 32224 (march_hi) R 32222 32224 32224 0 -1 4202496 998 0 0 0 839 0 0 0 25 0 1 0 964391000 4354048 733 33554432000 4194304 4955518 140734136339120 18446744073709551615 4238735 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32224/statm: 1063 733 104 186 0 876 0
[pid=32225] ppid=32201 vsize=406216 CPUtime=0 cores=0-7
/proc/32225/stat : 32225 (python) S 32201 32201 32171 0 -1 4202560 961 0 0 0 0 0 0 0 15 0 1 0 964391005 415965184 5764 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452960639935807752 0 0 17 0 0 0 0

################
# More data... #
################

/proc/32218/stat : 32218 (march_hi) R 32216 32218 32218 0 -1 4202496 6672 0 0 0 20571 2 0 0 25 0 1 0 964390992 36237312 6411 33554432000 4194304 4955518 140734807769408 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32218/statm: 8847 6411 104 186 0 8660 0
[pid=32216/tid=32242] ppid=32201 vsize=309912 CPUtime=0 cores=0-7
/proc/32216/task/32242/stat : 32242 (python) S 32201 32201 32171 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 964401076 317349888 5752 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 514 18446604454223471552 0 0 -1 4 0 0 0
[pid=32219] ppid=32201 vsize=320168 CPUtime=0.11 cores=0-7
/proc/32219/stat : 32219 (python) S 32201 32201 32171 0 -1 4202560 1132 0 0 0 7 4 0 0 18 0 2 0 964390996 327852032 5768 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/32219/statm: 80042 5768 400 364 0 15948 0
[pid=32221] ppid=32219 vsize=1017800 CPUtime=100.1 cores=0-7
/proc/32221/stat : 32221 (gnovelty+2) T 32219 32221 32221 0 -1 4202496 437 0 0 0 10010 0 0 0 25 0 1 0 964390997 1042227200 173 33554432000 134512640 135663704 4286577344 18446744073709551615 134544183 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32221/statm: 254450 173 113 282 0 254166 0
[pid=32219/tid=32238] ppid=32201 vsize=320168 CPUtime=0 cores=0-7
/proc/32219/task/32238/stat : 32238 (python) S 32201 32201 32171 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 964401007 327852032 5768 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 514 18446604466865540096 0 0 -1 1 0 0 0
[pid=32222] ppid=32201 vsize=330424 CPUtime=0.31 cores=0-7
/proc/32222/stat : 32222 (python) S 32201 32201 32171 0 -1 4202560 1031 0 0 0 18 13 0 0 15 0 1 0 964391000 338354176 5759 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452956241889296648 0 0 17 6 0 0 0
/proc/32222/statm: 82606 5759 371 364 0 18509 0
[pid=32224] ppid=32222 vsize=35388 CPUtime=207.34 cores=0-7
/proc/32224/stat : 32224 (march_hi) R 32222 32224 32224 0 -1 4202496 6720 0 0 0 20733 1 0 0 25 0 1 0 964391000 36237312 6455 33554432000 4194304 4955518 140734136339120 18446744073709551615 4282790 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32224/statm: 8847 6455 104 186 0 8660 0
[pid=32225] ppid=32201 vsize=406216 CPUtime=0.29 cores=0-7
/proc/32225/stat : 32225 (python) S 32201 32201 32171 0 -1 4202560 1033 0 0 0 17 12 0 0 15 0 1 0 964391005 415965184 5765 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452960639935807752 0 0 17 0 0 0 0
/proc/32225/statm: 101554 5765 371 364 0 37454 0
[pid=32227] ppid=32225 vsize=35388 CPUtime=206.99 cores=0-7
/proc/32227/stat : 32227 (march_hi) R 32225 32227 32227 0 -1 4202496 6672 0 0 0 20698 1 0 0 25 0 1 0 964391007 36237312 6405 33554432000 4194304 4955518 140734894339408 18446744073709551615 4209740 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32227/statm: 8847 6405 104 186 0 8660 0
[pid=32228] ppid=32201 vsize=416620 CPUtime=0.3 cores=0-7
/proc/32228/stat : 32228 (python) S 32201 32201 32171 0 -1 4202560 1072 0 0 0 18 12 0 0 15 0 1 0 964391009 426618880 5783 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 4220756862489821448 0 0 17 7 0 0 0
/proc/32228/statm: 104155 5783 377 364 0 40052 0
[pid=32230] ppid=32228 vsize=35388 CPUtime=206.66 cores=0-7
/proc/32230/stat : 32230 (march_hi) R 32228 32230 32230 0 -1 4202496 6700 0 0 0 20665 1 0 0 25 0 1 0 964391009 36237312 6429 33554432000 4194304 4955518 140734020939808 18446744073709551615 4227664 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32230/statm: 8847 6429 104 186 0 8660 0
[pid=32235] ppid=32201 vsize=426876 CPUtime=0.15 cores=0-7
/proc/32235/stat : 32235 (python) S 32201 32201 32171 0 -1 4202560 1024 0 0 0 8 7 0 0 15 0 1 0 964400996 437121024 5781 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 5635577638786400520 0 0 17 1 0 0 0
/proc/32235/statm: 106719 5781 371 364 0 42613 0
[pid=32237] ppid=32235 vsize=17320 CPUtime=107.49 cores=0-7
/proc/32237/stat : 32237 (march_hi) R 32235 32237 32237 0 -1 4202496 4101 0 0 0 10748 1 0 0 25 0 1 0 964400997 17735680 3832 33554432000 4194304 4955518 140733469193184 18446744073709551615 4239140 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32237/statm: 4330 3832 104 186 0 4143 0
[pid=32239] ppid=32201 vsize=436904 CPUtime=0.12 cores=0-7
/proc/32239/stat : 32239 (python) S 32201 32201 32171 0 -1 4202560 1004 0 0 0 7 5 0 0 18 0 1 0 964401012 447389696 5734 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 14361345892986880261 0 0 17 0 0 0 0
/proc/32239/statm: 109226 5734 371 364 0 45117 0
[pid=32241] ppid=32239 vsize=182448 CPUtime=107.32 cores=0-7
/proc/32241/stat : 32241 (kcnfs-2006) R 32239 32241 32241 0 -1 4202496 577 0 0 0 10732 0 0 0 25 0 1 0 964401012 186826752 311 33554432000 134512640 135163436 4288162176 18446744073709551615 134643330 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32241/statm: 45612 311 77 159 0 45452 0
[pid=32201/tid=32208] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32208/stat : 32208 (python) S 32199 32201 32171 0 -1 4202560 27 935 0 0 0 0 0 0 17 0 11 0 964390981 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32211] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32211/stat : 32211 (python) S 32199 32201 32171 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 11 0 964390985 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32214] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32214/stat : 32214 (python) S 32199 32201 32171 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 11 0 964390989 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 5 0 0 0
[pid=32201/tid=32217] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32217/stat : 32217 (python) S 32199 32201 32171 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 11 0 964390992 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 4 0 0 0
[pid=32201/tid=32220] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32220/stat : 32220 (python) S 32199 32201 32171 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 11 0 964390996 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32223] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32223/stat : 32223 (python) S 32199 32201 32171 0 -1 4202560 21 935 0 0 0 0 0 0 20 0 11 0 964391000 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 6 0 0 0
[pid=32201/tid=32226] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32226/stat : 32226 (python) S 32199 32201 32171 0 -1 4202560 28 935 0 0 0 0 0 0 19 0 11 0 964391005 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32229] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32229/stat : 32229 (python) S 32199 32201 32171 0 -1 4202560 70 935 0 0 0 0 0 0 21 0 11 0 964391009 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32236] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32236/stat : 32236 (python) S 32199 32201 32171 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 11 0 964400996 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32240] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32240/stat : 32240 (python) S 32199 32201 32171 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 11 0 964401012 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1659.89
Current children cumulated vsize (KiB) 6419612

[startup+212.702 s]
/proc/loadavg: 7.86 4.09 1.63 9/204 32245
/proc/meminfo: memFree=31188352/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=447468 CPUtime=1 cores=0-7
/proc/32201/stat : 32201 (python) S 32199 32201 32171 0 -1 4202496 18220 935 1 0 84 16 0 0 18 0 11 0 964390572 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32201/statm: 111867 7357 1894 364 0 47758 0
[pid=32207] ppid=32201 vsize=288848 CPUtime=0.11 cores=0-7
/proc/32207/stat : 32207 (python) S 32201 32201 32171 0 -1 4202560 1090 0 0 0 7 4 0 0 19 0 2 0 964390981 295780352 5635 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32207/statm: 72212 5635 410 364 0 8130 0
[pid=32209] ppid=32207 vsize=1017800 CPUtime=100.08 cores=0-7
/proc/32209/stat : 32209 (gnovelty+2) T 32207 32209 32209 0 -1 4202496 435 0 0 0 10008 0 0 0 25 0 1 0 964390982 1042227200 173 33554432000 134512640 135663704 4287478592 18446744073709551615 134525544 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/32209/statm: 254450 173 113 282 0 254166 0
[pid=32207/tid=32234] ppid=32201 vsize=288848 CPUtime=0 cores=0-7
/proc/32207/task/32234/stat : 32234 (python) S 32201 32201 32171 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 964400992 295780352 5635 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 514 18446604454223473344 0 0 -1 6 0 0 0
[pid=32210] ppid=32201 vsize=289300 CPUtime=0.3 cores=0-7
/proc/32210/stat : 32210 (python) S 32201 32201 32171 0 -1 4202560 997 0 0 0 17 13 0 0 15 0 1 0 964390985 296243200 5706 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 9426328693497626888 0 0 17 3 0 0 0
/proc/32210/statm: 72325 5706 371 364 0 8240 0
[pid=32212] ppid=32210 vsize=35388 CPUtime=208.26 cores=0-7
/proc/32212/stat : 32212 (march_hi) R 32210 32212 32212 0 -1 4202496 6723 0 0 0 20824 2 0 0 25 0 1 0 964390985 36237312 6462 33554432000 4194304 4955518 140734840986208 18446744073709551615 4209787 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32212/statm: 8847 6462 104 186 0 8660 0
[pid=32213] ppid=32201 vsize=299180 CPUtime=0.31 cores=0-7
/proc/32213/stat : 32213 (python) S 32201 32201 32171 0 -1 4202560 1002 0 0 0 19 12 0 0 15 0 1 0 964390988 306360320 5615 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 12544750378056384776 0 0 17 5 0 0 0
/proc/32213/statm: 74795 5615 371 364 0 10707 0
[pid=32215] ppid=32213 vsize=35388 CPUtime=208.22 cores=0-7
/proc/32215/stat : 32215 (march_hi) R 32213 32215 32215 0 -1 4202496 6735 0 0 0 20821 1 0 0 25 0 1 0 964390989 36237312 6473 33554432000 4194304 4955518 140734273709296 18446744073709551615 4227800 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32215/statm: 8847 6473 104 186 0 8660 0
[pid=32216] ppid=32201 vsize=309912 CPUtime=0.3 cores=0-7
/proc/32216/stat : 32216 (python) S 32201 32201 32171 0 -1 4202560 1175 0 0 0 17 13 0 0 15 0 2 0 964390992 317349888 5752 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32216/statm: 77478 5752 400 364 0 13387 0
[pid=32218] ppid=32216 vsize=35388 CPUtime=206.51 cores=0-7
/proc/32218/stat : 32218 (march_hi) R 32216 32218 32218 0 -1 4202496 6689 0 0 0 20649 2 0 0 25 0 1 0 964390992 36237312 6428 33554432000 4194304 4955518 140734807769408 18446744073709551615 4227732 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32218/statm: 8847 6428 104 186 0 8660 0
[pid=32216/tid=32242] ppid=32201 vsize=309912 CPUtime=0 cores=0-7
/proc/32216/task/32242/stat : 32242 (python) S 32201 32201 32171 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 964401076 317349888 5752 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 514 18446604454223471552 0 0 -1 4 0 0 0
[pid=32219] ppid=32201 vsize=320168 CPUtime=0.11 cores=0-7
/proc/32219/stat : 32219 (python) S 32201 32201 32171 0 -1 4202560 1132 0 0 0 7 4 0 0 18 0 2 0 964390996 327852032 5768 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/32219/statm: 80042 5768 400 364 0 15948 0
[pid=32221] ppid=32219 vsize=1017800 CPUtime=100.1 cores=0-7
/proc/32221/stat : 32221 (gnovelty+2) T 32219 32221 32221 0 -1 4202496 437 0 0 0 10010 0 0 0 25 0 1 0 964390997 1042227200 173 33554432000 134512640 135663704 4286577344 18446744073709551615 134544183 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32221/statm: 254450 173 113 282 0 254166 0
[pid=32219/tid=32238] ppid=32201 vsize=320168 CPUtime=0 cores=0-7
/proc/32219/task/32238/stat : 32238 (python) S 32201 32201 32171 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 964401007 327852032 5768 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 514 18446604466865540096 0 0 -1 1 0 0 0
[pid=32222] ppid=32201 vsize=330424 CPUtime=0.31 cores=0-7
/proc/32222/stat : 32222 (python) S 32201 32201 32171 0 -1 4202560 1031 0 0 0 18 13 0 0 15 0 1 0 964391000 338354176 5759 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452956241889296648 0 0 17 6 0 0 0
/proc/32222/statm: 82606 5759 371 364 0 18509 0
[pid=32224] ppid=32222 vsize=35388 CPUtime=208.14 cores=0-7
/proc/32224/stat : 32224 (march_hi) R 32222 32224 32224 0 -1 4202496 6737 0 0 0 20813 1 0 0 25 0 1 0 964391000 36237312 6472 33554432000 4194304 4955518 140734136339120 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32224/statm: 8847 6472 104 186 0 8660 0
[pid=32225] ppid=32201 vsize=406216 CPUtime=0.31 cores=0-7
/proc/32225/stat : 32225 (python) S 32201 32201 32171 0 -1 4202560 1034 0 0 0 18 13 0 0 15 0 1 0 964391005 415965184 5765 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 1452960639935807752 0 0 17 0 0 0 0
/proc/32225/statm: 101554 5765 371 364 0 37454 0
[pid=32227] ppid=32225 vsize=35388 CPUtime=207.78 cores=0-7
/proc/32227/stat : 32227 (march_hi) R 32225 32227 32227 0 -1 4202496 6689 0 0 0 20777 1 0 0 25 0 1 0 964391007 36237312 6422 33554432000 4194304 4955518 140734894339408 18446744073709551615 4227752 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32227/statm: 8847 6422 104 186 0 8660 0
[pid=32228] ppid=32201 vsize=416620 CPUtime=0.3 cores=0-7
/proc/32228/stat : 32228 (python) S 32201 32201 32171 0 -1 4202560 1072 0 0 0 18 12 0 0 15 0 1 0 964391009 426618880 5783 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 4220756862489821448 0 0 17 7 0 0 0
/proc/32228/statm: 104155 5783 377 364 0 40052 0
[pid=32230] ppid=32228 vsize=35388 CPUtime=207.46 cores=0-7
/proc/32230/stat : 32230 (march_hi) R 32228 32230 32230 0 -1 4202496 6718 0 0 0 20745 1 0 0 25 0 1 0 964391009 36237312 6447 33554432000 4194304 4955518 140734020939808 18446744073709551615 4227671 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32230/statm: 8847 6447 104 186 0 8660 0
[pid=32235] ppid=32201 vsize=426876 CPUtime=0.15 cores=0-7
/proc/32235/stat : 32235 (python) S 32201 32201 32171 0 -1 4202560 1024 0 0 0 8 7 0 0 15 0 1 0 964400996 437121024 5781 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 5635577638786400520 0 0 17 1 0 0 0
/proc/32235/statm: 106719 5781 371 364 0 42613 0
[pid=32237] ppid=32235 vsize=17320 CPUtime=108.29 cores=0-7
/proc/32237/stat : 32237 (march_hi) R 32235 32237 32237 0 -1 4202496 4126 0 0 0 10828 1 0 0 25 0 1 0 964400997 17735680 3857 33554432000 4194304 4955518 140733469193184 18446744073709551615 4238635 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32237/statm: 4330 3857 104 186 0 4143 0
[pid=32239] ppid=32201 vsize=436904 CPUtime=0.12 cores=0-7
/proc/32239/stat : 32239 (python) S 32201 32201 32171 0 -1 4202560 1004 0 0 0 7 5 0 0 18 0 1 0 964401012 447389696 5734 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895510598 0 0 16781312 514 14361345892986880261 0 0 17 0 0 0 0
/proc/32239/statm: 109226 5734 371 364 0 45117 0
[pid=32241] ppid=32239 vsize=182448 CPUtime=108.12 cores=0-7
/proc/32241/stat : 32241 (kcnfs-2006) R 32239 32241 32241 0 -1 4202496 577 0 0 0 10812 0 0 0 25 0 1 0 964401012 186826752 311 33554432000 134512640 135163436 4288162176 18446744073709551615 134572323 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32241/statm: 45612 311 77 159 0 45452 0
[pid=32201/tid=32208] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32208/stat : 32208 (python) S 32199 32201 32171 0 -1 4202560 27 935 0 0 0 0 0 0 17 0 11 0 964390981 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32211] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32211/stat : 32211 (python) S 32199 32201 32171 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 11 0 964390985 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32214] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32214/stat : 32214 (python) S 32199 32201 32171 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 11 0 964390989 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 5 0 0 0
[pid=32201/tid=32217] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32217/stat : 32217 (python) S 32199 32201 32171 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 11 0 964390992 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 4 0 0 0
[pid=32201/tid=32220] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32220/stat : 32220 (python) S 32199 32201 32171 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 11 0 964390996 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 1 0 0 0
[pid=32201/tid=32223] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32223/stat : 32223 (python) S 32199 32201 32171 0 -1 4202560 21 935 0 0 0 0 0 0 20 0 11 0 964391000 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 6 0 0 0
[pid=32201/tid=32226] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32226/stat : 32226 (python) S 32199 32201 32171 0 -1 4202560 28 935 0 0 0 0 0 0 19 0 11 0 964391005 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32229] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32229/stat : 32229 (python) S 32199 32201 32171 0 -1 4202560 70 935 0 0 0 0 0 0 21 0 11 0 964391009 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32236] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32236/stat : 32236 (python) S 32199 32201 32171 0 -1 4202560 31 935 0 0 0 0 0 0 20 0 11 0 964400996 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
[pid=32201/tid=32240] ppid=32199 vsize=447468 CPUtime=0 cores=0-7
/proc/32201/task/32240/stat : 32240 (python) S 32199 32201 32171 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 11 0 964401012 458207232 7357 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 2 18446604454223472448 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1666.28
Current children cumulated vsize (KiB) 6419612

[startup+213.102 s]
/proc/loadavg: 7.86 4.09 1.63 9/204 32245
/proc/meminfo: memFree=31188352/32950928 swapFree=67054844/67111528
[pid=32201] ppid=32199 vsize=385876 CPUtime=1669.46 cores=0-7
/proc/32201/stat : 32201 (python) R 32199 32201 32171 0 -1 4202496 21688 58169 1 0 85 16 166730 115 17 0 2 0 964390572 395137024 7314 33554432000 4194304 5683644 140733435522928 18446744073709551615 231895146576 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/32201/statm: 96469 7314 1875 364 0 32392 0
[pid=32201/tid=32223] ppid=32199 vsize=385876 CPUtime=1668.45 cores=0-7
/proc/32201/task/32223/stat : 32223 (python) S 32199 32201 32171 0 -1 4202560 22 58169 0 0 0 0 166730 115 18 0 2 0 964391000 395137024 7314 33554432000 4194304 5683644 140733435522928 18446744073709551615 231907314097 0 0 16781312 0 18446604454223472448 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1669.46
Current children cumulated vsize (KiB) 385876

Child status: 0
Real time (s): 213.11
CPU time (s): 1669.49
CPU user time (s): 1668.17
CPU system time (s): 1.3218
CPU usage (%): 783.396
Max. virtual memory (cumulated for all children) (KiB): 6419616

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1668.17
system time used= 1.3218
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 80453
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8329
involuntary context switches= 12224

runsolver used 0.677896 second user time and 1.48577 second system time

The end

Launcher Data 

Begin job on node114 at 2011-06-10 23:33:16
IDJOB=3321947
IDBENCH=82725
IDSOLVER=1712
FILE ID=node114/3321947-1307741596
RUNJOBID= node114-1307741595-32185
PBS_JOBID= 13550795
Free space on /tmp= 74116 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v450-c1917-S367251957-028.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321947-1307741596/watcher-3321947-1307741596 -o /tmp/evaluation-result-3321947-1307741596/solver-3321947-1307741596 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321947-1307741596.cnf -seed 960148277 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6ae9d83c80bad27a7e5f57fa7d9ee7b1
RANDOM SEED=960148277

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31426176 kB
Buffers:        235048 kB
Cached:        1065604 kB
SwapCached:      10540 kB
Active:         392052 kB
Inactive:       927568 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31426176 kB
SwapTotal:    67111528 kB
SwapFree:     67054844 kB
Dirty:           31908 kB
Writeback:           0 kB
AnonPages:       16428 kB
Mapped:          12232 kB
Slab:           139704 kB
PageTables:       4272 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   182340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74080 MiB
End job on node114 at 2011-06-10 23:36:52