Trace number 3317375

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 2267.35 569.496

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S614849838-039.UNKNOWN.cnf
MD5SUMc6bf5481c82f3a24100e294aa3a73c9c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark366.523
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data

0.32/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.46	c INFO: solving HOME/instance-3317375-1304269107.cnf
0.32/0.46	c INFO: computing task features
0.41/0.50	c INFO: computed variable-clause graph statistics
0.41/0.50	c INFO: computed clause balance statistics
0.51/0.69	c INFO: computed variable balance statistics
0.61/0.77	c INFO: computed small-clause counts
0.61/0.77	c INFO: computed Horn-clause counts
0.61/0.78	c INFO: computed variable graph statistics
0.61/0.78	c INFO: collected features for HOME/instance-3317375-1304269107.cnf in 0.31 s
0.71/0.80	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.55)
0.71/0.83	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.10)
0.71/0.86	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.05)
0.71/0.89	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.04)
400.59/101.00	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.03)
400.59/101.03	c INFO: running gnovelty+2@0 for 97 with 4699 remaining (b = 0.02)
400.59/101.09	c INFO: running FH@0 for 97 with 4699 remaining (b = 0.02)
400.93/101.13	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.01)
796.47/200.26	c INFO: running march_hi@0 for 2134 with 4600 remaining (b = 0.31)
796.81/200.37	c INFO: running march_hi@0 for 2134 with 4600 remaining (b = 0.29)
800.46/201.22	c INFO: running march_hi@0 for 388 with 4599 remaining (b = 0.11)
800.78/201.32	c INFO: running march_hi@0 for 388 with 4599 remaining (b = 0.09)
2266.84/569.47	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317375-1304269107/watcher-3317375-1304269107 -o /tmp/evaluation-result-3317375-1304269107/solver-3317375-1304269107 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317375-1304269107.cnf -seed 225418663 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.21 8.15 6.96 5/260 32703
/proc/meminfo: memFree=24037268/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/32703/stat : 32703 (python) R 32701 32703 31940 0 -1 4202496 891 0 0 0 0 0 0 0 25 0 1 0 519326817 16154624 772 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106429637 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32703/statm: 3944 773 343 364 0 431 0

[startup+0.042544 s]
/proc/loadavg: 8.21 8.15 6.96 5/260 32703
/proc/meminfo: memFree=24037268/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=25288 CPUtime=0.03 cores=1,3,5,7
/proc/32703/stat : 32703 (python) R 32701 32703 31940 0 -1 4202496 1345 0 0 0 3 0 0 0 25 0 1 0 519326817 25894912 1191 33554432000 4194304 5683644 140736519665616 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32703/statm: 6322 1191 438 364 0 723 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 25288

[startup+0.100532 s]
/proc/loadavg: 8.21 8.15 6.96 5/260 32703
/proc/meminfo: memFree=24037268/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=104228 CPUtime=0.07 cores=1,3,5,7
/proc/32703/stat : 32703 (python) R 32701 32703 31940 0 -1 4202496 3072 0 0 0 5 2 0 0 25 0 1 0 519326817 106729472 2752 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106766848 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32703/statm: 26057 2752 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300513 s]
/proc/loadavg: 8.21 8.15 6.96 5/260 32703
/proc/meminfo: memFree=24037268/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=187688 CPUtime=0.24 cores=1,3,5,7
/proc/32703/stat : 32703 (python) R 32701 32703 31940 0 -1 4202496 6829 936 1 0 18 6 0 0 17 0 1 0 519326817 192192512 4884 33554432000 4194304 5683644 140736519665616 18446744073709551615 255101845127 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/32703/statm: 46922 4884 1399 364 0 3723 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 187688

[startup+0.70043 s]
/proc/loadavg: 8.21 8.15 6.96 5/260 32703
/proc/meminfo: memFree=24037268/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=279552 CPUtime=0.61 cores=1,3,5,7
/proc/32703/stat : 32703 (python) R 32701 32703 31940 0 -1 4202496 9755 936 1 0 53 8 0 0 17 0 1 0 519326817 286261248 7274 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106460050 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/32703/statm: 69888 7274 1827 364 0 5812 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 279552

[startup+1.50125 s]
/proc/loadavg: 8.03 8.11 6.95 9/273 32720
/proc/meminfo: memFree=23996492/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=320312 CPUtime=0.8 cores=1,3,5,7
/proc/32703/stat : 32703 (python) S 32701 32703 31940 0 -1 4202496 12774 936 1 0 71 9 0 0 20 0 5 0 519326817 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/32703/statm: 80078 7277 1883 364 0 15987 0
[pid=32709] ppid=32703 vsize=278700 CPUtime=0 cores=1,3,5,7
/proc/32709/stat : 32709 (python) S 32703 32703 31940 0 -1 4202560 736 0 0 0 0 0 0 0 19 0 1 0 519326898 285388800 5614 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788879 0 0 16781312 514 3732450829332905983 0 0 17 5 0 0 0
/proc/32709/statm: 69675 5614 354 364 0 5593 0
[pid=32711] ppid=32709 vsize=1017932 CPUtime=0.68 cores=1,3,5,7
/proc/32711/stat : 32711 (gnovelty+2) R 32709 32711 32711 0 -1 4202496 508 0 0 0 68 0 0 0 22 0 1 0 519326899 1042362368 247 33554432000 134512640 135663704 4291522256 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32711/statm: 254483 247 113 282 0 254199 0
[pid=32712] ppid=32703 vsize=289420 CPUtime=0 cores=1,3,5,7
/proc/32712/stat : 32712 (python) S 32703 32703 31940 0 -1 4202560 746 0 0 0 0 0 0 0 21 0 1 0 519326901 296366080 5713 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 4591942092422381567 0 0 17 3 0 0 0
/proc/32712/statm: 72355 5713 348 364 0 8270 0
[pid=32714] ppid=32712 vsize=1017932 CPUtime=0.65 cores=1,3,5,7
/proc/32714/stat : 32714 (gnovelty+2) R 32712 32714 32714 0 -1 4202496 512 0 0 0 65 0 0 0 25 0 1 0 519326902 1042362368 248 33554432000 134512640 135663704 4290738512 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32714/statm: 254483 248 113 282 0 254199 0
[pid=32715] ppid=32703 vsize=299204 CPUtime=0 cores=1,3,5,7
/proc/32715/stat : 32715 (python) S 32703 32703 31940 0 -1 4202560 727 0 0 0 0 0 0 0 19 0 1 0 519326904 306384896 5610 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 7079758399201607679 0 0 17 3 0 0 0
/proc/32715/statm: 74801 5610 344 364 0 10713 0
[pid=32717] ppid=32715 vsize=416652 CPUtime=0.62 cores=1,3,5,7
/proc/32717/stat : 32717 (adaptg2wsat2009) R 32715 32717 32717 0 -1 4202496 568 0 0 0 62 0 0 0 22 0 1 0 519326904 426651648 302 33554432000 134512640 135107411 4289361632 18446744073709551615 134523217 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32717/statm: 104163 302 49 146 0 103039 0
[pid=32718] ppid=32703 vsize=310068 CPUtime=0 cores=1,3,5,7
/proc/32718/stat : 32718 (python) S 32703 32703 31940 0 -1 4202560 734 0 0 0 0 0 0 0 19 0 1 0 519326907 317509632 5734 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 10767069324117016575 0 0 17 5 0 0 0
/proc/32718/statm: 77517 5734 344 364 0 13426 0
[pid=32720] ppid=32718 vsize=416652 CPUtime=0.59 cores=1,3,5,7
/proc/32720/stat : 32720 (adaptg2wsat2009) R 32718 32720 32720 0 -1 4202496 567 0 0 0 59 0 0 0 22 0 1 0 519326907 426651648 303 33554432000 134512640 135107411 4290224096 18446744073709551615 134523300 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32720/statm: 104163 303 49 146 0 103039 0
[pid=32703/tid=32710] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32710/stat : 32710 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 519326898 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32713] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32713/stat : 32713 (python) S 32701 32703 31940 0 -1 4202560 21 936 0 0 0 0 0 0 22 0 5 0 519326901 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32716] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32716/stat : 32716 (python) S 32701 32703 31940 0 -1 4202560 20 936 0 0 0 0 0 0 20 0 5 0 519326904 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32719] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32719/stat : 32719 (python) S 32701 32703 31940 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 5 0 519326907 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3.34
Current children cumulated vsize (KiB) 4366872

[startup+3.10097 s]
/proc/loadavg: 8.03 8.11 6.95 9/273 32720
/proc/meminfo: memFree=23993764/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=320312 CPUtime=0.8 cores=1,3,5,7
/proc/32703/stat : 32703 (python) S 32701 32703 31940 0 -1 4202496 12774 936 1 0 71 9 0 0 20 0 5 0 519326817 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/32703/statm: 80078 7277 1883 364 0 15987 0
[pid=32709] ppid=32703 vsize=278700 CPUtime=0 cores=1,3,5,7
/proc/32709/stat : 32709 (python) S 32703 32703 31940 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 519326898 285388800 5614 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788879 0 0 16781312 514 3732450829332873478 0 0 17 5 0 0 0
/proc/32709/statm: 69675 5614 354 364 0 5593 0
[pid=32711] ppid=32709 vsize=1017932 CPUtime=2.28 cores=1,3,5,7
/proc/32711/stat : 32711 (gnovelty+2) R 32709 32711 32711 0 -1 4202496 508 0 0 0 228 0 0 0 25 0 1 0 519326899 1042362368 247 33554432000 134512640 135663704 4291522256 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32711/statm: 254483 247 113 282 0 254199 0
[pid=32712] ppid=32703 vsize=289420 CPUtime=0 cores=1,3,5,7
/proc/32712/stat : 32712 (python) S 32703 32703 31940 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 519326901 296366080 5713 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 4591942092422349063 0 0 17 3 0 0 0
/proc/32712/statm: 72355 5713 348 364 0 8270 0
[pid=32714] ppid=32712 vsize=1017932 CPUtime=2.25 cores=1,3,5,7
/proc/32714/stat : 32714 (gnovelty+2) R 32712 32714 32714 0 -1 4202496 512 0 0 0 225 0 0 0 25 0 1 0 519326902 1042362368 248 33554432000 134512640 135663704 4290738512 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32714/statm: 254483 248 113 282 0 254199 0
[pid=32715] ppid=32703 vsize=299204 CPUtime=0 cores=1,3,5,7
/proc/32715/stat : 32715 (python) S 32703 32703 31940 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 519326904 306384896 5614 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 7079758399201575176 0 0 17 3 0 0 0
/proc/32715/statm: 74801 5614 348 364 0 10713 0
[pid=32717] ppid=32715 vsize=416788 CPUtime=2.22 cores=1,3,5,7
/proc/32717/stat : 32717 (adaptg2wsat2009) R 32715 32717 32717 0 -1 4202496 630 0 0 0 222 0 0 0 25 0 1 0 519326904 426790912 364 33554432000 134512640 135107411 4289361632 18446744073709551615 134532288 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32717/statm: 104197 364 59 146 0 103073 0
[pid=32718] ppid=32703 vsize=310068 CPUtime=0 cores=1,3,5,7
/proc/32718/stat : 32718 (python) S 32703 32703 31940 0 -1 4202560 753 0 0 0 0 0 0 0 18 0 1 0 519326907 317509632 5738 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 10767069324116984071 0 0 17 5 0 0 0
/proc/32718/statm: 77517 5738 348 364 0 13426 0
[pid=32720] ppid=32718 vsize=416788 CPUtime=2.18 cores=1,3,5,7
/proc/32720/stat : 32720 (adaptg2wsat2009) R 32718 32720 32720 0 -1 4202496 627 0 0 0 218 0 0 0 25 0 1 0 519326907 426790912 363 33554432000 134512640 135107411 4290224096 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32720/statm: 104197 363 59 146 0 103073 0
[pid=32703/tid=32710] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32710/stat : 32710 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 519326898 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32713] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32713/stat : 32713 (python) S 32701 32703 31940 0 -1 4202560 21 936 0 0 0 0 0 0 22 0 5 0 519326901 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32716] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32716/stat : 32716 (python) S 32701 32703 31940 0 -1 4202560 20 936 0 0 0 0 0 0 20 0 5 0 519326904 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32719] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32719/stat : 32719 (python) S 32701 32703 31940 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 5 0 519326907 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.73
Current children cumulated vsize (KiB) 4367144

[startup+6.30141 s]
/proc/loadavg: 8.03 8.11 6.95 9/275 32722
/proc/meminfo: memFree=23988304/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=320312 CPUtime=0.8 cores=1,3,5,7
/proc/32703/stat : 32703 (python) S 32701 32703 31940 0 -1 4202496 12774 936 1 0 71 9 0 0 20 0 5 0 519326817 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/32703/statm: 80078 7277 1883 364 0 15987 0
[pid=32709] ppid=32703 vsize=278700 CPUtime=0 cores=1,3,5,7
/proc/32709/stat : 32709 (python) S 32703 32703 31940 0 -1 4202560 896 0 0 0 0 0 0 0 18 0 1 0 519326898 285388800 5636 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788879 0 0 16781312 514 3732450829332873478 0 0 17 5 0 0 0
/proc/32709/statm: 69675 5636 376 364 0 5593 0
[pid=32711] ppid=32709 vsize=1017932 CPUtime=5.46 cores=1,3,5,7
/proc/32711/stat : 32711 (gnovelty+2) R 32709 32711 32711 0 -1 4202496 508 0 0 0 546 0 0 0 25 0 1 0 519326899 1042362368 247 33554432000 134512640 135663704 4291522256 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32711/statm: 254483 247 113 282 0 254199 0
[pid=32712] ppid=32703 vsize=289420 CPUtime=0 cores=1,3,5,7
/proc/32712/stat : 32712 (python) S 32703 32703 31940 0 -1 4202560 901 0 0 0 0 0 0 0 18 0 1 0 519326901 296366080 5736 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 4591942092422349063 0 0 17 3 0 0 0
/proc/32712/statm: 72355 5736 371 364 0 8270 0
[pid=32714] ppid=32712 vsize=1017932 CPUtime=5.45 cores=1,3,5,7
/proc/32714/stat : 32714 (gnovelty+2) R 32712 32714 32714 0 -1 4202496 512 0 0 0 545 0 0 0 25 0 1 0 519326902 1042362368 248 33554432000 134512640 135663704 4290738512 18446744073709551615 134525691 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32714/statm: 254483 248 113 282 0 254199 0
[pid=32715] ppid=32703 vsize=299204 CPUtime=0 cores=1,3,5,7
/proc/32715/stat : 32715 (python) S 32703 32703 31940 0 -1 4202560 890 0 0 0 0 0 0 0 18 0 1 0 519326904 306384896 5636 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 7079758399201575176 0 0 17 3 0 0 0
/proc/32715/statm: 74801 5636 370 364 0 10713 0
[pid=32717] ppid=32715 vsize=416788 CPUtime=5.4 cores=1,3,5,7
/proc/32717/stat : 32717 (adaptg2wsat2009) R 32715 32717 32717 0 -1 4202496 630 0 0 0 540 0 0 0 25 0 1 0 519326904 426790912 364 33554432000 134512640 135107411 4289361632 18446744073709551615 134531942 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32717/statm: 104197 364 59 146 0 103073 0
[pid=32718] ppid=32703 vsize=310068 CPUtime=0 cores=1,3,5,7
/proc/32718/stat : 32718 (python) S 32703 32703 31940 0 -1 4202560 924 0 0 0 0 0 0 0 18 0 1 0 519326907 317509632 5761 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 10767069324116984071 0 0 17 5 0 0 0
/proc/32718/statm: 77517 5761 371 364 0 13426 0
[pid=32720] ppid=32718 vsize=416788 CPUtime=5.35 cores=1,3,5,7
/proc/32720/stat : 32720 (adaptg2wsat2009) R 32718 32720 32720 0 -1 4202496 627 0 0 0 535 0 0 0 25 0 1 0 519326907 426790912 363 33554432000 134512640 135107411 4290224096 18446744073709551615 134531817 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32720/statm: 104197 363 59 146 0 103073 0
[pid=32703/tid=32710] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32710/stat : 32710 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 5 0 519326898 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32713] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32713/stat : 32713 (python) S 32701 32703 31940 0 -1 4202560 21 936 0 0 0 0 0 0 22 0 5 0 519326901 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32716] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32716/stat : 32716 (python) S 32701 32703 31940 0 -1 4202560 20 936 0 0 0 0 0 0 20 0 5 0 519326904 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32719] ppid=32701 vsize=320312 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32719/stat : 32719 (python) S 32701 32703 31940 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 5 0 519326907 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.46
Current children cumulated vsize (KiB) 4367144

[startup+12.7013 s]
/proc/loadavg: 8.10 8.12 6.97 9/275 32722
/proc/meminfo: memFree=23984440/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=320312 CPUtime=0.8 cores=1,3,5,7
/proc/32703/stat : 32703 (python) S 32701 32703 31940 0 -1 4202496 12774 936 1 0 71 9 0 0 20 0 5 0 519326817 327999488 7277 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/32703/statm: 80078 7277 1883 364 0 15987 0
[pid=32709] ppid=32703 vsize=278700 CPUtime=0.01 cores=1,3,5,7
/proc/32709/stat : 32709 (python) S 32703 32703 31940 0 -1 4202560 898 0 0 0 0 1 0 0 18 0 1 0 519326898 285388800 5637 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788879 0 0 16781312 514 1702554173192503558 0 0 17 5 0 0 0
/proc/32709/statm: 69675 5637 377 364 0 5593 0
[pid=32711] ppid=32709 vsize=1017932 CPUtime=11.84 cores=1,3,5,7
/proc/32711/stat : 32711 (gnovelty+2) R 32709 32711 32711 0 -1 4202496 508 0 0 0 1184 0 0 0 25 0 1 0 519326899 1042362368 247 33554432000 134512640 135663704 4291522256 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32711/statm: 254483 247 113 282 0 254199 0
[pid=32712] ppid=32703 vsize=289420 CPUtime=0.02 cores=1,3,5,7

################
# More data... #
################

[pid=32740] ppid=32738 vsize=416788 CPUtime=98.03 cores=1,3,5,7
/proc/32740/stat : 32740 (adaptg2wsat2009) T 32738 32740 32740 0 -1 4202496 639 0 0 0 9803 0 0 0 25 0 1 0 519336932 426790912 364 33554432000 134512640 135107411 4292169360 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32740/statm: 104197 364 59 146 0 103073 0
[pid=32738/tid=32760] ppid=32703 vsize=351112 CPUtime=0 cores=1,3,5,7
/proc/32738/task/32760/stat : 32760 (python) S 32703 32703 31940 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 519346851 359538688 5841 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604458925869760 0 0 -1 7 0 0 0
[pid=32757] ppid=32703 vsize=361556 CPUtime=0.79 cores=1,3,5,7
/proc/32757/stat : 32757 (python) S 32703 32703 31940 0 -1 4202560 1058 0 0 0 44 35 0 0 15 0 1 0 519346844 370233344 5833 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 5601795607879450885 0 0 17 5 0 0 0
/proc/32757/statm: 90389 5833 371 364 0 26283 0
[pid=32759] ppid=32757 vsize=4844 CPUtime=368.23 cores=1,3,5,7
/proc/32759/stat : 32759 (march_hi) R 32757 32759 32759 0 -1 4202496 1763 0 0 0 36823 0 0 0 25 0 1 0 519346844 4960256 817 33554432000 4194304 4955518 140735862916576 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32759/statm: 1211 817 106 186 0 1024 0
[pid=32761] ppid=32703 vsize=371812 CPUtime=0.78 cores=1,3,5,7
/proc/32761/stat : 32761 (python) S 32703 32703 31940 0 -1 4202560 1044 0 0 0 43 35 0 0 15 0 1 0 519346855 380735488 5837 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 9276069434445758728 0 0 17 1 0 0 0
/proc/32761/statm: 92953 5837 371 364 0 28844 0
[pid=32763] ppid=32761 vsize=4844 CPUtime=368.9 cores=1,3,5,7
/proc/32763/stat : 32763 (march_hi) R 32761 32763 32763 0 -1 4202496 1762 0 0 0 36890 0 0 0 25 0 1 0 519346855 4960256 817 33554432000 4194304 4955518 140734087841760 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32763/statm: 1211 817 106 186 0 1024 0
[pid=32765] ppid=32703 vsize=382068 CPUtime=0.78 cores=1,3,5,7
/proc/32765/stat : 32765 (python) S 32703 32703 31940 0 -1 4202560 1028 0 0 0 41 37 0 0 15 0 1 0 519346940 391237632 5841 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 17145142213043257607 0 0 17 7 0 0 0
/proc/32765/statm: 95517 5841 371 364 0 31405 0
[pid=32767] ppid=32765 vsize=4080 CPUtime=360.91 cores=1,3,5,7
/proc/32767/stat : 32767 (march_hi) R 32765 32767 32767 0 -1 4202496 1743 0 0 0 36091 0 0 0 25 0 1 0 519346940 4177920 798 33554432000 4194304 4955518 140736859430064 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32767/statm: 1020 798 106 186 0 833 0
[pid=32703/tid=32710] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32710/stat : 32710 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 13 0 519326898 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32713] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32713/stat : 32713 (python) S 32701 32703 31940 0 -1 4202560 21 936 0 0 0 0 0 0 22 0 13 0 519326901 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32716] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32716/stat : 32716 (python) S 32701 32703 31940 0 -1 4202560 20 936 0 0 0 0 0 0 20 0 13 0 519326904 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32719] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32719/stat : 32719 (python) S 32701 32703 31940 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 13 0 519326907 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
[pid=32703/tid=32728] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32728/stat : 32728 (python) S 32701 32703 31940 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 13 0 519336918 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
[pid=32703/tid=32731] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32731/stat : 32731 (python) S 32701 32703 31940 0 -1 4202560 27 936 0 0 0 0 0 0 22 0 13 0 519336921 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32736] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32736/stat : 32736 (python) S 32701 32703 31940 0 -1 4202560 24 936 0 0 0 0 0 0 23 0 13 0 519336927 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32739] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32739/stat : 32739 (python) S 32701 32703 31940 0 -1 4202560 32 936 0 0 0 0 0 0 25 0 13 0 519336931 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32758] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32758/stat : 32758 (python) S 32701 32703 31940 0 -1 4202560 30 936 0 0 0 0 0 0 20 0 13 0 519346844 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32762] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32762/stat : 32762 (python) S 32701 32703 31940 0 -1 4202560 29 936 0 0 0 0 0 0 21 0 13 0 519346855 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32766] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32766/stat : 32766 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 13 0 519346940 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=302] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/302/stat : 302 (python) S 32701 32703 31940 0 -1 4202560 25 936 0 0 0 0 0 0 21 0 13 0 519346950 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2266.44
Current children cumulated vsize (KiB) 9425812

[startup+569.401 s]
/proc/loadavg: 8.21 8.14 7.48 9/314 326
/proc/meminfo: memFree=23635236/32951124 swapFree=67111448/67111528
[pid=32703] ppid=32701 vsize=402356 CPUtime=1.1 cores=1,3,5,7
/proc/32703/stat : 32703 (python) S 32701 32703 31940 0 -1 4202496 20014 936 1 0 99 11 0 0 21 0 13 0 519326817 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/32703/statm: 100589 7335 1900 364 0 36474 0
[pid=301] ppid=32703 vsize=392112 CPUtime=0.78 cores=1,3,5,7
/proc/301/stat : 301 (python) S 32703 32703 31940 0 -1 4202560 1031 0 0 0 44 34 0 0 15 0 1 0 519346950 401522688 5802 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 5601795607879450888 0 0 17 1 0 0 0
/proc/301/statm: 98028 5802 371 364 0 33913 0
[pid=303] ppid=301 vsize=4080 CPUtime=366.51 cores=1,3,5,7
/proc/303/stat : 303 (march_hi) R 301 303 303 0 -1 4202496 1759 0 0 0 36651 0 0 0 25 0 1 0 519346950 4177920 811 33554432000 4194304 4955518 140734287206736 18446744073709551615 4285664 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/303/statm: 1020 811 106 186 0 833 0
[pid=32709] ppid=32703 vsize=288944 CPUtime=0.16 cores=1,3,5,7
/proc/32709/stat : 32709 (python) S 32703 32703 31940 0 -1 4202560 1083 0 0 0 8 8 0 0 19 0 2 0 519326898 295878656 5675 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/32709/statm: 72236 5675 410 364 0 8154 0
[pid=32711] ppid=32709 vsize=1017932 CPUtime=99.82 cores=1,3,5,7
/proc/32711/stat : 32711 (gnovelty+2) T 32709 32711 32711 0 -1 4202496 508 0 0 0 9982 0 0 0 25 0 1 0 519326899 1042362368 247 33554432000 134512640 135663704 4291522256 18446744073709551615 134524868 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/32711/statm: 254483 247 113 282 0 254199 0
[pid=32709/tid=32725] ppid=32703 vsize=288944 CPUtime=0 cores=1,3,5,7
/proc/32709/task/32725/stat : 32725 (python) S 32703 32703 31940 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519336915 295878656 5675 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604470961591360 0 0 -1 1 0 0 0
[pid=32712] ppid=32703 vsize=289420 CPUtime=0.16 cores=1,3,5,7
/proc/32712/stat : 32712 (python) S 32703 32703 31940 0 -1 4202560 1086 0 0 0 9 7 0 0 19 0 2 0 519326901 296366080 5766 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32712/statm: 72355 5766 400 364 0 8270 0
[pid=32714] ppid=32712 vsize=1017932 CPUtime=100.15 cores=1,3,5,7
/proc/32714/stat : 32714 (gnovelty+2) T 32712 32714 32714 0 -1 4202496 512 0 0 0 10015 0 0 0 25 0 1 0 519326902 1042362368 248 33554432000 134512640 135663704 4290738512 18446744073709551615 134524916 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32714/statm: 254483 248 113 282 0 254199 0
[pid=32712/tid=32727] ppid=32703 vsize=289420 CPUtime=0 cores=1,3,5,7
/proc/32712/task/32727/stat : 32727 (python) S 32703 32703 31940 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519336918 296366080 5766 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604471161707264 0 0 -1 3 0 0 0
[pid=32715] ppid=32703 vsize=299204 CPUtime=0.16 cores=1,3,5,7
/proc/32715/stat : 32715 (python) S 32703 32703 31940 0 -1 4202560 1085 0 0 0 9 7 0 0 18 0 2 0 519326904 306384896 5667 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32715/statm: 74801 5667 400 364 0 10713 0
[pid=32717] ppid=32715 vsize=416788 CPUtime=99.83 cores=1,3,5,7
/proc/32717/stat : 32717 (adaptg2wsat2009) T 32715 32717 32717 0 -1 4202496 630 0 0 0 9983 0 0 0 25 0 1 0 519326904 426790912 364 33554432000 134512640 135107411 4289361632 18446744073709551615 134532224 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32717/statm: 104197 364 59 146 0 103073 0
[pid=32715/tid=32733] ppid=32703 vsize=299204 CPUtime=0 cores=1,3,5,7
/proc/32715/task/32733/stat : 32733 (python) S 32703 32703 31940 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 519336922 306384896 5667 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604463151012544 0 0 -1 1 0 0 0
[pid=32718] ppid=32703 vsize=310068 CPUtime=0.17 cores=1,3,5,7
/proc/32718/stat : 32718 (python) S 32703 32703 31940 0 -1 4202560 1115 0 0 0 9 8 0 0 19 0 2 0 519326907 317509632 5791 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32718/statm: 77517 5791 400 364 0 13426 0
[pid=32720] ppid=32718 vsize=416788 CPUtime=99.43 cores=1,3,5,7
/proc/32720/stat : 32720 (adaptg2wsat2009) T 32718 32720 32720 0 -1 4202496 627 0 0 0 9943 0 0 0 25 0 1 0 519326907 426790912 363 33554432000 134512640 135107411 4290224096 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/32720/statm: 104197 363 59 146 0 103073 0
[pid=32718/tid=32734] ppid=32703 vsize=310068 CPUtime=0 cores=1,3,5,7
/proc/32718/task/32734/stat : 32734 (python) S 32703 32703 31940 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 519336923 317509632 5791 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604468304498816 0 0 -1 3 0 0 0
[pid=32726] ppid=32703 vsize=320324 CPUtime=0.18 cores=1,3,5,7
/proc/32726/stat : 32726 (python) S 32703 32703 31940 0 -1 4202560 1128 0 0 0 10 8 0 0 19 0 2 0 519336918 328011776 5795 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/32726/statm: 80081 5795 400 364 0 15987 0
[pid=32729] ppid=32726 vsize=416788 CPUtime=99.98 cores=1,3,5,7
/proc/32729/stat : 32729 (adaptg2wsat2009) T 32726 32729 32729 0 -1 4202496 630 0 0 0 9998 0 0 0 25 0 1 0 519336918 426790912 362 33554432000 134512640 135107411 4289206688 18446744073709551615 134532128 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/32729/statm: 104197 362 59 146 0 103073 0
[pid=32726/tid=32764] ppid=32703 vsize=320324 CPUtime=0 cores=1,3,5,7
/proc/32726/task/32764/stat : 32764 (python) S 32703 32703 31940 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519346935 328011776 5795 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604467170404544 0 0 -1 5 0 0 0
[pid=32730] ppid=32703 vsize=330252 CPUtime=0.18 cores=1,3,5,7
/proc/32730/stat : 32730 (python) S 32703 32703 31940 0 -1 4202560 1134 0 0 0 10 8 0 0 19 0 2 0 519336921 338178048 5718 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/32730/statm: 82563 5718 400 364 0 18466 0
[pid=32732] ppid=32730 vsize=1017932 CPUtime=99.16 cores=1,3,5,7
/proc/32732/stat : 32732 (gnovelty+2) T 32730 32732 32732 0 -1 4202496 513 0 0 0 9916 0 0 0 25 0 1 0 519336921 1042362368 247 33554432000 134512640 135663704 4291382720 18446744073709551615 134525224 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32732/statm: 254483 247 113 282 0 254199 0
[pid=32730/tid=32756] ppid=32703 vsize=330252 CPUtime=0 cores=1,3,5,7
/proc/32730/task/32756/stat : 32756 (python) S 32703 32703 31940 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 519346840 338178048 5718 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604471138165824 0 0 -1 1 0 0 0
[pid=32735] ppid=32703 vsize=340856 CPUtime=0.17 cores=1,3,5,7
/proc/32735/stat : 32735 (python) S 32703 32703 31940 0 -1 4202560 1142 0 0 0 10 7 0 0 19 0 2 0 519336927 349036544 5808 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32735/statm: 85214 5808 400 364 0 21114 0
[pid=32737] ppid=32735 vsize=246932 CPUtime=100 cores=1,3,5,7
/proc/32737/stat : 32737 (FH) T 32735 32737 32737 0 -1 4202496 593 0 0 0 10000 0 0 0 25 0 1 0 519336927 252858368 326 33554432000 134512640 134936988 4290081296 18446744073709551615 134554229 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/32737/statm: 61733 326 41 104 0 61237 0
[pid=32735/tid=300] ppid=32703 vsize=340856 CPUtime=0 cores=1,3,5,7
/proc/32735/task/300/stat : 300 (python) S 32703 32703 31940 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 519346945 349036544 5808 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604471138166720 0 0 -1 3 0 0 0
[pid=32738] ppid=32703 vsize=351112 CPUtime=0.18 cores=1,3,5,7
/proc/32738/stat : 32738 (python) S 32703 32703 31940 0 -1 4202560 1190 0 0 0 10 8 0 0 19 0 2 0 519336931 359538688 5841 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/32738/statm: 87778 5841 406 364 0 23675 0
[pid=32740] ppid=32738 vsize=416788 CPUtime=98.03 cores=1,3,5,7
/proc/32740/stat : 32740 (adaptg2wsat2009) T 32738 32740 32740 0 -1 4202496 639 0 0 0 9803 0 0 0 25 0 1 0 519336932 426790912 364 33554432000 134512640 135107411 4292169360 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/32740/statm: 104197 364 59 146 0 103073 0
[pid=32738/tid=32760] ppid=32703 vsize=351112 CPUtime=0 cores=1,3,5,7
/proc/32738/task/32760/stat : 32760 (python) S 32703 32703 31940 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 519346851 359538688 5841 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 514 18446604458925869760 0 0 -1 7 0 0 0
[pid=32757] ppid=32703 vsize=361556 CPUtime=0.79 cores=1,3,5,7
/proc/32757/stat : 32757 (python) S 32703 32703 31940 0 -1 4202560 1058 0 0 0 44 35 0 0 15 0 1 0 519346844 370233344 5833 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 8708497134141276421 0 0 17 5 0 0 0
/proc/32757/statm: 90389 5833 371 364 0 26283 0
[pid=32759] ppid=32757 vsize=4844 CPUtime=368.33 cores=1,3,5,7
/proc/32759/stat : 32759 (march_hi) R 32757 32759 32759 0 -1 4202496 1763 0 0 0 36833 0 0 0 25 0 1 0 519346844 4960256 817 33554432000 4194304 4955518 140735862916576 18446744073709551615 4299850 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32759/statm: 1211 817 106 186 0 1024 0
[pid=32761] ppid=32703 vsize=371812 CPUtime=0.78 cores=1,3,5,7
/proc/32761/stat : 32761 (python) S 32703 32703 31940 0 -1 4202560 1044 0 0 0 43 35 0 0 15 0 1 0 519346855 380735488 5837 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 9276069434445758728 0 0 17 1 0 0 0
/proc/32761/statm: 92953 5837 371 364 0 28844 0
[pid=32763] ppid=32761 vsize=4844 CPUtime=369 cores=1,3,5,7
/proc/32763/stat : 32763 (march_hi) R 32761 32763 32763 0 -1 4202496 1762 0 0 0 36900 0 0 0 25 0 1 0 519346855 4960256 817 33554432000 4194304 4955518 140734087841760 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32763/statm: 1211 817 106 186 0 1024 0
[pid=32765] ppid=32703 vsize=382068 CPUtime=0.78 cores=1,3,5,7
/proc/32765/stat : 32765 (python) S 32703 32703 31940 0 -1 4202560 1028 0 0 0 41 37 0 0 15 0 1 0 519346940 391237632 5841 33554432000 4194304 5683644 140736519665616 18446744073709551615 255106788934 0 0 16781312 514 17145142213043257607 0 0 17 7 0 0 0
/proc/32765/statm: 95517 5841 371 364 0 31405 0
[pid=32767] ppid=32765 vsize=4080 CPUtime=361.01 cores=1,3,5,7
/proc/32767/stat : 32767 (march_hi) R 32765 32767 32767 0 -1 4202496 1743 0 0 0 36101 0 0 0 25 0 1 0 519346940 4177920 798 33554432000 4194304 4955518 140736859430064 18446744073709551615 4208724 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32767/statm: 1020 798 106 186 0 833 0
[pid=32703/tid=32710] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32710/stat : 32710 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 13 0 519326898 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32713] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32713/stat : 32713 (python) S 32701 32703 31940 0 -1 4202560 21 936 0 0 0 0 0 0 22 0 13 0 519326901 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32716] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32716/stat : 32716 (python) S 32701 32703 31940 0 -1 4202560 20 936 0 0 0 0 0 0 20 0 13 0 519326904 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32719] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32719/stat : 32719 (python) S 32701 32703 31940 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 13 0 519326907 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
[pid=32703/tid=32728] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32728/stat : 32728 (python) S 32701 32703 31940 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 13 0 519336918 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 5 0 0 0
[pid=32703/tid=32731] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32731/stat : 32731 (python) S 32701 32703 31940 0 -1 4202560 27 936 0 0 0 0 0 0 22 0 13 0 519336921 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 1 0 0 0
[pid=32703/tid=32736] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32736/stat : 32736 (python) S 32701 32703 31940 0 -1 4202560 24 936 0 0 0 0 0 0 23 0 13 0 519336927 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 3 0 0 0
[pid=32703/tid=32739] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32739/stat : 32739 (python) S 32701 32703 31940 0 -1 4202560 32 936 0 0 0 0 0 0 25 0 13 0 519336931 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32758] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32758/stat : 32758 (python) S 32701 32703 31940 0 -1 4202560 30 936 0 0 0 0 0 0 20 0 13 0 519346844 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32762] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32762/stat : 32762 (python) S 32701 32703 31940 0 -1 4202560 29 936 0 0 0 0 0 0 21 0 13 0 519346855 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=32766] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/32766/stat : 32766 (python) S 32701 32703 31940 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 13 0 519346940 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
[pid=32703/tid=302] ppid=32701 vsize=402356 CPUtime=0 cores=1,3,5,7
/proc/32703/task/302/stat : 302 (python) S 32701 32703 31940 0 -1 4202560 25 936 0 0 0 0 0 0 21 0 13 0 519346950 412012544 7335 33554432000 4194304 5683644 140736519665616 18446744073709551615 255118592433 0 0 16781312 2 18446604471161973824 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2266.84
Current children cumulated vsize (KiB) 9425812

Child status: 0
Real time (s): 569.496
CPU time (s): 2267.35
CPU user time (s): 2265.1
CPU system time (s): 2.24766
CPU usage (%): 398.132
Max. virtual memory (cumulated for all children) (KiB): 9425812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2265.1
system time used= 2.24766
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 50851
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5718
involuntary context switches= 20375

runsolver used 2.49762 second user time and 5.42518 second system time

The end

Launcher Data

Begin job on node144 at 2011-05-01 18:58:27
IDJOB=3317375
IDBENCH=82840
IDSOLVER=1705
FILE ID=node144/3317375-1304269107
RUNJOBID= node144-1304267279-31959
PBS_JOBID= 13173935
Free space on /tmp= 73524 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S614849838-039.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317375-1304269107/watcher-3317375-1304269107 -o /tmp/evaluation-result-3317375-1304269107/solver-3317375-1304269107 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317375-1304269107.cnf -seed 225418663 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c6bf5481c82f3a24100e294aa3a73c9c
RANDOM SEED=225418663

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24037548 kB
Buffers:       2136960 kB
Cached:        4912008 kB
SwapCached:         80 kB
Active:        1699516 kB
Inactive:      6647224 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24037548 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:           31848 kB
Writeback:           0 kB
AnonPages:     1297164 kB
Mapped:          25120 kB
Slab:           488020 kB
PageTables:      19024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 31265620 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73496 MiB
End job on node144 at 2011-05-01 19:07:56