Trace number 3317392

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (TO) 3971.73 1300.19

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S839353433-100.UNKNOWN.cnf
MD5SUMe68176dd0214c3858ad791ec08d1acee
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.32/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.45	c INFO: solving HOME/instance-3317392-1304269351.cnf
0.32/0.45	c INFO: computing task features
0.40/0.50	c INFO: computed variable-clause graph statistics
0.40/0.50	c INFO: computed clause balance statistics
0.60/0.76	c INFO: computed variable balance statistics
0.70/0.87	c INFO: computed small-clause counts
0.70/0.87	c INFO: computed Horn-clause counts
0.70/0.88	c INFO: computed variable graph statistics
0.70/0.88	c INFO: collected features for HOME/instance-3317392-1304269351.cnf in 0.42 s
0.80/0.91	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.49)
0.80/0.94	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.10)
0.80/0.96	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.06)
0.80/0.99	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.04)
350.63/101.13	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.03)
350.87/101.28	c INFO: running gnovelty+2@0 for 97 with 4699 remaining (b = 0.03)
419.73/124.26	c INFO: running FH@0 for 97 with 4676 remaining (b = 0.02)
421.98/125.18	c INFO: running adaptg2wsat2009++@0 for 97 with 4675 remaining (b = 0.02)
692.21/215.39	c INFO: running adaptg2wsat2009++@0 for 97 with 4585 remaining (b = 0.02)
734.23/229.43	c INFO: running hybridGM3@0 for 194 with 4571 remaining (b = 0.03)
859.77/271.57	c INFO: running FH@0 for 97 with 4528 remaining (b = 0.01)
898.82/284.65	c INFO: running march_hi@0 for 485 with 4515 remaining (b = 0.07)
1021.09/325.65	c INFO: running march_hi@0 for 388 with 4474 remaining (b = 0.05)
1155.83/370.81	c INFO: running hybridGM3@0 for 194 with 4429 remaining (b = 0.02)
1556.07/505.03	c INFO: running hybridGM3@98 for 97 with 4295 remaining (b = 0.01)
2033.03/654.33	c INFO: running hybridGM3@193 for 97 with 4146 remaining (b = 0.01)
2179.75/703.52	c INFO: running gnovelty+2@0 for 97 with 4096 remaining (b = 0.01)
2331.81/754.56	c INFO: running march_hi@0 for 388 with 4045 remaining (b = 0.04)
2513.69/815.55	c INFO: running march_hi@98 for 291 with 3984 remaining (b = 0.03)
2652.85/856.86	c INFO: running hybridGM3@0 for 194 with 3943 remaining (b = 0.02)
2729.96/882.80	c INFO: running march_hi@100 for 291 with 3917 remaining (b = 0.03)
3557.88/1160.84	c INFO: running march_hi@390 for 97 with 3639 remaining (b = 0.02)
3608.44/1177.89	c INFO: running march_hi@493 for 194 with 3622 remaining (b = 0.03)
3786.22/1237.68	c INFO: running adaptg2wsat2009++@0 for 97 with 3562 remaining (b = 0.01)
3851.06/1259.45	c INFO: running march_hi@678 for 97 with 3541 remaining (b = 0.02)
3933.66/1287.30	c INFO: running march_hi@195 for 194 with 3513 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317392-1304269351/watcher-3317392-1304269351 -o /tmp/evaluation-result-3317392-1304269351/solver-3317392-1304269351 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317392-1304269351.cnf -seed 199317606 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.97 9.12 7.96 7/285 30105
/proc/meminfo: memFree=28833684/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=15780 CPUtime=0 cores=1,3,5,7
/proc/30105/stat : 30105 (python) R 30103 30105 29287 0 -1 4202496 901 0 0 0 0 0 0 0 25 0 1 0 519350411 16158720 781 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261277381 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30105/statm: 3945 781 343 364 0 432 0

[startup+0.0173461 s]
/proc/loadavg: 8.97 9.12 7.96 7/285 30105
/proc/meminfo: memFree=28833684/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=16248 CPUtime=0.01 cores=1,3,5,7
/proc/30105/stat : 30105 (python) R 30103 30105 29287 0 -1 4202496 1052 0 0 0 1 0 0 0 25 0 1 0 519350411 16637952 923 33554432000 4194304 5683644 140734297748944 18446744073709551615 4868215 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30105/statm: 4062 923 381 364 0 549 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16248

[startup+0.100288 s]
/proc/loadavg: 8.97 9.12 7.96 7/285 30105
/proc/meminfo: memFree=28833684/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=104620 CPUtime=0.06 cores=1,3,5,7
/proc/30105/stat : 30105 (python) R 30103 30105 29287 0 -1 4202496 3144 0 0 0 5 1 0 0 25 0 1 0 519350411 107130880 2822 33554432000 4194304 5683644 140734297748944 18446744073709551615 4499535 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30105/statm: 26155 2822 847 364 0 1903 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104620

[startup+0.304252 s]
/proc/loadavg: 8.97 9.12 7.96 7/285 30105
/proc/meminfo: memFree=28833684/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=198920 CPUtime=0.23 cores=1,3,5,7
/proc/30105/stat : 30105 (python) R 30103 30105 29287 0 -1 4202496 7023 934 1 0 18 5 0 0 17 0 1 0 519350411 203694080 5053 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261283822 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/30105/statm: 49730 5053 1466 364 0 3757 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 198920

[startup+0.70018 s]
/proc/loadavg: 8.97 9.12 7.96 7/285 30105
/proc/meminfo: memFree=28833684/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=279944 CPUtime=0.6 cores=1,3,5,7
/proc/30105/stat : 30105 (python) R 30103 30105 29287 0 -1 4202496 10127 934 1 0 53 7 0 0 17 0 1 0 519350411 286662656 7384 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261283807 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/30105/statm: 69986 7384 1826 364 0 5910 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 279944

[startup+1.50104 s]
/proc/loadavg: 8.97 9.12 7.96 11/295 30119
/proc/meminfo: memFree=28797148/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=320360 CPUtime=0.9 cores=1,3,5,7
/proc/30105/stat : 30105 (python) S 30103 30105 29287 0 -1 4202496 13135 934 1 0 82 8 0 0 21 0 5 0 519350411 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/30105/statm: 80090 7288 1883 364 0 15999 0
[pid=30111] ppid=30105 vsize=278800 CPUtime=0 cores=1,3,5,7
/proc/30111/stat : 30111 (python) S 30105 30105 29287 0 -1 4202560 738 0 0 0 0 0 0 0 19 0 1 0 519350502 285491200 5638 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636623 0 0 16781312 514 976024106765910015 0 0 17 7 0 0 0
/proc/30111/statm: 69700 5638 354 364 0 5618 0
[pid=30113] ppid=30111 vsize=1018084 CPUtime=0.57 cores=1,3,5,7
/proc/30113/stat : 30113 (gnovelty+2) R 30111 30113 30113 0 -1 4202496 552 0 0 0 57 0 0 0 22 0 1 0 519350502 1042518016 286 33554432000 134512640 135663704 4293944464 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30113/statm: 254521 286 113 282 0 254237 0
[pid=30114] ppid=30105 vsize=289400 CPUtime=0 cores=1,3,5,7
/proc/30114/stat : 30114 (python) S 30105 30105 29287 0 -1 4202560 737 0 0 0 0 0 0 0 21 0 1 0 519350505 296345600 5707 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 4400081436544073727 0 0 17 3 0 0 0
/proc/30114/statm: 72350 5707 348 364 0 8265 0
[pid=30116] ppid=30114 vsize=1018084 CPUtime=0.55 cores=1,3,5,7
/proc/30116/stat : 30116 (gnovelty+2) R 30114 30116 30116 0 -1 4202496 551 0 0 0 55 0 0 0 25 0 1 0 519350505 1042518016 287 33554432000 134512640 135663704 4292256128 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30116/statm: 254521 287 113 282 0 254237 0
[pid=30117] ppid=30105 vsize=299320 CPUtime=0 cores=1,3,5,7
/proc/30117/stat : 30117 (python) S 30105 30105 29287 0 -1 4202560 719 0 0 0 0 0 0 0 19 0 1 0 519350507 306503680 5620 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 2317863699257229311 0 0 17 7 0 0 0
/proc/30117/statm: 74830 5620 344 364 0 10742 0
[pid=30119] ppid=30105 vsize=310116 CPUtime=0 cores=1,3,5,7
/proc/30119/stat : 30119 (python) S 30105 30105 29287 0 -1 4202560 734 0 0 0 0 0 0 0 21 0 1 0 519350510 317558784 5745 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 16752272964543578111 0 0 17 7 0 0 0
/proc/30119/statm: 77529 5745 344 364 0 13438 0
[pid=30105/tid=30112] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30112/stat : 30112 (python) S 30103 30105 29287 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 5 0 519350502 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30115] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30115/stat : 30115 (python) S 30103 30105 29287 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 5 0 519350505 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30118] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30118/stat : 30118 (python) S 30103 30105 29287 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 5 0 519350508 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.02
Current children cumulated vsize (KiB) 3534164

[startup+3.10076 s]
/proc/loadavg: 8.97 9.12 7.96 10/298 30122
/proc/meminfo: memFree=28792108/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=320360 CPUtime=0.9 cores=1,3,5,7
/proc/30105/stat : 30105 (python) S 30103 30105 29287 0 -1 4202496 13135 934 1 0 82 8 0 0 21 0 5 0 519350411 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/30105/statm: 80090 7288 1883 364 0 15999 0
[pid=30111] ppid=30105 vsize=278800 CPUtime=0 cores=1,3,5,7
/proc/30111/stat : 30111 (python) S 30105 30105 29287 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 519350502 285491200 5638 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636623 0 0 16781312 514 976024106765877511 0 0 17 7 0 0 0
/proc/30111/statm: 69700 5638 354 364 0 5618 0
[pid=30113] ppid=30111 vsize=1018084 CPUtime=2.17 cores=1,3,5,7
/proc/30113/stat : 30113 (gnovelty+2) R 30111 30113 30113 0 -1 4202496 552 0 0 0 217 0 0 0 25 0 1 0 519350502 1042518016 286 33554432000 134512640 135663704 4293944464 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30113/statm: 254521 286 113 282 0 254237 0
[pid=30114] ppid=30105 vsize=289400 CPUtime=0 cores=1,3,5,7
/proc/30114/stat : 30114 (python) S 30105 30105 29287 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 519350505 296345600 5707 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 4400081436544041223 0 0 17 3 0 0 0
/proc/30114/statm: 72350 5707 348 364 0 8265 0
[pid=30116] ppid=30114 vsize=1018084 CPUtime=2.15 cores=1,3,5,7
/proc/30116/stat : 30116 (gnovelty+2) R 30114 30116 30116 0 -1 4202496 551 0 0 0 215 0 0 0 25 0 1 0 519350505 1042518016 287 33554432000 134512640 135663704 4292256128 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30116/statm: 254521 287 113 282 0 254237 0
[pid=30117] ppid=30105 vsize=299320 CPUtime=0 cores=1,3,5,7
/proc/30117/stat : 30117 (python) S 30105 30105 29287 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 519350507 306503680 5624 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 2317863699257196806 0 0 17 7 0 0 0
/proc/30117/statm: 74830 5624 348 364 0 10742 0
[pid=30121] ppid=30117 vsize=417056 CPUtime=2.08 cores=1,3,5,7
/proc/30121/stat : 30121 (adaptg2wsat2009) R 30117 30121 30121 0 -1 4202496 717 0 0 0 208 0 0 0 25 0 1 0 519350512 427065344 450 33554432000 134512640 135107411 4290804512 18446744073709551615 134531736 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/30121/statm: 104264 450 59 146 0 103140 0
[pid=30119] ppid=30105 vsize=310116 CPUtime=0 cores=1,3,5,7
/proc/30119/stat : 30119 (python) S 30105 30105 29287 0 -1 4202560 751 0 0 0 0 0 0 0 18 0 1 0 519350510 317558784 5749 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 16752272964543545606 0 0 17 7 0 0 0
/proc/30119/statm: 77529 5749 348 364 0 13438 0
[pid=30122] ppid=30119 vsize=417056 CPUtime=1.03 cores=1,3,5,7
/proc/30122/stat : 30122 (adaptg2wsat2009) R 30119 30122 30122 0 -1 4202496 716 0 0 0 103 0 0 0 25 0 1 0 519350512 427065344 450 33554432000 134512640 135107411 4294039296 18446744073709551615 134531213 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30122/statm: 104264 450 59 146 0 103140 0
[pid=30105/tid=30112] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30112/stat : 30112 (python) S 30103 30105 29287 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 5 0 519350502 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30115] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30115/stat : 30115 (python) S 30103 30105 29287 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 5 0 519350505 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30118] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30118/stat : 30118 (python) S 30103 30105 29287 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 5 0 519350508 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30120] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30120/stat : 30120 (python) S 30103 30105 29287 0 -1 4202560 19 934 0 0 0 0 0 0 22 0 5 0 519350512 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.33
Current children cumulated vsize (KiB) 4368276

[startup+6.30119 s]
/proc/loadavg: 8.97 9.12 7.97 10/298 30122
/proc/meminfo: memFree=28789660/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=320360 CPUtime=0.9 cores=1,3,5,7
/proc/30105/stat : 30105 (python) S 30103 30105 29287 0 -1 4202496 13135 934 1 0 82 8 0 0 21 0 5 0 519350411 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/30105/statm: 80090 7288 1883 364 0 15999 0
[pid=30111] ppid=30105 vsize=278800 CPUtime=0 cores=1,3,5,7
/proc/30111/stat : 30111 (python) S 30105 30105 29287 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 519350502 285491200 5661 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636623 0 0 16781312 514 976024106765877511 0 0 17 7 0 0 0
/proc/30111/statm: 69700 5661 377 364 0 5618 0
[pid=30113] ppid=30111 vsize=1018084 CPUtime=5.31 cores=1,3,5,7
/proc/30113/stat : 30113 (gnovelty+2) R 30111 30113 30113 0 -1 4202496 552 0 0 0 531 0 0 0 25 0 1 0 519350502 1042518016 286 33554432000 134512640 135663704 4293944464 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30113/statm: 254521 286 113 282 0 254237 0
[pid=30114] ppid=30105 vsize=289400 CPUtime=0 cores=1,3,5,7
/proc/30114/stat : 30114 (python) S 30105 30105 29287 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 519350505 296345600 5730 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 4400081436544041223 0 0 17 3 0 0 0
/proc/30114/statm: 72350 5730 371 364 0 8265 0
[pid=30116] ppid=30114 vsize=1018084 CPUtime=5.35 cores=1,3,5,7
/proc/30116/stat : 30116 (gnovelty+2) R 30114 30116 30116 0 -1 4202496 551 0 0 0 535 0 0 0 25 0 1 0 519350505 1042518016 287 33554432000 134512640 135663704 4292256128 18446744073709551615 134525009 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30116/statm: 254521 287 113 282 0 254237 0
[pid=30117] ppid=30105 vsize=299320 CPUtime=0 cores=1,3,5,7
/proc/30117/stat : 30117 (python) S 30105 30105 29287 0 -1 4202560 901 0 0 0 0 0 0 0 18 0 1 0 519350507 306503680 5646 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 2317863699257196806 0 0 17 7 0 0 0
/proc/30117/statm: 74830 5646 370 364 0 10742 0
[pid=30121] ppid=30117 vsize=417056 CPUtime=5.28 cores=1,3,5,7
/proc/30121/stat : 30121 (adaptg2wsat2009) R 30117 30121 30121 0 -1 4202496 717 0 0 0 528 0 0 0 25 0 1 0 519350512 427065344 450 33554432000 134512640 135107411 4290804512 18446744073709551615 134532352 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/30121/statm: 104264 450 59 146 0 103140 0
[pid=30119] ppid=30105 vsize=310116 CPUtime=0 cores=1,3,5,7
/proc/30119/stat : 30119 (python) S 30105 30105 29287 0 -1 4202560 931 0 0 0 0 0 0 0 18 0 1 0 519350510 317558784 5772 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 16752272964543545606 0 0 17 7 0 0 0
/proc/30119/statm: 77529 5772 371 364 0 13438 0
[pid=30122] ppid=30119 vsize=417056 CPUtime=2.62 cores=1,3,5,7
/proc/30122/stat : 30122 (adaptg2wsat2009) R 30119 30122 30122 0 -1 4202496 716 0 0 0 262 0 0 0 25 0 1 0 519350512 427065344 450 33554432000 134512640 135107411 4294039296 18446744073709551615 134532224 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30122/statm: 104264 450 59 146 0 103140 0
[pid=30105/tid=30112] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30112/stat : 30112 (python) S 30103 30105 29287 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 5 0 519350502 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30115] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30115/stat : 30115 (python) S 30103 30105 29287 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 5 0 519350505 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30118] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30118/stat : 30118 (python) S 30103 30105 29287 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 5 0 519350508 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30120] ppid=30103 vsize=320360 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30120/stat : 30120 (python) S 30103 30105 29287 0 -1 4202560 19 934 0 0 0 0 0 0 22 0 5 0 519350512 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 19.46
Current children cumulated vsize (KiB) 4368276

[startup+12.7011 s]
/proc/loadavg: 8.98 9.12 7.97 10/298 30123
/proc/meminfo: memFree=28787880/32951124 swapFree=67111348/67111528
[pid=30105] ppid=30103 vsize=320360 CPUtime=0.9 cores=1,3,5,7
/proc/30105/stat : 30105 (python) S 30103 30105 29287 0 -1 4202496 13135 934 1 0 82 8 0 0 21 0 5 0 519350411 328048640 7288 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/30105/statm: 80090 7288 1883 364 0 15999 0
[pid=30111] ppid=30105 vsize=278800 CPUtime=0.01 cores=1,3,5,7
/proc/30111/stat : 30111 (python) S 30105 30105 29287 0 -1 4202560 904 0 0 0 0 1 0 0 18 0 1 0 519350502 285491200 5661 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636623 0 0 16781312 514 17776481785417269511 0 0 17 7 0 0 0
/proc/30111/statm: 69700 5661 377 364 0 5618 0
[pid=30113] ppid=30111 vsize=1018084 CPUtime=11.63 cores=1,3,5,7
/proc/30113/stat : 30113 (gnovelty+2) R 30111 30113 30113 0 -1 4202496 552 0 0 0 1163 0 0 0 25 0 1 0 519350502 1042518016 286 33554432000 134512640 135663704 4293944464 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30113/statm: 254521 286 113 282 0 254237 0
[pid=30114] ppid=30105 vsize=289400 CPUtime=0.01 cores=1,3,5,7
/proc/30114/stat : 30114 (python) S 30105 30105 29287 0 -1 4202560 900 0 0 0 1 0 0 0 18 0 1 0 519350505 296345600 5730 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 17776481785417269511 0 0 17 3 0 0 0
/proc/30114/statm: 72350 5730 371 364 0 8265 0
[pid=30116] ppid=30114 vsize=1018084 CPUtime=11.75 cores=1,3,5,7
/proc/30116/stat : 30116 (gnovelty+2) R 30114 30116 30116 0 -1 4202496 551 0 0 0 1175 0 0 0 25 0 1 0 519350505 1042518016 287 33554432000 134512640 135663704 4292256128 18446744073709551615 134524957 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30116/statm: 254521 287 113 282 0 254237 0
[pid=30117] ppid=30105 vsize=299320 CPUtime=0.02 cores=1,3,5,7
/proc/30117/stat : 30117 (python) S 30105 30105 29287 0 -1 4202560 905 0 0 0 1 1 0 0 18 0 1 0 519350507 306503680 5647 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 17776481785417269510 0 0 17 7 0 0 0
/proc/30117/statm: 74830 5647 371 364 0 10742 0

################
# More data... #
################

/proc/30121/statm: 104264 450 59 146 0 103140 0
[pid=30117/tid=30131] ppid=30105 vsize=299320 CPUtime=0 cores=1,3,5,7
/proc/30117/task/30131/stat : 30131 (python) S 30105 30105 29287 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 519360527 306503680 5677 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604470632232128 0 0 -1 7 0 0 0
[pid=30119] ppid=30105 vsize=310116 CPUtime=0.22 cores=1,3,5,7
/proc/30119/stat : 30119 (python) S 30105 30105 29287 0 -1 4202560 1125 0 0 0 13 9 0 0 19 0 2 0 519350510 317558784 5802 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30119/statm: 77529 5802 400 364 0 13438 0
[pid=30122] ppid=30119 vsize=417056 CPUtime=98.05 cores=1,3,5,7
/proc/30122/stat : 30122 (adaptg2wsat2009) T 30119 30122 30122 0 -1 4202496 716 0 0 0 9805 0 0 0 25 0 1 0 519350512 427065344 450 33554432000 134512640 135107411 4294039296 18446744073709551615 134539283 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/30122/statm: 104264 450 59 146 0 103140 0
[pid=30119/tid=30135] ppid=30105 vsize=310116 CPUtime=0 cores=1,3,5,7
/proc/30119/task/30135/stat : 30135 (python) S 30105 30105 29287 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 519362834 317558784 5802 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604469698037632 0 0 -1 3 0 0 0
[pid=30128] ppid=30105 vsize=320372 CPUtime=0.21 cores=1,3,5,7
/proc/30128/stat : 30128 (python) S 30105 30105 29287 0 -1 4202560 1135 0 0 0 12 9 0 0 19 0 2 0 519360524 328060928 5806 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30128/statm: 80093 5806 400 364 0 15999 0
[pid=30130] ppid=30128 vsize=417056 CPUtime=100.86 cores=1,3,5,7
/proc/30130/stat : 30130 (adaptg2wsat2009) T 30128 30130 30130 0 -1 4202496 717 0 0 0 10086 0 0 0 25 0 1 0 519360524 427065344 449 33554432000 134512640 135107411 4293428448 18446744073709551615 134531795 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/30130/statm: 104264 449 59 146 0 103140 0
[pid=30128/tid=30149] ppid=30105 vsize=320372 CPUtime=0 cores=1,3,5,7
/proc/30128/task/30149/stat : 30149 (python) S 30105 30105 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519371947 328060928 5806 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604471162826816 0 0 -1 7 0 0 0
[pid=30132] ppid=30105 vsize=330628 CPUtime=0.33 cores=1,3,5,7
/proc/30132/stat : 30132 (python) S 30105 30105 29287 0 -1 4202560 1153 0 0 0 17 16 0 0 19 0 2 0 519360539 338563072 5831 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30132/statm: 82657 5831 400 364 0 18560 0
[pid=30134] ppid=30132 vsize=1018084 CPUtime=98.76 cores=1,3,5,7
/proc/30134/stat : 30134 (gnovelty+2) T 30132 30134 30134 0 -1 4202496 554 0 0 0 9876 0 0 0 25 0 1 0 519360539 1042518016 287 33554432000 134512640 135663704 4290037200 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/30134/statm: 254521 287 113 282 0 254237 0
[pid=30132/tid=30167] ppid=30105 vsize=330628 CPUtime=0 cores=1,3,5,7
/proc/30132/task/30167/stat : 30167 (python) S 30105 30105 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519378872 338563072 5831 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604459096695744 0 0 -1 7 0 0 0
[pid=30136] ppid=30105 vsize=341048 CPUtime=0.27 cores=1,3,5,7
/proc/30136/stat : 30136 (python) S 30105 30105 29287 0 -1 4202560 1191 0 0 0 15 12 0 0 19 0 2 0 519362837 349233152 5861 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30136/statm: 85262 5861 406 364 0 21162 0
[pid=30138] ppid=30136 vsize=247232 CPUtime=98.23 cores=1,3,5,7
/proc/30138/stat : 30138 (FH) T 30136 30138 30138 0 -1 4202496 673 0 0 0 9823 0 0 0 25 0 1 0 519362837 253165568 406 33554432000 134512640 134936988 4292351408 18446744073709551615 134554976 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/30138/statm: 61808 406 41 104 0 61312 0
[pid=30136/tid=30162] ppid=30105 vsize=341048 CPUtime=0 cores=1,3,5,7
/proc/30136/task/30162/stat : 30162 (python) S 30105 30105 29287 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 519377564 349233152 5861 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604461659272384 0 0 -1 7 0 0 0
[pid=30140] ppid=30105 vsize=351304 CPUtime=0.19 cores=1,3,5,7
/proc/30140/stat : 30140 (python) S 30105 30105 29287 0 -1 4202560 1181 0 0 0 10 9 0 0 19 0 2 0 519362929 359735296 5865 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30140/statm: 87826 5865 406 364 0 23723 0
[pid=30142] ppid=30140 vsize=417056 CPUtime=100.65 cores=1,3,5,7
/proc/30142/stat : 30142 (adaptg2wsat2009) T 30140 30142 30142 0 -1 4202496 726 0 0 0 10065 0 0 0 25 0 1 0 519362929 427065344 452 33554432000 134512640 135107411 4288827280 18446744073709551615 134531600 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/30142/statm: 104264 452 59 146 0 103140 0
[pid=30140/tid=30153] ppid=30105 vsize=351304 CPUtime=0 cores=1,3,5,7
/proc/30140/task/30153/stat : 30153 (python) S 30105 30105 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519373350 359735296 5865 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604471119554496 0 0 -1 7 0 0 0
[pid=30150] ppid=30105 vsize=361560 CPUtime=0.21 cores=1,3,5,7
/proc/30150/stat : 30150 (python) S 30105 30105 29287 0 -1 4202560 1172 0 0 0 11 10 0 0 19 0 2 0 519371950 370237440 5866 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30150/statm: 90390 5866 400 364 0 26284 0
[pid=30152] ppid=30150 vsize=417056 CPUtime=100.66 cores=1,3,5,7
/proc/30152/stat : 30152 (adaptg2wsat2009) T 30150 30152 30152 0 -1 4202496 721 0 0 0 10066 0 0 0 25 0 1 0 519371951 427065344 451 33554432000 134512640 135107411 4292388768 18446744073709551615 134531797 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/30152/statm: 104264 451 59 146 0 103140 0
[pid=30150/tid=30172] ppid=30105 vsize=361560 CPUtime=0 cores=1,3,5,7
/proc/30150/task/30172/stat : 30172 (python) S 30105 30105 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519382972 370237440 5866 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604461729875264 0 0 -1 7 0 0 0
[pid=30154] ppid=30105 vsize=371816 CPUtime=0.99 cores=1,3,5,7
/proc/30154/stat : 30154 (python) S 30105 30105 29287 0 -1 4202560 1197 0 0 0 52 47 0 0 18 0 2 0 519373354 380739584 5905 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30154/statm: 92954 5905 409 364 0 28845 0
[pid=30156] ppid=30154 vsize=268420 CPUtime=389.01 cores=1,3,5,7
/proc/30156/stat : 30156 (hybridGM3) T 30154 30156 30156 0 -1 4202496 4920 0 0 0 38901 0 0 0 25 0 1 0 519373354 274862080 4649 33554432000 134512640 135204385 4292256144 18446744073709551615 134536986 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/30156/statm: 67105 4649 64 169 0 66935 0
[pid=30154/tid=30240] ppid=30105 vsize=371816 CPUtime=0 cores=1,3,5,7
/proc/30154/task/30240/stat : 30240 (python) S 30105 30105 29287 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 519400910 380739584 5905 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604464109192256 0 0 -1 1 0 0 0
[pid=30163] ppid=30105 vsize=382072 CPUtime=0.2 cores=1,3,5,7
/proc/30163/stat : 30163 (python) S 30105 30105 29287 0 -1 4202560 1166 0 0 0 14 6 0 0 19 0 2 0 519377568 391241728 5900 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30163/statm: 95518 5900 400 364 0 31406 0
[pid=30165] ppid=30163 vsize=247236 CPUtime=98.07 cores=1,3,5,7
/proc/30165/stat : 30165 (FH) T 30163 30165 30165 0 -1 4202496 678 0 0 0 9807 0 0 0 25 0 1 0 519377568 253169664 405 33554432000 134512640 134936988 4288952800 18446744073709551615 134554623 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/30165/statm: 61809 405 41 104 0 61313 0
[pid=30163/tid=30177] ppid=30105 vsize=382072 CPUtime=0 cores=1,3,5,7
/proc/30163/task/30177/stat : 30177 (python) S 30105 30105 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519387487 391241728 5900 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604469201273216 0 0 -1 7 0 0 0
[pid=30168] ppid=30105 vsize=392844 CPUtime=2.01 cores=1,3,5,7
/proc/30168/stat : 30168 (python) S 30105 30105 29287 0 -1 4202560 1199 0 0 0 112 89 0 0 15 0 2 0 519378876 402272256 6004 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/30168/statm: 98211 6004 400 364 0 34096 0
[pid=30170] ppid=30168 vsize=93576 CPUtime=843.26 cores=1,3,5,7
/proc/30170/stat : 30170 (march_hi) R 30168 30170 30170 0 -1 4202496 23388 0 0 0 84321 5 0 0 25 0 1 0 519378876 95821824 22300 33554432000 4194304 4955518 140735210640384 18446744073709551615 4208663 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/30170/statm: 23394 22300 106 186 0 23207 0
[pid=30168/tid=30265] ppid=30105 vsize=392844 CPUtime=0 cores=1,3,5,7
/proc/30168/task/30265/stat : 30265 (python) S 30105 30105 29287 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 519438686 402272256 6004 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604461411260224 0 0 -1 1 0 0 0
[pid=30173] ppid=30105 vsize=402224 CPUtime=1.93 cores=1,3,5,7
/proc/30173/stat : 30173 (python) S 30105 30105 29287 0 -1 4202560 1210 0 0 0 103 90 0 0 15 0 2 0 519382977 411877376 5789 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/30173/statm: 100556 5789 400 364 0 36438 0
[pid=30175] ppid=30173 vsize=93576 CPUtime=687.18 cores=1,3,5,7
/proc/30175/stat : 30175 (march_hi) R 30173 30175 30175 0 -1 4202496 19678 0 0 0 68714 4 0 0 25 0 1 0 519382977 95821824 18583 33554432000 4194304 4955518 140734934526544 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30175/statm: 23394 18583 106 186 0 23207 0
[pid=30173/tid=30258] ppid=30105 vsize=402224 CPUtime=0 cores=1,3,5,7
/proc/30173/task/30258/stat : 30258 (python) S 30105 30105 29287 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 519431962 411877376 5789 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604454225509248 0 0 -1 1 0 0 0
[pid=30178] ppid=30105 vsize=412884 CPUtime=0.62 cores=1,3,5,7
/proc/30178/stat : 30178 (python) S 30105 30105 29287 0 -1 4202560 1185 0 0 0 31 31 0 0 19 0 2 0 519387492 422793216 5911 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30178/statm: 103221 5911 400 364 0 39100 0
[pid=30180] ppid=30178 vsize=268420 CPUtime=195.88 cores=1,3,5,7
/proc/30180/stat : 30180 (hybridGM3) T 30178 30180 30180 0 -1 4202496 4919 0 0 0 19588 0 0 0 25 0 1 0 519387492 274862080 4649 33554432000 134512640 135204385 4290118640 18446744073709551615 134537376 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/30180/statm: 67105 4649 64 169 0 66935 0
[pid=30178/tid=30247] ppid=30105 vsize=412884 CPUtime=0 cores=1,3,5,7
/proc/30178/task/30247/stat : 30247 (python) S 30105 30105 29287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519420759 422793216 5911 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604456657015232 0 0 -1 1 0 0 0
[pid=30248] ppid=30105 vsize=423456 CPUtime=0.28 cores=1,3,5,7
/proc/30248/stat : 30248 (python) S 30105 30105 29287 0 -1 4202560 1231 0 0 0 15 13 0 0 19 0 2 0 519420763 433618944 5985 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30248/statm: 105864 5985 408 364 0 41740 0
[pid=30250] ppid=30248 vsize=1018084 CPUtime=97.08 cores=1,3,5,7
/proc/30250/stat : 30250 (gnovelty+2) T 30248 30250 30250 0 -1 4202496 567 0 0 0 9708 0 0 0 25 0 1 0 519420764 1042518016 287 33554432000 134512640 135663704 4292568640 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/30250/statm: 254521 287 113 282 0 254237 0
[pid=30248/tid=30260] ppid=30105 vsize=423456 CPUtime=0 cores=1,3,5,7
/proc/30248/task/30260/stat : 30260 (python) S 30105 30105 29287 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 519436093 433618944 5985 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604471112303872 0 0 -1 3 0 0 0
[pid=30252] ppid=30105 vsize=433712 CPUtime=1.11 cores=1,3,5,7
/proc/30252/stat : 30252 (python) S 30105 30105 29287 0 -1 4202560 1251 0 0 0 61 50 0 0 15 0 2 0 519425867 444121088 5988 33554432000 4194304 5683644 140734297748944 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30252/statm: 108428 5988 407 364 0 44301 0
[pid=30254] ppid=30252 vsize=63064 CPUtime=521.83 cores=1,3,5,7
/proc/30254/stat : 30254 (march_hi) R 30252 30254 30254 0 -1 4202496 15448 0 0 0 52178 5 0 0 25 0 1 0 519425867 64577536 14350 33554432000 4194304 4955518 140736440619776 18446744073709551615 4285809 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30254/statm: 15766 14350 106 186 0 15579 0
[pid=30252/tid=30281] ppid=30105 vsize=433712 CPUtime=0 cores=1,3,5,7
/proc/30252/task/30281/stat : 30281 (python) S 30105 30105 29287 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 519466491 444121088 5988 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604471112302976 0 0 -1 1 0 0 0
[pid=30261] ppid=30105 vsize=444132 CPUtime=0.73 cores=1,3,5,7
/proc/30261/stat : 30261 (python) S 30105 30105 29287 0 -1 4202560 1213 0 0 0 37 36 0 0 19 0 2 0 519436097 454791168 6027 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/30261/statm: 111033 6027 401 364 0 46903 0
[pid=30263] ppid=30261 vsize=268424 CPUtime=195.25 cores=1,3,5,7
/proc/30263/stat : 30263 (hybridGM3) T 30261 30263 30263 0 -1 4202496 4934 0 0 0 19525 0 0 0 25 0 1 0 519436098 274866176 4650 33554432000 134512640 135204385 4292436432 18446744073709551615 134537565 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/30263/statm: 67106 4650 64 169 0 66936 0
[pid=30261/tid=30284] ppid=30105 vsize=444132 CPUtime=0 cores=1,3,5,7
/proc/30261/task/30284/stat : 30284 (python) S 30105 30105 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519474175 454791168 6027 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 514 18446604469698035840 0 0 -1 7 0 0 0
[pid=30105/tid=30112] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30112/stat : 30112 (python) S 30103 30105 29287 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 18 0 519350502 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30115] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30115/stat : 30115 (python) S 30103 30105 29287 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 18 0 519350505 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 3 0 0 0
[pid=30105/tid=30118] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30118/stat : 30118 (python) S 30103 30105 29287 0 -1 4202560 38 934 0 0 0 0 0 0 18 0 18 0 519350508 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30120] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30120/stat : 30120 (python) S 30103 30105 29287 0 -1 4202560 19 934 0 0 0 0 0 0 22 0 18 0 519350512 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30129] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30129/stat : 30129 (python) S 30103 30105 29287 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 18 0 519360524 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30133] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30133/stat : 30133 (python) S 30103 30105 29287 0 -1 4202560 28 934 0 0 0 0 0 0 21 0 18 0 519360539 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30137] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30137/stat : 30137 (python) S 30103 30105 29287 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 18 0 519362837 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30141] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30141/stat : 30141 (python) S 30103 30105 29287 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 18 0 519362929 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30151] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30151/stat : 30151 (python) S 30103 30105 29287 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 18 0 519371951 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30155] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30155/stat : 30155 (python) S 30103 30105 29287 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 18 0 519373354 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30164] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30164/stat : 30164 (python) S 30103 30105 29287 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 18 0 519377568 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30169] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30169/stat : 30169 (python) S 30103 30105 29287 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 18 0 519378876 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30174] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30174/stat : 30174 (python) S 30103 30105 29287 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 18 0 519382977 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30179] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30179/stat : 30179 (python) S 30103 30105 29287 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 18 0 519387492 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30249] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30249/stat : 30249 (python) S 30103 30105 29287 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 18 0 519420763 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30253] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30253/stat : 30253 (python) S 30103 30105 29287 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 18 0 519425867 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
[pid=30105/tid=30262] ppid=30103 vsize=454284 CPUtime=0 cores=1,3,5,7
/proc/30105/task/30262/stat : 30262 (python) S 30103 30105 29287 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 18 0 519436097 465186816 7516 33554432000 4194304 5683644 140734297748944 18446744073709551615 254273440177 0 0 16781312 2 18446604462199980288 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3971.73
Current children cumulated vsize (KiB) 14317780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30105 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=679744
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=134979
# CPU time returned by wait4() is 1.81472
# while last known CPU time is 3971.73
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.19
CPU time (s): 3971.73
CPU user time (s): 3966.89
CPU system time (s): 4.84
CPU usage (%): 305.472
Max. virtual memory (cumulated for all children) (KiB): 14318096

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.67974
system time used= 0.134979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27484
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1157
involuntary context switches= 101

runsolver used 8.40572 second user time and 15.4876 second system time

The end

Launcher Data 

Begin job on node140 at 2011-05-01 19:02:31
IDJOB=3317392
IDBENCH=82857
IDSOLVER=1705
FILE ID=node140/3317392-1304269351
RUNJOBID= node140-1304267280-29306
PBS_JOBID= 13173939
Free space on /tmp= 73272 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S839353433-100.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317392-1304269351/watcher-3317392-1304269351 -o /tmp/evaluation-result-3317392-1304269351/solver-3317392-1304269351 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317392-1304269351.cnf -seed 199317606 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e68176dd0214c3858ad791ec08d1acee
RANDOM SEED=199317606

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28833716 kB
Buffers:        984336 kB
Cached:        1607716 kB
SwapCached:        176 kB
Active:        1194132 kB
Inactive:      2399912 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28833716 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           32100 kB
Writeback:           0 kB
AnonPages:     1001380 kB
Mapped:          25288 kB
Slab:           437764 kB
PageTables:      23476 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 30005940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73232 MiB
End job on node140 at 2011-05-01 19:24:13