Trace number 3292830

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-2-mt? (TO) 3067.8 1300.02

General information on the benchmark

NameSAT02/industrial/aloul/
Homer/homer17.shuffled.cnf
MD5SUMca62f6128dc3cad7229c7b9ee33a7492
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.484925
Satisfiable
(Un)Satisfiability was proved
Number of variables286
Number of clauses1742
Sum of the clauses size3718
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21716
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 526

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.00	c Using 4 threads
0.00/0.00	c This is CryptoMiniSat 3.0.0
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c Reading file 'HOME/instance-3292830-1304130490.cnf'
0.00/0.00	c -- header says num vars:            286
0.00/0.00	c -- header says num clauses:        1742
0.00/0.00	c -- clauses added:            0 learnts,         1742 normals,            0 xors
0.00/0.00	c -- vars added        286
0.00/0.00	c Parsing time:  0.00 s
0.00/0.00	c  N st     0         0       286        26      1716         0      3718         0   no data   no data
0.00/0.00	c asymm  cl-useful: 0/26/26 lits-rem:0 time: 0.00
0.00/0.00	c Flit:     0 Blit:      0 bXBeca:    0 bXProp:    0 Bins:      0 BRemL:      0 BRemN:      0 P:  0.0M T:  0.00
0.00/0.00	c blocked clauses removed:        0 vars:      0 tried:           0 T: 0.00 s
0.00/0.00	c bin-w-bin subsume rem            0 bins  time:  0.00 s
0.00/0.00	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  0.00 s
0.00/0.00	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:    286 time:  0.00 s
0.00/0.00	c Removed useless bin:       0  fixed:     0  props:   0.01M  time:  0.00 s
0.00/0.00	c lits-rem:         0  cl-subs:        0  v-elim:     26  v-fix:    0  time:  0.00 s
0.00/0.00	c Finding binary XORs  T:     0.00 s  found:       0
0.00/0.00	c Finding non-binary XORs:     0.00 s (found:       0, avg size: nan)
0.00/0.00	c calculated reachability. Time: 0.00
0.00/0.00	c Calc default polars -  time:   0.00 s pos:     128 undec:      26 neg:     132
0.00/0.00	c =========================================================================================
0.00/0.00	c types(t): F = full restart, N = normal restart
0.00/0.00	c types(t): S = simplification begin/end, E = solution found
0.00/0.00	c restart types(rt): st = static, dy = dynamic
0.00/0.00	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
0.00/0.00	c  B st     0         0       260       293      1423         0      6240         0   no data   no data
0.03/0.03	c Decided on static restart strategy
0.40/0.12	c  N st     8      4912       260       293      1423      4546      6240    143087   no data   no data
1.58/0.42	c  N st    10     11296       260       293      1423      4029      6240    117333   no data   no data
2.78/0.72	c  N st    11     17040       260       293      1423      8959      6240    263778   no data   no data
4.77/1.27	c  F st    12     25000       260       293      1423     10810      6240    357817   no data   no data
4.77/1.27	c Found part        0 vars:        130 clauses:       858 lits size:      3120
4.77/1.27	c Found part        1 vars:        130 clauses:       858 lits size:      3120
4.77/1.27	c Found parts:          2 time: 0.00 s
4.77/1.27	c Solving part 0
4.77/1.27	c  N st     0         0       130       145       713         0      3120         0   no data   no data
4.77/1.27	c asymm  cl-useful: 0/145/145 lits-rem:0 time: 0.00
4.77/1.27	c Flit:     0 Blit:      0 bXBeca:    0 bXProp:    0 Bins:      0 BRemL:      0 BRemN:      0 P:  0.0M T:  0.00
4.77/1.27	c Finding binary XORs  T:     0.00 s  found:       0
4.77/1.27	c Finding non-binary XORs:     0.00 s (found:       0, avg size: nan)
4.77/1.27	c calculated reachability. Time: 0.00
4.77/1.27	c Calc default polars -  time:   0.00 s pos:      67 undec:     156 neg:      63
4.77/1.27	c =========================================================================================
4.77/1.27	c types(t): F = full restart, N = normal restart
4.77/1.27	c types(t): S = simplification begin/end, E = solution found
4.77/1.27	c restart types(rt): st = static, dy = dynamic
4.77/1.27	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
4.77/1.27	c  B st     0         0       130       145       713         0      3120         0   no data   no data
5.17/1.31	c Decided on static restart strategy
5.17/1.37	c  N st     8      4914       130       145       713      4509      3120    137348   no data   no data
6.37/1.65	c  N st    10     11297       130       145       713      4112      3120    121972   no data   no data
7.17/1.89	c  N st    11     17043       130       145       713      9266      3120    308852   no data   no data
8.79/2.23	c  F st    12     25001       130       145       713     11488      3120    382646   no data   no data
8.79/2.23	c  N st    12     25001       130       145       713     11488      3120    382646   no data   no data
9.56/2.47	c Decided on static restart strategy
9.56/2.47	c  N st    18     30194       130       145       713      9906      3120    306419   no data   no data
11.17/2.85	c  N st    20     37307       130       145       713      9152      3120    282539   no data   no data
12.78/3.26	c  N st    21     43708       130       145       713     14742      3120    502051   no data   no data
15.96/4.01	c  N st    22     53308       130       145       713     14892      3120    500074   no data   no data
19.95/5.02	c  N st    23     67705       130       145       713     18936      3120    646665   no data   no data
27.53/6.92	c  F st    24     87501       130       145       713     16032      3120    523305   no data   no data
27.53/6.92	c  N st    24     87501       130       145       713     16032      3120    523305   no data   no data
29.13/7.36	c Decided on static restart strategy
30.36/7.64	c  N st    31     95541       130       145       713     11753      3120    356578   no data   no data
33.54/8.46	c  N st    33    106207       130       145       713     20937      3120    709496   no data   no data
37.13/9.31	c  N st    34    115807       130       145       713     17013      3120    538972   no data   no data
41.13/10.40	c  N st    35    130204       130       145       713     16689      3120    527901   no data   no data
51.51/12.97	c  N st    36    151799       130       145       713     21048      3120    707375   no data   no data
67.49/16.97	c  N st    37    184192       130       145       714     18624      3120    598283   no data   no data
87.06/21.80	c  N st    38    232780       130       145       714     27801      3120    959337   no data   no data
127.43/31.92	c  N st    39    305662       130       145       719     30980      3120   1007720   no data   no data
127.43/31.92	c Finding binary XORs  T:     0.00 s  found:       0
127.43/31.99	c  F st    40    306250       130       145       719     31438      3120   1026238   no data   no data
130.20/32.64	c Decided on static restart strategy
142.18/35.62	c  N st    50    334557       130       145       719     35196      3120   1197921   no data   no data
161.76/40.58	c  N st    52    370552       130       145       719     23903      3120    764291   no data   no data
185.73/46.54	c  N st    53    402944       130       145       719     28105      3120    945927   no data   no data
209.30/52.44	c  N st    54    451532       130       145       719     46878      3120   1687599   no data   no data
245.67/61.57	c  N st    55    524414       130       145       719     32471      3120   1079049   no data   no data
322.74/80.89	c  N st    56    633741       130       145       719     41480      3120   1408136   no data   no data
472.14/118.28	c  N st    57    797726       130       145       719     53275      3120   1849526   no data   no data
645.94/161.77	c  N st    58   1043702       129       145       723     52056      3120   1798390   no data   no data
680.69/170.46	c  F st    59   1071875       129       145       723     37712      3120   1225677   no data   no data
680.69/170.46	c  N st    59   1071875       129       145       723     37712      3120   1225677   no data   no data
683.86/171.22	c Decided on static restart strategy
699.04/175.00	c  N st    69   1100181       129       145       724     61309      3120   2113656   no data   no data
727.40/182.17	c  N st    71   1136176       129       145       724     53454      3120   1849836   no data   no data
738.98/185.06	c Finding binary XORs  T:     0.00 s  found:       0
765.75/191.73	c  N st    72   1168568       128       145       693     38279      3048   1227403   no data   no data
818.87/205.03	c  N st    73   1217157       127       145       698     39637      3048   1274110   no data   no data
842.85/211.02	c Finding binary XORs  T:     0.00 s  found:       0
881.31/220.95	c  N st    74   1290039       126       145       667     56205      2976   1888341   no data   no data
960.51/247.35	c Finding binary XORs  T:     0.00 s  found:       0
965.31/248.97	c  E st    75   1379306        77       121       531     13832      2153    269316   no data   no data

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3292830-1304130490/watcher-3292830-1304130490 -o /tmp/evaluation-result-3292830-1304130490/solver-3292830-1304130490 -C 4800 -W 1300 -M 15500 ./strangenight2-mt --threads=4 HOME/instance-3292830-1304130490.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.43 4.05 4.96 8/180 29291
/proc/meminfo: memFree=29746608/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=207988 CPUtime=0 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 665 0 0 0 0 0 0 0 25 0 4 0 603279667 212979712 588 33554432000 4194304 4627427 140735922465600 18446744073709551615 256415052833 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 51997 588 365 106 0 46968 0
[pid=29291/tid=29292] ppid=29289 vsize=207988 CPUtime=0 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 80 0 0 0 0 0 0 0 25 0 4 0 603279668 212979712 593 33554432000 4194304 4627427 140735922465600 18446744073709551615 4415488 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=207988 CPUtime=0 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 19 0 0 0 0 0 0 0 25 0 4 0 603279668 212979712 595 33554432000 4194304 4627427 140735922465600 18446744073709551615 256415496686 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=207988 CPUtime=0 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 76 0 0 0 0 0 0 0 25 0 4 0 603279668 212979712 595 33554432000 4194304 4627427 140735922465600 18446744073709551615 4507021 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.0127589 s]
/proc/loadavg: 3.43 4.05 4.96 8/180 29291
/proc/meminfo: memFree=29746608/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=282016 CPUtime=0.03 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 900 0 0 0 3 0 0 0 25 0 4 0 603279667 288784384 823 33554432000 4194304 4627427 140735922465600 18446744073709551615 4333399 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 70504 823 384 106 0 65475 0
[pid=29291/tid=29292] ppid=29289 vsize=282016 CPUtime=0 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 148 0 0 0 0 0 0 0 25 0 4 0 603279668 288784384 823 33554432000 4194304 4627427 140735922465600 18446744073709551615 256415496735 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=282016 CPUtime=0 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 109 0 0 0 0 0 0 0 25 0 4 0 603279668 288784384 823 33554432000 4194304 4627427 140735922465600 18446744073709551615 256415496686 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=282016 CPUtime=0 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 95 0 0 0 0 0 0 0 25 0 4 0 603279668 288784384 823 33554432000 4194304 4627427 140735922465600 18446744073709551615 4330954 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 282016

[startup+0.105604 s]
/proc/loadavg: 3.43 4.05 4.96 8/180 29291
/proc/meminfo: memFree=29746608/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=282420 CPUtime=0.4 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 1696 0 0 0 40 0 0 0 25 0 4 0 603279667 289198080 1619 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309270 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 70605 1619 384 106 0 65576 0
[pid=29291/tid=29292] ppid=29289 vsize=282420 CPUtime=0.1 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 357 0 0 0 10 0 0 0 25 0 4 0 603279668 289198080 1619 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309270 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=282420 CPUtime=0.1 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 301 0 0 0 10 0 0 0 25 0 4 0 603279668 289198080 1619 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309568 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=282420 CPUtime=0.09 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 293 0 0 0 9 0 0 0 25 0 4 0 603279668 289198080 1619 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309392 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 282420

[startup+0.300569 s]
/proc/loadavg: 3.43 4.05 4.96 8/180 29291
/proc/meminfo: memFree=29746608/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=284340 CPUtime=1.18 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 3006 0 0 0 118 0 0 0 25 0 4 0 603279667 291164160 2245 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309098 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 71085 2245 385 106 0 66056 0
[pid=29291/tid=29292] ppid=29289 vsize=284340 CPUtime=0.29 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 675 0 0 0 29 0 0 0 25 0 4 0 603279668 291164160 2245 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=284340 CPUtime=0.29 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 644 0 0 0 29 0 0 0 25 0 4 0 603279668 291164160 2245 33554432000 4194304 4627427 140735922465600 18446744073709551615 4308256 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=284340 CPUtime=0.29 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 635 0 0 0 29 0 0 0 25 0 4 0 603279668 291164160 2245 33554432000 4194304 4627427 140735922465600 18446744073709551615 4299718 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 284340

[startup+0.700496 s]
/proc/loadavg: 3.43 4.05 4.96 8/180 29291
/proc/meminfo: memFree=29746608/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=286364 CPUtime=2.78 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 5465 0 0 0 278 0 0 0 25 0 4 0 603279667 293236736 2881 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309195 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 71591 2881 385 106 0 66562 0
[pid=29291/tid=29292] ppid=29289 vsize=286364 CPUtime=0.69 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 1405 0 0 0 69 0 0 0 25 0 4 0 603279668 293236736 2881 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309287 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=286364 CPUtime=0.69 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 1328 0 0 0 69 0 0 0 25 0 4 0 603279668 293236736 2881 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=286364 CPUtime=0.69 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 1216 0 0 0 69 0 0 0 25 0 4 0 603279668 293236736 2881 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 286364

[startup+1.50034 s]
/proc/loadavg: 3.43 4.05 4.96 9/184 29296
/proc/meminfo: memFree=29721528/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=312976 CPUtime=5.97 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 9516 0 0 0 596 1 0 0 25 0 4 0 603279667 320487424 6189 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309902 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 78244 6189 386 106 0 73215 0
[pid=29291/tid=29292] ppid=29289 vsize=312976 CPUtime=1.49 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 2506 0 0 0 149 0 0 0 25 0 4 0 603279668 320487424 6189 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309392 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=312976 CPUtime=1.48 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 2415 0 0 0 148 0 0 0 25 0 4 0 603279668 320487424 6189 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309145 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=312976 CPUtime=1.49 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 2142 0 0 0 149 0 0 0 25 0 4 0 603279668 320487424 6189 33554432000 4194304 4627427 140735922465600 18446744073709551615 4308416 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 312976

[startup+3.10104 s]
/proc/loadavg: 3.43 4.05 4.96 9/184 29296
/proc/meminfo: memFree=29687312/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=350056 CPUtime=12.37 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 16303 0 0 0 1235 2 0 0 25 0 4 0 603279667 358457344 8639 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 87514 8639 386 106 0 82485 0
[pid=29291/tid=29292] ppid=29289 vsize=350056 CPUtime=3.09 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 3903 0 0 0 309 0 0 0 25 0 4 0 603279668 358457344 8639 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309256 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=350056 CPUtime=3.07 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 4193 0 0 0 307 0 0 0 25 0 4 0 603279668 358457344 8639 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309244 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=350056 CPUtime=3.09 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 3709 0 0 0 309 0 0 0 25 0 4 0 603279668 358457344 8639 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309568 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.37
Current children cumulated vsize (KiB) 350056

[startup+6.30044 s]
/proc/loadavg: 3.79 4.12 4.97 9/184 29296
/proc/meminfo: memFree=29669720/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=342208 CPUtime=25.15 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 26472 0 0 0 2511 4 0 0 25 0 4 0 603279667 350420992 10265 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309340 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 85552 10265 386 106 0 80523 0
[pid=29291/tid=29292] ppid=29289 vsize=342208 CPUtime=6.29 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 6203 0 0 0 629 0 0 0 25 0 4 0 603279668 350420992 10265 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=342208 CPUtime=6.26 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 6501 0 0 0 625 1 0 0 25 0 4 0 603279668 350420992 10265 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309572 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=342208 CPUtime=6.28 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 6687 0 0 0 628 0 0 0 25 0 4 0 603279668 350420992 10265 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309145 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 342208

[startup+12.7002 s]
/proc/loadavg: 4.13 4.18 4.99 9/184 29296
/proc/meminfo: memFree=29657080/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=333660 CPUtime=50.71 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 41785 0 0 0 5064 7 0 0 25 0 4 0 603279667 341667840 11945 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309225 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 83415 11945 386 106 0 78386 0
[pid=29291/tid=29292] ppid=29289 vsize=333660 CPUtime=12.68 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 8789 0 0 0 1268 0 0 0 25 0 4 0 603279668 341667840 11945 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=333660 CPUtime=12.62 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 10435 0 0 0 1260 2 0 0 25 0 4 0 603279668 341667840 11945 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309568 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=333660 CPUtime=12.69 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 10913 0 0 0 1268 1 0 0 25 0 4 0 603279668 341667840 11945 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309142 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 333660

[startup+25.5008 s]
/proc/loadavg: 4.99 4.37 5.04 9/184 29296
/proc/meminfo: memFree=29631500/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=346344 CPUtime=101.84 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 66067 0 0 0 10173 11 0 0 25 0 4 0 603279667 354656256 15322 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309098 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 86586 15322 386 106 0 81557 0
[pid=29291/tid=29292] ppid=29289 vsize=346344 CPUtime=25.49 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 12086 0 0 0 2548 1 0 0 25 0 4 0 603279668 354656256 15322 33554432000 4194304 4627427 140735922465600 18446744073709551615 4305493 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=346344 CPUtime=25.35 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 17031 0 0 0 2532 3 0 0 25 0 4 0 603279668 354656256 15322 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309098 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=346344 CPUtime=25.49 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 18133 0 0 0 2547 2 0 0 25 0 4 0 603279668 354656256 15322 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309270 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 346344

[startup+51.101 s]
/proc/loadavg: 6.16 4.69 5.13 9/184 29297
/proc/meminfo: memFree=29590360/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=361144 CPUtime=204.11 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 104522 0 0 0 20391 20 0 0 25 0 4 0 603279667 369811456 23015 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309242 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 90286 23015 386 106 0 85257 0
[pid=29291/tid=29292] ppid=29289 vsize=361144 CPUtime=51.09 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 18922 0 0 0 5106 3 0 0 25 0 4 0 603279668 369811456 23015 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=361144 CPUtime=50.81 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 28683 0 0 0 5076 5 0 0 25 0 4 0 603279668 369811456 23015 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309182 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=361144 CPUtime=51.09 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 28056 0 0 0 5104 5 0 0 25 0 4 0 603279668 369811456 23015 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309244 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.11
Current children cumulated vsize (KiB) 361144

[startup+102.306 s]
/proc/loadavg: 7.27 5.22 5.28 9/184 29298
/proc/meminfo: memFree=29499816/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=363212 CPUtime=408.65 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) R 29289 29291 29250 0 -1 4202496 169758 0 0 0 40831 34 0 0 25 0 4 0 603279667 371929088 32092 33554432000 4194304 4627427 140735922465600 18446744073709551615 4310126 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 90803 32092 386 106 0 85774 0
[pid=29291/tid=29292] ppid=29289 vsize=363212 CPUtime=102.3 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 32819 0 0 0 10223 7 0 0 25 0 4 0 603279668 371929088 32092 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309270 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=363212 CPUtime=101.74 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 46146 0 0 0 10165 9 0 0 25 0 4 0 603279668 371929088 32092 33554432000 4194304 4627427 140735922465600 18446744073709551615 4324341 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=363212 CPUtime=102.3 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 44132 0 0 0 10222 8 0 0 25 0 4 0 603279668 371929088 32092 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.65
Current children cumulated vsize (KiB) 363212

[startup+162.301 s]

################
# More data... #
################

[pid=29291] ppid=29289 vsize=325516 CPUtime=1872.32 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 372178 0 0 0 187154 78 0 0 25 0 4 0 603279667 333328384 19996 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 81379 19996 386 106 0 76350 0
[pid=29291/tid=29292] ppid=29289 vsize=325516 CPUtime=702.31 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 70220 11 0 0 25 0 4 0 603279668 333328384 19996 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=325516 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 333328384 19996 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=325516 CPUtime=702.31 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 167328 0 0 0 70201 30 0 0 25 0 4 0 603279668 333328384 19996 33554432000 4194304 4627427 140735922465600 18446744073709551615 4332648 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1872.32
Current children cumulated vsize (KiB) 325516

[startup+762.307 s]
/proc/loadavg: 4.07 5.00 5.37 5/184 29319
/proc/meminfo: memFree=29570980/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=325716 CPUtime=1992.33 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 382618 0 0 0 199153 80 0 0 25 0 4 0 603279667 333533184 21760 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 81429 21760 386 106 0 76400 0
[pid=29291/tid=29292] ppid=29289 vsize=325716 CPUtime=762.32 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 76221 11 0 0 25 0 4 0 603279668 333533184 21760 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714948 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=325716 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 333533184 21760 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=325716 CPUtime=762.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 177768 0 0 0 76200 32 0 0 25 0 4 0 603279668 333533184 21760 33554432000 4194304 4627427 140735922465600 18446744073709551615 4308416 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1992.33
Current children cumulated vsize (KiB) 325716

[startup+822.301 s]
/proc/loadavg: 4.02 4.82 5.28 5/184 29320
/proc/meminfo: memFree=29579504/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=326192 CPUtime=2112.33 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 395367 0 0 0 211150 83 0 0 25 0 4 0 603279667 334020608 20967 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 81548 20967 386 106 0 76519 0
[pid=29291/tid=29292] ppid=29289 vsize=326192 CPUtime=822.31 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 82220 11 0 0 25 0 4 0 603279668 334020608 20967 33554432000 4194304 4627427 140735922465600 18446744073709551615 4205248 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=326192 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 334020608 20967 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=326192 CPUtime=822.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 190517 0 0 0 82197 35 0 0 25 0 4 0 603279668 334020608 20967 33554432000 4194304 4627427 140735922465600 18446744073709551615 4310561 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2112.33
Current children cumulated vsize (KiB) 326192

[startup+882.3 s]
/proc/loadavg: 4.01 4.67 5.20 5/184 29322
/proc/meminfo: memFree=29570524/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=326548 CPUtime=2232.33 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 405556 0 0 0 223148 85 0 0 25 0 4 0 603279667 334385152 21605 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 81637 21605 386 106 0 76608 0
[pid=29291/tid=29292] ppid=29289 vsize=326548 CPUtime=882.31 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 88220 11 0 0 25 0 4 0 603279668 334385152 21605 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=326548 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 334385152 21605 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=326548 CPUtime=882.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 200706 0 0 0 88195 37 0 0 25 0 4 0 603279668 334385152 21605 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309145 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2232.33
Current children cumulated vsize (KiB) 326548

[startup+942.301 s]
/proc/loadavg: 4.00 4.54 5.12 5/184 29324
/proc/meminfo: memFree=29575164/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=326912 CPUtime=2352.33 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 415880 0 0 0 235146 87 0 0 25 0 4 0 603279667 334757888 22198 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 81728 22198 386 106 0 76699 0
[pid=29291/tid=29292] ppid=29289 vsize=326912 CPUtime=942.32 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 94221 11 0 0 25 0 4 0 603279668 334757888 22198 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714948 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=326912 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 334757888 22198 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=326912 CPUtime=942.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 211030 0 0 0 94193 39 0 0 25 0 4 0 603279668 334757888 22198 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309266 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2352.33
Current children cumulated vsize (KiB) 326912

[startup+1002.3 s]
/proc/loadavg: 4.00 4.44 5.05 5/184 29325
/proc/meminfo: memFree=29567800/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=327144 CPUtime=2472.34 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 426272 0 0 0 247145 89 0 0 25 0 4 0 603279667 334995456 22597 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 81786 22597 386 106 0 76757 0
[pid=29291/tid=29292] ppid=29289 vsize=327144 CPUtime=1002.32 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 100221 11 0 0 25 0 4 0 603279668 334995456 22597 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=327144 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 334995456 22597 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=327144 CPUtime=1002.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 221422 0 0 0 100192 40 0 0 25 0 4 0 603279668 334995456 22597 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309572 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2472.34
Current children cumulated vsize (KiB) 327144

[startup+1062.3 s]
/proc/loadavg: 4.00 4.36 4.98 5/184 29327
/proc/meminfo: memFree=29578660/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=388652 CPUtime=2592.34 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 433721 0 0 0 259144 90 0 0 25 0 4 0 603279667 397979648 19937 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 97163 19937 386 106 0 92134 0
[pid=29291/tid=29292] ppid=29289 vsize=388652 CPUtime=1062.32 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 106221 11 0 0 25 0 4 0 603279668 397979648 19937 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=388652 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 397979648 19937 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=388652 CPUtime=1062.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 228871 0 0 0 106190 42 0 0 25 0 4 0 603279668 397979648 19937 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309209 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2592.34
Current children cumulated vsize (KiB) 388652

[startup+1122.3 s]
/proc/loadavg: 4.00 4.29 4.91 5/184 29328
/proc/meminfo: memFree=29542032/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=453840 CPUtime=2712.35 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 444046 0 0 0 271143 92 0 0 25 0 4 0 603279667 464732160 29553 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 113460 29553 386 106 0 108431 0
[pid=29291/tid=29292] ppid=29289 vsize=453840 CPUtime=1122.32 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 112221 11 0 0 25 0 4 0 603279668 464732160 29553 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=453840 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 464732160 29553 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=453840 CPUtime=1122.32 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 239196 0 0 0 112189 43 0 0 25 0 4 0 603279668 464732160 29553 33554432000 4194304 4627427 140735922465600 18446744073709551615 4308399 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2712.35
Current children cumulated vsize (KiB) 453840

[startup+1182.3 s]
/proc/loadavg: 4.00 4.23 4.85 5/184 29330
/proc/meminfo: memFree=29505636/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=379612 CPUtime=2832.35 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 454463 0 0 0 283141 94 0 0 25 0 4 0 603279667 388722688 29341 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 94903 29341 386 106 0 89874 0
[pid=29291/tid=29292] ppid=29289 vsize=379612 CPUtime=1182.33 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 118222 11 0 0 25 0 4 0 603279668 388722688 29341 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=379612 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 388722688 29341 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=379612 CPUtime=1182.33 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 249613 0 0 0 118187 46 0 0 25 0 4 0 603279668 388722688 29341 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309584 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2832.35
Current children cumulated vsize (KiB) 379612

[startup+1242.3 s]
/proc/loadavg: 4.00 4.19 4.80 5/184 29332
/proc/meminfo: memFree=29495916/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=408276 CPUtime=2952.36 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 460014 0 0 0 295141 95 0 0 25 0 4 0 603279667 418074624 29663 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 102069 29663 386 106 0 97040 0
[pid=29291/tid=29292] ppid=29289 vsize=408276 CPUtime=1242.33 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 124222 11 0 0 25 0 4 0 603279668 418074624 29663 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=408276 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 418074624 29663 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=408276 CPUtime=1242.33 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 255164 0 0 0 124186 47 0 0 25 0 4 0 603279668 418074624 29663 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309095 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2952.36
Current children cumulated vsize (KiB) 408276



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.05 4.17 4.75 3/180 29334
/proc/meminfo: memFree=29629928/32950928 swapFree=67111364/67111528
[pid=29291] ppid=29289 vsize=408768 CPUtime=3067.78 cores=1,3,5,7
/proc/29291/stat : 29291 (strangenight2-m) S 29289 29291 29250 0 -1 4202496 470585 0 0 0 306681 97 0 0 25 0 4 0 603279667 418578432 29730 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29291/statm: 102192 29730 386 106 0 97163 0
[pid=29291/tid=29292] ppid=29289 vsize=408768 CPUtime=1300.04 cores=1,3,5,7
/proc/29291/task/29292/stat : 29292 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 49029 0 0 0 129993 11 0 0 25 0 4 0 603279668 418578432 29730 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808714795 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29291/tid=29293] ppid=29289 vsize=408768 CPUtime=218.6 cores=1,3,5,7
/proc/29291/task/29293/stat : 29293 (strangenight2-m) S 29289 29291 29250 0 -1 4202560 71288 0 0 0 21843 17 0 0 25 0 4 0 603279668 418578432 29730 33554432000 4194304 4627427 140735922465600 18446744073709551615 47946808739380 0 0 4096 2 18446604471127570240 0 0 -1 7 0 0 0
[pid=29291/tid=29294] ppid=29289 vsize=408768 CPUtime=1300.03 cores=1,3,5,7
/proc/29291/task/29294/stat : 29294 (strangenight2-m) R 29289 29291 29250 0 -1 4202560 265735 0 0 0 129955 48 0 0 25 0 4 0 603279668 418578432 29730 33554432000 4194304 4627427 140735922465600 18446744073709551615 4309270 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3067.78
Current children cumulated vsize (KiB) 408768

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.02
CPU time (s): 3067.8
CPU user time (s): 3066.82
CPU system time (s): 0.979851
CPU usage (%): 235.981
Max. virtual memory (cumulated for all children) (KiB): 454572

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3066.82
system time used= 0.979851
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 470585
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 191
involuntary context switches= 9690

runsolver used 2.23666 second user time and 4.87126 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-30 04:28:10
IDJOB=3292830
IDBENCH=87946
IDSOLVER=1586
FILE ID=node115/3292830-1304130490
RUNJOBID= node115-1304130490-29269
PBS_JOBID= 13170791
Free space on /tmp= 72872 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-2-mt
BENCH NAME= SAT02/industrial/aloul/Homer/homer17.shuffled.cnf
COMMAND LINE= ./strangenight2-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3292830-1304130490/watcher-3292830-1304130490 -o /tmp/evaluation-result-3292830-1304130490/solver-3292830-1304130490 -C 4800 -W 1300 -M 15500  ./strangenight2-mt --threads=4 HOME/instance-3292830-1304130490.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca62f6128dc3cad7229c7b9ee33a7492
RANDOM SEED=696936249

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29747012 kB
Buffers:        822392 kB
Cached:        1888660 kB
SwapCached:          0 kB
Active:         196552 kB
Inactive:      2580824 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29747012 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           11404 kB
Writeback:           4 kB
AnonPages:       66584 kB
Mapped:          14812 kB
Slab:           361156 kB
PageTables:       5136 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   272276 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72868 MiB
End job on node115 at 2011-04-30 04:49:52