Trace number 3367219

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-2-mt (fixed)? (TO) 3062.82 1300.02

General information on the benchmark

NameSAT02/industrial/aloul/
Homer/homer17.shuffled.cnf
MD5SUMca62f6128dc3cad7229c7b9ee33a7492
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.484925
Satisfiable
(Un)Satisfiability was proved
Number of variables286
Number of clauses1742
Sum of the clauses size3718
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21716
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 526

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.00	c Using 4 threads
0.00/0.00	c This is CryptoMiniSat 3.0.0
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c Reading file 'HOME/instance-3367219-1305417545.cnf'
0.00/0.00	c -- header says num vars:            286
0.00/0.00	c -- header says num clauses:        1742
0.00/0.00	c -- clauses added:            0 learnts,         1742 normals,            0 xors
0.00/0.00	c -- vars added        286
0.00/0.00	c Parsing time:  0.00 s
0.00/0.00	c  N st     0         0       286        26      1716         0      3718         0   no data   no data
0.00/0.00	c asymm  cl-useful: 0/26/26 lits-rem:0 time: 0.00
0.00/0.01	c Flit:     0 Blit:      0 bXBeca:    0 bXProp:    0 Bins:      0 BRemL:      0 BRemN:      0 P:  0.0M T:  0.00
0.00/0.01	c blocked clauses removed:        0 vars:      0 tried:           0 T: 0.00 s
0.00/0.01	c bin-w-bin subsume rem            0 bins  time:  0.00 s
0.00/0.01	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  0.00 s
0.00/0.01	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:    286 time:  0.00 s
0.00/0.01	c Removed useless bin:       0  fixed:     0  props:   0.01M  time:  0.00 s
0.00/0.01	c lits-rem:         0  cl-subs:        0  v-elim:     26  v-fix:    0  time:  0.00 s
0.00/0.01	c Finding binary XORs  T:     0.00 s  found:       0
0.00/0.01	c Finding non-binary XORs:     0.00 s (found:       0, avg size: nan)
0.00/0.01	c calculated reachability. Time: 0.00
0.00/0.01	c Calc default polars -  time:   0.00 s pos:     128 undec:      26 neg:     132
0.00/0.01	c =========================================================================================
0.00/0.01	c types(t): F = full restart, N = normal restart
0.00/0.01	c types(t): S = simplification begin/end, E = solution found
0.00/0.01	c restart types(rt): st = static, dy = dynamic
0.00/0.01	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
0.00/0.01	c  B st     0         0       260       293      1423         0      6240         0   no data   no data
0.00/0.04	c Decided on static restart strategy
0.41/0.12	c  N st     8      4912       260       293      1423      4546      6240    143087   no data   no data
1.58/0.42	c  N st    10     11296       260       293      1423      4029      6240    117333   no data   no data
2.77/0.73	c  N st    11     17040       260       293      1423      8959      6240    263778   no data   no data
4.80/1.27	c  F st    12     25000       260       293      1423     10810      6240    357817   no data   no data
4.80/1.27	c Found part        0 vars:        130 clauses:       858 lits size:      3120
4.80/1.27	c Found part        1 vars:        130 clauses:       858 lits size:      3120
4.80/1.27	c Found parts:          2 time: 0.00 s
4.80/1.27	c Solving part 0
4.80/1.27	c  N st     0         0       130       145       713         0      3120         0   no data   no data
4.80/1.27	c asymm  cl-useful: 0/145/145 lits-rem:0 time: 0.00
4.80/1.27	c Flit:     0 Blit:      0 bXBeca:    0 bXProp:    0 Bins:      0 BRemL:      0 BRemN:      0 P:  0.0M T:  0.00
4.80/1.27	c Finding binary XORs  T:     0.00 s  found:       0
4.80/1.27	c Finding non-binary XORs:     0.00 s (found:       0, avg size: nan)
4.80/1.27	c calculated reachability. Time: 0.00
4.80/1.27	c Calc default polars -  time:   0.00 s pos:      67 undec:     156 neg:      63
4.80/1.27	c =========================================================================================
4.80/1.27	c types(t): F = full restart, N = normal restart
4.80/1.27	c types(t): S = simplification begin/end, E = solution found
4.80/1.27	c restart types(rt): st = static, dy = dynamic
4.80/1.27	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
4.80/1.27	c  B st     0         0       130       145       713         0      3120         0   no data   no data
5.16/1.31	c Decided on static restart strategy
5.16/1.37	c  N st     8      4914       130       145       713      4509      3120    137348   no data   no data
6.36/1.64	c  N st    10     11297       130       145       713      4112      3120    121972   no data   no data
7.16/1.89	c  N st    11     17043       130       145       713      9266      3120    308852   no data   no data
8.78/2.22	c  F st    12     25001       130       145       713     11488      3120    382646   no data   no data
8.78/2.22	c  N st    12     25001       130       145       713     11488      3120    382646   no data   no data
9.55/2.46	c Decided on static restart strategy
9.55/2.46	c  N st    18     30194       130       145       713      9906      3120    306419   no data   no data
11.15/2.83	c  N st    20     37307       130       145       713      9152      3120    282539   no data   no data
12.75/3.24	c  N st    21     43708       130       145       713     14742      3120    502051   no data   no data
15.94/4.00	c  N st    22     53308       130       145       713     14892      3120    500074   no data   no data
19.93/5.00	c  N st    23     67705       130       145       713     18936      3120    646665   no data   no data
27.11/6.88	c  F st    24     87501       130       145       713     16032      3120    523305   no data   no data
27.11/6.88	c  N st    24     87501       130       145       713     16032      3120    523305   no data   no data
29.12/7.32	c Decided on static restart strategy
29.91/7.59	c  N st    31     95541       130       145       713     11753      3120    356578   no data   no data
33.50/8.42	c  N st    33    106207       130       145       713     20937      3120    709496   no data   no data
36.69/9.26	c  N st    34    115807       130       145       713     17013      3120    538972   no data   no data
41.08/10.34	c  N st    35    130204       130       145       713     16689      3120    527901   no data   no data
51.46/12.90	c  N st    36    151799       130       145       713     21048      3120    707375   no data   no data
67.43/16.90	c  N st    37    184192       130       145       714     18624      3120    598283   no data   no data
86.59/21.70	c  N st    38    232780       130       145       714     27801      3120    959337   no data   no data
126.50/31.78	c  N st    39    305662       130       145       719     30980      3120   1007720   no data   no data
126.50/31.78	c Finding binary XORs  T:     0.00 s  found:       0
126.90/31.85	c  F st    40    306250       130       145       719     31438      3120   1026238   no data   no data
129.69/32.51	c Decided on static restart strategy
141.26/35.48	c  N st    50    334557       130       145       719     35196      3120   1197921   no data   no data
160.82/40.39	c  N st    52    370552       130       145       719     23903      3120    764291   no data   no data
184.80/46.31	c  N st    53    402944       130       145       719     28105      3120    945927   no data   no data
208.31/52.24	c  N st    54    451532       130       145       719     46878      3120   1687599   no data   no data
244.24/61.27	c  N st    55    524414       130       145       719     32471      3120   1079049   no data   no data
320.90/80.45	c  N st    56    633741       130       145       719     41480      3120   1408136   no data   no data
470.15/117.81	c  N st    57    797726       130       145       719     53275      3120   1849526   no data   no data
642.53/161.00	c  N st    58   1043702       129       145       723     52056      3120   1798390   no data   no data
676.50/169.59	c  F st    59   1071875       129       145       723     37712      3120   1225677   no data   no data
676.50/169.59	c  N st    59   1071875       129       145       723     37712      3120   1225677   no data   no data
679.66/170.34	c Decided on static restart strategy
694.82/174.13	c  N st    69   1100181       129       145       724     61309      3120   2113656   no data   no data
722.76/181.19	c  N st    71   1136176       129       145       724     53454      3120   1849836   no data   no data
734.33/184.07	c Finding binary XORs  T:     0.00 s  found:       0
761.07/190.78	c  N st    72   1168568       128       145       693     38279      3048   1227403   no data   no data
813.76/203.95	c  N st    73   1217157       127       145       698     39637      3048   1274110   no data   no data
837.71/209.90	c Finding binary XORs  T:     0.00 s  found:       0
874.42/219.70	c  N st    74   1290039       126       145       667     56205      2976   1888341   no data   no data
952.43/245.70	c Finding binary XORs  T:     0.00 s  found:       0
956.93/247.29	c  E st    75   1379306        77       121       531     13832      2153    269316   no data   no data

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3367219-1305417545/watcher-3367219-1305417545 -o /tmp/evaluation-result-3367219-1305417545/solver-3367219-1305417545 -C 4800 -W 1300 -M 15500 ./strangenight2-mt --threads=4 HOME/instance-3367219-1305417545.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.15 8.08 7.93 5/282 20380
/proc/meminfo: memFree=20004008/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=281692 CPUtime=0 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) D 20378 20380 19869 0 -1 4202496 683 0 0 0 0 0 0 0 25 0 4 0 634169817 288452608 604 33554432000 4194304 4580107 140736371093648 18446744073709551615 254261659831 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 70423 604 358 95 0 65405 0
[pid=20380/tid=20381] ppid=20378 vsize=281692 CPUtime=0 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 71 0 0 0 0 0 0 0 25 0 4 0 634169817 288452608 718 33554432000 4194304 4580107 140736371093648 18446744073709551615 254261721582 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=281692 CPUtime=0 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 116 0 0 0 0 0 0 0 25 0 4 0 634169817 288452608 718 33554432000 4194304 4580107 140736371093648 18446744073709551615 4489474 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=281692 CPUtime=0 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 86 0 0 0 0 0 0 0 25 0 4 0 634169817 288452608 719 33554432000 4194304 4580107 140736371093648 18446744073709551615 4489474 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.110588 s]
/proc/loadavg: 8.15 8.08 7.93 5/282 20380
/proc/meminfo: memFree=20004008/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=281952 CPUtime=0.41 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 1707 0 0 0 41 0 0 0 25 0 4 0 634169817 288718848 1628 33554432000 4194304 4580107 140736371093648 18446744073709551615 4319937 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 70488 1628 377 95 0 65470 0
[pid=20380/tid=20381] ppid=20378 vsize=281952 CPUtime=0.1 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 334 0 0 0 10 0 0 0 25 0 4 0 634169817 288718848 1628 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294952 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=281952 CPUtime=0.1 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 330 0 0 0 10 0 0 0 25 0 4 0 634169817 288718848 1628 33554432000 4194304 4580107 140736371093648 18446744073709551615 4293975 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=281952 CPUtime=0.1 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 302 0 0 0 10 0 0 0 25 0 4 0 634169817 288718848 1628 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294634 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 281952

[startup+0.200574 s]
/proc/loadavg: 8.15 8.08 7.93 5/282 20380
/proc/meminfo: memFree=20004008/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=283596 CPUtime=0.77 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 2531 0 0 0 77 0 0 0 25 0 4 0 634169817 290402304 1768 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294386 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 70899 1768 377 95 0 65881 0
[pid=20380/tid=20381] ppid=20378 vsize=283596 CPUtime=0.19 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 525 0 0 0 19 0 0 0 25 0 4 0 634169817 290402304 1768 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294378 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=283596 CPUtime=0.19 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 539 0 0 0 19 0 0 0 25 0 4 0 634169817 290402304 1768 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294356 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=283596 CPUtime=0.19 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 530 0 0 0 19 0 0 0 25 0 4 0 634169817 290402304 1768 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294386 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 283596

[startup+0.300555 s]
/proc/loadavg: 8.15 8.08 7.93 5/282 20380
/proc/meminfo: memFree=20004008/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=283728 CPUtime=1.17 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 3004 0 0 0 117 0 0 0 25 0 4 0 634169817 290537472 2241 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294533 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 70932 2241 377 95 0 65914 0
[pid=20380/tid=20381] ppid=20378 vsize=283728 CPUtime=0.29 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 644 0 0 0 29 0 0 0 25 0 4 0 634169817 290537472 2241 33554432000 4194304 4580107 140736371093648 18446744073709551615 4295401 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=283728 CPUtime=0.29 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 675 0 0 0 29 0 0 0 25 0 4 0 634169817 290537472 2241 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294520 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=283728 CPUtime=0.29 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 643 0 0 0 29 0 0 0 25 0 4 0 634169817 290537472 2242 33554432000 4194304 4580107 140736371093648 18446744073709551615 4316670 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 283728

[startup+0.700487 s]
/proc/loadavg: 8.15 8.08 7.93 5/282 20380
/proc/meminfo: memFree=20004008/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=285704 CPUtime=2.77 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 5476 0 0 0 276 1 0 0 25 0 4 0 634169817 292560896 2890 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294507 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 71426 2890 377 95 0 66408 0
[pid=20380/tid=20381] ppid=20378 vsize=285704 CPUtime=0.68 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 1372 0 0 0 68 0 0 0 25 0 4 0 634169817 292560896 2890 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294955 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=285704 CPUtime=0.69 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 1366 0 0 0 69 0 0 0 25 0 4 0 634169817 292560896 2890 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294504 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=285704 CPUtime=0.69 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 1230 0 0 0 69 0 0 0 25 0 4 0 634169817 292560896 2890 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294624 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 285704

[startup+1.50034 s]
/proc/loadavg: 8.15 8.08 7.93 9/286 20384
/proc/meminfo: memFree=19988228/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=294952 CPUtime=5.96 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 9522 0 0 0 595 1 0 0 25 0 4 0 634169817 302030848 6193 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294363 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 73738 6193 378 95 0 68720 0
[pid=20380/tid=20381] ppid=20378 vsize=294952 CPUtime=1.47 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 2466 0 0 0 147 0 0 0 25 0 4 0 634169817 302030848 6194 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294624 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=294952 CPUtime=1.49 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 2430 0 0 0 149 0 0 0 25 0 4 0 634169817 302030848 6194 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294624 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=294952 CPUtime=1.49 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 2162 0 0 0 149 0 0 0 25 0 4 0 634169817 302030848 6194 33554432000 4194304 4580107 140736371093648 18446744073709551615 4489474 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 294952

[startup+3.10106 s]
/proc/loadavg: 8.14 8.08 7.93 9/286 20384
/proc/meminfo: memFree=19973348/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=340724 CPUtime=12.35 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 16574 0 0 0 1233 2 0 0 25 0 4 0 634169817 348901376 8160 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294530 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 85181 8160 378 95 0 80163 0
[pid=20380/tid=20381] ppid=20378 vsize=340724 CPUtime=3.06 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 4109 0 0 0 306 0 0 0 25 0 4 0 634169817 348901376 8160 33554432000 4194304 4580107 140736371093648 18446744073709551615 4342220 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=340724 CPUtime=3.08 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 4214 0 0 0 308 0 0 0 25 0 4 0 634169817 348901376 8160 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294952 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=340724 CPUtime=3.08 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 3726 0 0 0 308 0 0 0 25 0 4 0 634169817 348901376 8160 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294544 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 340724

[startup+6.3005 s]
/proc/loadavg: 8.14 8.08 7.93 9/286 20384
/proc/meminfo: memFree=19961132/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=333156 CPUtime=25.12 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 28320 0 0 0 2507 5 0 0 25 0 4 0 634169817 341151744 9955 33554432000 4194304 4580107 140736371093648 18446744073709551615 4324088 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 83289 9955 378 95 0 78271 0
[pid=20380/tid=20381] ppid=20378 vsize=333156 CPUtime=6.24 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 7987 0 0 0 623 1 0 0 25 0 4 0 634169817 341151744 9955 33554432000 4194304 4580107 140736371093648 18446744073709551615 4318373 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=333156 CPUtime=6.29 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 6509 0 0 0 628 1 0 0 25 0 4 0 634169817 341151744 9956 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294507 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=333156 CPUtime=6.29 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 6716 0 0 0 628 1 0 0 25 0 4 0 634169817 341151744 9956 33554432000 4194304 4580107 140736371093648 18446744073709551615 4489516 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 333156

[startup+12.7004 s]
/proc/loadavg: 8.12 8.07 7.93 9/286 20384
/proc/meminfo: memFree=19948588/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=345176 CPUtime=50.66 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 45632 0 0 0 5058 8 0 0 25 0 4 0 634169817 353460224 11822 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294624 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 86294 11822 378 95 0 81276 0
[pid=20380/tid=20381] ppid=20378 vsize=345176 CPUtime=12.57 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 12522 0 0 0 1256 1 0 0 25 0 4 0 634169817 353460224 11822 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294507 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=345176 CPUtime=12.69 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 10534 0 0 0 1267 2 0 0 25 0 4 0 634169817 353460224 11822 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294692 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=345176 CPUtime=12.68 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 10916 0 0 0 1267 1 0 0 25 0 4 0 634169817 353460224 11822 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294627 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 345176

[startup+25.5011 s]
/proc/loadavg: 8.10 8.07 7.93 9/286 20384
/proc/meminfo: memFree=19952452/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=337104 CPUtime=101.75 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 73136 0 0 0 10161 14 0 0 25 0 4 0 634169817 345194496 14661 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294544 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 84276 14661 378 95 0 79258 0
[pid=20380/tid=20381] ppid=20378 vsize=337104 CPUtime=25.26 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 18276 0 0 0 2523 3 0 0 25 0 4 0 634169817 345194496 14661 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294504 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=337104 CPUtime=25.49 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 17729 0 0 0 2546 3 0 0 25 0 4 0 634169817 345194496 14661 33554432000 4194304 4580107 140736371093648 18446744073709551615 4293222 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=337104 CPUtime=25.49 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 18223 0 0 0 2545 4 0 0 25 0 4 0 634169817 345194496 14661 33554432000 4194304 4580107 140736371093648 18446744073709551615 4295404 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.75
Current children cumulated vsize (KiB) 337104

[startup+51.1005 s]
/proc/loadavg: 8.13 8.08 7.94 9/286 20385
/proc/meminfo: memFree=19891404/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=351812 CPUtime=203.93 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 115554 0 0 0 20369 24 0 0 25 0 4 0 634169817 360255488 21433 33554432000 4194304 4580107 140736371093648 18446744073709551615 4489474 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 87953 21433 378 95 0 82935 0
[pid=20380/tid=20381] ppid=20378 vsize=351812 CPUtime=50.63 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 29710 0 0 0 5058 5 0 0 25 0 4 0 634169817 360255488 21433 33554432000 4194304 4580107 140736371093648 18446744073709551615 4293975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=351812 CPUtime=51.09 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 28820 0 0 0 5104 5 0 0 25 0 4 0 634169817 360255488 21433 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294955 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=351812 CPUtime=51.09 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 27962 0 0 0 5103 6 0 0 25 0 4 0 634169817 360255488 21433 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294585 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.93
Current children cumulated vsize (KiB) 351812

[startup+102.3 s]
/proc/loadavg: 8.16 8.09 7.95 9/286 20386
/proc/meminfo: memFree=19698164/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=365724 CPUtime=408.29 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) R 20378 20380 19869 0 -1 4202496 187616 0 0 0 40790 39 0 0 25 0 4 0 634169817 374501376 31234 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294426 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 91431 31234 378 95 0 86413 0
[pid=20380/tid=20381] ppid=20378 vsize=365724 CPUtime=101.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 49410 0 0 0 10128 10 0 0 25 0 4 0 634169817 374501376 31236 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294517 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=365724 CPUtime=102.3 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 47529 0 0 0 10221 9 0 0 25 0 4 0 634169817 374501376 31236 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294507 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=365724 CPUtime=102.29 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 43853 0 0 0 10220 9 0 0 25 0 4 0 634169817 374501376 31236 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294535 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.29
Current children cumulated vsize (KiB) 365724

[startup+162.301 s]

################
# More data... #
################

[pid=20380] ppid=20378 vsize=430432 CPUtime=1987.36 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 354830 0 0 0 198655 81 0 0 25 0 4 0 634169817 440762368 24372 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 107608 24372 378 95 0 102590 0
[pid=20380/tid=20381] ppid=20378 vsize=430432 CPUtime=760.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 76024 14 0 0 25 0 4 0 634169817 440762368 24373 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825515 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=430432 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 440762368 24373 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=430432 CPUtime=762.3 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 133385 0 0 0 76199 31 0 0 25 0 4 0 634169817 440762368 24373 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294546 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1987.36
Current children cumulated vsize (KiB) 430432

[startup+822.301 s]
/proc/loadavg: 6.04 6.26 6.99 7/286 20472
/proc/meminfo: memFree=21981516/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=343960 CPUtime=2107.35 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 359601 0 0 0 210653 82 0 0 25 0 4 0 634169817 352215040 20020 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 85990 20020 378 95 0 80972 0
[pid=20380/tid=20381] ppid=20378 vsize=343960 CPUtime=820.37 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 82023 14 0 0 25 0 4 0 634169817 352215040 20020 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825515 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=343960 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 352215040 20020 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=343960 CPUtime=822.29 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 138155 0 0 0 82197 32 0 0 25 0 4 0 634169817 352215040 20020 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294955 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2107.35
Current children cumulated vsize (KiB) 343960

[startup+882.311 s]
/proc/loadavg: 6.07 6.22 6.92 7/286 20474
/proc/meminfo: memFree=21874500/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=362088 CPUtime=2227.37 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 368542 0 0 0 222653 84 0 0 25 0 4 0 634169817 370778112 23972 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 90522 23972 378 95 0 85504 0
[pid=20380/tid=20381] ppid=20378 vsize=362088 CPUtime=880.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 88024 14 0 0 25 0 4 0 634169817 370778112 23972 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825668 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=362088 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 370778112 23972 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=362088 CPUtime=882.3 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 147096 0 0 0 88196 34 0 0 25 0 4 0 634169817 370778112 23972 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294963 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2227.37
Current children cumulated vsize (KiB) 362088

[startup+942.3 s]
/proc/loadavg: 6.03 6.18 6.87 7/286 20476
/proc/meminfo: memFree=21851644/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=362452 CPUtime=2347.35 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 373927 0 0 0 234650 85 0 0 25 0 4 0 634169817 371150848 24266 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 90613 24266 378 95 0 85595 0
[pid=20380/tid=20381] ppid=20378 vsize=362452 CPUtime=940.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 94024 14 0 0 25 0 4 0 634169817 371150848 24266 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825668 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=362452 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 371150848 24266 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=362452 CPUtime=942.29 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 152481 0 0 0 94194 35 0 0 25 0 4 0 634169817 371150848 24266 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294952 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2347.35
Current children cumulated vsize (KiB) 362452

[startup+1002.3 s]
/proc/loadavg: 6.06 6.16 6.81 7/286 20477
/proc/meminfo: memFree=21830676/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=362684 CPUtime=2467.36 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 379608 0 0 0 246650 86 0 0 25 0 4 0 634169817 371388416 24687 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 90671 24687 378 95 0 85653 0
[pid=20380/tid=20381] ppid=20378 vsize=362684 CPUtime=1000.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 100024 14 0 0 25 0 4 0 634169817 371388416 24687 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825515 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=362684 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 371388416 24687 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=362684 CPUtime=1002.29 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 158162 0 0 0 100193 36 0 0 25 0 4 0 634169817 371388416 24687 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294955 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2467.36
Current children cumulated vsize (KiB) 362684

[startup+1062.3 s]
/proc/loadavg: 6.02 6.13 6.76 7/286 20479
/proc/meminfo: memFree=21838180/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=418536 CPUtime=2587.36 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 385108 0 0 0 258649 87 0 0 25 0 4 0 634169817 428580864 20257 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 104634 20257 378 95 0 99616 0
[pid=20380/tid=20381] ppid=20378 vsize=418536 CPUtime=1060.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 106024 14 0 0 25 0 4 0 634169817 428580864 20257 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825668 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=418536 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 428580864 20257 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=418536 CPUtime=1062.3 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 163662 0 0 0 106193 37 0 0 25 0 4 0 634169817 428580864 20257 33554432000 4194304 4580107 140736371093648 18446744073709551615 4305310 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2587.36
Current children cumulated vsize (KiB) 418536

[startup+1122.3 s]
/proc/loadavg: 6.05 6.12 6.71 7/286 20480
/proc/meminfo: memFree=21589712/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=354156 CPUtime=2707.36 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 388734 0 0 0 270648 88 0 0 25 0 4 0 634169817 362655744 22828 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 88539 22828 378 95 0 83521 0
[pid=20380/tid=20381] ppid=20378 vsize=354156 CPUtime=1120.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 112024 14 0 0 25 0 4 0 634169817 362655744 22828 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825668 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=354156 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 362655744 22828 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=354156 CPUtime=1122.3 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 167288 0 0 0 112192 38 0 0 25 0 4 0 634169817 362655744 22828 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2707.36
Current children cumulated vsize (KiB) 354156

[startup+1182.3 s]
/proc/loadavg: 6.02 6.09 6.67 7/286 20482
/proc/meminfo: memFree=21185280/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=372264 CPUtime=2827.36 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 394219 0 0 0 282647 89 0 0 25 0 4 0 634169817 381198336 27424 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 93066 27424 378 95 0 88048 0
[pid=20380/tid=20381] ppid=20378 vsize=372264 CPUtime=1180.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 118024 14 0 0 25 0 4 0 634169817 381198336 27424 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825515 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=372264 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 381198336 27424 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=372264 CPUtime=1182.3 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 172773 0 0 0 118191 39 0 0 25 0 4 0 634169817 381198336 27424 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294544 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2827.36
Current children cumulated vsize (KiB) 372264

[startup+1242.3 s]
/proc/loadavg: 6.09 6.10 6.63 7/286 20484
/proc/meminfo: memFree=21196616/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=352936 CPUtime=2947.37 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 402351 0 0 0 294646 91 0 0 25 0 4 0 634169817 361406464 20269 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 88234 20269 378 95 0 83216 0
[pid=20380/tid=20381] ppid=20378 vsize=352936 CPUtime=1240.38 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 124024 14 0 0 25 0 4 0 634169817 361406464 20269 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598825668 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=352936 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 361406464 20269 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=352936 CPUtime=1242.3 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 180905 0 0 0 124189 41 0 0 25 0 4 0 634169817 361406464 20269 33554432000 4194304 4580107 140736371093648 18446744073709551615 4295702 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2947.37
Current children cumulated vsize (KiB) 352936



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 6.08 6.10 6.60 7/286 20485
/proc/meminfo: memFree=21167416/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=352968 CPUtime=3062.78 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 412931 0 0 0 306185 93 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 88242 20404 378 95 0 83224 0
[pid=20380/tid=20381] ppid=20378 vsize=352968 CPUtime=1298.09 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 129795 14 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 4205160 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=352968 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=352968 CPUtime=1300.01 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 191485 0 0 0 129958 43 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294426 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3062.78
Current children cumulated vsize (KiB) 352968

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 6.08 6.10 6.60 7/286 20485
/proc/meminfo: memFree=21167416/32951124 swapFree=67057896/67111528
[pid=20380] ppid=20378 vsize=352968 CPUtime=3062.78 cores=1,3,5,7
/proc/20380/stat : 20380 (strangenight2-m) S 20378 20380 19869 0 -1 4202496 412931 0 0 0 306185 93 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/20380/statm: 88242 20404 378 95 0 83224 0
[pid=20380/tid=20381] ppid=20378 vsize=352968 CPUtime=1298.09 cores=1,3,5,7
/proc/20380/task/20381/stat : 20381 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 65706 0 0 0 129795 14 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 4205160 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20380/tid=20382] ppid=20378 vsize=352968 CPUtime=217.27 cores=1,3,5,7
/proc/20380/task/20382/stat : 20382 (strangenight2-m) S 20378 20380 19869 0 -1 4202560 71167 0 0 0 21712 15 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 47486598850100 0 0 4096 2 18446604459096695744 0 0 -1 5 0 0 0
[pid=20380/tid=20383] ppid=20378 vsize=352968 CPUtime=1300.01 cores=1,3,5,7
/proc/20380/task/20383/stat : 20383 (strangenight2-m) R 20378 20380 19869 0 -1 4202560 191485 0 0 0 129958 43 0 0 25 0 4 0 634169817 361439232 20404 33554432000 4194304 4580107 140736371093648 18446744073709551615 4294426 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3062.78
Current children cumulated vsize (KiB) 352968

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.02
CPU time (s): 3062.82
CPU user time (s): 3061.87
CPU system time (s): 0.942856
CPU usage (%): 235.597
Max. virtual memory (cumulated for all children) (KiB): 451828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3061.87
system time used= 0.942856
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 412932
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 159
involuntary context switches= 20961

runsolver used 3.07653 second user time and 8.15176 second system time

The end

Launcher Data 

Begin job on node140 at 2011-05-15 01:59:05
IDJOB=3367219
IDBENCH=87946
IDSOLVER=1844
FILE ID=node140/3367219-1305417545
RUNJOBID= node140-1305414794-19888
PBS_JOBID= 13324552
Free space on /tmp= 73368 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-2-mt (fixed)
BENCH NAME= SAT02/industrial/aloul/Homer/homer17.shuffled.cnf
COMMAND LINE= ./strangenight2-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3367219-1305417545/watcher-3367219-1305417545 -o /tmp/evaluation-result-3367219-1305417545/solver-3367219-1305417545 -C 4800 -W 1300 -M 15500  ./strangenight2-mt --threads=4 HOME/instance-3367219-1305417545.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca62f6128dc3cad7229c7b9ee33a7492
RANDOM SEED=2473043

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20004288 kB
Buffers:        302920 kB
Cached:        3879100 kB
SwapCached:       8056 kB
Active:        9917696 kB
Inactive:      2709764 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20004288 kB
SwapTotal:    67111528 kB
SwapFree:     67057896 kB
Dirty:           78480 kB
Writeback:           0 kB
AnonPages:     8442640 kB
Mapped:          23552 kB
Slab:           224616 kB
PageTables:      32228 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 51036868 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73396 MiB
End job on node140 at 2011-05-15 02:20:47