Trace number 3369454

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-1-mt (fixed)? (TO) 4800.55 1202.94

General information on the benchmark

Namevelev-npe-1.0-9dlx-b71.cnf
MD5SUM75d91f0ba4398ccb5b452707c0e7fa27
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark20.3769
Satisfiable
(Un)Satisfiability was proved
Number of variables889302
Number of clauses14582074
Sum of the clauses size42006170
Maximum clause length5391
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 212803954
Number of clauses of size 3913633
Number of clauses of size 418493
Number of clauses of size 536153
Number of clauses of size over 5809840

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.00	c Using 4 threads
0.00/0.00	c This is CryptoMiniSat 2.9.0
0.00/0.00	c compiled with gcc version 4.4.5
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c Reading file 'HOME/instance-3369454-1307646801.cnf'
0.00/0.00	c -- header says num vars:         889302
0.00/0.00	c -- header says num clauses:    14582074
17.68/4.52	c -- clauses added:            0 learnts,     14582074 normals,            0 xors
17.68/4.52	c -- vars added     889302
17.68/4.53	c Parsing time: 16.24 s
17.68/4.53	c  N st     0         0    889302   1778118  12803934         0  42006124         0   no data   no data  --
18.85/4.80	c asymm  cl-useful: 0/1799/1778118 lits-rem:0 time: 0.80
52.43/13.30	c Flit:    41 Blit:    818 bXBeca:    0 bXProp:    0 Bins:      0 BRemL:      0 BRemN:      0 P: 200.0M T: 32.46
52.83/13.31	c Cleaning up after failed var search:     0.00 s 
66.74/16.80	c bin-w-bin subsume rem            0 bins  time:  6.20 s
71.93/18.10	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  5.20 s
112.28/28.24	c Subs w/ non-existent bins:      0 l-rem:      0 v-fix:     0 done:   2074 time: 40.49 s
114.30/28.76	c Removed useless bin:    1161  fixed:     0  props:  20.55M  time:  2.03 s
815.16/204.82	c lits-rem:         0  cl-subs:     6664  v-elim:   6172  v-fix:    0  time: 655.40 s
816.29/205.12	c Finding binary XORs  T:     1.09 s  found:       0
818.69/205.78	c Calc default polars -  time:   1.30 s pos:   10123 undec:    7069 neg:  872110
818.69/205.78	c =========================================================================================
818.69/205.78	c types(t): F = full restart, N = normal restart
818.69/205.78	c types(t): S = simplification begin/end, E = solution found
818.69/205.78	c restart types(rt): st = static, dy = dynamic
818.69/205.78	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
818.69/205.78	c  B st     0         0    882267   1781043  12767106         0  44121128         0   no data   no data  --
883.33/221.96	c  N dy    10      4083    882267   1781043  12767508      3637  44121128    785048     13.49     14.80  --
947.24/237.92	c  N dy    18      8224    882223   1781043  12771164      7378  44121127   1425090     10.81     11.55  --
1037.52/260.52	c  N dy    42     12511    882220   1781043  12771528     11277  44121123   2530208     11.11     11.81  --
1117.43/280.54	c  N dy    58     16571    882192   1781043  12773220     15049  44121122   3398340     10.84     11.57  --
1207.68/303.18	c  N dy    86     20641    882172   1781043  12774323      9632  44121122    355471     11.41     12.05  --
1279.01/321.00	c  N dy   112     24669    882170   1781043  12774519     13436  44121122   1331724     11.48     12.10  --
1287.76/323.22	c  F st   114     25000    882169   1781043  12775365     13744  44121122   1429538     11.45      9.86  --
1390.65/349.14	c  N dy   120     30000    882156   1781043  12773631     18479  44116808   3363031     11.45   no data  --
1390.65/349.15	c  S st   120     30000    882156   1781043  12773631     18479  44116808   3363031     11.45   no data  --
1416.14/355.51	c  S st   120     30500    882141   1781043  12773748     18846  44116808   3404471     11.45   no data  --
1418.14/356.03	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   2.10
2739.23/686.71	c Flit:     4 Blit:   4243 bXBeca:    0 bXProp:    0 Bins:   1022 BRemL:     12 BRemN:      0 P: 200.1M T: 1319.11
2739.23/686.75	c Cleaning up after failed var search:     0.00 s 
2742.86/687.69	c Replacing        1 vars Replaced      580 lits Time:     3.45 s 
2754.82/690.65	c bin-w-bin subsume rem            1 bins  time:  5.02 s
2760.44/692.07	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  5.47 s
2791.19/699.72	c Subs w/ non-existent bins:      0 l-rem:      3 v-fix:     0 done:   3551 time: 29.65 s
2793.16/700.27	c Removed useless bin:      36  fixed:     0  props:  20.00M  time:  2.18 s
3646.09/913.75	c lits-rem:         0  cl-subs:     5238  v-elim:   1526  v-fix:    0  time: 835.93 s
3647.29/914.08	c asymm  cl-useful: 0/114281/1786839 lits-rem:0 time: 1.29
3648.88/914.42	c  N dy   120     30500    876366   1786839  12659557     15903  44090765   1847085     11.45   no data  --
3715.98/931.28	c  N dy   140     34723    874825   1786839  12665578     19820  44090765   2862946     11.35     11.98  --
3770.72/944.98	c  N dy   158     38728    874817   1786839  12666034     23671  44090765   3840059     11.28     12.56  --
3844.20/963.36	c  N dy   182     42740    874815   1786839  12666290     27406  44090764   5100496     11.32     11.99  --
3896.54/976.47	c  S st   194     45751    874798   1786839  12666899     16001  44090763    591860     11.25      8.50  --
3919.31/982.18	c  S st   194     46252    874790   1786839  12666986     16399  44090763    608401     11.25   no data  --
3921.30/982.69	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   2.02

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3369454-1307646801/watcher-3369454-1307646801 -o /tmp/evaluation-result-3369454-1307646801/solver-3369454-1307646801 -C 4800 -W 1300 -M 15500 ./strangenight1-mt --threads=4 HOME/instance-3369454-1307646801.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.70 1.19 1.40 6/180 28537
/proc/meminfo: memFree=31927552/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 413 0 0 0 0 0 0 0 20 0 4 0 876283941 52465664 352 33554432000 4194304 4650419 140733655122608 18446744073709551615 47757586851762 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 12809 352 303 112 0 7774 0
[pid=28537/tid=28538] ppid=28535 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 4 0 876283941 52465664 352 33554432000 4194304 4650419 140733655122608 18446744073709551615 218371013617 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 4 0 876283941 52465664 352 33554432000 4194304 4650419 140733655122608 18446744073709551615 218371013617 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 4 0 876283941 52465664 352 33554432000 4194304 4650419 140733655122608 18446744073709551615 218365989096 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.105598 s]
/proc/loadavg: 1.70 1.19 1.40 6/180 28537
/proc/meminfo: memFree=31927552/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=442876 CPUtime=0.38 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) D 28535 28537 26276 0 -1 4202496 79616 0 0 0 27 11 0 0 18 0 4 0 876283941 453505024 62324 33554432000 4194304 4650419 140733655122608 18446744073709551615 4317116 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 110719 62324 341 112 0 105684 0
[pid=28537/tid=28538] ppid=28535 vsize=442876 CPUtime=0.07 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) D 28535 28537 26276 0 -1 4202560 19029 0 0 0 6 1 0 0 18 0 4 0 876283941 453505024 62324 33554432000 4194304 4650419 140733655122608 18446744073709551615 218370654605 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=442876 CPUtime=0.09 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) D 28535 28537 26276 0 -1 4202560 20894 0 0 0 7 2 0 0 18 0 4 0 876283941 453505024 62324 33554432000 4194304 4650419 140733655122608 18446744073709551615 4316340 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=442876 CPUtime=0.1 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 20518 0 0 0 6 4 0 0 18 0 4 0 876283941 453505024 62324 33554432000 4194304 4650419 140733655122608 18446744073709551615 218371015082 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 442876

[startup+0.225617 s]
/proc/loadavg: 1.70 1.19 1.40 6/180 28537
/proc/meminfo: memFree=31927552/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=757964 CPUtime=0.82 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 169514 0 0 0 56 26 0 0 18 0 4 0 876283941 776155136 134638 33554432000 4194304 4650419 140733655122608 18446744073709551615 218371062303 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 189491 134656 341 112 0 184456 0
[pid=28537/tid=28538] ppid=28535 vsize=757964 CPUtime=0.17 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) S 28535 28537 26276 0 -1 4202560 39359 0 0 0 13 4 0 0 17 0 4 0 876283941 776155136 134665 33554432000 4194304 4650419 140733655122608 18446744073709551615 218371062254 0 0 4096 2 18446604450150204736 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=757964 CPUtime=0.21 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 45634 0 0 0 14 7 0 0 18 0 4 0 876283941 776155136 134676 33554432000 4194304 4650419 140733655122608 18446744073709551615 4317116 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=757964 CPUtime=0.21 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 44123 0 0 0 14 7 0 0 18 0 4 0 876283941 776155136 134684 33554432000 4194304 4650419 140733655122608 18446744073709551615 4317116 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.82
Current children cumulated vsize (KiB) 757964

[startup+0.31681 s]
/proc/loadavg: 1.70 1.19 1.40 6/180 28537
/proc/meminfo: memFree=31927552/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=965540 CPUtime=1.08 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 221309 0 0 0 71 37 0 0 18 0 4 0 876283941 988712960 153565 33554432000 4194304 4650419 140733655122608 18446744073709551615 218371015082 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 241385 153565 341 112 0 236350 0
[pid=28537/tid=28538] ppid=28535 vsize=965540 CPUtime=0.24 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 53791 0 0 0 17 7 0 0 18 0 4 0 876283941 988712960 153565 33554432000 4194304 4650419 140733655122608 18446744073709551615 218370654850 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=965540 CPUtime=0.27 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) D 28535 28537 26276 0 -1 4202560 58107 0 0 0 18 9 0 0 18 0 4 0 876283941 988712960 153565 33554432000 4194304 4650419 140733655122608 18446744073709551615 4319766 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=965540 CPUtime=0.27 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) D 28535 28537 26276 0 -1 4202560 56280 0 0 0 17 10 0 0 18 0 4 0 876283941 988712960 153565 33554432000 4194304 4650419 140733655122608 18446744073709551615 4316340 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.08
Current children cumulated vsize (KiB) 965540

[startup+0.700295 s]
/proc/loadavg: 1.70 1.19 1.40 6/180 28537
/proc/meminfo: memFree=31927552/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=1268956 CPUtime=2.55 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 313139 0 0 0 199 56 0 0 18 0 4 0 876283941 1299410944 240197 33554432000 4194304 4650419 140733655122608 18446744073709551615 4263131 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 317239 240198 345 112 0 312204 0
[pid=28537/tid=28538] ppid=28535 vsize=1268956 CPUtime=0.6 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 78728 0 0 0 47 13 0 0 18 0 4 0 876283941 1299410944 240198 33554432000 4194304 4650419 140733655122608 18446744073709551615 4545933 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=1268956 CPUtime=0.65 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 80437 0 0 0 51 14 0 0 18 0 4 0 876283941 1299410944 240198 33554432000 4194304 4650419 140733655122608 18446744073709551615 4372470 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=1268956 CPUtime=0.65 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 77616 0 0 0 50 15 0 0 18 0 4 0 876283941 1299410944 240198 33554432000 4194304 4650419 140733655122608 18446744073709551615 4305878 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.55
Current children cumulated vsize (KiB) 1268956

[startup+1.50115 s]
/proc/loadavg: 1.70 1.19 1.40 9/184 28541
/proc/meminfo: memFree=30835372/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=1579012 CPUtime=5.73 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 377684 0 0 0 495 78 0 0 18 0 4 0 876283941 1616908288 304742 33554432000 4194304 4650419 140733655122608 18446744073709551615 4546990 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 394753 304744 345 112 0 389718 0
[pid=28537/tid=28538] ppid=28535 vsize=1579012 CPUtime=1.39 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 96062 0 0 0 120 19 0 0 18 0 4 0 876283941 1616908288 304746 33554432000 4194304 4650419 140733655122608 18446744073709551615 4520364 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=1579012 CPUtime=1.43 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 96732 0 0 0 124 19 0 0 18 0 4 0 876283941 1616908288 304747 33554432000 4194304 4650419 140733655122608 18446744073709551615 4372984 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=1579012 CPUtime=1.45 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 93886 0 0 0 125 20 0 0 18 0 4 0 876283941 1616908288 304749 33554432000 4194304 4650419 140733655122608 18446744073709551615 4520021 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.73
Current children cumulated vsize (KiB) 1579012

[startup+3.10087 s]
/proc/loadavg: 1.70 1.19 1.40 11/184 28541
/proc/meminfo: memFree=30442664/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=2354612 CPUtime=12.08 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 517802 0 0 0 1093 115 0 0 18 0 4 0 876283941 2411122688 444860 33554432000 4194304 4650419 140733655122608 18446744073709551615 4372724 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 588653 444861 345 112 0 583618 0
[pid=28537/tid=28538] ppid=28535 vsize=2354612 CPUtime=2.99 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 131207 0 0 0 270 29 0 0 18 0 4 0 876283941 2411122688 444862 33554432000 4194304 4650419 140733655122608 18446744073709551615 4306220 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=2354612 CPUtime=3.01 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 131492 0 0 0 272 29 0 0 18 0 4 0 876283941 2411122688 444863 33554432000 4194304 4650419 140733655122608 18446744073709551615 218370618401 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=2354612 CPUtime=3.04 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 128536 0 0 0 274 30 0 0 18 0 4 0 876283941 2411122688 444865 33554432000 4194304 4650419 140733655122608 18446744073709551615 4546969 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.08
Current children cumulated vsize (KiB) 2354612

[startup+6.30031 s]
/proc/loadavg: 2.29 1.32 1.44 9/184 28541
/proc/meminfo: memFree=29246924/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=3083164 CPUtime=24.84 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 789907 0 0 0 2313 171 0 0 20 0 4 0 876283941 3157159936 659427 33554432000 4194304 4650419 140733655122608 18446744073709551615 4370329 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 770791 659427 372 112 0 765756 0
[pid=28537/tid=28538] ppid=28535 vsize=3083164 CPUtime=6.18 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 205902 0 0 0 574 44 0 0 20 0 4 0 876283941 3157159936 659427 33554432000 4194304 4650419 140733655122608 18446744073709551615 4370329 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=3083164 CPUtime=6.21 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 206045 0 0 0 576 45 0 0 25 0 4 0 876283941 3157159936 659427 33554432000 4194304 4650419 140733655122608 18446744073709551615 4370264 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=3083164 CPUtime=6.21 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 177877 0 0 0 580 41 0 0 20 0 4 0 876283941 3157159936 659427 33554432000 4194304 4650419 140733655122608 18446744073709551615 4363750 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.84
Current children cumulated vsize (KiB) 3083164

[startup+12.7012 s]
/proc/loadavg: 2.74 1.43 1.47 9/184 28541
/proc/meminfo: memFree=29172160/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=3148700 CPUtime=50.41 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 800514 0 0 0 4867 174 0 0 25 0 4 0 876283941 3224268800 670034 33554432000 4194304 4650419 140733655122608 18446744073709551615 4243895 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 787175 670034 372 112 0 782140 0
[pid=28537/tid=28538] ppid=28535 vsize=3148700 CPUtime=12.59 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 205942 0 0 0 1215 44 0 0 25 0 4 0 876283941 3224268800 670034 33554432000 4194304 4650419 140733655122608 18446744073709551615 4370329 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=3148700 CPUtime=12.61 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 206088 0 0 0 1216 45 0 0 25 0 4 0 876283941 3224268800 670034 33554432000 4194304 4650419 140733655122608 18446744073709551615 4370318 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=3148700 CPUtime=12.57 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 188359 0 0 0 1214 43 0 0 25 0 4 0 876283941 3224268800 670034 33554432000 4194304 4650419 140733655122608 18446744073709551615 4303973 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.41
Current children cumulated vsize (KiB) 3148700

[startup+25.5009 s]
/proc/loadavg: 3.91 1.75 1.58 9/184 28542
/proc/meminfo: memFree=27932472/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=4444668 CPUtime=101.49 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 1085808 0 0 0 9928 221 0 0 25 0 4 0 876283941 4551340032 954716 33554432000 4194304 4650419 140733655122608 18446744073709551615 4340039 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 1111167 954716 385 112 0 1106132 0
[pid=28537/tid=28538] ppid=28535 vsize=4444668 CPUtime=25.36 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 294230 0 0 0 2477 59 0 0 25 0 4 0 876283941 4551340032 954716 33554432000 4194304 4650419 140733655122608 18446744073709551615 4446409 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=4444668 CPUtime=25.39 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 294088 0 0 0 2479 60 0 0 25 0 4 0 876283941 4551340032 954716 33554432000 4194304 4650419 140733655122608 18446744073709551615 4241210 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=4444668 CPUtime=25.31 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 209554 0 0 0 2484 47 0 0 25 0 4 0 876283941 4551340032 954716 33554432000 4194304 4650419 140733655122608 18446744073709551615 4363709 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.49
Current children cumulated vsize (KiB) 4444668

[startup+51.1004 s]
/proc/loadavg: 5.37 2.27 1.75 9/184 28542
/proc/meminfo: memFree=27431676/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=4962712 CPUtime=203.71 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 1893115 0 0 0 20026 345 0 0 25 0 4 0 876283941 5081817088 1071138 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476204 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 1240678 1071160 389 112 0 1235643 0
[pid=28537/tid=28538] ppid=28535 vsize=4962712 CPUtime=50.96 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 634770 0 0 0 4987 109 0 0 25 0 4 0 876283941 5081817088 1071169 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476502 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=4962712 CPUtime=50.98 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 489837 0 0 0 5007 91 0 0 25 0 4 0 876283941 5081817088 1071182 33554432000 4194304 4650419 140733655122608 18446744073709551615 218370654657 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=4962712 CPUtime=50.76 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 247916 0 0 0 5021 55 0 0 25 0 4 0 876283941 5081817088 1071194 33554432000 4194304 4650419 140733655122608 18446744073709551615 4363420 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.71
Current children cumulated vsize (KiB) 4962712

[startup+102.3 s]
/proc/loadavg: 6.97 3.18 2.09 9/184 28544
/proc/meminfo: memFree=27058792/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=5360364 CPUtime=407.67 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 13153947 0 0 0 38756 2011 0 0 25 0 4 0 876283941 5489012736 1151860 33554432000 4194304 4650419 140733655122608 18446744073709551615 4441903 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 1340091 1151868 403 112 0 1335056 0
[pid=28537/tid=28538] ppid=28535 vsize=5360364 CPUtime=101.98 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 4983691 0 0 0 9444 754 0 0 25 0 4 0 876283941 5489012736 1151908 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476522 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=5360364 CPUtime=102.05 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 4751647 0 0 0 9479 726 0 0 25 0 4 0 876283941 5489012736 1151920 33554432000 4194304 4650419 140733655122608 18446744073709551615 218370654667 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=5360364 CPUtime=101.47 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 318893 0 0 0 10081 66 0 0 25 0 4 0 876283941 5489012736 1151930 33554432000 4194304 4650419 140733655122608 18446744073709551615 4366869 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.67
Current children cumulated vsize (KiB) 5360364

[startup+162.301 s]

################
# More data... #
################

[pid=28537/tid=28540] ppid=28535 vsize=9586960 CPUtime=699.08 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 7517693 0 0 0 68869 1039 0 0 25 0 4 0 876283941 9817047040 1983383 33554432000 4194304 4650419 140733655122608 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2801.55
Current children cumulated vsize (KiB) 9586960

[startup+762.301 s]
/proc/loadavg: 8.14 7.58 5.13 9/184 28561
/proc/meminfo: memFree=23040464/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=9727712 CPUtime=3041.26 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 44792126 0 0 0 297608 6518 0 0 25 0 4 0 876283941 9961177088 2024435 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476519 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2431928 2024435 597 112 0 2426893 0
[pid=28537/tid=28538] ppid=28535 vsize=9727712 CPUtime=759.45 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 15785993 0 0 0 73671 2274 0 0 25 0 4 0 876283941 9961177088 2024435 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476502 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=9727712 CPUtime=761.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11276918 0 0 0 74454 1699 0 0 25 0 4 0 876283941 9961177088 2024435 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476522 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=9727712 CPUtime=759.07 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 7599873 0 0 0 74856 1051 0 0 25 0 4 0 876283941 9961177088 2024435 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230684 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3041.26
Current children cumulated vsize (KiB) 9727712

[startup+822.301 s]
/proc/loadavg: 8.14 7.68 5.32 9/184 28563
/proc/meminfo: memFree=23028720/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=9727712 CPUtime=3280.96 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 46326645 0 0 0 321390 6706 0 0 25 0 4 0 876283941 9961177088 2022561 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476519 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2431928 2022561 597 112 0 2426893 0
[pid=28537/tid=28538] ppid=28535 vsize=9727712 CPUtime=819.17 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 17312702 0 0 0 79456 2461 0 0 25 0 4 0 876283941 9961177088 2022561 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476519 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=9727712 CPUtime=821.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11276918 0 0 0 80454 1699 0 0 25 0 4 0 876283941 9961177088 2022561 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476519 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=9727712 CPUtime=819.06 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 7607683 0 0 0 80854 1052 0 0 25 0 4 0 876283941 9961177088 2022561 33554432000 4194304 4650419 140733655122608 18446744073709551615 4231182 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3280.96
Current children cumulated vsize (KiB) 9727712

[startup+882.307 s]
/proc/loadavg: 8.10 7.75 5.49 9/184 28564
/proc/meminfo: memFree=22911728/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=9727712 CPUtime=3520.67 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 51955568 0 0 0 344607 7460 0 0 25 0 4 0 876283941 9961177088 2025809 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476519 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2431928 2025809 597 112 0 2426893 0
[pid=28537/tid=28538] ppid=28535 vsize=9727712 CPUtime=878.87 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 22932991 0 0 0 84673 3214 0 0 25 0 4 0 876283941 9961177088 2025809 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476514 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=9727712 CPUtime=881.54 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11277734 0 0 0 86455 1699 0 0 25 0 4 0 876283941 9961177088 2025809 33554432000 4194304 4650419 140733655122608 18446744073709551615 4310912 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=9727712 CPUtime=879.06 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 7615479 0 0 0 86853 1053 0 0 25 0 4 0 876283941 9961177088 2025809 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230684 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3520.67
Current children cumulated vsize (KiB) 9727712

[startup+942.3 s]
/proc/loadavg: 8.16 7.83 5.66 9/184 28566
/proc/meminfo: memFree=22927296/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=9727712 CPUtime=3760.31 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 55824045 0 0 0 368083 7948 0 0 25 0 4 0 876283941 9961177088 2028307 33554432000 4194304 4650419 140733655122608 18446744073709551615 4363768 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2431928 2028307 597 112 0 2426893 0
[pid=28537/tid=28538] ppid=28535 vsize=9727712 CPUtime=938.55 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 26788665 0 0 0 90157 3698 0 0 25 0 4 0 876283941 9961177088 2028307 33554432000 4194304 4650419 140733655122608 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=9727712 CPUtime=941.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11281266 0 0 0 92453 1700 0 0 25 0 4 0 876283941 9961177088 2028307 33554432000 4194304 4650419 140733655122608 18446744073709551615 4363750 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=9727712 CPUtime=939.05 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 7622754 0 0 0 92850 1055 0 0 25 0 4 0 876283941 9961177088 2028307 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230557 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3760.31
Current children cumulated vsize (KiB) 9727712

[startup+1002.3 s]
/proc/loadavg: 8.17 7.88 5.81 9/184 28568
/proc/meminfo: memFree=22953928/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=9703968 CPUtime=4000 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 55910347 0 0 0 392034 7966 0 0 25 0 4 0 876283941 9936863232 2017549 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230546 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2425992 2017549 597 112 0 2420957 0
[pid=28537/tid=28538] ppid=28535 vsize=9703968 CPUtime=998.24 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 26822609 0 0 0 96118 3706 0 0 25 0 4 0 876283941 9936863232 2017549 33554432000 4194304 4650419 140733655122608 18446744073709551615 4363750 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=9703968 CPUtime=1001.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11284766 0 0 0 98451 1702 0 0 25 0 4 0 876283941 9936863232 2017549 33554432000 4194304 4650419 140733655122608 18446744073709551615 4365227 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=9703968 CPUtime=999.03 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 7641511 0 0 0 98846 1057 0 0 25 0 4 0 876283941 9936863232 2017549 33554432000 4194304 4650419 140733655122608 18446744073709551615 4243563 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4000
Current children cumulated vsize (KiB) 9703968

[startup+1062.3 s]
/proc/loadavg: 8.10 7.92 5.95 9/184 28569
/proc/meminfo: memFree=22411268/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=10359888 CPUtime=4239.69 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 56964307 0 0 0 415856 8113 0 0 25 0 4 0 876283941 10608525312 2134704 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230548 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2589972 2134704 597 112 0 2584937 0
[pid=28537/tid=28538] ppid=28535 vsize=10359888 CPUtime=1057.94 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 26834158 0 0 0 102087 3707 0 0 25 0 4 0 876283941 10608525312 2134704 33554432000 4194304 4650419 140733655122608 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=10359888 CPUtime=1061.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11311979 0 0 0 104445 1708 0 0 25 0 4 0 876283941 10608525312 2134704 33554432000 4194304 4650419 140733655122608 18446744073709551615 4419144 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=10359888 CPUtime=1059.04 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 8656687 0 0 0 104707 1197 0 0 25 0 4 0 876283941 10608525312 2134704 33554432000 4194304 4650419 140733655122608 18446744073709551615 4476519 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4239.69
Current children cumulated vsize (KiB) 10359888

[startup+1122.3 s]
/proc/loadavg: 8.07 7.94 6.08 9/184 28571
/proc/meminfo: memFree=22356928/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=10294352 CPUtime=4479.38 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 60027559 0 0 0 439410 8528 0 0 25 0 4 0 876283941 10541416448 2134590 33554432000 4194304 4650419 140733655122608 18446744073709551615 4231007 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2573588 2134606 597 112 0 2568553 0
[pid=28537/tid=28538] ppid=28535 vsize=10294352 CPUtime=1117.63 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 26842908 0 0 0 108055 3708 0 0 25 0 4 0 876283941 10541416448 2134614 33554432000 4194304 4650419 140733655122608 18446744073709551615 4231019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=10294352 CPUtime=1121.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11312149 0 0 0 110445 1708 0 0 25 0 4 0 876283941 10541416448 2134624 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=10294352 CPUtime=1119.03 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11711063 0 0 0 110293 1610 0 0 25 0 4 0 876283941 10541416448 2134634 33554432000 4194304 4650419 140733655122608 18446744073709551615 4441467 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4479.38
Current children cumulated vsize (KiB) 10294352

[startup+1182.3 s]
/proc/loadavg: 8.08 7.97 6.20 9/184 28572
/proc/meminfo: memFree=22224216/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=10425424 CPUtime=4719.08 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 62201969 0 0 0 463116 8792 0 0 25 0 4 0 876283941 10675634176 2145542 33554432000 4194304 4650419 140733655122608 18446744073709551615 4231022 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2606356 2145542 597 112 0 2601321 0
[pid=28537/tid=28538] ppid=28535 vsize=10425424 CPUtime=1177.33 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 26848329 0 0 0 114024 3709 0 0 25 0 4 0 876283941 10675634176 2145542 33554432000 4194304 4650419 140733655122608 18446744073709551615 4236872 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=10425424 CPUtime=1181.53 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11312149 0 0 0 116445 1708 0 0 25 0 4 0 876283941 10675634176 2145542 33554432000 4194304 4650419 140733655122608 18446744073709551615 4236879 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=10425424 CPUtime=1179.02 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 13880008 0 0 0 116029 1873 0 0 25 0 4 0 876283941 10675634176 2145542 33554432000 4194304 4650419 140733655122608 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4719.08
Current children cumulated vsize (KiB) 10425424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.6 s]
/proc/loadavg: 7.63 7.87 6.22 9/184 28615
/proc/meminfo: memFree=21596856/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=10425424 CPUtime=4800.18 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) R 28535 28537 26276 0 -1 4202496 62215464 0 0 0 471215 8803 0 0 25 0 4 0 876283941 10675634176 2157684 33554432000 4194304 4650419 140733655122608 18446744073709551615 4231007 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 2606356 2157684 597 112 0 2601321 0
[pid=28537/tid=28538] ppid=28535 vsize=10425424 CPUtime=1197.53 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 26848979 0 0 0 116044 3709 0 0 25 0 4 0 876283941 10675634176 2157684 33554432000 4194304 4650419 140733655122608 18446744073709551615 4230684 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28537/tid=28539] ppid=28535 vsize=10425424 CPUtime=1201.84 cores=0,2,4,6
/proc/28537/task/28539/stat : 28539 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 11312149 0 0 0 118468 1716 0 0 25 0 4 0 876283941 10675634176 2157684 33554432000 4194304 4650419 140733655122608 18446744073709551615 4236868 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28537/tid=28540] ppid=28535 vsize=10425424 CPUtime=1199.33 cores=0,2,4,6
/proc/28537/task/28540/stat : 28540 (strangenight1-m) R 28535 28537 26276 0 -1 4202560 13892853 0 0 0 118056 1877 0 0 25 0 4 0 876283941 10675634176 2157684 33554432000 4194304 4650419 140733655122608 18446744073709551615 4328465 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 10425424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.71 s]
/proc/loadavg: 7.63 7.87 6.22 9/184 28615
/proc/meminfo: memFree=21596856/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=0 CPUtime=4800.31 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) Z 28535 28537 26276 0 -1 4203548 62215465 0 0 0 471218 8813 0 0 25 0 2 0 876283941 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 0 0 0 0 0 0 0
[pid=28537/tid=28538] ppid=28535 vsize=0 CPUtime=1197.63 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4203588 26848979 0 0 0 116044 3719 0 0 25 0 2 0 876283941 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 0

[startup+1202.9 s]
/proc/loadavg: 7.63 7.87 6.22 9/184 28615
/proc/meminfo: memFree=21596856/32951124 swapFree=67050780/67111528
[pid=28537] ppid=28535 vsize=0 CPUtime=4800.5 cores=0,2,4,6
/proc/28537/stat : 28537 (strangenight1-m) Z 28535 28537 26276 0 -1 4203548 62215465 0 0 0 471218 8832 0 0 25 0 2 0 876283941 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28537/statm: 0 0 0 0 0 0 0
[pid=28537/tid=28538] ppid=28535 vsize=0 CPUtime=1197.82 cores=0,2,4,6
/proc/28537/task/28538/stat : 28538 (strangenight1-m) R 28535 28537 26276 0 -1 4203588 26848979 0 0 0 116044 3738 0 0 25 0 2 0 876283941 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.94
CPU time (s): 4800.55
CPU user time (s): 4712.18
CPU system time (s): 88.3666
CPU usage (%): 399.066
Max. virtual memory (cumulated for all children) (KiB): 10481860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4712.18
system time used= 88.3666
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 62215465
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39602
involuntary context switches= 35552

runsolver used 1.75473 second user time and 4.38633 second system time

The end

Launcher Data 

Begin job on node101 at 2011-06-09 21:13:32
IDJOB=3369454
IDBENCH=71686
IDSOLVER=1846
FILE ID=node101/3369454-1307646801
RUNJOBID= node101-1307646801-28506
PBS_JOBID= 13549390
Free space on /tmp= 73888 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-1-mt (fixed)
BENCH NAME= SAT_RACE06/velev-npe-1.0-9dlx-b71.cnf
COMMAND LINE= ./strangenight1-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3369454-1307646801/watcher-3369454-1307646801 -o /tmp/evaluation-result-3369454-1307646801/solver-3369454-1307646801 -C 4800 -W 1300 -M 15500  ./strangenight1-mt --threads=4 HOME/instance-3369454-1307646801.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75d91f0ba4398ccb5b452707c0e7fa27
RANDOM SEED=748484252

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31928476 kB
Buffers:        101656 kB
Cached:         535924 kB
SwapCached:      27576 kB
Active:         603120 kB
Inactive:       251716 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31928476 kB
SwapTotal:    67111528 kB
SwapFree:     67050780 kB
Dirty:          332352 kB
Writeback:           0 kB
AnonPages:      211684 kB
Mapped:           9700 kB
Slab:           103568 kB
PageTables:       5160 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   455168 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73768 MiB
End job on node101 at 2011-06-09 21:33:36