Trace number 3369601

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat Strange-Night-1-mt (fixed)UNSAT 975.195 340.314

General information on the benchmark

Nameapplication/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf
MD5SUM28b7074e04e59e64b5e4d7991d54f9d1
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark15.4606
Satisfiable
(Un)Satisfiability was proved
Number of variables448370
Number of clauses1130525
Sum of the clauses size2637889
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2753682
Number of clauses of size 3376841
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.01	c Using 4 threads
0.00/0.01	c This is CryptoMiniSat 2.9.0
0.00/0.01	c compiled with gcc version 4.4.5
0.00/0.01	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.01	c Reading file 'HOME/instance-3369601-1305394164.cnf'
0.00/0.01	c -- header says num vars:         448370
0.00/0.01	c -- header says num clauses:     1130525
1.68/0.55	c -- clauses added:            0 learnts,      1130525 normals,            0 xors
1.68/0.55	c -- vars added     448370
1.68/0.55	c Parsing time:  1.73 s
1.68/0.55	c  N st     0         0    448370    376841    753682         0   2637887         0   no data   no data  --
1.68/1.09	c asymm  cl-useful: 0/543/373184 lits-rem:0 time: 2.10
41.01/10.38	c Flit:     0 Blit:   4740 bXBeca:    0 bXProp: 3414 Bins:      0 BRemL:      0 BRemN:      0 P: 200.0M T: 36.78
41.01/10.40	c Cleaning up after failed var search:     0.09 s 
41.41/10.48	c Replacing     3415 vars Replaced    44395 lits Time:     0.24 s 
42.16/10.65	c bin-w-bin subsume rem            0 bins  time:  0.14 s
42.56/10.78	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  0.51 s
54.17/13.70	c Subs w/ non-existent bins:  32547 l-rem:  32547 v-fix:     0 done:  34651 time: 11.57 s
55.32/13.99	c Removed useless bin:      22  fixed:     0  props:  20.16M  time:  1.14 s
59.71/15.00	c lits-rem:         0  cl-subs:        0  v-elim: 145519  v-fix:    0  time:  4.02 s
59.71/15.06	c Finding binary XORs  T:     0.23 s  found:    1328
60.11/15.10	c Replacing     1328 vars Replaced    10706 lits Time:     0.14 s 
60.51/15.28	c Finding non-binary XORs:     0.51 s (found:   38452, avg size: 3.0)
60.51/15.28	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:    418 locsubst:     0 time:   0.18
60.91/15.31	c Calc default polars -  time:   0.08 s pos:   34474 undec:  196756 neg:  217140
60.91/15.31	c =========================================================================================
60.91/15.31	c types(t): F = full restart, N = normal restart
60.91/15.31	c types(t): S = simplification begin/end, E = solution found
60.91/15.31	c restart types(rt): st = static, dy = dynamic
60.91/15.31	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits
60.91/15.31	c  B st     0         0    289292    251825    329998         0   1530027         0   no data   no data  --
82.05/20.65	c Decided on static restart strategy
105.98/26.61	c  N st     8      4915    286778    251825    330157      4666   1530027   2968445   no data   no data  --
165.80/41.60	c  N st    10     11298    271693    220321    329508     10894   1416521   7173290   no data   no data  --
165.80/41.67	c Finding binary XORs  T:     0.27 s  found:    7599
167.40/42.04	c Replacing     8847 vars Replaced   143798 lits Time:     1.50 s 
279.84/70.26	c  N st    11     17042    262846    220321    306415     16521   1381133  14071062   no data   no data  --
280.64/70.48	c Finding binary XORs  T:     0.30 s  found:   22735
282.28/70.90	c Replacing    22737 vars Replaced   398545 lits Time:     1.67 s 
325.30/81.68	c  F st    12     25000    194855    143794    250935     14572   1010263   6247371   no data   no data  --
326.89/82.01	c  N st    12     25000    194855    143794    250935     14572   1010263   6247371   no data   no data  --
333.28/83.64	c Replacing     1872 vars Replaced    29215 lits Time:     0.54 s 
352.03/88.34	c Decided on static restart strategy
352.03/88.34	c  N st    18     30000    181670    126799    247001     19383    938458   7166537   no data   no data  --
352.03/88.35	c  S st    18     30000    181670    126799    247001     19383    938458   7166537   no data   no data  --
352.03/88.40	c Finding binary XORs  T:     0.21 s  found:    3799
353.22/88.66	c Replacing     3799 vars Replaced   118890 lits Time:     1.04 s 
358.00/89.86	c Replacing     4368 vars Replaced    57405 lits Time:     0.47 s 
358.40/89.96	c  S st    18     30502    160936    114867    221787     19706    852820   5885024   no data   no data  --
358.80/90.01	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.19
971.27/338.34	c Flit:   220 Blit:   1428 bXBeca:    0 bXProp: 25125 Bins:    695 BRemL:      1 BRemN:     23 P: 200.0M T: 611.94
971.27/338.38	c Cleaning up after failed var search:     0.08 s 
971.47/338.45	c Replacing    27664 vars Replaced   571847 lits Time:     0.11 s 
971.67/338.50	c bin-w-bin subsume rem           42 bins  time:  0.03 s
971.67/338.55	c subs with bin:        8  lits-rem:      1406  v-fix:    0  time:  0.09 s
972.07/338.75	c Subs w/ non-existent bins:      2 l-rem:    436 v-fix:     0 done:  20742 time:  0.40 s
972.27/338.81	c Removed useless bin:       0  fixed:     0  props:  20.00M  time:  0.13 s
974.07/339.79	c lits-rem:      4042  cl-subs:     6106  v-elim:  54490  v-fix:    0  time:  1.95 s
975.07/340.20	c asymm  cl-useful: 0/19891/20434 lits-rem:0 time: 0.83
975.07/340.21	c  N st    18     30502     27246     20434     43025     13385    174331    139633   no data   no data  --
975.07/340.21	c Following stats are for *FIRST FINISHED THREAD ONLY*
975.07/340.21	c num threads              : 4          
975.07/340.21	c restarts                 : 34         
975.07/340.21	c dynamic restarts         : 0          
975.07/340.21	c static restarts          : 34         
975.07/340.21	c full restarts            : 2          
975.07/340.21	c total simplify time      : 7.81       
975.07/340.21	c learnts DL2              : 0          
975.07/340.21	c learnts size 2           : 1168180    
975.07/340.21	c learnts size 1           : 149046      (33.24     % of vars)
975.07/340.21	c filedLit time            : 98.91       (10.16     % time)
975.07/340.21	c v-elim SatELite          : 219017      (48.85     % vars)
975.07/340.21	c SatELite time            : 34.99       (3.59      % time)
975.07/340.21	c v-elim xor               : 807         (0.18      % vars)
975.07/340.21	c xor elim time            : 0.39        (0.04      % time)
975.07/340.21	c num binary xor trees     : 5096       
975.07/340.21	c binxor trees' crown      : 73635       (14.45     leafs/tree)
975.07/340.21	c bin xor find time        : 1.44       
975.07/340.21	c OTF clause improved      : 12797       (0.11      clauses/conflict)
975.07/340.21	c OTF impr. size diff      : 13414       (1.05       lits/clause)
975.07/340.21	c OTF cl watch-shrink      : 7858        (0.07      clauses/conflict)
975.07/340.21	c OTF cl watch-sh-lit      : 12604       (1.60       lits/clause)
975.07/340.21	c tried to recurMin cls    : 15013       (12.99      % of conflicts)
975.07/340.21	c updated cache            : 0           (0.00       lits/tried recurMin)
975.07/340.21	c unit cls received        : 695         (0.47      % of units)
975.07/340.21	c unit cls sent            : 62652       (42.04     % of units)
975.07/340.21	c bin cls received         : 171728     
975.07/340.21	c bin cls sent             : 83416      
975.07/340.21	c clauses over max glue    : 0           (0.00      % of all clauses)
975.07/340.21	c conflicts                : 115584      (118.74    / sec)
975.07/340.21	c decisions                : 1479474     (1.17      % random)
975.07/340.21	c bogo-props               : 2420861126  (2486872.64 / sec)
975.07/340.21	c conflict literals        : 29693691    (3.66      % deleted)
975.07/340.21	c Memory used              : 2190.43     MB
975.07/340.21	c single-thread CPU time   : 973.46      s
975.07/340.21	c all-threads sum CPU time : 973.46      s
975.07/340.21	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3369601-1305394164/watcher-3369601-1305394164 -o /tmp/evaluation-result-3369601-1305394164/solver-3369601-1305394164 -C 4800 -W 1300 -M 15500 ./strangenight1-mt --threads=4 HOME/instance-3369601-1305394164.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.05 8.26 8.04 5/367 32030
/proc/meminfo: memFree=13974296/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=51236 CPUtime=0.01 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 412 0 0 0 1 0 0 0 22 0 4 0 631832125 52465664 352 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180456 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 12809 352 303 112 0 7774 0
[pid=32030/tid=32031] ppid=32028 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 0 0 0 0 0 0 0 0 23 0 4 0 631832125 52465664 352 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726461425 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 0 0 0 0 0 0 0 0 23 0 4 0 631832125 52465664 352 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180466 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=51236 CPUtime=0 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 4 0 631832125 52465664 352 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180460 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.0738219 s]
/proc/loadavg: 9.05 8.26 8.04 5/367 32030
/proc/meminfo: memFree=13974296/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=353768 CPUtime=0.23 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 33321 0 0 0 17 6 0 0 18 0 4 0 631832125 362258432 24730 33554432000 4194304 4650419 140733310790592 18446744073709551615 4319147 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 88442 24738 344 112 0 83407 0
[pid=32030/tid=32031] ppid=32028 vsize=353768 CPUtime=0.05 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 8154 0 0 0 4 1 0 0 24 0 4 0 631832125 362258432 24741 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726073585 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=353768 CPUtime=0.05 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 8076 0 0 0 4 1 0 0 18 0 4 0 631832125 362258432 24746 33554432000 4194304 4650419 140733310790592 18446744073709551615 4317116 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=353768 CPUtime=0.05 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 8365 0 0 0 4 1 0 0 18 0 4 0 631832125 362258432 24750 33554432000 4194304 4650419 140733310790592 18446744073709551615 4319147 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 353768

[startup+0.100816 s]
/proc/loadavg: 9.05 8.26 8.04 5/367 32030
/proc/meminfo: memFree=13974296/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=372804 CPUtime=0.34 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 41502 0 0 0 26 8 0 0 18 0 4 0 631832125 381751296 32773 33554432000 4194304 4650419 140733310790592 18446744073709551615 4319147 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 93201 32774 344 112 0 88166 0
[pid=32030/tid=32031] ppid=32028 vsize=372804 CPUtime=0.07 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 10180 0 0 0 6 1 0 0 24 0 4 0 631832125 381751296 32777 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726073862 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=372804 CPUtime=0.07 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 10144 0 0 0 6 1 0 0 18 0 4 0 631832125 381751296 32780 33554432000 4194304 4650419 140733310790592 18446744073709551615 4317116 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=372804 CPUtime=0.07 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 10405 0 0 0 6 1 0 0 18 0 4 0 631832125 381751296 32781 33554432000 4194304 4650419 140733310790592 18446744073709551615 4520322 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 372804

[startup+0.327941 s]
/proc/loadavg: 9.05 8.26 8.04 5/367 32030
/proc/meminfo: memFree=13974296/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=614812 CPUtime=1.22 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) D 32028 32030 31462 0 -1 4202496 119906 0 0 0 98 24 0 0 18 0 4 0 631832125 629567488 100660 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726448263 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 153703 100148 344 112 0 148668 0
[pid=32030/tid=32031] ppid=32028 vsize=614812 CPUtime=0.29 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) D 32028 32030 31462 0 -1 4202560 29817 0 0 0 24 5 0 0 18 0 4 0 631832125 629567488 100148 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726448263 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=614812 CPUtime=0.3 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) D 32028 32030 31462 0 -1 4202560 29932 0 0 0 24 6 0 0 18 0 4 0 631832125 629567488 100148 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726448263 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=614812 CPUtime=0.29 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 29885 0 0 0 24 5 0 0 18 0 4 0 631832125 629567488 100148 33554432000 4194304 4650419 140733310790592 18446744073709551615 264726448263 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 614812

[startup+1.14663 s]
/proc/loadavg: 9.05 8.26 8.04 5/367 32030
/proc/meminfo: memFree=13974296/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=1026320 CPUtime=4.48 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 202245 0 0 0 407 41 0 0 19 0 4 0 631832125 1050951680 165513 33554432000 4194304 4650419 140733310790592 18446744073709551615 4512108 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 256580 165513 370 112 0 251545 0
[pid=32030/tid=32031] ppid=32028 vsize=1026320 CPUtime=1.11 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 51184 0 0 0 102 9 0 0 19 0 4 0 631832125 1050951680 165513 33554432000 4194304 4650419 140733310790592 18446744073709551615 4512108 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=1026320 CPUtime=1.11 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 51186 0 0 0 101 10 0 0 19 0 4 0 631832125 1050951680 165513 33554432000 4194304 4650419 140733310790592 18446744073709551615 4512108 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=1026320 CPUtime=1.11 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 48568 0 0 0 101 10 0 0 19 0 4 0 631832125 1050951680 165513 33554432000 4194304 4650419 140733310790592 18446744073709551615 4363750 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.48
Current children cumulated vsize (KiB) 1026320

[startup+1.50056 s]
/proc/loadavg: 9.05 8.26 8.04 9/371 32034
/proc/meminfo: memFree=13303696/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=906524 CPUtime=5.93 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 205319 0 0 0 552 41 0 0 19 0 4 0 631832125 928280576 161953 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370329 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 226631 161953 372 112 0 221596 0
[pid=32030/tid=32031] ppid=32028 vsize=906524 CPUtime=1.46 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 52217 0 0 0 137 9 0 0 19 0 4 0 631832125 928280576 161953 33554432000 4194304 4650419 140733310790592 18446744073709551615 4369376 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=906524 CPUtime=1.49 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 52229 0 0 0 138 11 0 0 19 0 4 0 631832125 928280576 161953 33554432000 4194304 4650419 140733310790592 18446744073709551615 4369188 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=906524 CPUtime=1.48 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 48570 0 0 0 138 10 0 0 19 0 4 0 631832125 928280576 161953 33554432000 4194304 4650419 140733310790592 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 906524

[startup+3.10126 s]
/proc/loadavg: 9.05 8.26 8.04 9/371 32034
/proc/meminfo: memFree=13405056/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=906524 CPUtime=12.26 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 205377 0 0 0 1185 41 0 0 23 0 4 0 631832125 928280576 162011 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370329 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 226631 162011 372 112 0 221596 0
[pid=32030/tid=32031] ppid=32028 vsize=906524 CPUtime=3.03 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 52217 0 0 0 294 9 0 0 23 0 4 0 631832125 928280576 162011 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370329 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=906524 CPUtime=3.07 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 52229 0 0 0 296 11 0 0 23 0 4 0 631832125 928280576 162011 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370329 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=906524 CPUtime=3.06 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 48628 0 0 0 296 10 0 0 23 0 4 0 631832125 928280576 162011 33554432000 4194304 4650419 140733310790592 18446744073709551615 4364907 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.26
Current children cumulated vsize (KiB) 906524

[startup+6.30065 s]
/proc/loadavg: 8.97 8.26 8.04 9/371 32034
/proc/meminfo: memFree=13201400/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=906524 CPUtime=25.02 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 205996 0 0 0 2460 42 0 0 25 0 4 0 631832125 928280576 162630 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370340 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 226631 162630 372 112 0 221596 0
[pid=32030/tid=32031] ppid=32028 vsize=906524 CPUtime=6.19 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 52217 0 0 0 610 9 0 0 25 0 4 0 631832125 928280576 162630 33554432000 4194304 4650419 140733310790592 18446744073709551615 4369075 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=906524 CPUtime=6.27 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 52229 0 0 0 616 11 0 0 25 0 4 0 631832125 928280576 162630 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370329 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=906524 CPUtime=6.26 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 49247 0 0 0 616 10 0 0 25 0 4 0 631832125 928280576 162630 33554432000 4194304 4650419 140733310790592 18446744073709551615 4364883 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 906524

[startup+12.7004 s]
/proc/loadavg: 8.89 8.26 8.04 9/371 32034
/proc/meminfo: memFree=12444772/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=1119072 CPUtime=50.54 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 267133 0 0 0 5001 53 0 0 21 0 4 0 631832125 1145929728 223764 33554432000 4194304 4650419 140733310790592 18446744073709551615 4446475 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 279768 223764 385 112 0 274733 0
[pid=32030/tid=32031] ppid=32028 vsize=1119072 CPUtime=12.51 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 71346 0 0 0 1238 13 0 0 25 0 4 0 631832125 1145929728 223764 33554432000 4194304 4650419 140733310790592 18446744073709551615 4550186 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=1119072 CPUtime=12.67 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 72029 0 0 0 1253 14 0 0 21 0 4 0 631832125 1145929728 223764 33554432000 4194304 4650419 140733310790592 18446744073709551615 4446402 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=1119072 CPUtime=12.66 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 51515 0 0 0 1255 11 0 0 25 0 4 0 631832125 1145929728 223764 33554432000 4194304 4650419 140733310790592 18446744073709551615 4315553 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.54
Current children cumulated vsize (KiB) 1119072

[startup+25.501 s]
/proc/loadavg: 8.69 8.24 8.04 9/371 32034
/proc/meminfo: memFree=11600888/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=1520168 CPUtime=101.59 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 349784 0 0 0 10092 67 0 0 25 0 4 0 631832125 1556652032 286381 33554432000 4194304 4650419 140733310790592 18446744073709551615 4315977 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 380042 286381 394 112 0 375007 0
[pid=32030/tid=32031] ppid=32028 vsize=1520168 CPUtime=25.16 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 99543 0 0 0 2499 17 0 0 25 0 4 0 631832125 1556652032 286381 33554432000 4194304 4650419 140733310790592 18446744073709551615 4364017 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=1520168 CPUtime=25.47 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 99915 0 0 0 2528 19 0 0 25 0 4 0 631832125 1556652032 286381 33554432000 4194304 4650419 140733310790592 18446744073709551615 4363750 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=1520168 CPUtime=25.46 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 60249 0 0 0 2534 12 0 0 25 0 4 0 631832125 1556652032 286381 33554432000 4194304 4650419 140733310790592 18446744073709551615 4365357 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.59
Current children cumulated vsize (KiB) 1520168

[startup+51.1142 s]
/proc/loadavg: 8.13 8.16 8.02 10/371 32066
/proc/meminfo: memFree=24147464/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=1585712 CPUtime=203.73 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 378841 0 0 0 20295 78 0 0 25 0 4 0 631832125 1623769088 315438 33554432000 4194304 4650419 140733310790592 18446744073709551615 4315222 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 396428 315438 394 112 0 391393 0
[pid=32030/tid=32031] ppid=32028 vsize=1585712 CPUtime=50.47 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 104617 0 0 0 5027 20 0 0 25 0 4 0 631832125 1623769088 315438 33554432000 4194304 4650419 140733310790592 18446744073709551615 4333632 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=1585712 CPUtime=51.08 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 107648 0 0 0 5086 22 0 0 25 0 4 0 631832125 1623769088 315438 33554432000 4194304 4650419 140733310790592 18446744073709551615 4315103 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=1585712 CPUtime=51.08 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 69255 0 0 0 5091 17 0 0 25 0 4 0 631832125 1623769088 315438 33554432000 4194304 4650419 140733310790592 18446744073709551615 4419144 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.73
Current children cumulated vsize (KiB) 1585712

[startup+102.301 s]
/proc/loadavg: 8.19 8.17 8.03 6/371 32127
/proc/meminfo: memFree=24305940/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=1693328 CPUtime=407.86 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 634013 0 0 0 40670 116 0 0 25 0 4 0 631832125 1733967872 330203 33554432000 4194304 4650419 140733310790592 18446744073709551615 4230546 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 423332 330203 396 112 0 418297 0
[pid=32030/tid=32031] ppid=32028 vsize=1693328 CPUtime=101.05 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 178849 0 0 0 10076 29 0 0 25 0 4 0 631832125 1733967872 330203 33554432000 4194304 4650419 140733310790592 18446744073709551615 4314858 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=1693328 CPUtime=102.25 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 230567 0 0 0 10188 37 0 0 25 0 4 0 631832125 1733967872 330203 33554432000 4194304 4650419 140733310790592 18446744073709551615 4315246 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=1693328 CPUtime=102.26 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 89952 0 0 0 10204 22 0 0 25 0 4 0 631832125 1733967872 330203 33554432000 4194304 4650419 140733310790592 18446744073709551615 4314876 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.86
Current children cumulated vsize (KiB) 1693328

[startup+162.301 s]

################
# More data... #
################

/proc/32030/statm: 557883 459567 396 112 0 552848 0
[pid=32030/tid=32031] ppid=32028 vsize=2231532 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2285088768 459567 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2231532 CPUtime=162.24 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 16177 47 0 0 25 0 4 0 631832125 2285088768 459567 33554432000 4194304 4650419 140733310790592 18446744073709551615 4220608 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2231532 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2285088768 459567 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 619.26
Current children cumulated vsize (KiB) 2231532

[startup+222.301 s]
/proc/loadavg: 6.65 7.68 7.87 7/371 32190
/proc/meminfo: memFree=23163312/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=739.26 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803216 0 0 0 73762 164 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 4230691 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462433 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=222.24 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 22177 47 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 739.26
Current children cumulated vsize (KiB) 2242996

[startup+282.301 s]
/proc/loadavg: 6.24 7.37 7.75 7/371 32192
/proc/meminfo: memFree=23075112/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=859.27 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803216 0 0 0 85763 164 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 4230695 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462433 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=282.24 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 28177 47 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155499 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462433 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 859.27
Current children cumulated vsize (KiB) 2242996

Solver just ended. Dumping a history of the last processes samples

[startup+307.601 s]
/proc/loadavg: 6.22 7.28 7.71 5/371 32193
/proc/meminfo: memFree=23039248/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=909.87 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803241 0 0 0 90823 164 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 4230691 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462458 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=307.54 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 30707 47 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 909.87
Current children cumulated vsize (KiB) 2242996

[startup+320.401 s]
/proc/loadavg: 5.28 7.02 7.61 3/362 32210
/proc/meminfo: memFree=23886324/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=935.47 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803241 0 0 0 93383 164 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 4230702 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462458 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=320.34 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 31987 47 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462458 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 935.47
Current children cumulated vsize (KiB) 2242996

[startup+333.201 s]
/proc/loadavg: 4.78 6.85 7.55 3/362 32210
/proc/meminfo: memFree=23886376/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=961.07 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803242 0 0 0 95943 164 0 0 25 0 4 0 631832125 2296827904 462459 33554432000 4194304 4650419 140733310790592 18446744073709551615 4229677 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462459 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462459 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=333.14 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 33267 47 0 0 25 0 4 0 631832125 2296827904 462459 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155499 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462459 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 961.07
Current children cumulated vsize (KiB) 2242996

[startup+336.401 s]
/proc/loadavg: 4.56 6.77 7.52 3/362 32210
/proc/meminfo: memFree=23886248/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=967.47 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803253 0 0 0 96583 164 0 0 25 0 4 0 631832125 2296827904 462470 33554432000 4194304 4650419 140733310790592 18446744073709551615 4351871 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462470 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462470 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=336.34 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 33587 47 0 0 25 0 4 0 631832125 2296827904 462470 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462470 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 967.47
Current children cumulated vsize (KiB) 2242996

[startup+338.001 s]
/proc/loadavg: 4.56 6.77 7.52 3/362 32210
/proc/meminfo: memFree=23886364/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=970.67 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803270 0 0 0 96903 164 0 0 25 0 4 0 631832125 2296827904 462487 33554432000 4194304 4650419 140733310790592 18446744073709551615 4243895 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462487 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462487 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=337.94 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 33747 47 0 0 25 0 4 0 631832125 2296827904 462487 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462487 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 970.67
Current children cumulated vsize (KiB) 2242996

[startup+339.601 s]
/proc/loadavg: 4.35 6.69 7.49 3/362 32211
/proc/meminfo: memFree=23886240/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=973.87 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 803672 0 0 0 97223 164 0 0 25 0 4 0 631832125 2296827904 462889 33554432000 4194304 4650419 140733310790592 18446744073709551615 4433140 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 462889 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 462889 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=339.54 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 33907 47 0 0 25 0 4 0 631832125 2296827904 462889 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155499 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 462889 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 973.87
Current children cumulated vsize (KiB) 2242996

[startup+340.001 s]
/proc/loadavg: 4.35 6.69 7.49 3/362 32211
/proc/meminfo: memFree=23886240/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=974.67 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 804013 0 0 0 97303 164 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 4369877 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 463230 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=339.94 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 33947 47 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155499 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 974.67
Current children cumulated vsize (KiB) 2242996

[startup+340.201 s]
/proc/loadavg: 4.35 6.69 7.49 3/362 32211
/proc/meminfo: memFree=23886240/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=2242996 CPUtime=975.07 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) R 32028 32030 31462 0 -1 4202496 804013 0 0 0 97343 164 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 4370441 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 560749 463230 396 112 0 555714 0
[pid=32030/tid=32031] ppid=32028 vsize=2242996 CPUtime=158.53 cores=0,2,4,6
/proc/32030/task/32031/stat : 32031 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 202042 0 0 0 15818 35 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
[pid=32030/tid=32032] ppid=32028 vsize=2242996 CPUtime=340.14 cores=0,2,4,6
/proc/32030/task/32032/stat : 32032 (strangenight1-m) R 32028 32030 31462 0 -1 4202560 267398 0 0 0 33967 47 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035155652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=32030/tid=32033] ppid=32028 vsize=2242996 CPUtime=136.2 cores=0,2,4,6
/proc/32030/task/32033/stat : 32033 (strangenight1-m) S 32028 32030 31462 0 -1 4202560 195809 0 0 0 13566 54 0 0 25 0 4 0 631832125 2296827904 463230 33554432000 4194304 4650419 140733310790592 18446744073709551615 47164035180084 0 0 4096 2 18446604441619572800 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 975.07
Current children cumulated vsize (KiB) 2242996

[startup+340.301 s]
/proc/loadavg: 4.35 6.69 7.49 2/360 32211
/proc/meminfo: memFree=25622372/32951124 swapFree=63083164/67111528
[pid=32030] ppid=32028 vsize=0 CPUtime=975.18 cores=0,2,4,6
/proc/32030/stat : 32030 (strangenight1-m) Z 32028 32030 31462 0 -1 4203548 804016 0 0 0 97345 173 0 0 25 0 1 0 631832125 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32030/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 975.18
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 340.314
CPU time (s): 975.195
CPU user time (s): 973.456
CPU system time (s): 1.73873
CPU usage (%): 286.557
Max. virtual memory (cumulated for all children) (KiB): 2242996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 973.456
system time used= 1.73873
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 804016
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4023
involuntary context switches= 4243

runsolver used 1.16382 second user time and 2.85656 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-14 19:29:25
IDJOB=3369601
IDBENCH=82450
IDSOLVER=1846
FILE ID=node141/3369601-1305394164
RUNJOBID= node141-1305392659-31777
PBS_JOBID= 13324432
Free space on /tmp= 73156 MiB

SOLVER NAME= CryptoMiniSat Strange-Night-1-mt (fixed)
BENCH NAME= SAT11/application/jarvisalo/smtqfbv-aigs/smtlib-qfbv-aigs-lfsr_008_079_112-tseitin.cnf
COMMAND LINE= ./strangenight1-mt --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3369601-1305394164/watcher-3369601-1305394164 -o /tmp/evaluation-result-3369601-1305394164/solver-3369601-1305394164 -C 4800 -W 1300 -M 15500  ./strangenight1-mt --threads=4 HOME/instance-3369601-1305394164.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 28b7074e04e59e64b5e4d7991d54f9d1
RANDOM SEED=869175268

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13979412 kB
Buffers:        218032 kB
Cached:        4898776 kB
SwapCached:      15356 kB
Active:       13540212 kB
Inactive:      5162608 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13979412 kB
SwapTotal:    67111528 kB
SwapFree:     63083164 kB
Dirty:           26788 kB
Writeback:           0 kB
AnonPages:    13577652 kB
Mapped:          13456 kB
Slab:           138888 kB
PageTables:      61528 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 98704688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73272 MiB
End job on node141 at 2011-05-14 19:35:06