Trace number 3280684

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CryptoMiniSat TechDemo-Alpha-mt? (TO) 4800.55 1205.17

General information on the benchmark

Nameindustrial/palacios/medium/
cube-11-h14-sat.cnf
MD5SUM7cc30e40be8c690e76c3fb158623be61
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark229.736
Satisfiable
(Un)Satisfiability was proved
Number of variables508177
Number of clauses1529045
Sum of the clauses size3568287
Maximum clause length19
Minimum clause length1
Number of clauses of size 11331
Number of clauses of size 21019705
Number of clauses of size 3505422
Number of clauses of size 42413
Number of clauses of size 519
Number of clauses of size over 5155

Solver Data 

0.00/0.00	c Outputting solution to console
0.00/0.00	c This is CryptoMiniSat 2.9.0
0.00/0.00	c compiled with gcc version 4.4.5
0.00/0.00	c Using 4 thread(s)
0.00/0.00	c WARNING: for repeatability, setting FPU to use double precision
0.00/0.00	c Reading file 'HOME/instance-3280684-1304032408.cnf'
0.00/0.00	c -- header says num vars:         509512
0.00/0.00	c -- header says num clauses:     1529045
2.99/3.07	c -- clauses added:            0 learnts,      1529045 normals,            0 xors
2.99/3.07	c -- vars added     509512
2.99/3.07	c Parsing time:  2.72 s
2.99/3.08	c  N st     0         0    509512    506678   1018374         0   3560301         0   no data   no data  --
5.94/3.87	c asymm  cl-useful: 8/14/506678 lits-rem:10 time: 3.08
44.67/13.54	c Flit:     0 Blit:     54 bXBeca:    0 bXProp: 3848 Bin:      0 BRemL:      0 BRemN:      0 CBin:       0 P: 60.0M T: 38.24
55.44/16.21	c Calc non-exist non-lernt bins v-fix:     0 done:  11026 time: 10.26 s
55.44/16.23	c Cache  BProp: 0 Set: 0 BXProp: 0 T: 0.05
55.44/16.26	c Subs w/ non-existent bins:    151 time:  0.13 s
57.04/16.64	c Replacing     3848 vars Replaced   272461 lits Time:     1.47 s 
58.24/16.96	c bin-w-bin subsume rem            1 bins  time:  0.57 s
59.44/17.24	c subs with bin:        0  lits-rem:         0  v-fix:    0  time:  1.13 s
60.65/17.53	c Removed useless bin:       0  fixed:     0  bprops:  10.00M  time:  1.14 s
79.18/22.25	c lits-rem:         0  cl-subs:     5188  v-elim: 168253  v-fix:    0  time: 18.03 s
79.18/22.25	c learnt bin added due to v-elim: 0
79.58/22.39	c Finding binary XORs  T:     0.53 s  found:   21766
81.18/22.70	c Replacing    21766 vars Replaced   173368 lits Time:     1.22 s 
88.75/24.69	c Finding non-binary XORs:     7.38 s (found:       0, avg size: nan)
88.75/24.69	c Calc default polars -  time:   0.29 s pos:  109936 undec:  196298 neg:  203278
88.75/24.69	c =========================================================================================
88.75/24.69	c types(t): F = full restart, N = normal restart
88.75/24.69	c types(t): S = simplification begin/end, E = solution found
88.75/24.69	c restart types(rt): st = static, dy = dynamic
88.75/24.69	c  t rt  Rest     Confl      Vars   NormCls    BinCls   Learnts    ClLits    LtLits   MTavgCS    LTAvgG
88.75/24.69	c  B st     0         0    314580    576898    567188         0   3107984         0   no data   no data  --
128.69/34.68	c Decided on static restart strategy
173.82/45.98	c  N dy    15      4263    314580    576898    567241      4051   3107983    386317    135.93      9.72  --
268.15/70.49	c  N dy    35      8420    314578    576898    567307      8053   3107983   1292817    338.02     13.25  --
368.39/95.57	c  N dy    55     12525    314578    576898    567628     12768   3107981   1758951     79.68     12.60  --
495.02/127.21	c  N dy    77     16753    314116    576898    567710     16811   3107981   2351272    155.39     12.81  --
624.44/159.67	c  N dy    92     20895    314114    576898    567756     10851   3107981    233452     81.04     11.82  --
751.48/191.46	c  N dy   110     25002    313892    576898    567808     14800   3107981    796860     91.65     12.05  --
922.02/234.19	c  N dy   129     29090    313848    576898    567867     18784   3107981   1335879    148.90     11.82  --
963.17/244.47	c  S st   134     30000    313635    576898    567874     19666   3107981   1409837     76.78     11.76  --
987.93/250.65	c  S st   134     30503    313635    576898    567948     20094   3107981   1441524     76.78     11.76  --
988.75/250.83	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.70
3897.57/979.01	c Flit:     6 Blit:      0 bXBeca:    0 bXProp:   25 Bin: 686117 BRemL:    277 BRemN:      0 CBin:       0 P: 60.1M T: 2908.60
3913.13/982.97	c Calc non-exist non-lernt bins v-fix:     0 done:  16822 time: 15.44 s
3913.13/982.99	c Cache  BProp: 0 Set: 0 BXProp: 0 T: 0.08
3914.33/983.23	c Subs w/ non-existent bins:      1 time:  0.96 s
3917.12/983.96	c Replacing       25 vars Replaced    96976 lits Time:     2.85 s 
3921.12/984.93	c bin-w-bin subsume rem         1533 bins  time:  1.16 s
3933.10/987.99	c subs with bin:      382  lits-rem:     35206  v-fix:    0  time: 12.21 s
3935.90/988.63	c Removed useless bin:       0  fixed:     0  bprops:  10.00M  time:  2.57 s
3982.23/1000.27	c lits-rem:       115  cl-subs:    25885  v-elim: 189067  v-fix:    0  time: 46.40 s
3982.23/1000.27	c learnt bin added due to v-elim: 0
3984.23/1000.74	c asymm  cl-useful: 5/15/685133 lits-rem:5 time: 1.89
3984.63/1000.82	c  N dy   134     30503    123757    685133    447264      5651   2766487    722899     76.78     11.76  --
3984.63/1000.82	c  F st   134     30503    123757    685133    447264      5651   2766487    722899     76.78     11.76  --
3992.62/1002.89	c Finding binary XORs  T:     0.37 s  found:     591
4038.95/1014.44	c Decided on dynamic restart strategy
4074.11/1023.22	c  N dy   153     34612    123757    685133    447284      9666   2766483    983150     70.69     11.79  --
4168.79/1046.91	c  N dy   180     38663    123748    685133    447307     13628   2766483   1286873    114.01     11.66  --
4274.65/1073.44	c  N dy   207     42748    123747    685133    735807     29284   2767649   2280501    141.92     11.77  --
4296.62/1078.93	c Finding binary XORs  T:     0.41 s  found:      18
4347.74/1091.76	c  S st   228     45754    123717    684493    736023     32221   2765464   2543225    112.92     11.87  --
4360.13/1094.81	c  S st   228     46255    123716    684493    736030     32712   2765464   2587037    112.92     11.87  --
4360.53/1094.95	c x-sub:     0 x-cut:      0 vfix:      0 v-elim:      0 locsubst:     0 time:   0.54
4410.46/1107.49	c Flit:     4 Blit:      1 bXBeca:    0 bXProp:    5 Bin: 173099 BRemL:  30078 BRemN:      0 CBin:       0 P: 60.0M T: 50.10
4416.46/1108.93	c Calc non-exist non-lernt bins v-fix:     0 done:  25411 time:  5.58 s
4416.46/1108.94	c Cache  BProp: 0 Set: 0 BXProp: 0 T: 0.05
4418.86/1109.59	c Subs w/ non-existent bins:   1341 time:  2.58 s
4420.85/1110.07	c Replacing      614 vars Replaced    81811 lits Time:     1.88 s 
4424.05/1110.80	c bin-w-bin subsume rem         1001 bins  time:  0.86 s
4432.43/1112.90	c subs with bin:      111  lits-rem:     40320  v-fix:    0  time:  8.38 s
4434.03/1113.32	c Removed useless bin:       8  fixed:     0  bprops:  10.00M  time:  1.67 s
4460.01/1119.89	c lits-rem:       698  cl-subs:    13894  v-elim:  21965  v-fix:    0  time: 26.25 s
4460.01/1119.89	c learnt bin added due to v-elim: 0
4461.59/1120.28	c asymm  cl-useful: 4/19/673174 lits-rem:8 time: 1.57
4461.99/1120.35	c  N dy   228     46255    118320    673174    841099     19847   2719770   1863668    112.92     11.87  --
4475.18/1123.63	c Finding binary XORs  T:     0.32 s  found:       0
4535.51/1138.77	c  N dy   255     50353    118319    673174    841117     23836   2719766   2142409     39.38     11.95  --
4593.82/1153.34	c  N dy   282     54369    118318    673174    841130     27777   2719766   2406307     44.47     11.80  --
4673.72/1173.33	c  N dy   308     58413    118317    673174    841144     31709   2719764   2745317     97.32     11.96  --
4741.24/1190.21	c  N dy   335     62536    118316    673174    841156     35761   2719764   3052397    131.44     11.94  --

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280684-1304032408/watcher-3280684-1304032408 -o /tmp/evaluation-result-3280684-1304032408/solver-3280684-1304032408 -C 4800 -W 1300 -M 15500 ./techdemo --threads=4 HOME/instance-3280684-1304032408.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.54 7.74 7.78 2/177 10226
/proc/meminfo: memFree=14033268/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=24376 CPUtime=0 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 1380 0 0 0 0 0 0 0 20 0 1 0 514840737 24961024 1319 33554432000 4194304 4797429 140733436668912 18446744073709551615 248089395296 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/10226/statm: 6136 1328 346 148 0 1065 0

[startup+0.038218 s]
/proc/loadavg: 6.54 7.74 7.78 2/177 10226
/proc/meminfo: memFree=14033268/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=69760 CPUtime=0.02 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 5870 0 0 0 2 0 0 0 20 0 1 0 514840737 71434240 4415 33554432000 4194304 4797429 140733436668912 18446744073709551615 4366300 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/10226/statm: 17440 4415 350 148 0 12369 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 69760

[startup+0.101205 s]
/proc/loadavg: 6.54 7.74 7.78 2/177 10226
/proc/meminfo: memFree=14033268/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=91544 CPUtime=0.09 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 12612 0 0 0 8 1 0 0 20 0 1 0 514840737 93741056 9305 33554432000 4194304 4797429 140733436668912 18446744073709551615 4366300 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/10226/statm: 22886 9305 350 148 0 17815 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 91544

[startup+0.301178 s]
/proc/loadavg: 6.54 7.74 7.78 2/177 10226
/proc/meminfo: memFree=14033268/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=152084 CPUtime=0.29 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 31714 0 0 0 25 4 0 0 21 0 1 0 514840737 155734016 24629 33554432000 4194304 4797429 140733436668912 18446744073709551615 4367649 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/10226/statm: 38021 24632 350 148 0 32950 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 152084

[startup+0.70099 s]
/proc/loadavg: 6.54 7.74 7.78 2/177 10226
/proc/meminfo: memFree=14033268/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=270132 CPUtime=0.69 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 68970 0 0 0 61 8 0 0 22 0 1 0 514840737 276615168 54327 33554432000 4194304 4797429 140733436668912 18446744073709551615 4365731 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/10226/statm: 67566 54328 350 148 0 62495 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 270132

[startup+1.5009 s]
/proc/loadavg: 6.54 7.74 7.78 3/178 10227
/proc/meminfo: memFree=13463356/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=517128 CPUtime=1.49 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 140485 0 0 0 133 16 0 0 25 0 1 0 514840737 529539072 110869 33554432000 4194304 4797429 140733436668912 18446744073709551615 4549553 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/10226/statm: 129282 110869 350 148 0 124211 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 517128

[startup+3.10057 s]
/proc/loadavg: 6.54 7.74 7.78 3/178 10227
/proc/meminfo: memFree=12852908/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=1152372 CPUtime=3.15 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 285653 0 0 0 280 35 0 0 25 0 4 0 514840737 1180028928 225797 33554432000 4194304 4797429 140733436668912 18446744073709551615 4653420 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 288093 225797 373 148 0 283022 0
Current children cumulated CPU time (s) 3.15
Current children cumulated vsize (KiB) 1152372

[startup+6.301 s]
/proc/loadavg: 6.41 7.70 7.77 9/184 10233
/proc/meminfo: memFree=12375840/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=1537556 CPUtime=15.91 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 313996 0 0 0 1550 41 0 0 25 0 4 0 514840737 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427256 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 384389 244220 384 148 0 379318 0
[pid=10226/tid=10231] ppid=10224 vsize=1537556 CPUtime=3.19 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 8344 0 0 0 316 3 0 0 25 0 4 0 514841045 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427390 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=1537556 CPUtime=3.19 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 6341 0 0 0 319 0 0 0 25 0 4 0 514841045 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4428600 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=1537556 CPUtime=3.21 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 7231 0 0 0 320 1 0 0 25 0 4 0 514841045 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427984 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15.91
Current children cumulated vsize (KiB) 1537556

[startup+12.7009 s]
/proc/loadavg: 6.54 7.70 7.77 9/184 10233
/proc/meminfo: memFree=12374504/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=1537556 CPUtime=41.48 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 313996 0 0 0 4107 41 0 0 25 0 4 0 514840737 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427384 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 384389 244220 384 148 0 379318 0
[pid=10226/tid=10231] ppid=10224 vsize=1537556 CPUtime=9.59 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 8344 0 0 0 956 3 0 0 25 0 4 0 514841045 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4428443 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=1537556 CPUtime=9.55 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 6341 0 0 0 955 0 0 0 25 0 4 0 514841045 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4428632 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=1537556 CPUtime=9.61 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 7231 0 0 0 960 1 0 0 25 0 4 0 514841045 1574457344 244220 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427384 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 41.48
Current children cumulated vsize (KiB) 1537556

[startup+25.5006 s]
/proc/loadavg: 6.94 7.73 7.78 9/184 10233
/proc/meminfo: memFree=9657916/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3304644 CPUtime=92.35 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 707680 0 0 0 9089 146 0 0 18 0 4 0 514840737 3383955456 628090 33554432000 4194304 4797429 140733436668912 18446744073709551615 4423077 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 826161 628090 1153 148 0 821090 0
[pid=10226/tid=10231] ppid=10224 vsize=3304644 CPUtime=22.31 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 106435 0 0 0 2200 31 0 0 25 0 4 0 514841045 3383955456 628090 33554432000 4194304 4797429 140733436668912 18446744073709551615 4331627 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3304644 CPUtime=22.21 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 104034 0 0 0 2194 27 0 0 18 0 4 0 514841045 3383955456 628090 33554432000 4194304 4797429 140733436668912 18446744073709551615 4422912 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3304644 CPUtime=22.39 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 105341 0 0 0 2218 21 0 0 25 0 4 0 514841045 3383955456 628090 33554432000 4194304 4797429 140733436668912 18446744073709551615 4424639 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 92.35
Current children cumulated vsize (KiB) 3304644

[startup+51.1011 s]
/proc/loadavg: 7.30 7.75 7.78 9/184 10234
/proc/meminfo: memFree=9580912/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3304644 CPUtime=194.59 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 710506 0 0 0 19312 147 0 0 25 0 4 0 514840737 3383955456 630903 33554432000 4194304 4797429 140733436668912 18446744073709551615 4354716 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 826161 630903 1154 148 0 821090 0
[pid=10226/tid=10231] ppid=10224 vsize=3304644 CPUtime=47.91 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 107268 0 0 0 4760 31 0 0 25 0 4 0 514841045 3383955456 630903 33554432000 4194304 4797429 140733436668912 18446744073709551615 4424383 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3304644 CPUtime=47.67 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 104697 0 0 0 4739 28 0 0 25 0 4 0 514841045 3383955456 630903 33554432000 4194304 4797429 140733436668912 18446744073709551615 4422912 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3304644 CPUtime=47.98 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 106194 0 0 0 4777 21 0 0 25 0 4 0 514841045 3383955456 630903 33554432000 4194304 4797429 140733436668912 18446744073709551615 4424194 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 194.59
Current children cumulated vsize (KiB) 3304644

[startup+102.307 s]
/proc/loadavg: 7.76 7.80 7.80 9/184 10235
/proc/meminfo: memFree=9332400/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3432812 CPUtime=395.59 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 741939 0 0 0 39404 155 0 0 25 0 4 0 514840737 3515199488 661660 33554432000 4194304 4797429 140733436668912 18446744073709551615 4423077 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 858203 661660 1048 148 0 853132 0
[pid=10226/tid=10231] ppid=10224 vsize=3432812 CPUtime=99.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 115232 0 0 0 9879 32 0 0 25 0 4 0 514841045 3515199488 661660 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259112 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3432812 CPUtime=97.2 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 109047 0 0 0 9691 29 0 0 25 0 4 0 514841045 3515199488 661660 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259664 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3432812 CPUtime=97.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 111144 0 0 0 9681 23 0 0 25 0 4 0 514841045 3515199488 661660 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 395.59
Current children cumulated vsize (KiB) 3432812

[startup+162.3 s]
/proc/loadavg: 7.91 7.84 7.81 9/184 10237
/proc/meminfo: memFree=7698172/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3458932 CPUtime=635.22 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 751046 0 0 0 63365 157 0 0 25 0 4 0 514840737 3541946368 661502 33554432000 4194304 4797429 140733436668912 18446744073709551615 4388582 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 864733 661502 835 148 0 859662 0
[pid=10226/tid=10231] ppid=10224 vsize=3458932 CPUtime=159.1 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 115260 0 0 0 15878 32 0 0 25 0 4 0 514841045 3541946368 661502 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259254 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3458932 CPUtime=156.86 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 110115 0 0 0 15657 29 0 0 25 0 4 0 514841045 3541946368 661502 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3458932 CPUtime=157.03 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 112154 0 0 0 15679 24 0 0 25 0 4 0 514841045 3541946368 661502 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259308 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 635.22
Current children cumulated vsize (KiB) 3458932

[startup+222.301 s]
/proc/loadavg: 8.06 7.89 7.83 9/184 10239
/proc/meminfo: memFree=7227928/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3458932 CPUtime=874.88 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 758454 0 0 0 87329 159 0 0 25 0 4 0 514840737 3541946368 663813 33554432000 4194304 4797429 140733436668912 18446744073709551615 4341204 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 864733 663813 811 148 0 859662 0
[pid=10226/tid=10231] ppid=10224 vsize=3458932 CPUtime=219.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 118798 0 0 0 21878 33 0 0 25 0 4 0 514841045 3541946368 663813 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259680 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3458932 CPUtime=216.54 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 111922 0 0 0 21624 30 0 0 25 0 4 0 514841045 3541946368 663813 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259664 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3458932 CPUtime=217.02 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 113258 0 0 0 21678 24 0 0 25 0 4 0 514841045 3541946368 663813 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259254 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 874.88
Current children cumulated vsize (KiB) 3458932

[startup+282.301 s]
/proc/loadavg: 8.10 7.94 7.84 9/184 10240
/proc/meminfo: memFree=7032236/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3542980 CPUtime=1114.56 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 765646 0 0 0 111295 161 0 0 25 0 4 0 514840737 3628011520 671004 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259081 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 885745 671004 811 148 0 880674 0
[pid=10226/tid=10231] ppid=10224 vsize=3542980 CPUtime=279.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 118798 0 0 0 27878 33 0 0 25 0 4 0 514841045 3628011520 671004 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259081 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3542980 CPUtime=276.22 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 112893 0 0 0 27592 30 0 0 25 0 4 0 514841045 3628011520 671004 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259081 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3542980 CPUtime=277.02 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 116166 0 0 0 27677 25 0 0 25 0 4 0 514841045 3628011520 671004 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1114.56

################
# More data... #
################


[startup+702.301 s]
/proc/loadavg: 8.00 7.99 7.90 9/184 10251
/proc/meminfo: memFree=6666584/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3587044 CPUtime=2792.26 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 782126 0 0 0 279058 168 0 0 25 0 4 0 514840737 3673133056 683757 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259308 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 896761 683757 811 148 0 891690 0
[pid=10226/tid=10231] ppid=10224 vsize=3587044 CPUtime=699.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 123246 0 0 0 69876 35 0 0 25 0 4 0 514841045 3673133056 683757 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3587044 CPUtime=693.94 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 117731 0 0 0 69362 32 0 0 25 0 4 0 514841045 3673133056 683757 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259106 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3587044 CPUtime=697.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 118901 0 0 0 69677 27 0 0 25 0 4 0 514841045 3673133056 683757 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2792.26
Current children cumulated vsize (KiB) 3587044

[startup+762.307 s]
/proc/loadavg: 8.00 7.99 7.91 9/184 10253
/proc/meminfo: memFree=6621552/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3599464 CPUtime=3031.95 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 783992 0 0 0 303026 169 0 0 25 0 4 0 514840737 3685851136 685623 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259096 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 899866 685623 811 148 0 894795 0
[pid=10226/tid=10231] ppid=10224 vsize=3599464 CPUtime=759.12 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 123387 0 0 0 75877 35 0 0 25 0 4 0 514841045 3685851136 685623 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259096 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3599464 CPUtime=753.62 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 119322 0 0 0 75330 32 0 0 25 0 4 0 514841045 3685851136 685623 33554432000 4194304 4797429 140733436668912 18446744073709551615 248089363462 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3599464 CPUtime=757.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 118964 0 0 0 75677 27 0 0 25 0 4 0 514841045 3685851136 685623 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259308 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3031.95
Current children cumulated vsize (KiB) 3599464

[startup+822.301 s]
/proc/loadavg: 8.07 8.01 7.91 9/184 10255
/proc/meminfo: memFree=6637020/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3611884 CPUtime=3271.6 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 788367 0 0 0 326990 170 0 0 25 0 4 0 514840737 3698569216 687900 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 902971 687900 811 148 0 897900 0
[pid=10226/tid=10231] ppid=10224 vsize=3611884 CPUtime=819.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 124754 0 0 0 81876 35 0 0 25 0 4 0 514841045 3698569216 687900 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259106 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3611884 CPUtime=813.29 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 119483 0 0 0 81297 32 0 0 25 0 4 0 514841045 3698569216 687900 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3611884 CPUtime=817.03 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 119277 0 0 0 81676 27 0 0 25 0 4 0 514841045 3698569216 687900 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259096 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3271.6
Current children cumulated vsize (KiB) 3611884

[startup+882.301 s]
/proc/loadavg: 8.13 8.03 7.93 9/184 10256
/proc/meminfo: memFree=6630180/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3611884 CPUtime=3511.28 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 788512 0 0 0 350957 171 0 0 25 0 4 0 514840737 3698569216 688045 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259265 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 902971 688045 811 148 0 897900 0
[pid=10226/tid=10231] ppid=10224 vsize=3611884 CPUtime=879.12 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 124764 0 0 0 87876 36 0 0 25 0 4 0 514841045 3698569216 688045 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259096 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3611884 CPUtime=872.97 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 119502 0 0 0 87265 32 0 0 25 0 4 0 514841045 3698569216 688045 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3611884 CPUtime=877.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 119311 0 0 0 87677 27 0 0 25 0 4 0 514841045 3698569216 688045 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3511.28
Current children cumulated vsize (KiB) 3611884

[startup+942.301 s]
/proc/loadavg: 8.10 8.04 7.93 9/184 10258
/proc/meminfo: memFree=6613420/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3611884 CPUtime=3750.95 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 790463 0 0 0 374923 172 0 0 25 0 4 0 514840737 3698569216 689996 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259686 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 902971 689996 811 148 0 897900 0
[pid=10226/tid=10231] ppid=10224 vsize=3611884 CPUtime=939.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 124845 0 0 0 93875 36 0 0 25 0 4 0 514841045 3698569216 689996 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259149 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3611884 CPUtime=932.64 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 119728 0 0 0 93232 32 0 0 25 0 4 0 514841045 3698569216 689996 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3611884 CPUtime=937.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 120816 0 0 0 93676 28 0 0 25 0 4 0 514841045 3698569216 689996 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3750.95
Current children cumulated vsize (KiB) 3611884

[startup+1002.3 s]
/proc/loadavg: 8.09 8.04 7.94 9/184 10259
/proc/meminfo: memFree=6367872/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=3843108 CPUtime=3990.62 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 855793 0 0 0 398868 194 0 0 25 0 4 0 514840737 3935342592 749856 33554432000 4194304 4797429 140733436668912 18446744073709551615 4424194 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 960777 749856 812 148 0 955706 0
[pid=10226/tid=10231] ppid=10224 vsize=3843108 CPUtime=999.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 128149 0 0 0 99874 37 0 0 25 0 4 0 514841045 3935342592 749856 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259096 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=3843108 CPUtime=992.32 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 119783 0 0 0 99200 32 0 0 25 0 4 0 514841045 3935342592 749856 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=3843108 CPUtime=997.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 121183 0 0 0 99676 28 0 0 25 0 4 0 514841045 3935342592 749856 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427256 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3990.62
Current children cumulated vsize (KiB) 3843108

[startup+1062.3 s]
/proc/loadavg: 8.09 8.05 7.94 9/184 10261
/proc/meminfo: memFree=5948616/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=4139316 CPUtime=4230.31 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 989907 0 0 0 422805 226 0 0 25 0 4 0 514840737 4238659584 845535 33554432000 4194304 4797429 140733436668912 18446744073709551615 4424750 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 1034829 845535 637 148 0 1029758 0
[pid=10226/tid=10231] ppid=10224 vsize=4139316 CPUtime=1059.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 129928 0 0 0 105873 38 0 0 25 0 4 0 514841045 4238659584 845535 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259683 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=4139316 CPUtime=1052.01 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 125632 0 0 0 105168 33 0 0 25 0 4 0 514841045 4238659584 845535 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=4139316 CPUtime=1057.03 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 241666 0 0 0 105647 56 0 0 25 0 4 0 514841045 4238659584 845535 33554432000 4194304 4797429 140733436668912 18446744073709551615 4258789 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4230.31
Current children cumulated vsize (KiB) 4139316

[startup+1122.3 s]
/proc/loadavg: 8.08 8.05 7.95 9/184 10263
/proc/meminfo: memFree=5818392/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=4312260 CPUtime=4469.98 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 1020819 0 0 0 446762 236 0 0 25 0 4 0 514840737 4415754240 874855 33554432000 4194304 4797429 140733436668912 18446744073709551615 4424194 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 1078065 874855 637 148 0 1072994 0
[pid=10226/tid=10231] ppid=10224 vsize=4312260 CPUtime=1119.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 130129 0 0 0 111873 38 0 0 25 0 4 0 514841045 4415754240 874855 33554432000 4194304 4797429 140733436668912 18446744073709551615 4427384 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=4312260 CPUtime=1111.69 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 125694 0 0 0 111136 33 0 0 25 0 4 0 514841045 4415754240 874855 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259278 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=4312260 CPUtime=1117.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 245765 0 0 0 111647 57 0 0 25 0 4 0 514841045 4415754240 874855 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259072 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4469.98
Current children cumulated vsize (KiB) 4312260

[startup+1182.3 s]
/proc/loadavg: 8.06 8.06 7.95 9/184 10264
/proc/meminfo: memFree=5505388/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=4600840 CPUtime=4709.67 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 1330377 0 0 0 470686 281 0 0 25 0 4 0 514840737 4711260160 961396 33554432000 4194304 4797429 140733436668912 18446744073709551615 4258789 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 1150210 961396 638 148 0 1145139 0
[pid=10226/tid=10231] ppid=10224 vsize=4600840 CPUtime=1179.11 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 132218 0 0 0 117872 39 0 0 25 0 4 0 514841045 4711260160 961396 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259149 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=4600840 CPUtime=1171.39 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 358790 0 0 0 117071 68 0 0 25 0 4 0 514841045 4711260160 961396 33554432000 4194304 4797429 140733436668912 18446744073709551615 4567905 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=4600840 CPUtime=1177.04 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 318974 0 0 0 117638 66 0 0 25 0 4 0 514841045 4711260160 961396 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259081 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4709.67
Current children cumulated vsize (KiB) 4600840



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205 s]
/proc/loadavg: 8.10 8.06 7.96 5/179 10266
/proc/meminfo: memFree=10198456/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=4625912 CPUtime=4800.35 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) R 10224 10226 9768 0 -1 4202496 1340930 0 0 0 479753 282 0 0 25 0 4 0 514840737 4736933888 969788 33554432000 4194304 4797429 140733436668912 18446744073709551615 4423077 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 1156478 969788 638 148 0 1151407 0
[pid=10226/tid=10231] ppid=10224 vsize=4625912 CPUtime=1201.82 cores=0,2,4,6
/proc/10226/task/10231/stat : 10231 (techdemo) R 10224 10226 9768 0 -1 4202560 132433 0 0 0 120143 39 0 0 25 0 4 0 514841045 4736933888 969788 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259272 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=4625912 CPUtime=1193.96 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4202560 364621 0 0 0 119328 68 0 0 25 0 4 0 514841045 4736933888 969788 33554432000 4194304 4797429 140733436668912 18446744073709551615 4259092 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=10226/tid=10233] ppid=10224 vsize=4625912 CPUtime=1199.75 cores=0,2,4,6
/proc/10226/task/10233/stat : 10233 (techdemo) R 10224 10226 9768 0 -1 4202560 323014 0 0 0 119908 67 0 0 25 0 4 0 514841045 4736933888 969788 33554432000 4194304 4797429 140733436668912 18446744073709551615 4236524 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 4625912

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.11 s]
/proc/loadavg: 8.10 8.06 7.96 5/179 10266
/proc/meminfo: memFree=10198456/32950928 swapFree=67111528/67111528
[pid=10226] ppid=10224 vsize=0 CPUtime=4800.47 cores=0,2,4,6
/proc/10226/stat : 10226 (techdemo) Z 10224 10226 9768 0 -1 4203548 1340930 0 0 0 479755 292 0 0 25 0 2 0 514840737 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/10226/statm: 0 0 0 0 0 0 0
[pid=10226/tid=10232] ppid=10224 vsize=0 CPUtime=1194.06 cores=0,2,4,6
/proc/10226/task/10232/stat : 10232 (techdemo) R 10224 10226 9768 0 -1 4203588 364621 0 0 0 119328 78 0 0 25 0 2 0 514841045 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.47
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.17
CPU time (s): 4800.55
CPU user time (s): 4797.56
CPU system time (s): 2.99054
CPU usage (%): 398.328
Max. virtual memory (cumulated for all children) (KiB): 4625912

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.56
system time used= 2.99055
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1340930
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27347
involuntary context switches= 24080

runsolver used 1.89671 second user time and 4.6063 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-29 01:13:29
IDJOB=3280684
IDBENCH=20423
IDSOLVER=1584
FILE ID=node123/3280684-1304032408
RUNJOBID= node123-1304032408-10206
PBS_JOBID= 13170329
Free space on /tmp= 72760 MiB

SOLVER NAME= CryptoMiniSat TechDemo-Alpha-mt
BENCH NAME= SAT07/industrial/palacios/medium/cube-11-h14-sat.cnf
COMMAND LINE= ./techdemo --threads=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280684-1304032408/watcher-3280684-1304032408 -o /tmp/evaluation-result-3280684-1304032408/solver-3280684-1304032408 -C 4800 -W 1300 -M 15500  ./techdemo --threads=4 HOME/instance-3280684-1304032408.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7cc30e40be8c690e76c3fb158623be61
RANDOM SEED=1552459090

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14034052 kB
Buffers:       2190652 kB
Cached:       16062748 kB
SwapCached:          0 kB
Active:        9186880 kB
Inactive:      9180468 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14034052 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           65712 kB
Writeback:           0 kB
AnonPages:      113044 kB
Mapped:          15276 kB
Slab:           487120 kB
PageTables:       4684 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   289484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72776 MiB
End job on node123 at 2011-04-29 01:33:36