Trace number 2077594

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Sugar v1.14.6+minisat? (TO) 1800.06 1862.52

General information on the benchmark

Namecsp/wordsHerald/
normalized-crossword-m1-words-19-01.xml
MD5SUM9f01dc7a4ec49ede22f1d95a14de7260
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.600907
Satisfiable
(Un)Satisfiability was proved
Number of variables301
Number of constraints2940
Maximum constraint arity18
Maximum domain size26
Number of constraints which are defined in extension128
Number of constraints which are defined in intension2812
Global constraints used (with number of constraints)

Solver Data 

0.00/0.08	c 0	Sugar v1-14-6 + HOME/minisat
0.00/0.08	c 0	BEGIN Sun Jul 12 04:21:25 2009
0.00/0.08	c 0	PID 20306
0.00/0.08	c 0	HOST node26.alineos.net
0.00/0.08	c 0	CONVERTING HOME/instance-2077594-1247365285.xml TO HOME/temp.csp
0.00/0.08	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.XML2CSP -v -v 'HOME/instance-2077594-1247365285.xml' 'HOME/temp.csp'
0.06/0.90	c 1	1 domains, 301 variables, 7 predicates, 7 relations, 2940 constraints
0.06/0.93	c 1	ENCODING HOME/temp.csp TO HOME/temp.cnf
0.06/0.93	c 1	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -encode 'HOME/temp.csp' 'HOME/temp.cnf' 'HOME/temp.map'
0.90/1.02	c 1	Parsing HOME/temp.csp
1.41/1.51	c 2	parsed 3256 expressions
1.41/1.52	c 2	Heap : 8 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
1.41/1.52	c 2	Converting to clausal form CSP
1.41/1.60	c 2	converted 326 (10%) expressions
4.27/4.44	c 5	converted 652 (20%) expressions
4.27/4.48	c 5	converted 977 (30%) expressions
4.46/4.63	c 5	converted 1303 (40%) expressions
4.46/4.66	c 5	converted 1628 (50%) expressions
4.56/4.71	c 5	converted 1954 (60%) expressions
4.67/4.80	c 5	converted 2280 (70%) expressions
4.67/4.86	c 5	converted 2605 (80%) expressions
4.86/5.03	c 5	converted 2931 (90%) expressions
6.15/6.30	c 7	converted 3256 (100%) expressions
6.15/6.30	c 7	CSP : 301 integers, 0 booleans, 2940 clauses, largest domain size 26
6.15/6.30	c 7	Heap : 107 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
6.15/6.30	c 7	Propagation in CSP
6.15/6.32	c 7	0 values, 0 unsatisfiable literals, and 0 valid clauses are removed
6.15/6.32	c 7	CSP : 301 integers, 0 booleans, 2940 clauses, largest domain size 26
6.15/6.32	c 7	Heap : 108 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
6.15/6.33	c 7	Simplifing CSP by introducing new Boolean variables
6.46/6.62	c 7	CSP : 301 integers, 23092 booleans, 26032 clauses, largest domain size 26
6.46/6.62	c 7	Heap : 110 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
7.44/7.62	c 8	Encoding CSP to SAT : HOME/temp.cnf
7.44/7.66	c 8	31 (10%) CSP integer variables are encoded (744 clauses, 8040 bytes)
7.44/7.66	c 8	61 (20%) CSP integer variables are encoded (1464 clauses, 16969 bytes)
7.44/7.66	c 8	91 (30%) CSP integer variables are encoded (2184 clauses, 26329 bytes)
7.44/7.66	c 8	121 (40%) CSP integer variables are encoded (2904 clauses, 35689 bytes)
7.44/7.66	c 8	151 (50%) CSP integer variables are encoded (3624 clauses, 45049 bytes)
7.44/7.66	c 8	181 (60%) CSP integer variables are encoded (4344 clauses, 54409 bytes)
7.44/7.66	c 8	211 (70%) CSP integer variables are encoded (5064 clauses, 63769 bytes)
7.44/7.67	c 8	241 (80%) CSP integer variables are encoded (5784 clauses, 73129 bytes)
7.44/7.67	c 8	271 (90%) CSP integer variables are encoded (6504 clauses, 82489 bytes)
7.44/7.67	c 8	301 (100%) CSP integer variables are encoded (7224 clauses, 91849 bytes)
130.42/151.65	c 152	2604 (10%) CSP clauses are encoded (1223752 clauses, 55070121 bytes)
130.57/151.86	c 152	5207 (20%) CSP clauses are encoded (1284205 clauses, 56193155 bytes)
147.36/170.35	c 171	7810 (30%) CSP clauses are encoded (1407979 clauses, 61142949 bytes)
147.45/170.47	c 171	10413 (40%) CSP clauses are encoded (1468407 clauses, 62287741 bytes)
147.55/170.59	c 171	13016 (50%) CSP clauses are encoded (1528860 clauses, 63480017 bytes)
161.76/185.05	c 185	15620 (60%) CSP clauses are encoded (1652660 clauses, 68708692 bytes)
161.86/185.18	c 185	18223 (70%) CSP clauses are encoded (1713113 clauses, 69900968 bytes)
193.55/217.70	c 218	20826 (80%) CSP clauses are encoded (1900208 clauses, 79165024 bytes)
299.32/326.15	c 326	23429 (90%) CSP clauses are encoded (2362819 clauses, 107552827 bytes)
299.42/326.27	c 327	26032 (100%) CSP clauses are encoded (2425172 clauses, 108779575 bytes)
299.42/326.27	c 327	26032 CSP clauses encoded
299.42/326.27	c 327	Writing map file : HOME/temp.map
299.42/326.29	c 327	Heap : 186 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
299.42/326.29	c 327	SAT : 30617 SAT variables, 2425172 SAT clauses, 108779575 bytes
299.42/326.29	c 327	Heap : 186 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
299.51/326.35	c 327	SOLVING HOME/temp.cnf
299.51/326.35	c 327	CMD HOME/minisat 'HOME/temp.cnf' 'HOME/temp.out'
299.51/326.36	c 327	This is MiniSat 2.0 beta
299.51/326.36	c 327	WARNING: for repeatability, setting FPU to use double precision
299.51/326.36	c 327	============================[ Problem Statistics ]=============================
299.51/326.36	c 327	|                                                                             |
299.51/326.36	c 327	|  Number of variables:  30617                                                |
299.51/326.36	c 327	|  Number of clauses:    2425172                                              |
301.94/329.32	c 330	|  Parsing time:         2.14         s                                       |
302.02/329.50	c 330	============================[ Search Statistics ]==============================
302.02/329.50	c 330	| Conflicts |          ORIGINAL         |          LEARNT          | Progress |
302.02/329.50	c 330	|           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
302.11/329.50	c 330	===============================================================================
302.11/329.50	c 330	|         0 |   30617  2425172 19123222 |   808390        0    nan |  0.000 % |
302.21/329.65	c 330	|       102 |   30617  2425172 19123222 |   889229      102     11 |  0.000 % |
302.30/329.79	c 330	|       253 |   30617  2425172 19123222 |   978152      253     10 |  0.000 % |
302.33/329.89	c 330	|       479 |   30617  2425172 19123222 |  1075967      479     10 |  0.000 % |
302.50/330.05	c 330	|       816 |   30617  2425172 19123222 |  1183564      816     10 |  0.000 % |
302.68/330.23	c 331	|      1322 |   30617  2425172 19123222 |  1301921     1322     11 |  0.000 % |
302.82/330.41	c 331	|      2083 |   30617  2425172 19123222 |  1432113     2083     11 |  0.000 % |
303.33/331.10	c 331	|      3222 |   30617  2425172 19123222 |  1575324     3222     10 |  0.000 % |
303.72/331.66	c 332	|      4932 |   30617  2425172 19123222 |  1732857     4932     10 |  0.000 % |
304.31/332.41	c 333	|      7494 |   30617  2425172 19123222 |  1906142     7494     10 |  0.000 % |
305.12/333.46	c 334	|     11339 |   30617  2425172 19123222 |  2096757    11339     11 |  0.000 % |
306.52/335.02	c 335	|     17105 |   30617  2425172 19123222 |  2306432    17105     11 |  0.000 % |
309.42/338.35	c 339	|     25755 |   30617  2425172 19123222 |  2537076    25755     11 |  0.000 % |
312.64/342.04	c 342	|     38729 |   30617  2425172 19123222 |  2790783    38729     11 |  0.000 % |
316.09/346.24	c 347	|     58190 |   30617  2425172 19123222 |  3069862    58190     11 |  0.000 % |
331.63/365.97	c 366	|     87382 |   30617  2425172 19123222 |  3376848    87382     12 |  0.000 % |
346.28/383.55	c 384	|    131172 |   30616  2425172 19123222 |  3714533   131171     13 |  0.003 % |
374.52/418.30	c 419	|    196856 |   30614  2425172 19123222 |  4085986   196853     13 |  0.010 % |
418.30/467.59	c 468	|    295382 |   30613  2425172 19123222 |  4494585   295378     13 |  0.013 % |
497.25/547.27	c 548	|    443172 |   30612  2425172 19123222 |  4944043   443167     14 |  0.016 % |
673.08/724.76	c 725	|    664856 |   30612  2425172 19123222 |  5438448   664851     15 |  0.016 % |
1037.50/1092.61	c 1093	|    997381 |   30611  2424724 19121998 |  5982292   997369     15 |  0.020 % |
1646.89/1707.83	c 1708	|   1496169 |   30611  2424724 19121998 |  6580522  1496157     16 |  0.020 % |
1800.03/1862.42	c ERROR INTERRUPTED
1800.03/1862.46	s UNKNOWN
1800.03/1862.46	c 1863	CPU 299.57 (0.06 0.02 298.08 1.41)
1800.03/1862.46	c 1863	END Sun Jul 12 04:52:28 2009

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2077594-1247365285/watcher-2077594-1247365285 -o /tmp/evaluation-result-2077594-1247365285/solver-2077594-1247365285 -C 1800 -W 2000 -M 900 HOME/sugar -c -vv -memlimit=900 -jar=HOME/sugar-v1-14-6.jar -solver=HOME/minisat -tmp=HOME/temp HOME/instance-2077594-1247365285.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.18 2.23 2.34 4/82 20306
/proc/meminfo: memFree=1245192/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=12268 CPUtime=0
/proc/20306/stat : 20306 (sugar) R 20304 20306 20092 0 -1 4194304 348 0 0 0 0 0 0 0 22 0 1 0 23594852 12562432 316 996147200 4194304 4206940 548682068608 18446744073709551615 269028653669 0 2147483391 4224 0 0 0 0 17 1 0 0
/proc/20306/statm: 3067 316 241 3 0 167 0

[startup+0.0878199 s]
/proc/loadavg: 2.18 2.23 2.34 4/82 20306
/proc/meminfo: memFree=1245192/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.06
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.10137 s]
/proc/loadavg: 2.18 2.23 2.34 4/82 20306
/proc/meminfo: memFree=1245192/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.06
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.301369 s]
/proc/loadavg: 2.18 2.23 2.34 4/82 20306
/proc/meminfo: memFree=1245192/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.06
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.701434 s]
/proc/loadavg: 2.18 2.23 2.34 4/82 20306
/proc/meminfo: memFree=1245192/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.06
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+1.50252 s]
/proc/loadavg: 2.18 2.23 2.34 3/93 20328
/proc/meminfo: memFree=1237552/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.86
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1309 8839 0 1 5 1 75 5 15 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
[pid=20319] ppid=20306 vsize=5356 CPUtime=0
/proc/20319/stat : 20319 (sh) S 20306 20306 20092 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 23594945 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/20319/statm: 1339 233 193 169 0 50 0
[pid=20320] ppid=20319 vsize=862284 CPUtime=0.55
/proc/20320/stat : 20320 (java) S 20319 20306 20092 0 -1 0 6211 0 1 0 51 4 0 0 19 0 9 0 23594946 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/20320/statm: 215571 5500 2158 9 0 210484 0
[pid=20320/tid=20321] ppid=20319 vsize=862284 CPUtime=0.31
/proc/20320/task/20321/stat : 20321 (java) R 20319 20306 20092 0 -1 64 2018 0 1 0 30 1 0 0 21 0 9 0 23594947 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20322] ppid=20319 vsize=862284 CPUtime=0.16
/proc/20320/task/20322/stat : 20322 (java) R 20319 20306 20092 0 -1 64 3183 0 0 0 15 1 0 0 16 0 9 0 23594948 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 102759235 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20323] ppid=20319 vsize=862284 CPUtime=0
/proc/20320/task/20323/stat : 20323 (java) S 20319 20306 20092 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 23594948 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20324] ppid=20319 vsize=862284 CPUtime=0
/proc/20320/task/20324/stat : 20324 (java) S 20319 20306 20092 0 -1 64 9 0 0 0 0 0 0 0 15 0 9 0 23594948 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20325] ppid=20319 vsize=862284 CPUtime=0
/proc/20320/task/20325/stat : 20325 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 23594951 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20326] ppid=20319 vsize=862284 CPUtime=0.03
/proc/20320/task/20326/stat : 20326 (java) S 20319 20306 20092 0 -1 64 306 0 0 0 3 0 0 0 16 0 9 0 23594951 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20327] ppid=20319 vsize=862284 CPUtime=0
/proc/20320/task/20327/stat : 20327 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 23594951 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20328] ppid=20319 vsize=862284 CPUtime=0
/proc/20320/task/20328/stat : 20328 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 23594951 882978816 5500 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 884508

[startup+3.10278 s]
/proc/loadavg: 2.18 2.23 2.34 5/93 20328
/proc/meminfo: memFree=1211184/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.86
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1309 8839 0 1 5 1 75 5 16 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
[pid=20319] ppid=20306 vsize=5356 CPUtime=0
/proc/20319/stat : 20319 (sh) S 20306 20306 20092 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 23594945 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/20319/statm: 1339 233 193 169 0 50 0
[pid=20320] ppid=20319 vsize=864256 CPUtime=2.13
/proc/20320/stat : 20320 (java) S 20319 20306 20092 0 -1 0 17207 0 1 0 203 10 0 0 19 0 9 0 23594946 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/20320/statm: 216064 16443 2566 9 0 210569 0
[pid=20320/tid=20321] ppid=20319 vsize=864256 CPUtime=0.97
/proc/20320/task/20321/stat : 20321 (java) R 20319 20306 20092 0 -1 64 3182 0 1 0 95 2 0 0 23 0 9 0 23594947 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 103211699 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20322] ppid=20319 vsize=864256 CPUtime=1.08
/proc/20320/task/20322/stat : 20322 (java) S 20319 20306 20092 0 -1 64 13008 0 0 0 102 6 0 0 16 0 9 0 23594948 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20323] ppid=20319 vsize=864256 CPUtime=0
/proc/20320/task/20323/stat : 20323 (java) S 20319 20306 20092 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 23594948 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20324] ppid=20319 vsize=864256 CPUtime=0
/proc/20320/task/20324/stat : 20324 (java) S 20319 20306 20092 0 -1 64 9 0 0 0 0 0 0 0 15 0 9 0 23594948 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20325] ppid=20319 vsize=864256 CPUtime=0
/proc/20320/task/20325/stat : 20325 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 23594951 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20326] ppid=20319 vsize=864256 CPUtime=0.04
/proc/20320/task/20326/stat : 20326 (java) S 20319 20306 20092 0 -1 64 313 0 0 0 4 0 0 0 16 0 9 0 23594951 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20327] ppid=20319 vsize=864256 CPUtime=0
/proc/20320/task/20327/stat : 20327 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 23594951 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20328] ppid=20319 vsize=864256 CPUtime=0
/proc/20320/task/20328/stat : 20328 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 23594951 884998144 16443 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 886480

[startup+6.30229 s]
/proc/loadavg: 2.33 2.25 2.35 4/93 20328
/proc/meminfo: memFree=1119984/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.86
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1309 8839 0 1 5 1 75 5 16 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
[pid=20319] ppid=20306 vsize=5356 CPUtime=0
/proc/20319/stat : 20319 (sh) S 20306 20306 20092 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 23594945 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/20319/statm: 1339 233 193 169 0 50 0
[pid=20320] ppid=20319 vsize=868620 CPUtime=5.29
/proc/20320/stat : 20320 (java) S 20319 20306 20092 0 -1 0 44641 0 1 0 504 25 0 0 19 0 9 0 23594946 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/20320/statm: 217155 33567 2567 9 0 211660 0
[pid=20320/tid=20321] ppid=20319 vsize=868620 CPUtime=1.99
/proc/20320/task/20321/stat : 20321 (java) R 20319 20306 20092 0 -1 64 3688 0 1 0 197 2 0 0 24 0 9 0 23594947 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4126549080 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20322] ppid=20319 vsize=868620 CPUtime=3.09
/proc/20320/task/20322/stat : 20322 (java) S 20319 20306 20092 0 -1 64 38769 0 0 0 290 19 0 0 23 0 9 0 23594948 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20323] ppid=20319 vsize=868620 CPUtime=0
/proc/20320/task/20323/stat : 20323 (java) S 20319 20306 20092 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 23594948 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20324] ppid=20319 vsize=868620 CPUtime=0
/proc/20320/task/20324/stat : 20324 (java) S 20319 20306 20092 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 23594948 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20325] ppid=20319 vsize=868620 CPUtime=0
/proc/20320/task/20325/stat : 20325 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 23594951 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20326] ppid=20319 vsize=868620 CPUtime=0.16
/proc/20320/task/20326/stat : 20326 (java) S 20319 20306 20092 0 -1 64 1480 0 0 0 15 1 0 0 16 0 9 0 23594951 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20327] ppid=20319 vsize=868620 CPUtime=0
/proc/20320/task/20327/stat : 20327 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 23594951 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20328] ppid=20319 vsize=868620 CPUtime=0
/proc/20320/task/20328/stat : 20328 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 23594951 889466880 33567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 890844

[startup+12.7023 s]
/proc/loadavg: 2.46 2.28 2.36 3/93 20328
/proc/meminfo: memFree=1097584/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.87
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1310 8839 0 1 6 1 75 5 16 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
[pid=20319] ppid=20306 vsize=5356 CPUtime=0
/proc/20319/stat : 20319 (sh) S 20306 20306 20092 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 23594945 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/20319/statm: 1339 233 193 169 0 50 0
[pid=20320] ppid=20319 vsize=868732 CPUtime=11.61
/proc/20320/stat : 20320 (java) S 20319 20306 20092 0 -1 0 55998 0 1 0 1124 37 0 0 19 0 9 0 23594946 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/20320/statm: 217183 36214 2593 9 0 211660 0
[pid=20320/tid=20321] ppid=20319 vsize=868732 CPUtime=6.92
/proc/20320/task/20321/stat : 20321 (java) R 20319 20306 20092 0 -1 64 4615 0 1 0 683 9 0 0 25 0 9 0 23594947 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4125952186 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20322] ppid=20319 vsize=868732 CPUtime=4.43
/proc/20320/task/20322/stat : 20322 (java) S 20319 20306 20092 0 -1 64 49148 0 0 0 417 26 0 0 16 0 9 0 23594948 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20323] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20323/stat : 20323 (java) S 20319 20306 20092 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 23594948 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20324] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20324/stat : 20324 (java) S 20319 20306 20092 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 23594948 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20325] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20325/stat : 20325 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 23594951 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20326] ppid=20319 vsize=868732 CPUtime=0.23
/proc/20320/task/20326/stat : 20326 (java) S 20319 20306 20092 0 -1 64 1531 0 0 0 22 1 0 0 16 0 9 0 23594951 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20327] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20327/stat : 20327 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 23594951 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20328] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20328/stat : 20328 (java) S 20319 20306 20092 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 23594951 889581568 36214 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.48
Current children cumulated vsize (KiB) 890956

[startup+25.5014 s]
/proc/loadavg: 2.36 2.27 2.35 3/93 20328
/proc/meminfo: memFree=1084912/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=0.87
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1310 8839 0 1 6 1 75 5 16 0 1 0 23594852 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1111 409 3 0 796 0
[pid=20319] ppid=20306 vsize=5356 CPUtime=0
/proc/20319/stat : 20319 (sh) S 20306 20306 20092 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 23594945 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/20319/statm: 1339 233 193 169 0 50 0
[pid=20320] ppid=20319 vsize=868732 CPUtime=24.26
/proc/20320/stat : 20320 (java) S 20319 20306 20092 0 -1 0 56217 0 1 0 2381 45 0 0 19 0 9 0 23594946 889581568 36366 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/20320/statm: 217183 36366 2593 9 0 211660 0
[pid=20320/tid=20321] ppid=20319 vsize=868732 CPUtime=19.24
/proc/20320/task/20321/stat : 20321 (java) R 20319 20306 20092 0 -1 64 4682 0 1 0 1908 16 0 0 25 0 9 0 23594947 889581568 36366 996147200 134512640 134550932 4294955936 18446744073709551615 4126961394 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20322] ppid=20319 vsize=868732 CPUtime=4.75
/proc/20320/task/20322/stat : 20322 (java) S 20319 20306 20092 0 -1 64 49300 0 0 0 449 26 0 0 16 0 9 0 23594948 889581568 36366 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20323] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20323/stat : 20323 (java) S 20319 20306 20092 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 23594948 889581568 36366 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20324] ppid=20319 vsize=868732 CPUtime=0
/proc/20320/task/20324/stat : 20324 (java) S 20319 20306 20092 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 23594948 889581568 36366 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=20320/tid=20325] ppid=20319 vsize=868732 CPUtime=0

################
# More data... #
################

/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 76753 0 0 0 112324 72 0 0 25 0 1 0 23627488 322981888 76739 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 78853 76739 76 150 0 78700 0
Current children cumulated CPU time (s) 1423.53
Current children cumulated vsize (KiB) 337636

[startup+1542.3 s]
/proc/loadavg: 2.33 2.12 2.21 3/75 22950
/proc/meminfo: memFree=1172512/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=319604 CPUtime=1183.39
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 77816 0 0 0 118266 73 0 0 25 0 1 0 23627488 327274496 77802 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 79901 77802 76 150 0 79748 0
Current children cumulated CPU time (s) 1482.96
Current children cumulated vsize (KiB) 341828

[startup+1602.3 s]
/proc/loadavg: 2.15 2.11 2.20 3/75 22950
/proc/meminfo: memFree=1169440/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=322460 CPUtime=1242.82
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 78543 0 0 0 124209 73 0 0 25 0 1 0 23627488 330199040 78529 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 80615 78529 76 150 0 80462 0
Current children cumulated CPU time (s) 1542.39
Current children cumulated vsize (KiB) 344684

[startup+1662.3 s]
/proc/loadavg: 2.05 2.09 2.18 3/75 22950
/proc/meminfo: memFree=1165344/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=326488 CPUtime=1302.25
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 79564 0 0 0 130151 74 0 0 25 0 1 0 23627488 334323712 79550 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 81622 79550 76 150 0 81469 0
Current children cumulated CPU time (s) 1601.82
Current children cumulated vsize (KiB) 348712

[startup+1722.3 s]
/proc/loadavg: 2.02 2.07 2.17 3/75 22950
/proc/meminfo: memFree=1160864/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=331056 CPUtime=1361.69
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 80671 0 0 0 136093 76 0 0 25 0 1 0 23627488 339001344 80657 996147200 134512640 135127466 4294956256 18446744073709551615 134530766 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 82764 80657 76 150 0 82611 0
Current children cumulated CPU time (s) 1661.26
Current children cumulated vsize (KiB) 353280

[startup+1782.3 s]
/proc/loadavg: 2.00 2.05 2.16 3/75 22952
/proc/meminfo: memFree=1154336/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=337232 CPUtime=1421.11
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 82261 0 0 0 142034 77 0 0 25 0 1 0 23627488 345325568 82247 996147200 134512640 135127466 4294956256 18446744073709551615 134530647 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 84308 82247 76 150 0 84155 0
Current children cumulated CPU time (s) 1720.68
Current children cumulated vsize (KiB) 359456

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 2.15 3/75 22952
/proc/meminfo: memFree=1151712/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=342916 CPUtime=1480.56
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 82912 0 0 0 147978 78 0 0 25 0 1 0 23627488 351145984 82898 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 85729 82898 76 150 0 85576 0
Current children cumulated CPU time (s) 1780.13
Current children cumulated vsize (KiB) 365140



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1862.4 s]
/proc/loadavg: 2.00 2.04 2.14 3/75 22952
/proc/meminfo: memFree=1150304/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=344060 CPUtime=1500.46
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 83232 0 0 0 149968 78 0 0 25 0 1 0 23627488 352317440 83218 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 86015 83218 76 150 0 85862 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 366284

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (299.62 s) is less than in the last sample (1800.03 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (1500.41 s) to the 'lost time'.

[startup+1862.4 s]
/proc/loadavg: 2.00 2.04 2.14 3/75 22952
/proc/meminfo: memFree=1150304/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=16868 CPUtime=299.57
/proc/20306/stat : 20306 (sugar) S 20304 20306 20092 0 -1 4194304 1376 95588 0 2 6 2 29808 141 16 0 1 0 23594852 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269037383778 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20306/statm: 4217 1113 409 3 0 796 0
[pid=12492] ppid=20306 vsize=5356 CPUtime=0
/proc/12492/stat : 12492 (sh) S 20306 20306 20092 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 23627488 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269028483908 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/12492/statm: 1339 232 193 169 0 50 0
[pid=12496] ppid=12492 vsize=344060 CPUtime=1500.46
/proc/12496/stat : 12496 (minisat) R 12492 20306 20092 0 -1 4194304 83232 0 0 0 149968 78 0 0 25 0 1 0 23627488 352317440 83218 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/12496/statm: 86015 83218 76 150 0 85862 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 366284

[startup+1862.52 s]
/proc/loadavg: 2.00 2.04 2.14 3/75 22952
/proc/meminfo: memFree=1150304/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=0 CPUtime=299.62
/proc/20306/stat : 20306 (sugar) R 20304 20306 20092 0 -1 4194308 1482 95865 0 2 6 7 29808 141 16 0 1 0 23594852 0 0 996147200 0 0 0 0 0 0 0 4224 16386 0 0 0 17 1 0 0
/proc/20306/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 299.62
Current children cumulated vsize (KiB) 0
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+1862.52 s]
/proc/loadavg: 2.00 2.04 2.14 3/75 22952
/proc/meminfo: memFree=1150304/2055920 swapFree=4192812/4192956
[pid=20306] ppid=20304 vsize=0 CPUtime=299.62
/proc/20306/stat : 20306 (sugar) R 20304 20306 20092 0 -1 4194308 1482 95865 0 2 6 7 29808 141 16 0 1 0 23594852 0 0 996147200 0 0 0 0 0 0 0 4224 16386 0 0 0 17 1 0 0
/proc/20306/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 299.62
Current children cumulated vsize (KiB) 0

Child status: 0

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 1500.41
#  lost CPU user time (s): 1499.68
#  lost CPU system time (s): 0.73

Real time (s): 1862.52
CPU time (s): 1800.06
CPU user time (s): 1797.84
CPU system time (s): 2.22677
CPU usage (%): 96.6466
Max. virtual memory (cumulated for all children) (KiB): 916568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 298.158
system time used= 1.49677
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 97347
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15201
involuntary context switches= 23811

runsolver used 2.23866 second user time and 6.542 second system time

The end

Launcher Data 

Begin job on node26 at 2009-07-12 04:21:25
IDJOB=2077594
IDBENCH=56626
IDSOLVER=739
FILE ID=node26/2077594-1247365285
PBS_JOBID= 9507081
Free space on /tmp= 66396 MiB

SOLVER NAME= Sugar v1.14.6+minisat
BENCH NAME= CPAI08/csp/wordsHerald/normalized-crossword-m1-words-19-01.xml
COMMAND LINE= DIR/sugar -c -vv -memlimit=MEMLIMIT -jar="DIR/sugar-v1-14-6.jar" -solver="DIR/minisat" -tmp="TMPDIR/temp" BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2077594-1247365285/watcher-2077594-1247365285 -o /tmp/evaluation-result-2077594-1247365285/solver-2077594-1247365285 -C 1800 -W 2000 -M 900  HOME/sugar -c -vv -memlimit=900 -jar="HOME/sugar-v1-14-6.jar" -solver="HOME/minisat" -tmp="HOME/temp" HOME/instance-2077594-1247365285.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 9f01dc7a4ec49ede22f1d95a14de7260
RANDOM SEED=625170369

node26.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1245672 kB
Buffers:         39836 kB
Cached:         242228 kB
SwapCached:          0 kB
Active:         565588 kB
Inactive:       172720 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1245672 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            4016 kB
Writeback:           0 kB
Mapped:         476664 kB
Slab:            56396 kB
Committed_AS:   622224 kB
PageTables:       2648 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66392 MiB
End job on node26 at 2009-07-12 04:52:30