Trace number 2070026

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Sugar v1.14.6+minisat? (TO) 1800.08 1811.44

General information on the benchmark

Namecsp/wordsVg/
normalized-crossword-m1c-words-vg6-7_ext.xml
MD5SUM657781a6d23736d0b0bda28228085d0b
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark712.806
Satisfiable
(Un)Satisfiability was proved
Number of variables42
Number of constraints13
Maximum constraint arity7
Maximum domain size26
Number of constraints which are defined in extension13
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data 

0.00/0.08	c 0	Sugar v1-14-6 + HOME/minisat
0.00/0.08	c 0	BEGIN Sun Jul 12 00:22:45 2009
0.00/0.08	c 0	PID 16251
0.00/0.08	c 0	HOST node13.alineos.net
0.00/0.08	c 0	CONVERTING HOME/instance-2070026-1247350965.xml TO HOME/temp.csp
0.00/0.08	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.XML2CSP -v -v 'HOME/instance-2070026-1247350965.xml' 'HOME/temp.csp'
0.07/0.38	c 0	1 domains, 42 variables, 0 predicates, 2 relations, 13 constraints
0.07/0.41	c 0	ENCODING HOME/temp.csp TO HOME/temp.cnf
0.07/0.41	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -encode 'HOME/temp.csp' 'HOME/temp.cnf' 'HOME/temp.map'
0.07/0.49	c 0	Parsing HOME/temp.csp
0.37/0.65	c 1	parsed 58 expressions
0.37/0.66	c 1	Heap : 2 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
0.37/0.66	c 1	Converting to clausal form CSP
0.37/0.68	c 1	converted 6 (10%) expressions
0.37/0.68	c 1	converted 12 (20%) expressions
0.37/0.68	c 1	converted 18 (30%) expressions
0.37/0.68	c 1	converted 24 (40%) expressions
0.37/0.68	c 1	converted 29 (50%) expressions
0.37/0.68	c 1	converted 35 (60%) expressions
0.37/0.68	c 1	converted 41 (70%) expressions
0.37/0.84	c 1	converted 47 (80%) expressions
1.13/1.23	c 1	converted 53 (90%) expressions
1.53/1.64	c 2	converted 58 (100%) expressions
1.53/1.64	c 2	CSP : 42 integers, 0 booleans, 13 clauses, largest domain size 26
1.53/1.64	c 2	Heap : 27 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
1.53/1.64	c 2	Propagation in CSP
1.53/1.64	c 2	0 values, 0 unsatisfiable literals, and 0 valid clauses are removed
1.53/1.64	c 2	CSP : 42 integers, 0 booleans, 13 clauses, largest domain size 26
1.53/1.65	c 2	Heap : 27 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
1.53/1.65	c 2	Simplifing CSP by introducing new Boolean variables
1.53/1.65	c 2	CSP : 42 integers, 0 booleans, 13 clauses, largest domain size 26
1.53/1.65	c 2	Heap : 27 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
1.72/1.82	c 2	Encoding CSP to SAT : HOME/temp.cnf
1.72/1.83	c 2	5 (10%) CSP integer variables are encoded (120 clauses, 1176 bytes)
1.72/1.83	c 2	9 (20%) CSP integer variables are encoded (216 clauses, 2232 bytes)
1.72/1.83	c 2	13 (30%) CSP integer variables are encoded (312 clauses, 3288 bytes)
1.72/1.83	c 2	17 (40%) CSP integer variables are encoded (408 clauses, 4344 bytes)
1.72/1.84	c 2	21 (50%) CSP integer variables are encoded (504 clauses, 5400 bytes)
1.72/1.84	c 2	26 (60%) CSP integer variables are encoded (624 clauses, 6720 bytes)
1.72/1.84	c 2	30 (70%) CSP integer variables are encoded (720 clauses, 7776 bytes)
1.72/1.84	c 2	34 (80%) CSP integer variables are encoded (816 clauses, 8832 bytes)
1.72/1.84	c 2	38 (90%) CSP integer variables are encoded (912 clauses, 9888 bytes)
1.72/1.84	c 2	42 (100%) CSP integer variables are encoded (1008 clauses, 11041 bytes)
8.55/8.71	c 9	2 (10%) CSP clauses are encoded (62952 clauses, 2473175 bytes)
11.82/12.08	c 12	3 (20%) CSP clauses are encoded (93924 clauses, 3717607 bytes)
15.19/15.50	c 15	4 (30%) CSP clauses are encoded (124896 clauses, 4962270 bytes)
22.22/22.55	c 23	6 (40%) CSP clauses are encoded (186840 clauses, 7582165 bytes)
25.59/25.95	c 26	7 (50%) CSP clauses are encoded (217812 clauses, 8897584 bytes)
34.40/34.88	c 35	8 (60%) CSP clauses are encoded (268422 clauses, 10874213 bytes)
52.42/53.06	c 53	10 (70%) CSP clauses are encoded (369642 clauses, 15671629 bytes)
61.33/62.09	c 62	11 (80%) CSP clauses are encoded (420252 clauses, 18070337 bytes)
70.45/71.24	c 71	12 (90%) CSP clauses are encoded (470862 clauses, 20469045 bytes)
79.36/80.27	c 80	13 (100%) CSP clauses are encoded (521472 clauses, 22925487 bytes)
79.36/80.27	c 80	13 CSP clauses encoded
79.36/80.28	c 80	Writing map file : HOME/temp.map
79.36/80.28	c 80	Heap : 37 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
79.36/80.28	c 80	SAT : 1050 SAT variables, 521472 SAT clauses, 22925487 bytes
79.36/80.28	c 80	Heap : 37 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
79.44/80.31	c 80	SOLVING HOME/temp.cnf
79.44/80.31	c 80	CMD HOME/minisat 'HOME/temp.cnf' 'HOME/temp.out'
79.44/80.32	c 80	This is MiniSat 2.0 beta
79.44/80.32	c 80	WARNING: for repeatability, setting FPU to use double precision
79.44/80.32	c 80	============================[ Problem Statistics ]=============================
79.44/80.32	c 80	|                                                                             |
79.44/80.32	c 80	|  Number of variables:  1050                                                 |
79.44/80.32	c 80	|  Number of clauses:    521472                                               |
79.46/80.87	c 81	|  Parsing time:         0.50         s                                       |
79.46/80.91	c 81	============================[ Search Statistics ]==============================
79.46/80.91	c 81	| Conflicts |          ORIGINAL         |          LEARNT          | Progress |
79.46/80.91	c 81	|           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
79.46/80.91	c 81	===============================================================================
79.46/80.91	c 81	|         0 |    1050   521472  4968586 |   173824        0    nan |  0.000 % |
79.46/80.93	c 81	|       101 |    1050   521472  4968586 |   191206      101      5 |  0.000 % |
79.46/80.97	c 81	|       252 |    1050   521472  4968586 |   210327      252      6 |  0.002 % |
79.46/81.03	c 81	|       480 |    1050   521472  4968586 |   231359      480      7 |  0.002 % |
79.46/81.26	c 81	|       817 |    1050   521472  4968586 |   254495      817      8 |  0.002 % |
80.81/81.74	c 82	|      1325 |    1050   521472  4968586 |   279945     1325     11 |  0.001 % |
81.72/82.69	c 83	|      2084 |    1050   521472  4968586 |   307939     2084     12 |  0.002 % |
83.40/84.40	c 84	|      3223 |    1050   521472  4968586 |   338733     3223     13 |  0.000 % |
85.87/86.81	c 87	|      4931 |    1050   521472  4968586 |   372607     4931     14 |  0.001 % |
89.83/90.86	c 91	|      7493 |    1050   521472  4968586 |   409867     7493     13 |  0.000 % |
94.09/95.13	c 95	|     11337 |    1050   521472  4968586 |   450854    11337     14 |  0.002 % |
100.23/101.32	c 101	|     17104 |    1050   521472  4968586 |   495940    17104     15 |  0.001 % |
113.70/114.94	c 115	|     25753 |    1050   521472  4968586 |   545534    25753     15 |  0.001 % |
135.89/137.35	c 137	|     38728 |    1050   521472  4968586 |   600087    38728     16 |  0.000 % |
170.86/172.62	c 173	|     58189 |    1050   521472  4968586 |   660096    58189     17 |  0.002 % |
238.62/241.04	c 241	|     87381 |    1050   521472  4968586 |   726105    87381     17 |  0.001 % |
349.37/352.81	c 353	|    131173 |    1050   521472  4968586 |   798716   131173     18 |  0.002 % |
516.88/521.95	c 522	|    196857 |    1050   521472  4968586 |   878588   196857     18 |  0.000 % |
790.79/798.45	c 798	|    295383 |    1049   521320  4967567 |   966447   283944     19 |  0.095 % |
1361.66/1372.87	c 1373	|    443173 |    1049   521320  4967567 |  1063091   431734     19 |  0.097 % |
1800.08/1811.41	c ERROR INTERRUPTED
1800.08/1811.43	s UNKNOWN
1800.08/1811.43	c 1811	CPU 79.46 (0.06 0.01 79.01 0.38)
1800.08/1811.43	c 1811	END Sun Jul 12 00:52:56 2009

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2070026-1247350965/watcher-2070026-1247350965 -o /tmp/evaluation-result-2070026-1247350965/solver-2070026-1247350965 -C 1800 -W 2000 -M 900 HOME/sugar -c -vv -memlimit=900 -jar=HOME/sugar-v1-14-6.jar -solver=HOME/minisat -tmp=HOME/temp HOME/instance-2070026-1247350965.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.70 1.76 1.92 4/81 16251
/proc/meminfo: memFree=1886184/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=12272 CPUtime=0
/proc/16251/stat : 16251 (sugar) R 16249 16251 13937 0 -1 4194304 359 0 0 0 0 0 0 0 22 0 1 0 22163406 12566528 327 996147200 4194304 4206940 548682068608 18446744073709551615 269757413989 0 0 4224 0 0 0 0 17 1 0 0
/proc/16251/statm: 3068 327 246 3 0 168 0

[startup+0.154374 s]
/proc/loadavg: 1.70 1.76 1.92 4/81 16251
/proc/meminfo: memFree=1886184/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.07
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1227 128 0 0 6 1 0 0 23 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16868

[startup+0.202394 s]
/proc/loadavg: 1.70 1.76 1.92 4/81 16251
/proc/meminfo: memFree=1886184/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.07
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1227 128 0 0 6 1 0 0 23 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16868

[startup+0.302404 s]
/proc/loadavg: 1.70 1.76 1.92 4/81 16251
/proc/meminfo: memFree=1886184/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.07
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1227 128 0 0 6 1 0 0 23 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16868

[startup+0.701444 s]
/proc/loadavg: 1.70 1.76 1.92 4/81 16251
/proc/meminfo: memFree=1886184/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.37
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1310 6501 0 1 6 1 26 4 15 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 16868

[startup+1.50155 s]
/proc/loadavg: 1.70 1.76 1.92 4/92 16273
/proc/meminfo: memFree=1862480/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.37
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1310 6501 0 1 6 1 26 4 16 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
[pid=16264] ppid=16251 vsize=5356 CPUtime=0
/proc/16264/stat : 16264 (sh) S 16251 16251 13937 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 22163447 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16264/statm: 1339 233 193 169 0 50 0
[pid=16265] ppid=16264 vsize=864432 CPUtime=1.06
/proc/16265/stat : 16265 (java) S 16264 16251 13937 0 -1 0 10829 0 1 0 102 4 0 0 18 0 9 0 22163447 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16265/statm: 216108 10032 2566 9 0 210613 0
[pid=16265/tid=16266] ppid=16264 vsize=864432 CPUtime=0.45
/proc/16265/task/16266/stat : 16266 (java) R 16264 16251 13937 0 -1 64 2766 0 1 0 44 1 0 0 23 0 9 0 22163448 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16267] ppid=16264 vsize=864432 CPUtime=0.54
/proc/16265/task/16267/stat : 16267 (java) R 16264 16251 13937 0 -1 64 7048 0 0 0 52 2 0 0 17 0 9 0 22163449 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 102768016 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16268] ppid=16264 vsize=864432 CPUtime=0
/proc/16265/task/16268/stat : 16268 (java) S 16264 16251 13937 0 -1 64 14 0 0 0 0 0 0 0 16 0 9 0 22163450 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16269] ppid=16264 vsize=864432 CPUtime=0
/proc/16265/task/16269/stat : 16269 (java) S 16264 16251 13937 0 -1 64 5 0 0 0 0 0 0 0 15 0 9 0 22163450 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16270] ppid=16264 vsize=864432 CPUtime=0
/proc/16265/task/16270/stat : 16270 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 22163452 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16271] ppid=16264 vsize=864432 CPUtime=0.05
/proc/16265/task/16271/stat : 16271 (java) S 16264 16251 13937 0 -1 64 316 0 0 0 5 0 0 0 16 0 9 0 22163452 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16272] ppid=16264 vsize=864432 CPUtime=0
/proc/16265/task/16272/stat : 16272 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 22163452 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16273] ppid=16264 vsize=864432 CPUtime=0
/proc/16265/task/16273/stat : 16273 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 22163452 885178368 10032 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.43
Current children cumulated vsize (KiB) 886656

[startup+3.10175 s]
/proc/loadavg: 1.70 1.76 1.92 3/92 16273
/proc/meminfo: memFree=1847312/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.37
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1310 6501 0 1 6 1 26 4 15 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
[pid=16264] ppid=16251 vsize=5356 CPUtime=0
/proc/16264/stat : 16264 (sh) S 16251 16251 13937 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 22163447 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16264/statm: 1339 233 193 169 0 50 0
[pid=16265] ppid=16264 vsize=864400 CPUtime=2.64
/proc/16265/stat : 16265 (java) S 16264 16251 13937 0 -1 0 12213 0 1 0 259 5 0 0 18 0 9 0 22163447 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16265/statm: 216100 11335 2590 9 0 210577 0
[pid=16265/tid=16266] ppid=16264 vsize=864400 CPUtime=1.74
/proc/16265/task/16266/stat : 16266 (java) R 16264 16251 13937 0 -1 64 3003 0 1 0 173 1 0 0 25 0 9 0 22163448 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4126594900 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16267] ppid=16264 vsize=864400 CPUtime=0.8
/proc/16265/task/16267/stat : 16267 (java) S 16264 16251 13937 0 -1 64 8174 0 0 0 77 3 0 0 16 0 9 0 22163449 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16268] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16268/stat : 16268 (java) S 16264 16251 13937 0 -1 64 14 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16269] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16269/stat : 16269 (java) S 16264 16251 13937 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16270] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16270/stat : 16270 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 22163452 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16271] ppid=16264 vsize=864400 CPUtime=0.08
/proc/16265/task/16271/stat : 16271 (java) S 16264 16251 13937 0 -1 64 337 0 0 0 8 0 0 0 16 0 9 0 22163452 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16272] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16272/stat : 16272 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 22163452 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16273] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16273/stat : 16273 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 22163452 885145600 11335 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.01
Current children cumulated vsize (KiB) 886624

[startup+6.30218 s]
/proc/loadavg: 1.73 1.76 1.92 3/92 16273
/proc/meminfo: memFree=1843024/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.37
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1310 6501 0 1 6 1 26 4 15 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
[pid=16264] ppid=16251 vsize=5356 CPUtime=0
/proc/16264/stat : 16264 (sh) S 16251 16251 13937 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 22163447 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16264/statm: 1339 233 193 169 0 50 0
[pid=16265] ppid=16264 vsize=864400 CPUtime=5.81
/proc/16265/stat : 16265 (java) S 16264 16251 13937 0 -1 0 13111 0 1 0 574 7 0 0 18 0 9 0 22163447 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16265/statm: 216100 12186 2590 9 0 210577 0
[pid=16265/tid=16266] ppid=16264 vsize=864400 CPUtime=4.84
/proc/16265/task/16266/stat : 16266 (java) R 16264 16251 13937 0 -1 64 3050 0 1 0 482 2 0 0 25 0 9 0 22163448 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4126575943 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16267] ppid=16264 vsize=864400 CPUtime=0.86
/proc/16265/task/16267/stat : 16267 (java) S 16264 16251 13937 0 -1 64 9021 0 0 0 82 4 0 0 16 0 9 0 22163449 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16268] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16268/stat : 16268 (java) S 16264 16251 13937 0 -1 64 14 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16269] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16269/stat : 16269 (java) S 16264 16251 13937 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16270] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16270/stat : 16270 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 22163452 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16271] ppid=16264 vsize=864400 CPUtime=0.08
/proc/16265/task/16271/stat : 16271 (java) S 16264 16251 13937 0 -1 64 341 0 0 0 8 0 0 0 16 0 9 0 22163452 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16272] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16272/stat : 16272 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 22163452 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16273] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16273/stat : 16273 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 22163452 885145600 12186 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 886624

[startup+12.703 s]
/proc/loadavg: 1.75 1.77 1.92 3/92 16273
/proc/meminfo: memFree=1833304/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.37
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1310 6501 0 1 6 1 26 4 16 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
[pid=16264] ppid=16251 vsize=5356 CPUtime=0
/proc/16264/stat : 16264 (sh) S 16251 16251 13937 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 22163447 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16264/statm: 1339 233 193 169 0 50 0
[pid=16265] ppid=16264 vsize=864400 CPUtime=12.15
/proc/16265/stat : 16265 (java) S 16264 16251 13937 0 -1 0 14935 0 1 0 1205 10 0 0 18 0 9 0 22163447 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16265/statm: 216100 13923 2590 9 0 210577 0
[pid=16265/tid=16266] ppid=16264 vsize=864400 CPUtime=11.04
/proc/16265/task/16266/stat : 16266 (java) R 16264 16251 13937 0 -1 64 3137 0 1 0 1101 3 0 0 25 0 9 0 22163448 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4126575816 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16267] ppid=16264 vsize=864400 CPUtime=0.99
/proc/16265/task/16267/stat : 16267 (java) S 16264 16251 13937 0 -1 64 10757 0 0 0 94 5 0 0 15 0 9 0 22163449 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16268] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16268/stat : 16268 (java) S 16264 16251 13937 0 -1 64 14 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16269] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16269/stat : 16269 (java) S 16264 16251 13937 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16270] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16270/stat : 16270 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 22163452 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16271] ppid=16264 vsize=864400 CPUtime=0.09
/proc/16265/task/16271/stat : 16271 (java) S 16264 16251 13937 0 -1 64 342 0 0 0 9 0 0 0 17 0 9 0 22163452 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16272] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16272/stat : 16272 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 22163452 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16273] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16273/stat : 16273 (java) S 16264 16251 13937 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 22163452 885145600 13923 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.52
Current children cumulated vsize (KiB) 886624

[startup+25.5027 s]
/proc/loadavg: 1.80 1.78 1.92 3/92 16273
/proc/meminfo: memFree=1824152/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=0.37
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1310 6501 0 1 6 1 26 4 16 0 1 0 22163406 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1111 409 3 0 796 0
[pid=16264] ppid=16251 vsize=5356 CPUtime=0
/proc/16264/stat : 16264 (sh) S 16251 16251 13937 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 22163447 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16264/statm: 1339 233 193 169 0 50 0
[pid=16265] ppid=16264 vsize=864400 CPUtime=24.82
/proc/16265/stat : 16265 (java) S 16264 16251 13937 0 -1 0 18857 0 1 0 2467 15 0 0 18 0 9 0 22163447 885145600 15181 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16265/statm: 216100 15181 2590 9 0 210577 0
[pid=16265/tid=16266] ppid=16264 vsize=864400 CPUtime=23.26
/proc/16265/task/16266/stat : 16266 (java) R 16264 16251 13937 0 -1 64 3290 0 1 0 2321 5 0 0 25 0 9 0 22163448 885145600 15181 996147200 134512640 134550932 4294955936 18446744073709551615 4126575866 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16267] ppid=16264 vsize=864400 CPUtime=1.43
/proc/16265/task/16267/stat : 16267 (java) S 16264 16251 13937 0 -1 64 14523 0 0 0 135 8 0 0 16 0 9 0 22163449 885145600 15181 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16268] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16268/stat : 16268 (java) S 16264 16251 13937 0 -1 64 14 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 15181 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16269] ppid=16264 vsize=864400 CPUtime=0
/proc/16265/task/16269/stat : 16269 (java) S 16264 16251 13937 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 22163450 885145600 15181 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16265/tid=16270] ppid=16264 vsize=864400 CPUtime=0

################
# More data... #
################

/proc/meminfo: memFree=1743976/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=90432 CPUtime=1271.7
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 22080 0 0 0 127149 21 0 0 25 0 1 0 22171438 92602368 22066 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 22608 22066 75 150 0 22455 0
Current children cumulated CPU time (s) 1351.16
Current children cumulated vsize (KiB) 112656

[startup+1422.3 s]
/proc/loadavg: 1.99 2.00 1.94 3/83 16395
/proc/meminfo: memFree=1740008/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=93216 CPUtime=1331.68
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 22749 0 0 0 133146 22 0 0 25 0 1 0 22171438 95453184 22735 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 23304 22735 75 150 0 23151 0
Current children cumulated CPU time (s) 1411.14
Current children cumulated vsize (KiB) 115440

[startup+1482.3 s]
/proc/loadavg: 1.99 2.00 1.94 3/83 16395
/proc/meminfo: memFree=1738216/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=94812 CPUtime=1391.66
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 23165 0 0 0 139143 23 0 0 25 0 1 0 22171438 97087488 23151 996147200 134512640 135127466 4294956256 18446744073709551615 134530814 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 23703 23151 75 150 0 23550 0
Current children cumulated CPU time (s) 1471.12
Current children cumulated vsize (KiB) 117036

[startup+1542.31 s]
/proc/loadavg: 1.99 2.00 1.94 3/83 16395
/proc/meminfo: memFree=1736488/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=97216 CPUtime=1451.63
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 23553 0 0 0 145139 24 0 0 25 0 1 0 22171438 99549184 23539 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 24304 23539 75 150 0 24151 0
Current children cumulated CPU time (s) 1531.09
Current children cumulated vsize (KiB) 119440

[startup+1602.3 s]
/proc/loadavg: 2.05 2.01 1.95 4/83 16395
/proc/meminfo: memFree=1734824/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=98972 CPUtime=1511.6
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 24005 0 0 0 151136 24 0 0 25 0 1 0 22171438 101347328 23991 996147200 134512640 135127466 4294956256 18446744073709551615 134530654 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 24743 23991 75 150 0 24590 0
Current children cumulated CPU time (s) 1591.06
Current children cumulated vsize (KiB) 121196

[startup+1662.3 s]
/proc/loadavg: 2.02 2.01 1.95 3/83 16397
/proc/meminfo: memFree=1732904/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=100780 CPUtime=1571.58
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 24455 0 0 0 157134 24 0 0 25 0 1 0 22171438 103198720 24441 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 25195 24441 75 150 0 25042 0
Current children cumulated CPU time (s) 1651.04
Current children cumulated vsize (KiB) 123004

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/83 16397
/proc/meminfo: memFree=1731112/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=102536 CPUtime=1631.56
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 24902 0 0 0 163131 25 0 0 25 0 1 0 22171438 104996864 24888 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 25634 24888 75 150 0 25481 0
Current children cumulated CPU time (s) 1711.02
Current children cumulated vsize (KiB) 124760

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/83 16397
/proc/meminfo: memFree=1729384/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=104248 CPUtime=1691.53
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 25318 0 0 0 169128 25 0 0 25 0 1 0 22171438 106749952 25304 996147200 134512640 135127466 4294956256 18446744073709551615 134528362 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 26062 25304 75 150 0 25909 0
Current children cumulated CPU time (s) 1770.99
Current children cumulated vsize (KiB) 126472



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1811.4 s]
/proc/loadavg: 2.00 2.00 1.95 3/83 16397
/proc/meminfo: memFree=1728552/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=105040 CPUtime=1720.62
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 25531 0 0 0 172037 25 0 0 25 0 1 0 22171438 107560960 25517 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 26260 25517 75 150 0 26107 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 127264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1811.4 s]
/proc/loadavg: 2.00 2.00 1.95 3/83 16397
/proc/meminfo: memFree=1728552/2055920 swapFree=4192812/4192956
[pid=16251] ppid=16249 vsize=16868 CPUtime=79.46
/proc/16251/stat : 16251 (sugar) S 16249 16251 13937 0 -1 4194304 1376 31879 0 2 6 1 7901 38 16 0 1 0 22163406 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 269766144098 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/16251/statm: 4217 1113 409 3 0 796 0
[pid=16274] ppid=16251 vsize=5356 CPUtime=0
/proc/16274/stat : 16274 (sh) S 16251 16251 13937 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 22171437 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 269757244228 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16274/statm: 1339 232 193 169 0 50 0
[pid=16275] ppid=16274 vsize=105040 CPUtime=1720.62
/proc/16275/stat : 16275 (minisat) R 16274 16251 13937 0 -1 4194304 25531 0 0 0 172037 25 0 0 25 0 1 0 22171438 107560960 25517 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/16275/statm: 26260 25517 75 150 0 26107 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 127264

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16251 and gives
#  childrusage.ru_utime.tv_sec=79
#  childrusage.ru_utime.tv_usec=78978
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=419936
# CPU time returned by wait4() is 79.4989
# while last known CPU time is 1800.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1811.44
CPU time (s): 1800.08
CPU user time (s): 1799.44
CPU system time (s): 0.64
CPU usage (%): 99.3731
Max. virtual memory (cumulated for all children) (KiB): 891752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 79.079
system time used= 0.419936
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33638
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10027
involuntary context switches= 11536

runsolver used 2.16867 second user time and 6.08507 second system time

The end

Launcher Data 

Begin job on node13 at 2009-07-12 00:22:45
IDJOB=2070026
IDBENCH=55124
IDSOLVER=739
FILE ID=node13/2070026-1247350965
PBS_JOBID= 9506834
Free space on /tmp= 66300 MiB

SOLVER NAME= Sugar v1.14.6+minisat
BENCH NAME= CPAI08/csp/wordsVg/normalized-crossword-m1c-words-vg6-7_ext.xml
COMMAND LINE= DIR/sugar -c -vv -memlimit=MEMLIMIT -jar="DIR/sugar-v1-14-6.jar" -solver="DIR/minisat" -tmp="TMPDIR/temp" BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2070026-1247350965/watcher-2070026-1247350965 -o /tmp/evaluation-result-2070026-1247350965/solver-2070026-1247350965 -C 1800 -W 2000 -M 900  HOME/sugar -c -vv -memlimit=900 -jar="HOME/sugar-v1-14-6.jar" -solver="HOME/minisat" -tmp="HOME/temp" HOME/instance-2070026-1247350965.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 657781a6d23736d0b0bda28228085d0b
RANDOM SEED=1186827462

node13.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.241
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1886664 kB
Buffers:         13020 kB
Cached:          63752 kB
SwapCached:          0 kB
Active:         101340 kB
Inactive:        21788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1886664 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            1812 kB
Writeback:           0 kB
Mapped:          66800 kB
Slab:            31132 kB
Committed_AS:   219268 kB
PageTables:       1996 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66296 MiB
End job on node13 at 2009-07-12 00:52:58