Trace number 2090761

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Sugar v1.14.6+minisat? (TO) 1800.02 1801.93

General information on the benchmark

Namecsp/tightness0.9/
normalized-rand-2-40-180-84-900-47_ext.xml
MD5SUM0293ed4d3177082bd80a0695733fe5fc
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.47162
Satisfiable
(Un)Satisfiability was proved
Number of variables40
Number of constraints84
Maximum constraint arity2
Maximum domain size180
Number of constraints which are defined in extension84
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data

0.00/0.08	c 0	Sugar v1-14-6 + HOME/minisat
0.00/0.08	c 0	BEGIN Sun Jul 12 11:35:08 2009
0.00/0.08	c 0	PID 28261
0.06/0.08	c 0	HOST node29.alineos.net
0.06/0.08	c 0	CONVERTING HOME/instance-2090761-1247391307.xml TO HOME/temp.csp
0.06/0.08	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.XML2CSP -v -v 'HOME/instance-2090761-1247391307.xml' 'HOME/temp.csp'
0.95/1.02	c 1	1 domains, 40 variables, 0 predicates, 84 relations, 84 constraints
0.95/1.03	c 1	ENCODING HOME/temp.csp TO HOME/temp.cnf
0.95/1.03	c 1	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -encode 'HOME/temp.csp' 'HOME/temp.cnf' 'HOME/temp.map'
0.98/1.11	c 1	Parsing HOME/temp.csp
2.62/2.70	c 3	parsed 209 expressions
2.62/2.71	c 3	Heap : 28 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
2.62/2.71	c 3	Converting to clausal form CSP
2.62/2.73	c 3	converted 21 (10%) expressions
2.62/2.74	c 3	converted 42 (20%) expressions
2.62/2.76	c 3	converted 63 (30%) expressions
2.62/2.78	c 3	converted 84 (40%) expressions
2.62/2.78	c 3	converted 105 (50%) expressions
2.92/3.01	c 3	converted 126 (60%) expressions
3.12/3.22	c 3	converted 147 (70%) expressions
3.22/3.36	c 3	converted 168 (80%) expressions
3.42/3.53	c 3	converted 189 (90%) expressions
3.51/3.66	c 3	converted 209 (100%) expressions
3.51/3.66	c 3	CSP : 40 integers, 0 booleans, 84 clauses, largest domain size 180
3.51/3.66	c 3	Heap : 57 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
3.51/3.66	c 3	Propagation in CSP
3.51/3.66	c 3	0 values, 0 unsatisfiable literals, and 0 valid clauses are removed
3.51/3.66	c 3	CSP : 40 integers, 0 booleans, 84 clauses, largest domain size 180
3.51/3.66	c 3	Heap : 57 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
3.51/3.67	c 3	Simplifing CSP by introducing new Boolean variables
3.51/3.67	c 3	CSP : 40 integers, 0 booleans, 84 clauses, largest domain size 180
3.51/3.67	c 3	Heap : 57 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
3.71/3.84	c 4	Encoding CSP to SAT : HOME/temp.cnf
3.71/3.86	c 4	4 (10%) CSP integer variables are encoded (712 clauses, 7682 bytes)
3.71/3.86	c 4	8 (20%) CSP integer variables are encoded (1424 clauses, 16375 bytes)
3.71/3.87	c 4	12 (30%) CSP integer variables are encoded (2136 clauses, 25631 bytes)
3.71/3.87	c 4	16 (40%) CSP integer variables are encoded (2848 clauses, 34887 bytes)
3.71/3.87	c 4	20 (50%) CSP integer variables are encoded (3560 clauses, 44143 bytes)
3.71/3.87	c 4	24 (60%) CSP integer variables are encoded (4272 clauses, 53399 bytes)
3.71/3.87	c 4	28 (70%) CSP integer variables are encoded (4984 clauses, 62655 bytes)
3.71/3.87	c 4	32 (80%) CSP integer variables are encoded (5696 clauses, 71911 bytes)
3.71/3.87	c 4	36 (90%) CSP integer variables are encoded (6408 clauses, 81167 bytes)
3.71/3.87	c 4	40 (100%) CSP integer variables are encoded (7120 clauses, 90423 bytes)
4.11/4.21	c 4	9 (10%) CSP clauses are encoded (34604 clauses, 653861 bytes)
4.32/4.46	c 4	17 (20%) CSP clauses are encoded (58800 clauses, 1170986 bytes)
4.61/4.74	c 5	26 (30%) CSP clauses are encoded (85896 clauses, 1767251 bytes)
4.81/4.99	c 5	34 (40%) CSP clauses are encoded (110328 clauses, 2338298 bytes)
5.11/5.24	c 5	42 (50%) CSP clauses are encoded (134493 clauses, 2902923 bytes)
5.40/5.52	c 5	51 (60%) CSP clauses are encoded (161382 clauses, 3530764 bytes)
5.60/5.77	c 6	59 (70%) CSP clauses are encoded (185513 clauses, 4094381 bytes)
5.90/6.05	c 6	68 (80%) CSP clauses are encoded (212849 clauses, 4733088 bytes)
6.19/6.30	c 6	76 (90%) CSP clauses are encoded (236921 clauses, 5295147 bytes)
6.40/6.56	c 6	84 (100%) CSP clauses are encoded (261188 clauses, 5862319 bytes)
6.40/6.56	c 6	84 CSP clauses encoded
6.40/6.56	c 6	Writing map file : HOME/temp.map
6.40/6.56	c 6	Heap : 24 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
6.40/6.56	c 6	SAT : 7160 SAT variables, 261188 SAT clauses, 5862319 bytes
6.40/6.56	c 6	Heap : 24 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
6.45/6.62	c 6	SOLVING HOME/temp.cnf
6.45/6.62	c 6	CMD HOME/minisat 'HOME/temp.cnf' 'HOME/temp.out'
6.45/6.62	c 6	This is MiniSat 2.0 beta
6.45/6.62	c 6	WARNING: for repeatability, setting FPU to use double precision
6.45/6.62	c 6	============================[ Problem Statistics ]=============================
6.45/6.62	c 6	|                                                                             |
6.45/6.63	c 6	|  Number of variables:  7160                                                 |
6.45/6.63	c 6	|  Number of clauses:    261188                                               |
6.48/6.78	c 7	|  Parsing time:         0.14         s                                       |
6.48/6.79	c 7	============================[ Search Statistics ]==============================
6.48/6.79	c 7	| Conflicts |          ORIGINAL         |          LEARNT          | Progress |
6.48/6.79	c 7	|           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
6.48/6.79	c 7	===============================================================================
6.48/6.79	c 7	|         0 |    7160   261188  1001042 |    87062        0    nan |  0.000 % |
6.48/6.83	c 7	|       100 |    7160   261188  1001042 |    95768      100      6 |  0.000 % |
6.48/6.95	c 7	|       250 |    7160   261188  1001042 |   105345      250     15 |  0.001 % |
6.48/7.13	c 7	|       475 |    7160   261188  1001042 |   115880      475     14 |  0.000 % |
6.48/7.33	c 7	|       813 |    7160   261188  1001042 |   127468      813     16 |  0.000 % |
7.54/7.73	c 8	|      1320 |    7160   261188  1001042 |   140215     1320     17 |  0.000 % |
7.83/8.02	c 8	|      2080 |    7160   261188  1001042 |   154236     2080     15 |  0.000 % |
8.33/8.57	c 8	|      3219 |    7160   261188  1001042 |   169660     3219     15 |  0.000 % |
9.22/9.45	c 9	|      4927 |    7160   261188  1001042 |   186626     4927     15 |  0.000 % |
11.00/11.26	c 11	|      7489 |    7160   261188  1001042 |   205289     7489     15 |  0.000 % |
13.68/13.90	c 14	|     11334 |    7160   261188  1001042 |   225818    11334     17 |  0.000 % |
17.94/18.26	c 18	|     17100 |    7160   261188  1001042 |   248399    17100     17 |  0.000 % |
25.07/25.44	c 25	|     25749 |    7160   261188  1001042 |   273239    25749     17 |  0.000 % |
35.67/36.10	c 36	|     38723 |    7160   261188  1001042 |   300563    38723     17 |  0.000 % |
58.06/58.71	c 59	|     58187 |    7160   261188  1001042 |   330620    58187     19 |  0.000 % |
98.47/99.57	c 99	|     87381 |    7160   261188  1001042 |   363682    87381     20 |  0.000 % |
156.61/157.93	c 158	|    131170 |    7160   261188  1001042 |   400050   131170     19 |  0.001 % |
272.76/274.17	c 274	|    196854 |    7160   261188  1001042 |   440055   196854     20 |  0.001 % |
532.16/533.60	c 533	|    295381 |    7160   261188  1001042 |   484061   295381     21 |  0.001 % |
897.34/898.96	c 899	|    443170 |    7159   261129  1000871 |   532467   190801     18 |  0.014 % |
1536.12/1537.92	c 1538	|    664853 |    7158   261046  1000595 |   585714   223231     17 |  0.028 % |
1800.02/1801.91	c 1802	DECODING HOME/temp.out WITH HOME/temp.map
1800.02/1801.91	c 1802	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -decode 'HOME/temp.out' 'HOME/temp.map'
1800.02/1801.92	c ERROR INTERRUPTED
1800.02/1801.92	s UNKNOWN
1800.02/1801.92	c 1802	CPU 6.48 (0.05 0.02 6.15 0.26)
1800.02/1801.92	c 1802	END Sun Jul 12 12:05:10 2009

Verifier Data

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2090761-1247391307/watcher-2090761-1247391307 -o /tmp/evaluation-result-2090761-1247391307/solver-2090761-1247391307 -C 1800 -W 2000 -M 900 HOME/sugar -c -vv -memlimit=900 -jar=HOME/sugar-v1-14-6.jar -solver=HOME/minisat -tmp=HOME/temp HOME/instance-2090761-1247391307.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.98 2.02 2.01 4/82 28261
/proc/meminfo: memFree=1826312/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=4708 CPUtime=0
/proc/28261/stat : 28261 (sugar) R 28259 28261 25813 0 -1 4194304 58 0 0 0 0 0 0 0 20 0 1 0 26196931 4820992 43 996147200 4194304 4206940 548682068608 18446744073709551615 221778081161 0 0 4096 0 0 0 0 17 1 0 0
/proc/28261/statm: 1177 43 33 3 0 8 0

[startup+0.0827279 s]
/proc/loadavg: 1.98 2.02 2.01 4/82 28261
/proc/meminfo: memFree=1826312/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16740 CPUtime=0.06
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1152 0 0 0 4 2 0 0 18 0 1 0 26196931 17141760 1107 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4185 1107 406 3 0 764 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16740

[startup+0.105041 s]
/proc/loadavg: 1.98 2.02 2.01 4/82 28261
/proc/meminfo: memFree=1826312/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=0.06
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1227 128 0 0 4 2 0 0 19 0 1 0 26196931 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.30105 s]
/proc/loadavg: 1.98 2.02 2.01 4/82 28261
/proc/meminfo: memFree=1826312/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=0.06
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1227 128 0 0 4 2 0 0 19 0 1 0 26196931 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.701271 s]
/proc/loadavg: 1.98 2.02 2.01 4/82 28261
/proc/meminfo: memFree=1826312/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=0.06
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1227 128 0 0 4 2 0 0 19 0 1 0 26196931 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+1.50113 s]
/proc/loadavg: 1.98 2.02 2.01 3/93 28273
/proc/meminfo: memFree=1803440/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=0.98
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1309 7986 0 1 4 2 83 9 16 0 1 0 26196931 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.98
Current children cumulated vsize (KiB) 16868

[startup+3.10223 s]
/proc/loadavg: 2.06 2.04 2.01 3/93 28283
/proc/meminfo: memFree=1794736/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=0.98
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1309 7986 0 1 4 2 83 9 16 0 1 0 26196931 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1111 409 3 0 796 0
[pid=28274] ppid=28261 vsize=5356 CPUtime=0
/proc/28274/stat : 28274 (sh) S 28261 28261 25813 0 -1 4194304 278 0 0 0 0 0 0 0 17 0 1 0 26197034 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28274/statm: 1339 233 193 169 0 50 0
[pid=28275] ppid=28274 vsize=864376 CPUtime=2.04
/proc/28275/stat : 28275 (java) S 28274 28261 25813 0 -1 0 15139 0 1 0 197 7 0 0 18 0 9 0 26197035 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28275/statm: 216094 14382 2566 9 0 210599 0
[pid=28275/tid=28276] ppid=28274 vsize=864376 CPUtime=1.08
/proc/28275/task/28276/stat : 28276 (java) R 28274 28261 25813 0 -1 64 3179 0 1 0 106 2 0 0 25 0 9 0 26197036 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4126517187 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28277] ppid=28274 vsize=864376 CPUtime=0.9
/proc/28275/task/28277/stat : 28277 (java) S 28274 28261 25813 0 -1 64 10945 0 0 0 86 4 0 0 17 0 9 0 26197037 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28278] ppid=28274 vsize=864376 CPUtime=0
/proc/28275/task/28278/stat : 28278 (java) S 28274 28261 25813 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 26197037 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28279] ppid=28274 vsize=864376 CPUtime=0
/proc/28275/task/28279/stat : 28279 (java) S 28274 28261 25813 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 26197037 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28280] ppid=28274 vsize=864376 CPUtime=0
/proc/28275/task/28280/stat : 28280 (java) S 28274 28261 25813 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 26197039 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28281] ppid=28274 vsize=864376 CPUtime=0.04
/proc/28275/task/28281/stat : 28281 (java) S 28274 28261 25813 0 -1 64 312 0 0 0 4 0 0 0 16 0 9 0 26197039 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28282] ppid=28274 vsize=864376 CPUtime=0
/proc/28275/task/28282/stat : 28282 (java) S 28274 28261 25813 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 26197039 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28283] ppid=28274 vsize=864376 CPUtime=0
/proc/28275/task/28283/stat : 28283 (java) S 28274 28261 25813 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 26197039 885121024 14382 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 886600

[startup+6.30243 s]
/proc/loadavg: 2.06 2.04 2.01 3/93 28283
/proc/meminfo: memFree=1748208/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=0.99
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1310 7986 0 1 5 2 83 9 15 0 1 0 26196931 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1111 409 3 0 796 0
[pid=28274] ppid=28261 vsize=5356 CPUtime=0
/proc/28274/stat : 28274 (sh) S 28261 28261 25813 0 -1 4194304 278 0 0 0 0 0 0 0 17 0 1 0 26197034 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28274/statm: 1339 233 193 169 0 50 0
[pid=28275] ppid=28274 vsize=864488 CPUtime=5.2
/proc/28275/stat : 28275 (java) S 28274 28261 25813 0 -1 0 20074 0 1 0 506 14 0 0 18 0 9 0 26197035 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28275/statm: 216122 19204 2590 9 0 210599 0
[pid=28275/tid=28276] ppid=28274 vsize=864488 CPUtime=3.69
/proc/28275/task/28276/stat : 28276 (java) R 28274 28261 25813 0 -1 64 3337 0 1 0 363 6 0 0 25 0 9 0 26197036 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 102094018 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28277] ppid=28274 vsize=864488 CPUtime=1.41
/proc/28275/task/28277/stat : 28277 (java) S 28274 28261 25813 0 -1 64 15699 0 0 0 134 7 0 0 16 0 9 0 26197037 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28278] ppid=28274 vsize=864488 CPUtime=0
/proc/28275/task/28278/stat : 28278 (java) S 28274 28261 25813 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 26197037 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28279] ppid=28274 vsize=864488 CPUtime=0
/proc/28275/task/28279/stat : 28279 (java) S 28274 28261 25813 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 26197037 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28280] ppid=28274 vsize=864488 CPUtime=0
/proc/28275/task/28280/stat : 28280 (java) S 28274 28261 25813 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 26197039 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28281] ppid=28274 vsize=864488 CPUtime=0.08
/proc/28275/task/28281/stat : 28281 (java) S 28274 28261 25813 0 -1 64 335 0 0 0 8 0 0 0 16 0 9 0 26197039 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28282] ppid=28274 vsize=864488 CPUtime=0
/proc/28275/task/28282/stat : 28282 (java) S 28274 28261 25813 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 26197039 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28275/tid=28283] ppid=28274 vsize=864488 CPUtime=0
/proc/28275/task/28283/stat : 28283 (java) S 28274 28261 25813 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 26197039 885235712 19204 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 886712

[startup+12.7018 s]
/proc/loadavg: 2.05 2.04 2.01 3/85 28285
/proc/meminfo: memFree=1794864/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=16824 CPUtime=6.01
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 4056 0 0 0 599 2 0 0 25 0 1 0 26197594 17227776 4042 996147200 134512640 135127466 4294956256 18446744073709551615 134528068 0 0 4096 3 0 0 0 17 1 0 0
/proc/28285/statm: 4206 4042 75 150 0 4053 0
Current children cumulated CPU time (s) 12.49
Current children cumulated vsize (KiB) 39048

[startup+25.5016 s]
/proc/loadavg: 2.12 2.05 2.02 3/85 28285
/proc/meminfo: memFree=1792112/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=18420 CPUtime=18.69
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 4478 0 0 0 1866 3 0 0 25 0 1 0 26197594 18862080 4464 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/28285/statm: 4605 4464 75 150 0 4452 0
Current children cumulated CPU time (s) 25.17
Current children cumulated vsize (KiB) 40644

[startup+51.1012 s]
/proc/loadavg: 2.08 2.05 2.02 3/85 28285
/proc/meminfo: memFree=1788720/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=21436 CPUtime=44.04
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 5214 0 0 0 4401 3 0 0 25 0 1 0 26197594 21950464 5200 996147200 134512640 135127466 4294956256 18446744073709551615 134530621 0 0 4096 3 0 0 0 17 1 0 0
/proc/28285/statm: 5359 5200 75 150 0 5206 0
Current children cumulated CPU time (s) 50.52
Current children cumulated vsize (KiB) 43660

[startup+102.306 s]
/proc/loadavg: 2.03 2.03 2.01 3/84 28285
/proc/meminfo: memFree=1784176/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=25780 CPUtime=94.77
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 6299 0 0 0 9472 5 0 0 25 0 1 0 26197594 26398720 6285 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 1 0 0
/proc/28285/statm: 6445 6285 75 150 0 6292 0
Current children cumulated CPU time (s) 101.25
Current children cumulated vsize (KiB) 48004

[startup+162.301 s]
/proc/loadavg: 2.05 2.04 2.01 3/77 28336
/proc/meminfo: memFree=1798512/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=30456 CPUtime=154.53
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 7482 0 0 0 15445 8 0 0 25 0 1 0 26197594 31186944 7468 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 7614 7468 75 150 0 7461 0
Current children cumulated CPU time (s) 161.01
Current children cumulated vsize (KiB) 52680

################
# More data... #
################

/proc/meminfo: memFree=1761072/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60220 CPUtime=1354.09
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14788 0 0 0 135391 18 0 0 25 0 1 0 26197594 61665280 14774 996147200 134512640 135127466 4294956256 18446744073709551615 134530624 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15055 14774 75 150 0 14902 0
Current children cumulated CPU time (s) 1360.57
Current children cumulated vsize (KiB) 82444

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/77 28338
/proc/meminfo: memFree=1760240/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60484 CPUtime=1414.08
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14850 0 0 0 141389 19 0 0 25 0 1 0 26197594 61935616 14836 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15121 14836 75 150 0 14968 0
Current children cumulated CPU time (s) 1420.56
Current children cumulated vsize (KiB) 82708

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/77 28338
/proc/meminfo: memFree=1760304/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60484 CPUtime=1474.05
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14850 0 0 0 147386 19 0 0 25 0 1 0 26197594 61935616 14836 996147200 134512640 135127466 4294956256 18446744073709551615 134530621 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15121 14836 75 150 0 14968 0
Current children cumulated CPU time (s) 1480.53
Current children cumulated vsize (KiB) 82708

[startup+1542.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/77 28338
/proc/meminfo: memFree=1760176/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60636 CPUtime=1534.03
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14877 0 0 0 153384 19 0 0 25 0 1 0 26197594 62091264 14863 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15159 14863 75 150 0 15006 0
Current children cumulated CPU time (s) 1540.51
Current children cumulated vsize (KiB) 82860

[startup+1602.3 s]
/proc/loadavg: 2.18 2.06 2.01 3/77 28344
/proc/meminfo: memFree=1759280/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60636 CPUtime=1594.01
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14896 0 0 0 159382 19 0 0 25 0 1 0 26197594 62091264 14882 996147200 134512640 135127466 4294956256 18446744073709551615 134530814 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15159 14882 75 150 0 15006 0
Current children cumulated CPU time (s) 1600.49
Current children cumulated vsize (KiB) 82860

[startup+1662.3 s]
/proc/loadavg: 2.06 2.04 2.01 3/77 28344
/proc/meminfo: memFree=1759152/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60772 CPUtime=1653.98
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14925 0 0 0 165379 19 0 0 25 0 1 0 26197594 62230528 14911 996147200 134512640 135127466 4294956256 18446744073709551615 134530654 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15193 14911 75 150 0 15040 0
Current children cumulated CPU time (s) 1660.46
Current children cumulated vsize (KiB) 82996

[startup+1722.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/77 28344
/proc/meminfo: memFree=1759088/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60772 CPUtime=1713.96
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14940 0 0 0 171377 19 0 0 25 0 1 0 26197594 62230528 14926 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15193 14926 75 150 0 15040 0
Current children cumulated CPU time (s) 1720.44
Current children cumulated vsize (KiB) 82996

[startup+1782.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/77 28344
/proc/meminfo: memFree=1758832/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60904 CPUtime=1773.94
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14958 0 0 0 177375 19 0 0 25 0 1 0 26197594 62365696 14944 996147200 134512640 135127466 4294956256 18446744073709551615 134530814 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15226 14944 75 150 0 15073 0
Current children cumulated CPU time (s) 1780.42
Current children cumulated vsize (KiB) 83128



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.9 s]
/proc/loadavg: 2.00 2.02 2.00 3/77 28344
/proc/meminfo: memFree=1758832/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60904 CPUtime=1793.54
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14966 0 0 0 179335 19 0 0 25 0 1 0 26197594 62365696 14952 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15226 14952 75 150 0 15073 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 83128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1801.9 s]
/proc/loadavg: 2.00 2.02 2.00 3/77 28344
/proc/meminfo: memFree=1758832/2055920 swapFree=4191900/4192956
[pid=28261] ppid=28259 vsize=16868 CPUtime=6.48
/proc/28261/stat : 28261 (sugar) S 28259 28261 25813 0 -1 4194304 1376 28371 0 2 5 2 615 26 16 0 1 0 26196931 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 221789597794 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/28261/statm: 4217 1113 409 3 0 796 0
[pid=28284] ppid=28261 vsize=5356 CPUtime=0
/proc/28284/stat : 28284 (sh) S 28261 28261 25813 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 26197594 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 221780697924 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/28284/statm: 1339 232 193 169 0 50 0
[pid=28285] ppid=28284 vsize=60904 CPUtime=1793.54
/proc/28285/stat : 28285 (minisat) R 28284 28261 25813 0 -1 4194304 14966 0 0 0 179335 19 0 0 25 0 1 0 26197594 62365696 14952 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/28285/statm: 15226 14952 75 150 0 15073 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 83128

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28261 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=211055
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=298954
# CPU time returned by wait4() is 6.51001
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1801.93
CPU time (s): 1800.02
CPU user time (s): 1799.55
CPU system time (s): 0.47
CPU usage (%): 99.8942
Max. virtual memory (cumulated for all children) (KiB): 886712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.21105
system time used= 0.298954
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30221
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3560
involuntary context switches= 3682

runsolver used 2.00569 second user time and 6.20406 second system time

The end

Launcher Data

Begin job on node29 at 2009-07-12 11:35:08
IDJOB=2090761
IDBENCH=59888
IDSOLVER=739
FILE ID=node29/2090761-1247391307
PBS_JOBID= 9507306
Free space on /tmp= 66376 MiB

SOLVER NAME= Sugar v1.14.6+minisat
BENCH NAME= CPAI08/csp/tightness0.9/normalized-rand-2-40-180-84-900-47_ext.xml
COMMAND LINE= DIR/sugar -c -vv -memlimit=MEMLIMIT -jar="DIR/sugar-v1-14-6.jar" -solver="DIR/minisat" -tmp="TMPDIR/temp" BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2090761-1247391307/watcher-2090761-1247391307 -o /tmp/evaluation-result-2090761-1247391307/solver-2090761-1247391307 -C 1800 -W 2000 -M 900  HOME/sugar -c -vv -memlimit=900 -jar="HOME/sugar-v1-14-6.jar" -solver="HOME/minisat" -tmp="HOME/temp" HOME/instance-2090761-1247391307.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 0293ed4d3177082bd80a0695733fe5fc
RANDOM SEED=1350059908

node29.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.225
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.225
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1826792 kB
Buffers:         24548 kB
Cached:         101064 kB
SwapCached:        392 kB
Active:         135748 kB
Inactive:        42988 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1826792 kB
SwapTotal:     4192956 kB
SwapFree:      4191900 kB
Dirty:            6248 kB
Writeback:           0 kB
Mapped:          72812 kB
Slab:            35584 kB
Committed_AS:   280040 kB
PageTables:       2020 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66368 MiB
End job on node29 at 2009-07-12 12:05:12