Trace number 2080784

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Sugar v1.14.6+minisat? (TO) 1800.09 1802.16

General information on the benchmark

Namecsp/haystacks/
normalized-haystacks-46.xml
MD5SUMbf3260c27f381e64bb908b737ec83dbb
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2116
Number of constraints47655
Maximum constraint arity2
Maximum domain size46
Number of constraints which are defined in extension0
Number of constraints which are defined in intension47655
Global constraints used (with number of constraints)

Solver Data 

0.00/0.08	c 0	Sugar v1-14-6 + HOME/minisat
0.00/0.08	c 0	BEGIN Sun Jul 12 06:00:13 2009
0.00/0.08	c 0	PID 23414
0.06/0.08	c 0	HOST node36.alineos.net
0.06/0.08	c 0	CONVERTING HOME/instance-2080784-1247371213.xml TO HOME/temp.csp
0.06/0.08	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.XML2CSP -v -v 'HOME/instance-2080784-1247371213.xml' 'HOME/temp.csp'
2.63/2.71	c 3	1 domains, 2116 variables, 4 predicates, 0 relations, 47655 constraints
2.63/2.77	c 3	ENCODING HOME/temp.csp TO HOME/temp.cnf
2.63/2.78	c 3	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -encode 'HOME/temp.csp' 'HOME/temp.cnf' 'HOME/temp.map'
2.66/2.85	c 3	Parsing HOME/temp.csp
2.66/3.00	c 3	parsed 10000 expressions
2.66/3.11	c 4	parsed 20000 expressions
3.07/3.24	c 4	parsed 30000 expressions
3.16/3.32	c 4	parsed 40000 expressions
3.25/3.47	c 4	parsed 49776 expressions
3.25/3.48	c 4	Heap : 12 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
3.25/3.48	c 4	Converting to clausal form CSP
4.25/4.45	c 5	converted 4978 (10%) expressions
5.54/5.77	c 6	converted 9956 (20%) expressions
6.72/6.92	c 7	converted 14933 (30%) expressions
8.11/8.38	c 9	converted 19911 (40%) expressions
9.30/9.52	c 10	converted 24888 (50%) expressions
10.39/10.67	c 11	converted 29866 (60%) expressions
11.96/12.20	c 13	converted 34844 (70%) expressions
13.05/13.39	c 14	converted 39821 (80%) expressions
14.24/14.52	c 15	converted 44799 (90%) expressions
15.33/15.65	c 16	converted 49776 (100%) expressions
15.33/15.65	c 16	CSP : 2116 integers, 45906 booleans, 141537 clauses, largest domain size 46
15.33/15.65	c 16	Heap : 79 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
15.33/15.65	c 16	Propagation in CSP
17.52/17.88	c 18	0 values, 0 unsatisfiable literals, and 0 valid clauses are removed
17.52/17.88	c 18	CSP : 2116 integers, 45906 booleans, 141537 clauses, largest domain size 46
17.52/17.88	c 18	Heap : 82 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
17.62/17.92	c 18	Simplifing CSP by introducing new Boolean variables
17.91/18.21	c 19	CSP : 2116 integers, 95220 booleans, 190851 clauses, largest domain size 46
17.91/18.21	c 19	Heap : 95 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
18.41/18.79	c 19	Encoding CSP to SAT : HOME/temp.cnf
18.60/18.90	c 19	212 (10%) CSP integer variables are encoded (9328 clauses, 119165 bytes)
18.60/18.94	c 19	424 (20%) CSP integer variables are encoded (18656 clauses, 258188 bytes)
18.60/18.99	c 19	635 (30%) CSP integer variables are encoded (27940 clauses, 397448 bytes)
18.70/19.04	c 19	847 (40%) CSP integer variables are encoded (37268 clauses, 537368 bytes)
18.70/19.08	c 19	1058 (50%) CSP integer variables are encoded (46552 clauses, 676628 bytes)
18.81/19.13	c 20	1270 (60%) CSP integer variables are encoded (55880 clauses, 816548 bytes)
18.81/19.17	c 20	1482 (70%) CSP integer variables are encoded (65208 clauses, 956468 bytes)
18.91/19.22	c 20	1693 (80%) CSP integer variables are encoded (74492 clauses, 1095728 bytes)
18.91/19.26	c 20	1905 (90%) CSP integer variables are encoded (83820 clauses, 1235648 bytes)
19.01/19.31	c 20	2116 (100%) CSP integer variables are encoded (93104 clauses, 1374908 bytes)
22.17/22.57	c 23	19086 (10%) CSP clauses are encoded (746629 clauses, 14923250 bytes)
25.42/25.81	c 26	38171 (20%) CSP clauses are encoded (1399801 clauses, 29058839 bytes)
28.69/29.11	c 30	57256 (30%) CSP clauses are encoded (2056852 clauses, 43949297 bytes)
31.86/32.39	c 33	76341 (40%) CSP clauses are encoded (2711307 clauses, 58777156 bytes)
35.11/35.66	c 36	95426 (50%) CSP clauses are encoded (3364629 clauses, 73580977 bytes)
38.38/38.92	c 39	114511 (60%) CSP clauses are encoded (4017252 clauses, 88369378 bytes)
41.54/42.19	c 43	133596 (70%) CSP clauses are encoded (4675770 clauses, 103293505 bytes)
44.80/45.48	c 46	152681 (80%) CSP clauses are encoded (5330445 clauses, 118129261 bytes)
48.05/48.79	c 49	171766 (90%) CSP clauses are encoded (5986358 clauses, 132992769 bytes)
51.31/52.08	c 52	190851 (100%) CSP clauses are encoded (6640610 clauses, 147817251 bytes)
51.31/52.08	c 52	190851 CSP clauses encoded
51.31/52.08	c 52	Writing map file : HOME/temp.map
51.41/52.11	c 53	Heap : 78 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
51.41/52.11	c 53	SAT : 190440 SAT variables, 6640610 SAT clauses, 147817251 bytes
51.41/52.11	c 53	Heap : 78 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
51.41/52.16	c 53	SOLVING HOME/temp.cnf
51.41/52.16	c 53	CMD HOME/minisat 'HOME/temp.cnf' 'HOME/temp.out'
51.41/52.17	c 53	This is MiniSat 2.0 beta
51.41/52.17	c 53	WARNING: for repeatability, setting FPU to use double precision
51.41/52.17	c 53	============================[ Problem Statistics ]=============================
51.41/52.17	c 53	|                                                                             |
51.41/52.17	c 53	|  Number of variables:  190440                                               |
51.41/52.17	c 53	|  Number of clauses:    6640610                                              |
55.04/55.84	c 56	|  Parsing time:         3.19         s                                       |
55.25/56.04	c 56	============================[ Search Statistics ]==============================
55.25/56.04	c 56	| Conflicts |          ORIGINAL         |          LEARNT          | Progress |
55.25/56.04	c 56	|           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
55.25/56.04	c 56	===============================================================================
55.25/56.04	c 56	|         0 |  190440  6640610 19490764 |  2213536        0    nan |  0.000 % |
55.93/56.73	c 57	|       100 |  190440  6640610 19490764 |  2434890      100      5 |  0.000 % |
56.13/56.92	c 57	|       250 |  190440  6640610 19490764 |  2678379      250      6 |  0.000 % |
56.53/57.38	c 58	|       475 |  190440  6640610 19490764 |  2946217      475      6 |  0.000 % |
57.02/57.84	c 58	|       813 |  190440  6640610 19490764 |  3240839      813      6 |  0.000 % |
57.81/58.60	c 59	|      1321 |  190440  6640610 19490764 |  3564922     1321      6 |  0.000 % |
58.89/59.77	c 60	|      2080 |  190440  6640610 19490764 |  3921415     2080      6 |  0.000 % |
60.19/61.07	c 61	|      3219 |  190440  6640610 19490764 |  4313556     3219      6 |  0.000 % |
61.48/62.30	c 63	|      4927 |  190440  6640610 19490764 |  4744912     4927      7 |  0.000 % |
64.65/65.59	c 66	|      7490 |  190440  6640610 19490764 |  5219403     7490      7 |  0.000 % |
67.91/68.86	c 69	|     11334 |  190440  6640610 19490764 |  5741344    11334      7 |  0.000 % |
72.67/73.67	c 74	|     17101 |  190440  6640610 19490764 |  6315478    17101      8 |  0.000 % |
80.01/81.01	c 81	|     25750 |  190440  6640610 19490764 |  6947026    25750     10 |  0.000 % |
85.85/86.99	c 87	|     38724 |  190440  6640610 19490764 |  7641728    38724     11 |  0.000 % |
95.84/97.04	c 97	|     58185 |  190440  6640610 19490764 |  8405901    58185     11 |  0.000 % |
106.87/108.15	c 109	|     87377 |  190440  6640610 19490764 |  9246491    87377     12 |  0.000 % |
118.26/119.56	c 120	|    131166 |  190440  6640610 19490764 | 10171141   131166     13 |  0.000 % |
135.55/136.88	c 137	|    196852 |  190440  6640610 19490764 | 11188255   196852     12 |  0.000 % |
182.82/184.18	c 185	|    295378 |  190440  6640610 19490764 | 12307080   295378     13 |  0.000 % |
249.69/251.03	c 251	|    443167 |  190440  6640610 19490764 | 13537788   443167     14 |  0.000 % |
401.62/403.06	c 403	|    664850 |  190440  6640610 19490764 | 14891567   664850     15 |  0.000 % |
835.80/837.48	c 838	|    997375 |  190440  6640610 19490764 | 16380724   997375     16 |  0.000 % |
1618.30/1620.30	c 1621	|   1496163 |  190440  6640610 19490764 | 18018797  1496163     17 |  0.000 % |
1800.03/1802.02	c ERROR INTERRUPTED
1800.03/1802.08	s UNKNOWN
1800.03/1802.08	c 1802	CPU 51.48 (0.06 0.02 50.05 1.35)
1800.03/1802.08	c 1802	END Sun Jul 12 06:30:15 2009

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2080784-1247371213/watcher-2080784-1247371213 -o /tmp/evaluation-result-2080784-1247371213/solver-2080784-1247371213 -C 1800 -W 2000 -M 900 HOME/sugar -c -vv -memlimit=900 -jar=HOME/sugar-v1-14-6.jar -solver=HOME/minisat -tmp=HOME/temp HOME/instance-2080784-1247371213.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB

[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 4/81 23414
/proc/meminfo: memFree=1342592/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=18576 CPUtime=0
/proc/23414/stat : 23414 (runsolver) R 23412 18511 18511 0 -1 4194368 10 0 0 0 0 0 0 0 19 0 1 0 24186015 19021824 282 996147200 4194304 4302564 548682068304 18446744073709551615 240905123532 0 0 4096 24578 0 0 0 17 1 0 0
/proc/23414/statm: 4644 282 247 26 0 2626 0
Current StackSize limit: 10240 KiB


[startup+0.0821329 s]
/proc/loadavg: 2.00 2.00 2.00 4/81 23414
/proc/meminfo: memFree=1342592/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16740 CPUtime=0.06
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1152 0 0 0 5 1 0 0 18 0 1 0 24186015 17141760 1107 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4185 1107 406 3 0 764 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16740

[startup+0.101248 s]
/proc/loadavg: 2.00 2.00 2.00 4/81 23414
/proc/meminfo: memFree=1342592/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=0.06
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.301261 s]
/proc/loadavg: 2.00 2.00 2.00 4/81 23414
/proc/meminfo: memFree=1342592/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=0.06
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.701305 s]
/proc/loadavg: 2.00 2.00 2.00 4/81 23414
/proc/meminfo: memFree=1342592/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=0.06
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+1.50239 s]
/proc/loadavg: 2.08 2.02 2.01 3/92 23426
/proc/meminfo: memFree=1314152/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=0.06
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1227 128 0 0 5 1 0 0 19 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
[pid=23417] ppid=23414 vsize=5356 CPUtime=0
/proc/23417/stat : 23417 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24186023 5484544 233 996147200 4194304 4889804 548682068752 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23417/statm: 1339 233 193 169 0 50 0
[pid=23418] ppid=23417 vsize=864772 CPUtime=1.38
/proc/23418/stat : 23418 (java) S 23417 23414 18511 0 -1 0 15990 0 1 0 130 8 0 0 18 0 9 0 24186024 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/23418/statm: 216193 13522 2556 9 0 210705 0
[pid=23418/tid=23419] ppid=23417 vsize=864772 CPUtime=0.81
/proc/23418/task/23419/stat : 23419 (java) R 23417 23414 18511 0 -1 64 3100 0 1 0 78 3 0 0 24 0 9 0 24186025 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23420] ppid=23417 vsize=864772 CPUtime=0.44
/proc/23418/task/23420/stat : 23420 (java) R 23417 23414 18511 0 -1 64 11669 0 0 0 40 4 0 0 16 0 9 0 24186026 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 102709360 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23421] ppid=23417 vsize=864772 CPUtime=0
/proc/23418/task/23421/stat : 23421 (java) S 23417 23414 18511 0 -1 64 16 0 0 0 0 0 0 0 16 0 9 0 24186026 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23422] ppid=23417 vsize=864772 CPUtime=0
/proc/23418/task/23422/stat : 23422 (java) S 23417 23414 18511 0 -1 64 10 0 0 0 0 0 0 0 15 0 9 0 24186026 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23423] ppid=23417 vsize=864772 CPUtime=0
/proc/23418/task/23423/stat : 23423 (java) S 23417 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 24186028 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23424] ppid=23417 vsize=864772 CPUtime=0.11
/proc/23418/task/23424/stat : 23424 (java) S 23417 23414 18511 0 -1 64 516 0 0 0 11 0 0 0 16 0 9 0 24186028 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23425] ppid=23417 vsize=864772 CPUtime=0
/proc/23418/task/23425/stat : 23425 (java) S 23417 23414 18511 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 24186028 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23418/tid=23426] ppid=23417 vsize=864772 CPUtime=0
/proc/23418/task/23426/stat : 23426 (java) S 23417 23414 18511 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 24186028 885526528 13522 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.44
Current children cumulated vsize (KiB) 886996

[startup+3.10154 s]
/proc/loadavg: 2.08 2.02 2.01 3/92 23426
/proc/meminfo: memFree=1272424/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=2.66
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1309 24257 0 1 5 1 245 15 15 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 16868

[startup+6.30186 s]
/proc/loadavg: 2.08 2.02 2.01 3/92 23436
/proc/meminfo: memFree=1303400/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=2.66
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1309 24257 0 1 5 1 245 15 16 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
[pid=23427] ppid=23414 vsize=5356 CPUtime=0
/proc/23427/stat : 23427 (sh) S 23414 23414 18511 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24186293 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23427/statm: 1339 233 193 169 0 50 0
[pid=23428] ppid=23427 vsize=868636 CPUtime=3.47
/proc/23428/stat : 23428 (java) S 23427 23414 18511 0 -1 0 13750 0 1 0 341 6 0 0 18 0 9 0 24186293 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/23428/statm: 217159 12354 2567 9 0 211664 0
[pid=23428/tid=23429] ppid=23427 vsize=868636 CPUtime=2.62
/proc/23428/task/23429/stat : 23429 (java) R 23427 23414 18511 0 -1 64 2950 0 1 0 261 1 0 0 25 0 9 0 24186294 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4126555917 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23430] ppid=23427 vsize=868636 CPUtime=0.64
/proc/23428/task/23430/stat : 23430 (java) S 23427 23414 18511 0 -1 64 8622 0 0 0 61 3 0 0 16 0 9 0 24186295 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23431] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23431/stat : 23431 (java) S 23427 23414 18511 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24186295 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23432] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23432/stat : 23432 (java) S 23427 23414 18511 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 24186295 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23433] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23433/stat : 23433 (java) S 23427 23414 18511 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 24186298 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23434] ppid=23427 vsize=868636 CPUtime=0.18
/proc/23428/task/23434/stat : 23434 (java) S 23427 23414 18511 0 -1 64 1476 0 0 0 18 0 0 0 15 0 9 0 24186298 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23435] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23435/stat : 23435 (java) S 23427 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 24186298 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23436] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23436/stat : 23436 (java) S 23427 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 15 0 9 0 24186298 889483264 12354 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.13
Current children cumulated vsize (KiB) 890860

[startup+12.7025 s]
/proc/loadavg: 2.07 2.02 2.00 4/92 23436
/proc/meminfo: memFree=1254696/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=2.66
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1309 24257 0 1 5 1 245 15 16 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
[pid=23427] ppid=23414 vsize=5356 CPUtime=0
/proc/23427/stat : 23427 (sh) S 23414 23414 18511 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24186293 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23427/statm: 1339 233 193 169 0 50 0
[pid=23428] ppid=23427 vsize=868636 CPUtime=9.8
/proc/23428/stat : 23428 (java) S 23427 23414 18511 0 -1 0 33099 0 1 0 964 16 0 0 18 0 9 0 24186293 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/23428/statm: 217159 22127 2568 9 0 211664 0
[pid=23428/tid=23429] ppid=23427 vsize=868636 CPUtime=7.7
/proc/23428/task/23429/stat : 23429 (java) R 23427 23414 18511 0 -1 64 3788 0 1 0 767 3 0 0 25 0 9 0 24186294 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4126564808 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23430] ppid=23427 vsize=868636 CPUtime=1.9
/proc/23428/task/23430/stat : 23430 (java) S 23427 23414 18511 0 -1 64 27130 0 0 0 178 12 0 0 16 0 9 0 24186295 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23431] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23431/stat : 23431 (java) S 23427 23414 18511 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24186295 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23432] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23432/stat : 23432 (java) S 23427 23414 18511 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 24186295 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23433] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23433/stat : 23433 (java) S 23427 23414 18511 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 24186298 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23434] ppid=23427 vsize=868636 CPUtime=0.18
/proc/23428/task/23434/stat : 23434 (java) S 23427 23414 18511 0 -1 64 1479 0 0 0 18 0 0 0 16 0 9 0 24186298 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23435] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23435/stat : 23435 (java) S 23427 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 24186298 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23436] ppid=23427 vsize=868636 CPUtime=0
/proc/23428/task/23436/stat : 23436 (java) R 23427 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 15 0 9 0 24186298 889483264 22127 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.46
Current children cumulated vsize (KiB) 890860

[startup+25.5028 s]
/proc/loadavg: 2.13 2.03 2.01 3/92 23436
/proc/meminfo: memFree=1198248/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=2.67
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1310 24257 0 1 6 1 245 15 16 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
[pid=23427] ppid=23414 vsize=5356 CPUtime=0
/proc/23427/stat : 23427 (sh) S 23414 23414 18511 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24186293 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23427/statm: 1339 233 193 169 0 50 0
[pid=23428] ppid=23427 vsize=868748 CPUtime=22.46
/proc/23428/stat : 23428 (java) S 23427 23414 18511 0 -1 0 43179 0 1 0 2207 39 0 0 18 0 9 0 24186293 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/23428/statm: 217187 30857 2593 9 0 211664 0
[pid=23428/tid=23429] ppid=23427 vsize=868748 CPUtime=19.16
/proc/23428/task/23429/stat : 23429 (java) R 23427 23414 18511 0 -1 64 4091 0 1 0 1897 19 0 0 25 0 9 0 24186294 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4126555908 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23430] ppid=23427 vsize=868748 CPUtime=2.98
/proc/23428/task/23430/stat : 23430 (java) S 23427 23414 18511 0 -1 64 36860 0 0 0 281 17 0 0 16 0 9 0 24186295 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23431] ppid=23427 vsize=868748 CPUtime=0
/proc/23428/task/23431/stat : 23431 (java) S 23427 23414 18511 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24186295 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23432] ppid=23427 vsize=868748 CPUtime=0
/proc/23428/task/23432/stat : 23432 (java) S 23427 23414 18511 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 24186295 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23433] ppid=23427 vsize=868748 CPUtime=0
/proc/23428/task/23433/stat : 23433 (java) S 23427 23414 18511 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 24186298 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23434] ppid=23427 vsize=868748 CPUtime=0.28
/proc/23428/task/23434/stat : 23434 (java) S 23427 23414 18511 0 -1 64 1526 0 0 0 27 1 0 0 16 0 9 0 24186298 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23435] ppid=23427 vsize=868748 CPUtime=0
/proc/23428/task/23435/stat : 23435 (java) S 23427 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 24186298 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=23428/tid=23436] ppid=23427 vsize=868748 CPUtime=0
/proc/23428/task/23436/stat : 23436 (java) S 23427 23414 18511 0 -1 64 0 0 0 0 0 0 0 0 15 0 9 0 24186298 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 890972

[startup+51.1023 s]
/proc/loadavg: 2.08 2.03 2.01 3/92 23442
/proc/meminfo: memFree=1084456/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=2.67
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1310 24257 0 1 6 1 245 15 16 0 1 0 24186015 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23414/statm: 4217 1111 409 3 0 796 0
[pid=23427] ppid=23414 vsize=5356 CPUtime=0
/proc/23427/stat : 23427 (sh) S 23414 23414 18511 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24186293 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23427/statm: 1339 233 193 169 0 50 0
[pid=23428] ppid=23427 vsize=868748 CPUtime=47.75
/proc/23428/stat : 23428 (java) S 23427 23414 18511 0 -1 0 43662 0 1 0 4662 113 0 0 18 0 9 0 24186293 889597952 30857 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/23428/statm: 217187 30857 2593 9 0 211664 0

################
# More data... #
################

/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 111339 0 0 0 136810 91 0 0 25 0 1 0 24191232 465997824 111325 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 113769 111325 76 150 0 113616 0
Current children cumulated CPU time (s) 1420.48
Current children cumulated vsize (KiB) 477300

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=509024/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=458052 CPUtime=1428.98
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 112066 0 0 0 142807 91 0 0 25 0 1 0 24191232 469045248 112052 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 114513 112052 76 150 0 114360 0
Current children cumulated CPU time (s) 1480.45
Current children cumulated vsize (KiB) 480276

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=506464/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=460696 CPUtime=1488.95
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 112718 0 0 0 148803 92 0 0 25 0 1 0 24191232 471752704 112704 996147200 134512640 135127466 4294956256 18446744073709551615 134530679 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 115174 112704 76 150 0 115021 0
Current children cumulated CPU time (s) 1540.42
Current children cumulated vsize (KiB) 482920

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=504352/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=462716 CPUtime=1548.93
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 113246 0 0 0 154800 93 0 0 25 0 1 0 24191232 473821184 113232 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 115679 113232 76 150 0 115526 0
Current children cumulated CPU time (s) 1600.4
Current children cumulated vsize (KiB) 484940

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=494240/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=475536 CPUtime=1608.91
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 115761 0 0 0 160795 96 0 0 25 0 1 0 24191232 486948864 115747 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 118884 115747 76 150 0 118731 0
Current children cumulated CPU time (s) 1660.38
Current children cumulated vsize (KiB) 497760

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=487840/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=481940 CPUtime=1668.89
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 117371 0 0 0 166792 97 0 0 25 0 1 0 24191232 493506560 117357 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 120485 117357 76 150 0 120332 0
Current children cumulated CPU time (s) 1720.36
Current children cumulated vsize (KiB) 504164

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=483104/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=486464 CPUtime=1728.86
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 118516 0 0 0 172787 99 0 0 25 0 1 0 24191232 498139136 118502 996147200 134512640 135127466 4294956256 18446744073709551615 134530630 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 121616 118502 76 150 0 121463 0
Current children cumulated CPU time (s) 1780.33
Current children cumulated vsize (KiB) 508688



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1802 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=476640/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=487852 CPUtime=1748.56
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 118872 0 0 0 174756 100 0 0 25 0 1 0 24191232 499560448 118858 996147200 134512640 135127466 4294956256 18446744073709551615 134530621 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 121963 118858 76 150 0 121810 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 510076

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (51.51 s) is less than in the last sample (1800.03 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (1748.52 s) to the 'lost time'.

[startup+1802 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=476640/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.47
/proc/23414/stat : 23414 (sugar) S 23412 23414 18511 0 -1 4194304 1376 68246 0 2 6 2 5005 134 16 0 1 0 24186015 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 240916672610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23414/statm: 4217 1113 409 3 0 796 0
[pid=23443] ppid=23414 vsize=5356 CPUtime=0
/proc/23443/stat : 23443 (sh) S 23414 23414 18511 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24191231 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 240907772740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/23443/statm: 1339 232 193 169 0 50 0
[pid=23444] ppid=23443 vsize=487852 CPUtime=1748.56
/proc/23444/stat : 23444 (minisat) R 23443 23414 18511 0 -1 4194304 118872 0 0 0 174756 100 0 0 25 0 1 0 24191232 499560448 118858 996147200 134512640 135127466 4294956256 18446744073709551615 134530621 0 0 4096 3 0 0 0 17 0 0 0
/proc/23444/statm: 121963 118858 76 150 0 121810 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 510076

[startup+1802.12 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=476640/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.51
/proc/23414/stat : 23414 (sugar) R 23412 23414 18511 0 -1 4194304 1423 68523 0 2 6 5 5005 135 17 0 1 0 24186015 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 240907949097 0 0 4224 16386 0 0 0 17 0 0 0
/proc/23414/statm: 4217 1114 410 3 0 796 0
Current children cumulated CPU time (s) 51.51
Current children cumulated vsize (KiB) 16868
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+1802.12 s]
/proc/loadavg: 2.00 2.00 2.00 3/84 23487
/proc/meminfo: memFree=476640/2055920 swapFree=4192956/4192956
[pid=23414] ppid=23412 vsize=16868 CPUtime=51.51
/proc/23414/stat : 23414 (sugar) R 23412 23414 18511 0 -1 4194304 1423 68523 0 2 6 5 5005 135 17 0 1 0 24186015 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 240907949097 0 0 4224 16386 0 0 0 17 0 0 0
/proc/23414/statm: 4217 1114 410 3 0 796 0
Current children cumulated CPU time (s) 51.51
Current children cumulated vsize (KiB) 16868

Child status: 0

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 1748.52
#  lost CPU user time (s): 1747.56
#  lost CPU system time (s): 0.96

Real time (s): 1802.16
CPU time (s): 1800.09
CPU user time (s): 1797.68
CPU system time (s): 2.40578
CPU usage (%): 99.8851
Max. virtual memory (cumulated for all children) (KiB): 901612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 50.1204
system time used= 1.44578
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 70005
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11618
involuntary context switches= 12903

runsolver used 2.07468 second user time and 6.15406 second system time

The end

Launcher Data 

Begin job on node36 at 2009-07-12 06:00:13
IDJOB=2080784
IDBENCH=57149
IDSOLVER=739
FILE ID=node36/2080784-1247371213
PBS_JOBID= 9506989
Free space on /tmp= 66388 MiB

SOLVER NAME= Sugar v1.14.6+minisat
BENCH NAME= CPAI08/csp/haystacks/normalized-haystacks-46.xml
COMMAND LINE= DIR/sugar -c -vv -memlimit=MEMLIMIT -jar="DIR/sugar-v1-14-6.jar" -solver="DIR/minisat" -tmp="TMPDIR/temp" BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2080784-1247371213/watcher-2080784-1247371213 -o /tmp/evaluation-result-2080784-1247371213/solver-2080784-1247371213 -C 1800 -W 2000 -M 900  HOME/sugar -c -vv -memlimit=900 -jar="HOME/sugar-v1-14-6.jar" -solver="HOME/minisat" -tmp="HOME/temp" HOME/instance-2080784-1247371213.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= bf3260c27f381e64bb908b737ec83dbb
RANDOM SEED=2059305

node36.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.238
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1343072 kB
Buffers:         74724 kB
Cached:         493348 kB
SwapCached:          0 kB
Active:         225216 kB
Inactive:       418956 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1343072 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            7164 kB
Writeback:           0 kB
Mapped:          96584 kB
Slab:            53820 kB
Committed_AS:   265840 kB
PageTables:       1904 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66376 MiB
End job on node36 at 2009-07-12 06:30:17