Trace number 2083445

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Sugar v1.14.6+picosat? (MO) 294.81 297.371

General information on the benchmark

Namecsp/fapp/fapp33/
normalized-fapp33-0650-7.xml
MD5SUMf7a160e85c0f22f460747e3f10500acd
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark29.3565
Satisfiable
(Un)Satisfiability was proved
Number of variables650
Number of constraints8684
Maximum constraint arity2
Maximum domain size498
Number of constraints which are defined in extension0
Number of constraints which are defined in intension8684
Global constraints used (with number of constraints)

Solver Data 

0.00/0.08	c 0	Sugar v1-14-6 + HOME/picosat
0.00/0.08	c 0	BEGIN Sun Jul 12 07:43:20 2009
0.00/0.08	c 0	PID 24013
0.07/0.08	c 0	HOST node4.alineos.net
0.07/0.08	c 0	CONVERTING HOME/instance-2083445-1247377399.xml TO HOME/temp.csp
0.07/0.08	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.XML2CSP -v -v 'HOME/instance-2083445-1247377399.xml' 'HOME/temp.csp'
0.97/1.10	c 1	11 domains, 650 variables, 8 predicates, 0 relations, 8684 constraints
1.07/1.13	c 1	ENCODING HOME/temp.csp TO HOME/temp.cnf
1.07/1.13	c 1	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -encode 'HOME/temp.csp' 'HOME/temp.cnf' 'HOME/temp.map'
1.07/1.21	c 1	Parsing HOME/temp.csp
1.07/1.52	c 1	parsed 9353 expressions
1.07/1.53	c 1	Heap : 4 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
1.07/1.53	c 1	Converting to clausal form CSP
2.20/2.38	c 2	converted 936 (10%) expressions
3.99/4.13	c 4	converted 1871 (20%) expressions
5.38/5.56	c 5	converted 2806 (30%) expressions
6.75/6.91	c 6	converted 3742 (40%) expressions
7.94/8.14	c 8	converted 4677 (50%) expressions
9.03/9.27	c 9	converted 5612 (60%) expressions
10.52/10.72	c 10	converted 6548 (70%) expressions
11.51/11.80	c 11	converted 7483 (80%) expressions
12.61/12.83	c 12	converted 8418 (90%) expressions
13.60/13.86	c 13	converted 9353 (100%) expressions
13.60/13.86	c 13	CSP : 1292 integers, 24789 booleans, 52634 clauses, largest domain size 3209
13.60/13.86	c 13	Heap : 50 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
13.60/13.86	c 13	Propagation in CSP
14.20/14.44	c 14	164 values, 0 unsatisfiable literals, and 0 valid clauses are removed
14.20/14.44	c 14	CSP : 1292 integers, 24789 booleans, 52634 clauses, largest domain size 3209
14.20/14.44	c 14	Heap : 49 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
14.20/14.47	c 14	Simplifing CSP by introducing new Boolean variables
14.69/14.91	c 14	CSP : 1292 integers, 41905 booleans, 69750 clauses, largest domain size 3209
14.69/14.91	c 14	Heap : 54 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
15.00/15.28	c 15	Encoding CSP to SAT : HOME/temp.cnf
16.38/16.69	c 16	130 (10%) CSP integer variables are encoded (48368 clauses, 703434 bytes)
17.67/17.99	c 17	259 (20%) CSP integer variables are encoded (95144 clauses, 1405074 bytes)
19.07/19.31	c 19	388 (30%) CSP integer variables are encoded (142394 clauses, 2199155 bytes)
20.27/20.57	c 20	517 (40%) CSP integer variables are encoded (187018 clauses, 2957763 bytes)
21.46/21.78	c 21	646 (50%) CSP integer variables are encoded (230640 clauses, 3699337 bytes)
21.95/22.27	c 22	776 (60%) CSP integer variables are encoded (577018 clauses, 9587763 bytes)
22.35/22.69	c 22	905 (70%) CSP integer variables are encoded (918955 clauses, 15400692 bytes)
22.86/23.13	c 23	1034 (80%) CSP integer variables are encoded (1263646 clauses, 21789608 bytes)
23.15/23.49	c 23	1163 (90%) CSP integer variables are encoded (1543223 clauses, 27101571 bytes)
23.54/23.84	c 23	1292 (100%) CSP integer variables are encoded (1815446 clauses, 32273808 bytes)
34.76/35.18	c 35	6975 (10%) CSP clauses are encoded (3968814 clauses, 85498502 bytes)
44.88/45.34	c 45	13950 (20%) CSP clauses are encoded (6292845 clauses, 145284277 bytes)
54.01/54.56	c 54	20925 (30%) CSP clauses are encoded (8569007 clauses, 204237589 bytes)
63.50/64.15	c 64	27900 (40%) CSP clauses are encoded (10922454 clauses, 265556929 bytes)
73.57/74.34	c 74	34875 (50%) CSP clauses are encoded (13583298 clauses, 335552562 bytes)
81.05/81.91	c 81	41850 (60%) CSP clauses are encoded (15674006 clauses, 390068160 bytes)
89.74/90.70	c 90	48825 (70%) CSP clauses are encoded (17887662 clauses, 447717165 bytes)
97.74/98.83	c 98	55800 (80%) CSP clauses are encoded (20066844 clauses, 504611474 bytes)
106.80/108.06	c 108	62775 (90%) CSP clauses are encoded (22523850 clauses, 569061398 bytes)
114.91/116.29	c 116	69750 (100%) CSP clauses are encoded (24781304 clauses, 628101165 bytes)
114.91/116.29	c 116	69750 CSP clauses encoded
114.91/116.30	c 116	Writing map file : HOME/temp.map
115.00/116.37	c 116	Heap : 56 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
115.00/116.37	c 116	SAT : 1858643 SAT variables, 24781304 SAT clauses, 628101165 bytes
115.00/116.37	c 116	Heap : 56 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
115.08/116.42	c 116	SOLVING HOME/temp.cnf
115.08/116.42	c 116	CMD HOME/picosat 'HOME/temp.cnf' -o 'HOME/temp.out'
294.51/296.82	c ERROR INTERRUPTED
115.11/296.95	s UNKNOWN
115.11/296.95	c 296	CPU 115.12 (0.06 0.02 110.81 4.23)
115.11/296.95	c 296	END Sun Jul 12 07:48:16 2009

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2083445-1247377399/watcher-2083445-1247377399 -o /tmp/evaluation-result-2083445-1247377399/solver-2083445-1247377399 -C 1800 -W 2000 -M 900 HOME/sugar -c -vv -memlimit=900 -jar=HOME/sugar-v1-14-6.jar -solver=HOME/picosat -tmp=HOME/temp HOME/instance-2083445-1247377399.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.09 2.29 2.17 4/82 24013
/proc/meminfo: memFree=1141400/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=4708 CPUtime=0
/proc/24013/stat : 24013 (sugar) R 24011 24013 18871 0 -1 4194304 58 0 0 0 0 0 0 0 20 0 1 0 24807449 4820992 43 996147200 4194304 4206940 548682068608 18446744073709551615 259910599632 0 0 4096 0 0 0 0 17 1 0 0
/proc/24013/statm: 1177 43 33 3 0 8 0

[startup+0.08699 s]
/proc/loadavg: 2.09 2.29 2.17 4/82 24013
/proc/meminfo: memFree=1141400/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16740 CPUtime=0.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1152 0 0 0 5 2 0 0 18 0 1 0 24807449 17141760 1107 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4185 1107 406 3 0 764 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16740

[startup+0.10212 s]
/proc/loadavg: 2.09 2.29 2.17 4/82 24013
/proc/meminfo: memFree=1141400/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=0.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1227 128 0 0 5 2 0 0 19 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16868

[startup+0.301131 s]
/proc/loadavg: 2.09 2.29 2.17 4/82 24013
/proc/meminfo: memFree=1141400/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=0.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1227 128 0 0 5 2 0 0 19 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16868

[startup+0.701175 s]
/proc/loadavg: 2.09 2.29 2.17 4/82 24013
/proc/meminfo: memFree=1141400/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=0.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1227 128 0 0 5 2 0 0 19 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16868

[startup+1.50125 s]
/proc/loadavg: 2.09 2.29 2.17 3/93 24025
/proc/meminfo: memFree=1114304/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1309 8845 0 1 5 2 96 4 16 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 1.07
Current children cumulated vsize (KiB) 16868

[startup+3.1024 s]
/proc/loadavg: 2.09 2.29 2.17 3/93 24035
/proc/meminfo: memFree=1113664/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1309 8845 0 1 5 2 96 4 15 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
[pid=24026] ppid=24013 vsize=5356 CPUtime=0
/proc/24026/stat : 24026 (sh) S 24013 24013 18871 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24807562 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24026/statm: 1339 233 193 169 0 50 0
[pid=24027] ppid=24026 vsize=868608 CPUtime=1.93
/proc/24027/stat : 24027 (java) S 24026 24013 18871 0 -1 0 8097 0 1 0 187 6 0 0 19 0 9 0 24807563 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/24027/statm: 217152 7205 2566 9 0 211657 0
[pid=24027/tid=24028] ppid=24026 vsize=868608 CPUtime=1.5
/proc/24027/task/24028/stat : 24028 (java) R 24026 24013 18871 0 -1 64 2801 0 1 0 149 1 0 0 25 0 9 0 24807564 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4126547248 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24029] ppid=24026 vsize=868608 CPUtime=0.23
/proc/24027/task/24029/stat : 24029 (java) S 24026 24013 18871 0 -1 64 3155 0 0 0 21 2 0 0 16 0 9 0 24807565 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24030] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24030/stat : 24030 (java) S 24026 24013 18871 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24807565 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24031] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24031/stat : 24031 (java) S 24026 24013 18871 0 -1 64 5 0 0 0 0 0 0 0 15 0 9 0 24807565 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24032] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24032/stat : 24032 (java) S 24026 24013 18871 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 24807567 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24033] ppid=24026 vsize=868608 CPUtime=0.17
/proc/24027/task/24033/stat : 24033 (java) S 24026 24013 18871 0 -1 64 1442 0 0 0 16 1 0 0 16 0 9 0 24807567 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24034] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24034/stat : 24034 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 24807568 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24035] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24035/stat : 24035 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 24807568 889454592 7205 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 890832

[startup+6.30271 s]
/proc/loadavg: 2.08 2.29 2.17 3/93 24035
/proc/meminfo: memFree=1091520/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1309 8845 0 1 5 2 96 4 16 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
[pid=24026] ppid=24013 vsize=5356 CPUtime=0
/proc/24026/stat : 24026 (sh) S 24013 24013 18871 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24807562 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24026/statm: 1339 233 193 169 0 50 0
[pid=24027] ppid=24026 vsize=868608 CPUtime=5.09
/proc/24027/stat : 24027 (java) S 24026 24013 18871 0 -1 0 11202 0 1 0 500 9 0 0 19 0 9 0 24807563 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/24027/statm: 217152 10006 2566 9 0 211657 0
[pid=24027/tid=24028] ppid=24026 vsize=868608 CPUtime=4.32
/proc/24027/task/24028/stat : 24028 (java) R 24026 24013 18871 0 -1 64 3187 0 1 0 430 2 0 0 25 0 9 0 24807564 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4126509786 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24029] ppid=24026 vsize=868608 CPUtime=0.57
/proc/24027/task/24029/stat : 24029 (java) S 24026 24013 18871 0 -1 64 5869 0 0 0 52 5 0 0 16 0 9 0 24807565 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24030] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24030/stat : 24030 (java) S 24026 24013 18871 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24807565 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24031] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24031/stat : 24031 (java) S 24026 24013 18871 0 -1 64 5 0 0 0 0 0 0 0 15 0 9 0 24807565 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24032] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24032/stat : 24032 (java) S 24026 24013 18871 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 24807567 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24033] ppid=24026 vsize=868608 CPUtime=0.18
/proc/24027/task/24033/stat : 24033 (java) S 24026 24013 18871 0 -1 64 1447 0 0 0 17 1 0 0 15 0 9 0 24807567 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24034] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24034/stat : 24034 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 24807568 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24035] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24035/stat : 24035 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 24807568 889454592 10006 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 890832

[startup+12.7021 s]
/proc/loadavg: 2.07 2.28 2.17 3/93 24035
/proc/meminfo: memFree=1041088/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1309 8845 0 1 5 2 96 4 16 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
[pid=24026] ppid=24013 vsize=5356 CPUtime=0
/proc/24026/stat : 24026 (sh) S 24013 24013 18871 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24807562 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24026/statm: 1339 233 193 169 0 50 0
[pid=24027] ppid=24026 vsize=868608 CPUtime=11.44
/proc/24027/stat : 24027 (java) S 24026 24013 18871 0 -1 0 21256 0 1 0 1127 17 0 0 19 0 9 0 24807563 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/24027/statm: 217152 16925 2569 9 0 211657 0
[pid=24027/tid=24028] ppid=24026 vsize=868608 CPUtime=9.67
/proc/24027/task/24028/stat : 24028 (java) R 24026 24013 18871 0 -1 64 3796 0 1 0 963 4 0 0 25 0 9 0 24807564 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4126546438 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24029] ppid=24026 vsize=868608 CPUtime=1.54
/proc/24027/task/24029/stat : 24029 (java) S 24026 24013 18871 0 -1 64 15310 0 0 0 144 10 0 0 16 0 9 0 24807565 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24030] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24030/stat : 24030 (java) S 24026 24013 18871 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24807565 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24031] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24031/stat : 24031 (java) S 24026 24013 18871 0 -1 64 5 0 0 0 0 0 0 0 15 0 9 0 24807565 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24032] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24032/stat : 24032 (java) S 24026 24013 18871 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 24807567 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24033] ppid=24026 vsize=868608 CPUtime=0.19
/proc/24027/task/24033/stat : 24033 (java) S 24026 24013 18871 0 -1 64 1451 0 0 0 18 1 0 0 16 0 9 0 24807567 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24034] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24034/stat : 24034 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 24807568 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24035] ppid=24026 vsize=868608 CPUtime=0
/proc/24027/task/24035/stat : 24035 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 24807568 889454592 16925 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.51
Current children cumulated vsize (KiB) 890832

[startup+25.5023 s]
/proc/loadavg: 2.28 2.32 2.18 3/93 24035
/proc/meminfo: memFree=939392/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1310 8845 0 1 5 2 96 4 16 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
[pid=24026] ppid=24013 vsize=5356 CPUtime=0
/proc/24026/stat : 24026 (sh) S 24013 24013 18871 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24807562 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24026/statm: 1339 233 193 169 0 50 0
[pid=24027] ppid=24026 vsize=868720 CPUtime=24.16
/proc/24027/stat : 24027 (java) S 24026 24013 18871 0 -1 0 26222 0 1 0 2372 44 0 0 19 0 9 0 24807563 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/24027/statm: 217180 20384 2593 9 0 211657 0
[pid=24027/tid=24028] ppid=24026 vsize=868720 CPUtime=21.38
/proc/24027/task/24028/stat : 24028 (java) R 24026 24013 18871 0 -1 64 4491 0 1 0 2110 28 0 0 25 0 9 0 24807564 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4126941985 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24029] ppid=24026 vsize=868720 CPUtime=2.49
/proc/24027/task/24029/stat : 24029 (java) S 24026 24013 18871 0 -1 64 19534 0 0 0 235 14 0 0 16 0 9 0 24807565 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24030] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24030/stat : 24030 (java) S 24026 24013 18871 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24807565 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24031] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24031/stat : 24031 (java) S 24026 24013 18871 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 24807565 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24032] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24032/stat : 24032 (java) S 24026 24013 18871 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 24807567 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24033] ppid=24026 vsize=868720 CPUtime=0.27
/proc/24027/task/24033/stat : 24033 (java) S 24026 24013 18871 0 -1 64 1498 0 0 0 26 1 0 0 15 0 9 0 24807567 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24034] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24034/stat : 24034 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 24807568 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24035] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24035/stat : 24035 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 24807568 889569280 20384 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 890944

[startup+51.1028 s]
/proc/loadavg: 2.18 2.29 2.18 3/93 24035
/proc/meminfo: memFree=706688/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1310 8845 0 1 5 2 96 4 16 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
[pid=24026] ppid=24013 vsize=5356 CPUtime=0
/proc/24026/stat : 24026 (sh) S 24013 24013 18871 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24807562 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24026/statm: 1339 233 193 169 0 50 0
[pid=24027] ppid=24026 vsize=868720 CPUtime=49.56
/proc/24027/stat : 24027 (java) S 24026 24013 18871 0 -1 0 26772 0 1 0 4826 130 0 0 19 0 9 0 24807563 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/24027/statm: 217180 20391 2593 9 0 211657 0

################
# More data... #
################

/proc/meminfo: memFree=187008/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=1.07
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1310 8845 0 1 5 2 96 4 16 0 1 0 24807449 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/24013/statm: 4217 1111 409 3 0 796 0
[pid=24026] ppid=24013 vsize=5356 CPUtime=0
/proc/24026/stat : 24026 (sh) S 24013 24013 18871 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 24807562 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/24026/statm: 1339 233 193 169 0 50 0
[pid=24027] ppid=24026 vsize=868720 CPUtime=100.11
/proc/24027/stat : 24027 (java) S 24026 24013 18871 0 -1 0 28049 0 1 0 9657 354 0 0 19 0 9 0 24807563 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/24027/statm: 217180 20391 2593 9 0 211657 0
[pid=24027/tid=24028] ppid=24026 vsize=868720 CPUtime=96.31
/proc/24027/task/24028/stat : 24028 (java) R 24026 24013 18871 0 -1 64 6311 0 1 0 9307 324 0 0 25 0 9 0 24807564 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4126453624 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24029] ppid=24026 vsize=868720 CPUtime=3.49
/proc/24027/task/24029/stat : 24029 (java) S 24026 24013 18871 0 -1 64 19534 0 0 0 322 27 0 0 16 0 9 0 24807565 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24030] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24030/stat : 24030 (java) S 24026 24013 18871 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 24807565 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24031] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24031/stat : 24031 (java) S 24026 24013 18871 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 24807565 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24032] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24032/stat : 24032 (java) S 24026 24013 18871 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 24807567 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24033] ppid=24026 vsize=868720 CPUtime=0.28
/proc/24027/task/24033/stat : 24033 (java) S 24026 24013 18871 0 -1 64 1505 0 0 0 27 1 0 0 16 0 9 0 24807567 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24034] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24034/stat : 24034 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 24807568 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=24027/tid=24035] ppid=24026 vsize=868720 CPUtime=0
/proc/24027/task/24035/stat : 24035 (java) S 24026 24013 18871 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 24807568 889569280 20391 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.18
Current children cumulated vsize (KiB) 890944

[startup+162.302 s]
/proc/loadavg: 2.08 2.22 2.16 4/85 24114
/proc/meminfo: memFree=202816/2055920 swapFree=4192956/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.11
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1366 37566 0 2 6 2 11081 422 16 0 1 0 24807449 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/24013/statm: 4217 1114 409 3 0 796 0
[pid=24065] ppid=24013 vsize=5356 CPUtime=0
/proc/24065/stat : 24065 (sh) S 24013 24013 18871 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24819092 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24065/statm: 1339 232 193 169 0 50 0
[pid=24066] ppid=24065 vsize=318164 CPUtime=45.66
/proc/24066/stat : 24066 (picosat) R 24065 24013 18871 0 -1 4194304 75181 0 0 0 2113 2453 0 0 25 0 1 0 24819092 325799936 75167 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 0 0 0
/proc/24066/statm: 79541 75167 40 102 0 79436 0
Current children cumulated CPU time (s) 160.77
Current children cumulated vsize (KiB) 340388

[startup+222.302 s]
/proc/loadavg: 2.44 2.28 2.19 3/85 24114
/proc/meminfo: memFree=16000/2055920 swapFree=4192952/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.11
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1366 37566 0 2 6 2 11081 422 16 0 1 0 24807449 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/24013/statm: 4217 1114 409 3 0 796 0
[pid=24065] ppid=24013 vsize=5356 CPUtime=0
/proc/24065/stat : 24065 (sh) S 24013 24013 18871 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24819092 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24065/statm: 1339 232 193 169 0 50 0
[pid=24066] ppid=24065 vsize=576008 CPUtime=105.35
/proc/24066/stat : 24066 (picosat) R 24065 24013 18871 0 -1 4194304 133908 0 0 0 4862 5673 0 0 25 0 1 0 24819092 589832192 133894 996147200 134512640 134931368 4294956256 18446744073709551615 134597664 0 0 4096 0 0 0 0 17 0 0 0
/proc/24066/statm: 144002 133894 40 102 0 143897 0
Current children cumulated CPU time (s) 220.46
Current children cumulated vsize (KiB) 598232

[startup+282.303 s]
/proc/loadavg: 2.91 2.44 2.24 3/85 24114
/proc/meminfo: memFree=16256/2055920 swapFree=4192952/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.11
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1366 37566 0 2 6 2 11081 422 16 0 1 0 24807449 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/24013/statm: 4217 1114 409 3 0 796 0
[pid=24065] ppid=24013 vsize=5356 CPUtime=0
/proc/24065/stat : 24065 (sh) S 24013 24013 18871 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24819092 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24065/statm: 1339 232 193 169 0 50 0
[pid=24066] ppid=24065 vsize=849708 CPUtime=164.99
/proc/24066/stat : 24066 (picosat) R 24065 24013 18871 0 -1 4194304 192525 0 0 0 7612 8887 0 0 25 0 1 0 24819092 870100992 192511 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 0 0 0
/proc/24066/statm: 212427 192511 40 102 0 212322 0
Current children cumulated CPU time (s) 280.1
Current children cumulated vsize (KiB) 871932



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+296.801 s]
/proc/loadavg: 2.93 2.46 2.25 3/85 24114
/proc/meminfo: memFree=14848/2055920 swapFree=4192812/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.11
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1366 37566 0 2 6 2 11081 422 16 0 1 0 24807449 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/24013/statm: 4217 1114 409 3 0 796 0
[pid=24065] ppid=24013 vsize=5356 CPUtime=0
/proc/24065/stat : 24065 (sh) S 24013 24013 18871 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24819092 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24065/statm: 1339 232 193 169 0 50 0
[pid=24066] ppid=24065 vsize=899604 CPUtime=179.4
/proc/24066/stat : 24066 (picosat) R 24065 24013 18871 0 -1 4194304 206577 0 0 0 8272 9668 0 0 25 0 1 0 24819092 921194496 206563 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 0 0 0
/proc/24066/statm: 224901 206563 40 102 0 224796 0
Current children cumulated CPU time (s) 294.51
Current children cumulated vsize (KiB) 921828

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (115.11 s) is less than in the last sample (294.51 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (179.4 s) to the 'lost time'.

[startup+296.801 s]
/proc/loadavg: 2.93 2.46 2.25 3/85 24114
/proc/meminfo: memFree=14848/2055920 swapFree=4192812/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.11
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1366 37566 0 2 6 2 11081 422 16 0 1 0 24807449 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/24013/statm: 4217 1114 409 3 0 796 0
[pid=24065] ppid=24013 vsize=5356 CPUtime=0
/proc/24065/stat : 24065 (sh) S 24013 24013 18871 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 24819092 5484544 232 996147200 4194304 4889804 548682068848 18446744073709551615 259913212740 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/24065/statm: 1339 232 193 169 0 50 0
[pid=24066] ppid=24065 vsize=899604 CPUtime=179.4
/proc/24066/stat : 24066 (picosat) R 24065 24013 18871 0 -1 4194304 206577 0 0 0 8272 9668 0 0 25 0 1 0 24819092 921194496 206563 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 0 0 0
/proc/24066/statm: 224901 206563 40 102 0 224796 0
Current children cumulated CPU time (s) 294.51
Current children cumulated vsize (KiB) 921828

[startup+296.92 s]
/proc/loadavg: 2.93 2.46 2.25 3/86 24115
/proc/meminfo: memFree=722616/2055920 swapFree=4192812/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.11
/proc/24013/stat : 24013 (sugar) S 24011 24013 18871 0 -1 4194304 1395 37566 0 2 6 2 11081 422 16 0 1 0 24807449 17272832 1114 996147200 4194304 4206940 548682068608 18446744073709551615 259922112610 0 16384 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/24013/statm: 4217 1114 409 3 0 796 0
[pid=24065] ppid=24013 vsize=0 CPUtime=0
/proc/24065/stat : 24065 (sh) Z 24013 24013 18871 0 -1 4195340 277 0 0 0 0 0 0 0 16 0 1 0 24819092 0 0 996147200 0 0 0 0 0 0 65536 4100 65538 18446744071563351923 0 0 17 0 0 0
/proc/24065/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 115.11
Current children cumulated vsize (KiB) 16868
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+297.007 s]
/proc/loadavg: 2.93 2.46 2.25 3/86 24115
/proc/meminfo: memFree=722616/2055920 swapFree=4192812/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.12
/proc/24013/stat : 24013 (sugar) D 24011 24013 18871 0 -1 4194304 1424 37843 0 2 6 2 11081 423 16 0 1 0 24807449 17272832 1115 996147200 4194304 4206940 548682068608 18446744073709551615 259913389097 0 0 4224 16386 18446744071563608240 0 0 17 0 0 0
/proc/24013/statm: 4217 1115 410 3 0 796 0
Current children cumulated CPU time (s) 115.12
Current children cumulated vsize (KiB) 16868

[startup+297.201 s]
/proc/loadavg: 2.93 2.46 2.25 3/86 24115
/proc/meminfo: memFree=722616/2055920 swapFree=4192812/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.29
/proc/24013/stat : 24013 (sugar) R 24011 24013 18871 0 -1 4194304 1424 37843 0 2 6 19 11081 423 17 0 1 0 24807449 17272832 1115 996147200 4194304 4206940 548682068608 18446744073709551615 259913389097 0 0 4224 16386 0 0 0 17 0 0 0
/proc/24013/statm: 4217 1115 410 3 0 796 0
Current children cumulated CPU time (s) 115.29
Current children cumulated vsize (KiB) 16868

[startup+297.307 s]
/proc/loadavg: 2.93 2.46 2.25 3/86 24115
/proc/meminfo: memFree=722616/2055920 swapFree=4192812/4192956
[pid=24013] ppid=24011 vsize=16868 CPUtime=115.39
/proc/24013/stat : 24013 (sugar) D 24011 24013 18871 0 -1 4194304 1424 37843 0 2 6 29 11081 423 18 0 1 0 24807449 17272832 1115 996147200 4194304 4206940 548682068608 18446744073709551615 259913389097 0 0 4224 16386 18446744071563608240 0 0 17 0 0 0
/proc/24013/statm: 4217 1115 410 3 0 796 0
Current children cumulated CPU time (s) 115.39
Current children cumulated vsize (KiB) 16868

Child status: 0

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 179.4
#  lost CPU user time (s): 82.72
#  lost CPU system time (s): 96.68

Real time (s): 297.371
CPU time (s): 294.81
CPU user time (s): 193.599
CPU system time (s): 101.211
CPU usage (%): 99.139
Max. virtual memory (cumulated for all children) (KiB): 921828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 110.879
system time used= 4.53131
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 39326
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31598
involuntary context switches= 34715

runsolver used 0.352946 second user time and 0.896863 second system time

The end

Launcher Data 

Begin job on node4 at 2009-07-12 07:43:19
IDJOB=2083445
IDBENCH=57817
IDSOLVER=738
FILE ID=node4/2083445-1247377399
PBS_JOBID= 9507046
Free space on /tmp= 66268 MiB

SOLVER NAME= Sugar v1.14.6+picosat
BENCH NAME= CPAI08/csp/fapp/fapp33/normalized-fapp33-0650-7.xml
COMMAND LINE= DIR/sugar -c -vv -memlimit=MEMLIMIT -jar="DIR/sugar-v1-14-6.jar" -solver="DIR/picosat" -tmp="TMPDIR/temp" BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2083445-1247377399/watcher-2083445-1247377399 -o /tmp/evaluation-result-2083445-1247377399/solver-2083445-1247377399 -C 1800 -W 2000 -M 900  HOME/sugar -c -vv -memlimit=900 -jar="HOME/sugar-v1-14-6.jar" -solver="HOME/picosat" -tmp="HOME/temp" HOME/instance-2083445-1247377399.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= f7a160e85c0f22f460747e3f10500acd
RANDOM SEED=1152624925

node4.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1141880 kB
Buffers:         81272 kB
Cached:         646736 kB
SwapCached:          0 kB
Active:         272428 kB
Inactive:       560776 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1141880 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            5212 kB
Writeback:           0 kB
Mapped:         125572 kB
Slab:            65772 kB
Committed_AS:   327020 kB
PageTables:       2124 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 65888 MiB
End job on node4 at 2009-07-12 07:48:18