Trace number 2065185

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Sugar v1.14.6+picosat? (MO) 896.426 905.245

General information on the benchmark

Namecsp/fischer/
normalized-fischer-11-9-fair.xml
MD5SUM6fa7172765415230a524481a7e5679c2
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables26193
Number of constraints24812
Maximum constraint arity3
Maximum domain size20001
Number of constraints which are defined in extension0
Number of constraints which are defined in intension24812
Global constraints used (with number of constraints)

Solver Data 

0.00/0.07	c 0	Sugar v1-14-6 + HOME/picosat
0.00/0.07	c 0	BEGIN Sat Jul 11 20:46:51 2009
0.00/0.07	c 0	PID 18855
0.00/0.07	c 0	HOST node92.alineos.net
0.00/0.07	c 0	CONVERTING HOME/instance-2065185-1247338011.xml TO HOME/temp.csp
0.00/0.07	c 0	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.XML2CSP -v -v 'HOME/instance-2065185-1247338011.xml' 'HOME/temp.csp'
1.97/2.03	c 2	3 domains, 26193 variables, 9 predicates, 0 relations, 24812 constraints
1.97/2.06	c 2	ENCODING HOME/temp.csp TO HOME/temp.cnf
1.97/2.06	c 2	CMD java -Xmx700M -cp 'HOME/sugar-v1-14-6.jar' jp.ac.kobe_u.cs.sugar.SugarMain -v -v -competition -encode 'HOME/temp.csp' 'HOME/temp.cnf' 'HOME/temp.map'
2.04/2.13	c 3	Parsing HOME/temp.csp
2.23/2.31	c 3	parsed 10000 expressions
2.33/2.40	c 3	parsed 20000 expressions
2.43/2.51	c 3	parsed 30000 expressions
2.52/2.60	c 3	parsed 40000 expressions
2.63/2.76	c 3	parsed 50000 expressions
2.63/2.77	c 3	parsed 51017 expressions
2.63/2.77	c 3	Heap : 14 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
2.63/2.77	c 3	Converting to clausal form CSP
2.72/2.82	c 3	converted 5102 (10%) expressions
2.72/2.83	c 3	converted 10204 (20%) expressions
2.72/2.84	c 3	converted 15306 (30%) expressions
2.72/2.86	c 3	converted 20407 (40%) expressions
2.72/2.86	c 3	converted 25509 (50%) expressions
3.03/3.20	c 4	converted 30611 (60%) expressions
3.71/3.90	c 4	converted 35712 (70%) expressions
4.51/4.60	c 5	converted 40814 (80%) expressions
4.92/5.09	c 5	converted 45916 (90%) expressions
5.81/5.95	c 6	converted 51017 (100%) expressions
5.81/5.96	c 6	CSP : 45989 integers, 1532 booleans, 111824 clauses, largest domain size 20001
5.81/5.96	c 6	Heap : 67 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
5.81/5.96	c 6	Propagation in CSP
760.33/763.94	c 764	322308047 values, 0 unsatisfiable literals, and 0 valid clauses are removed
760.33/763.94	c 764	CSP : 45989 integers, 1532 booleans, 111824 clauses, largest domain size 20001
760.33/763.94	c 764	Heap : 71 MiB used (max 694 MiB), NonHeap : 13 MiB used (max 116 MiB)
760.33/763.98	c 764	Simplifing CSP by introducing new Boolean variables
760.63/764.20	c 765	CSP : 45989 integers, 41582 booleans, 151874 clauses, largest domain size 20001
760.63/764.20	c 765	Heap : 82 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
761.13/764.74	c 765	Encoding CSP to SAT : HOME/temp.cnf
761.62/765.26	c 766	4599 (10%) CSP integer variables are encoded (397737 clauses, 6544496 bytes)
764.20/767.85	c 768	9198 (20%) CSP integer variables are encoded (2586249 clauses, 46927869 bytes)
765.20/768.84	c 769	13797 (30%) CSP integer variables are encoded (3406941 clauses, 62521017 bytes)
765.99/769.68	c 770	18396 (40%) CSP integer variables are encoded (4106864 clauses, 75819554 bytes)
766.62/771.18	c 772	22995 (50%) CSP integer variables are encoded (4625576 clauses, 85675082 bytes)
766.62/771.19	c 772	27594 (60%) CSP integer variables are encoded (4625576 clauses, 85675082 bytes)
767.51/772.05	c 772	32193 (70%) CSP integer variables are encoded (5345432 clauses, 99352346 bytes)
768.00/772.50	c 773	36792 (80%) CSP integer variables are encoded (5725356 clauses, 106570902 bytes)
768.20/772.74	c 773	41391 (90%) CSP integer variables are encoded (5915328 clauses, 110180370 bytes)
768.50/773.04	c 773	45989 (100%) CSP integer variables are encoded (6165290 clauses, 114929648 bytes)
799.93/807.22	c 808	15188 (10%) CSP clauses are encoded (25588467 clauses, 531055674 bytes)
800.61/807.91	c 808	30375 (20%) CSP clauses are encoded (26034085 clauses, 540035243 bytes)
802.66/810.01	c 810	45563 (30%) CSP clauses are encoded (27479511 clauses, 569958441 bytes)
804.91/812.30	c 813	60750 (40%) CSP clauses are encoded (29043768 clauses, 603188968 bytes)
806.30/814.41	c 815	75937 (50%) CSP clauses are encoded (30009083 clauses, 623693129 bytes)
806.30/814.50	c 815	91125 (60%) CSP clauses are encoded (30016256 clauses, 623839015 bytes)
806.40/814.58	c 815	106312 (70%) CSP clauses are encoded (30023393 clauses, 623984214 bytes)
808.00/816.17	c 817	121500 (80%) CSP clauses are encoded (31110814 clauses, 647085685 bytes)
808.98/817.19	c 818	136687 (90%) CSP clauses are encoded (31797060 clauses, 661660769 bytes)
809.08/817.30	c 818	151874 (100%) CSP clauses are encoded (31819577 clauses, 662248691 bytes)
809.08/817.30	c 818	151874 CSP clauses encoded
809.19/817.30	c 818	Writing map file : HOME/temp.map
809.19/817.37	c 818	Heap : 64 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
809.19/817.37	c 818	SAT : 6219628 SAT variables, 31819577 SAT clauses, 662248691 bytes
809.19/817.37	c 818	Heap : 64 MiB used (max 694 MiB), NonHeap : 14 MiB used (max 116 MiB)
809.25/817.45	c 818	SOLVING HOME/temp.cnf
809.25/817.45	c 818	CMD HOME/picosat 'HOME/temp.cnf' -o 'HOME/temp.out'
896.39/905.11	c ERROR INTERRUPTED
809.29/905.24	s UNKNOWN
809.29/905.24	c 906	CPU 809.3 (0.07 0.01 803.46 5.76)
809.29/905.24	c 906	END Sat Jul 11 21:01:57 2009

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2065185-1247338011/watcher-2065185-1247338011 -o /tmp/evaluation-result-2065185-1247338011/solver-2065185-1247338011 -C 1800 -W 2000 -M 900 HOME/sugar -c -vv -memlimit=900 -jar=HOME/sugar-v1-14-6.jar -solver=HOME/picosat -tmp=HOME/temp HOME/instance-2065185-1247338011.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.03 2.05 4/74 18855
/proc/meminfo: memFree=1844912/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=12272 CPUtime=0
/proc/18855/stat : 18855 (sugar) R 18853 18855 18658 0 -1 4194304 356 0 0 0 0 0 0 0 18 0 1 0 20866165 12566528 324 996147200 4194304 4206940 548682068608 18446744073709551615 251292680176 0 0 4224 0 0 0 0 17 0 0 0
/proc/18855/statm: 3068 326 245 3 0 168 0

[startup+0.0971129 s]
/proc/loadavg: 2.00 2.03 2.05 4/74 18855
/proc/meminfo: memFree=1844912/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=0.06
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1227 128 0 0 5 1 0 0 17 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.101109 s]
/proc/loadavg: 2.00 2.03 2.05 4/74 18855
/proc/meminfo: memFree=1844912/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=0.06
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1227 128 0 0 5 1 0 0 17 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.301136 s]
/proc/loadavg: 2.00 2.03 2.05 4/74 18855
/proc/meminfo: memFree=1844912/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=0.06
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1227 128 0 0 5 1 0 0 17 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+0.701185 s]
/proc/loadavg: 2.00 2.03 2.05 4/74 18855
/proc/meminfo: memFree=1844912/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=0.06
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1227 128 0 0 5 1 0 0 17 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16868

[startup+1.50229 s]
/proc/loadavg: 2.00 2.03 2.05 3/85 18867
/proc/meminfo: memFree=1808664/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=0.06
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1227 128 0 0 5 1 0 0 17 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18858] ppid=18855 vsize=5356 CPUtime=0
/proc/18858/stat : 18858 (sh) S 18855 18855 18658 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 20866173 5484544 233 996147200 4194304 4889804 548682068752 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18858/statm: 1339 233 193 169 0 50 0
[pid=18859] ppid=18858 vsize=864772 CPUtime=1.4
/proc/18859/stat : 18859 (java) S 18858 18855 18658 0 -1 0 18667 0 1 0 130 10 0 0 18 0 9 0 20866173 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18859/statm: 216193 15227 2556 9 0 210705 0
[pid=18859/tid=18860] ppid=18858 vsize=864772 CPUtime=0.63
/proc/18859/task/18860/stat : 18860 (java) R 18858 18855 18658 0 -1 64 3104 0 1 0 61 2 0 0 25 0 9 0 20866174 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4126730208 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18861] ppid=18858 vsize=864772 CPUtime=0.64
/proc/18859/task/18861/stat : 18861 (java) S 18858 18855 18658 0 -1 64 14348 0 0 0 58 6 0 0 17 0 9 0 20866175 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18862] ppid=18858 vsize=864772 CPUtime=0
/proc/18859/task/18862/stat : 18862 (java) S 18858 18855 18658 0 -1 64 16 0 0 0 0 0 0 0 16 0 9 0 20866175 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18863] ppid=18858 vsize=864772 CPUtime=0
/proc/18859/task/18863/stat : 18863 (java) S 18858 18855 18658 0 -1 64 10 0 0 0 0 0 0 0 16 0 9 0 20866175 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18864] ppid=18858 vsize=864772 CPUtime=0
/proc/18859/task/18864/stat : 18864 (java) S 18858 18855 18658 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 20866177 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18865] ppid=18858 vsize=864772 CPUtime=0.11
/proc/18859/task/18865/stat : 18865 (java) S 18858 18855 18658 0 -1 64 510 0 0 0 11 0 0 0 16 0 9 0 20866177 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18866] ppid=18858 vsize=864772 CPUtime=0
/proc/18859/task/18866/stat : 18866 (java) S 18858 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 20866177 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18859/tid=18867] ppid=18858 vsize=864772 CPUtime=0
/proc/18859/task/18867/stat : 18867 (java) S 18858 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 20866177 885526528 15227 996147200 134512640 134550932 4294955984 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 886996

[startup+3.10249 s]
/proc/loadavg: 2.00 2.03 2.05 3/81 18873
/proc/meminfo: memFree=1837304/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=2.01
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1309 20594 0 1 5 1 182 13 16 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18868] ppid=18855 vsize=5356 CPUtime=0
/proc/18868/stat : 18868 (sh) S 18855 18855 18658 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 20866372 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18868/statm: 1339 233 193 169 0 50 0
[pid=18869] ppid=18868 vsize=868556 CPUtime=1.02
/proc/18869/stat : 18869 (java) S 18868 18855 18658 0 -1 0 11414 0 1 0 97 5 0 0 20 0 9 0 20866372 889401344 10321 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/18869/statm: 217139 10321 2569 9 0 211644 0
[pid=18869/tid=18870] ppid=18868 vsize=868556 CPUtime=0.56
/proc/18869/task/18870/stat : 18870 (java) R 18868 18855 18658 0 -1 64 2724 0 1 0 55 1 0 0 25 0 9 0 20866373 889401344 10321 996147200 134512640 134550932 4294955936 18446744073709551615 4126566919 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18871] ppid=18868 vsize=868556 CPUtime=0.29
/proc/18869/task/18871/stat : 18871 (java) S 18868 18855 18658 0 -1 64 6518 0 0 0 27 2 0 0 16 0 9 0 20866374 889401344 10321 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18872] ppid=18868 vsize=868556 CPUtime=0
/proc/18869/task/18872/stat : 18872 (java) S 18868 18855 18658 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 20866374 889401344 10321 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18873] ppid=18868 vsize=868556 CPUtime=0
/proc/18869/task/18873/stat : 18873 (java) S 18868 18855 18658 0 -1 64 9 0 0 0 0 0 0 0 15 0 9 0 20866374 889401344 10321 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3.03
Current children cumulated vsize (KiB) 890780

[startup+6.30189 s]
/proc/loadavg: 2.00 2.03 2.05 4/85 18877
/proc/meminfo: memFree=1764376/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=2.01
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1310 20594 0 1 5 1 182 13 16 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18868] ppid=18855 vsize=5356 CPUtime=0
/proc/18868/stat : 18868 (sh) S 18855 18855 18658 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 20866372 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18868/statm: 1339 233 193 169 0 50 0
[pid=18869] ppid=18868 vsize=868640 CPUtime=4.19
/proc/18869/stat : 18869 (java) S 18868 18855 18658 0 -1 0 26504 0 1 0 408 11 0 0 20 0 9 0 20866372 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/18869/statm: 217160 24501 2566 9 0 211665 0
[pid=18869/tid=18870] ppid=18868 vsize=868640 CPUtime=2.33
/proc/18869/task/18870/stat : 18870 (java) R 18868 18855 18658 0 -1 64 3648 0 1 0 231 2 0 0 25 0 9 0 20866373 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4126583789 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18871] ppid=18868 vsize=868640 CPUtime=1.65
/proc/18869/task/18871/stat : 18871 (java) S 18868 18855 18658 0 -1 64 20650 0 0 0 158 7 0 0 16 0 9 0 20866374 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18872] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18872/stat : 18872 (java) S 18868 18855 18658 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18873] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18873/stat : 18873 (java) S 18868 18855 18658 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18874] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18874/stat : 18874 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18875] ppid=18868 vsize=868640 CPUtime=0.18
/proc/18869/task/18875/stat : 18875 (java) S 18868 18855 18658 0 -1 64 1503 0 0 0 18 0 0 0 16 0 9 0 20866376 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18876] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18876/stat : 18876 (java) S 18868 18855 18658 0 -1 64 0 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18877] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18877/stat : 18877 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 20866376 889487360 24501 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 890864

[startup+12.7027 s]
/proc/loadavg: 2.00 2.02 2.05 3/85 18877
/proc/meminfo: memFree=1751512/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=2.01
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1310 20594 0 1 5 1 182 13 16 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18868] ppid=18855 vsize=5356 CPUtime=0
/proc/18868/stat : 18868 (sh) S 18855 18855 18658 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 20866372 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18868/statm: 1339 233 193 169 0 50 0
[pid=18869] ppid=18868 vsize=868640 CPUtime=10.57
/proc/18869/stat : 18869 (java) S 18868 18855 18658 0 -1 0 26710 0 1 0 1044 13 0 0 20 0 9 0 20866372 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/18869/statm: 217160 24563 2566 9 0 211665 0
[pid=18869/tid=18870] ppid=18868 vsize=868640 CPUtime=8.6
/proc/18869/task/18870/stat : 18870 (java) R 18868 18855 18658 0 -1 64 3792 0 1 0 858 2 0 0 25 0 9 0 20866373 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4126974848 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18871] ppid=18868 vsize=868640 CPUtime=1.75
/proc/18869/task/18871/stat : 18871 (java) S 18868 18855 18658 0 -1 64 20712 0 0 0 166 9 0 0 16 0 9 0 20866374 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18872] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18872/stat : 18872 (java) S 18868 18855 18658 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18873] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18873/stat : 18873 (java) S 18868 18855 18658 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18874] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18874/stat : 18874 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18875] ppid=18868 vsize=868640 CPUtime=0.18
/proc/18869/task/18875/stat : 18875 (java) S 18868 18855 18658 0 -1 64 1503 0 0 0 18 0 0 0 16 0 9 0 20866376 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18876] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18876/stat : 18876 (java) S 18868 18855 18658 0 -1 64 0 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18877] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18877/stat : 18877 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 20866376 889487360 24563 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 890864

[startup+25.5023 s]
/proc/loadavg: 2.00 2.02 2.05 3/85 18877
/proc/meminfo: memFree=1751448/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=2.01
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1310 20594 0 1 5 1 182 13 16 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18868] ppid=18855 vsize=5356 CPUtime=0
/proc/18868/stat : 18868 (sh) S 18855 18855 18658 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 20866372 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18868/statm: 1339 233 193 169 0 50 0
[pid=18869] ppid=18868 vsize=868640 CPUtime=23.32
/proc/18869/stat : 18869 (java) S 18868 18855 18658 0 -1 0 27001 0 1 0 2316 16 0 0 20 0 9 0 20866372 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/18869/statm: 217160 24567 2566 9 0 211665 0
[pid=18869/tid=18870] ppid=18868 vsize=868640 CPUtime=21.21
/proc/18869/task/18870/stat : 18870 (java) R 18868 18855 18658 0 -1 64 4079 0 1 0 2117 4 0 0 25 0 9 0 20866373 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4126974849 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18871] ppid=18868 vsize=868640 CPUtime=1.89
/proc/18869/task/18871/stat : 18871 (java) S 18868 18855 18658 0 -1 64 20716 0 0 0 179 10 0 0 16 0 9 0 20866374 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18872] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18872/stat : 18872 (java) S 18868 18855 18658 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18873] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18873/stat : 18873 (java) S 18868 18855 18658 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18874] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18874/stat : 18874 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18875] ppid=18868 vsize=868640 CPUtime=0.18
/proc/18869/task/18875/stat : 18875 (java) S 18868 18855 18658 0 -1 64 1503 0 0 0 18 0 0 0 16 0 9 0 20866376 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18876] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18876/stat : 18876 (java) S 18868 18855 18658 0 -1 64 0 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18877] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18877/stat : 18877 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 20866376 889487360 24567 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.33

################
# More data... #
################

[pid=18855] ppid=18853 vsize=16868 CPUtime=2.01
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1310 20594 0 1 5 1 182 13 16 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18868] ppid=18855 vsize=5356 CPUtime=0
/proc/18868/stat : 18868 (sh) S 18855 18855 18658 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 20866372 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18868/statm: 1339 233 193 169 0 50 0
[pid=18869] ppid=18868 vsize=868640 CPUtime=697.03
/proc/18869/stat : 18869 (java) S 18868 18855 18658 0 -1 0 42304 0 1 0 69536 167 0 0 20 0 9 0 20866372 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/18869/statm: 217160 24743 2566 9 0 211665 0
[pid=18869/tid=18870] ppid=18868 vsize=868640 CPUtime=686.98
/proc/18869/task/18870/stat : 18870 (java) R 18868 18855 18658 0 -1 64 19206 0 1 0 68640 58 0 0 25 0 9 0 20866373 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4125952222 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18871] ppid=18868 vsize=868640 CPUtime=9.82
/proc/18869/task/18871/stat : 18871 (java) S 18868 18855 18658 0 -1 64 20892 0 0 0 876 106 0 0 16 0 9 0 20866374 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18872] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18872/stat : 18872 (java) S 18868 18855 18658 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18873] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18873/stat : 18873 (java) S 18868 18855 18658 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18874] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18874/stat : 18874 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18875] ppid=18868 vsize=868640 CPUtime=0.18
/proc/18869/task/18875/stat : 18875 (java) S 18868 18855 18658 0 -1 64 1503 0 0 0 18 0 0 0 16 0 9 0 20866376 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18876] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18876/stat : 18876 (java) S 18868 18855 18658 0 -1 64 0 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18877] ppid=18868 vsize=868640 CPUtime=0.01
/proc/18869/task/18877/stat : 18877 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 1 0 0 0 15 0 9 0 20866376 889487360 24743 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 699.04
Current children cumulated vsize (KiB) 890864

[startup+762.308 s]
/proc/loadavg: 2.00 2.00 2.00 3/86 18880
/proc/meminfo: memFree=1749904/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=2.01
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1310 20594 0 1 5 1 182 13 16 0 1 0 20866165 17272832 1111 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1111 409 3 0 796 0
[pid=18868] ppid=18855 vsize=5356 CPUtime=0
/proc/18868/stat : 18868 (sh) S 18855 18855 18658 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 20866372 5484544 233 996147200 4194304 4889804 548682068704 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18868/statm: 1339 233 193 169 0 50 0
[pid=18869] ppid=18868 vsize=868640 CPUtime=756.74
/proc/18869/stat : 18869 (java) S 18868 18855 18658 0 -1 0 43656 0 1 0 75492 182 0 0 20 0 9 0 20866372 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/18869/statm: 217160 24758 2566 9 0 211665 0
[pid=18869/tid=18870] ppid=18868 vsize=868640 CPUtime=745.97
/proc/18869/task/18870/stat : 18870 (java) R 18868 18855 18658 0 -1 64 20543 0 1 0 74533 64 0 0 25 0 9 0 20866373 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4125952294 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18871] ppid=18868 vsize=868640 CPUtime=10.55
/proc/18869/task/18871/stat : 18871 (java) S 18868 18855 18658 0 -1 64 20907 0 0 0 939 116 0 0 16 0 9 0 20866374 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18872] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18872/stat : 18872 (java) S 18868 18855 18658 0 -1 64 15 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18873] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18873/stat : 18873 (java) S 18868 18855 18658 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 20866374 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18874] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18874/stat : 18874 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18875] ppid=18868 vsize=868640 CPUtime=0.18
/proc/18869/task/18875/stat : 18875 (java) S 18868 18855 18658 0 -1 64 1503 0 0 0 18 0 0 0 16 0 9 0 20866376 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18876] ppid=18868 vsize=868640 CPUtime=0
/proc/18869/task/18876/stat : 18876 (java) S 18868 18855 18658 0 -1 64 0 0 0 0 0 0 0 0 25 0 9 0 20866376 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18869/tid=18877] ppid=18868 vsize=868640 CPUtime=0.01
/proc/18869/task/18877/stat : 18877 (java) S 18868 18855 18658 0 -1 64 1 0 0 0 1 0 0 0 15 0 9 0 20866376 889487360 24758 996147200 134512640 134550932 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 758.75
Current children cumulated vsize (KiB) 890864

[startup+822.301 s]
/proc/loadavg: 3.45 2.38 2.13 3/78 18884
/proc/meminfo: memFree=1104720/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=809.29
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1365 74301 0 3 7 1 80345 576 16 0 1 0 20866165 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1113 409 3 0 796 0
[pid=18882] ppid=18855 vsize=5356 CPUtime=0
/proc/18882/stat : 18882 (sh) S 18855 18855 18658 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 20947910 5484544 232 996147200 4194304 4889804 548682068832 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18882/statm: 1339 232 193 169 0 50 0
[pid=18883] ppid=18882 vsize=87320 CPUtime=4.81
/proc/18883/stat : 18883 (picosat) R 18882 18855 18658 0 -1 4194304 17258 0 0 0 222 259 0 0 25 0 1 0 20947911 89415680 17244 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 1 0 0
/proc/18883/statm: 21830 17244 40 102 0 21725 0
Current children cumulated CPU time (s) 814.1
Current children cumulated vsize (KiB) 109544

[startup+882.302 s]
/proc/loadavg: 3.37 2.57 2.21 3/78 18891
/proc/meminfo: memFree=519248/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=809.29
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1365 74301 0 3 7 1 80345 576 16 0 1 0 20866165 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1113 409 3 0 796 0
[pid=18882] ppid=18855 vsize=5356 CPUtime=0
/proc/18882/stat : 18882 (sh) S 18855 18855 18658 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 20947910 5484544 232 996147200 4194304 4889804 548682068832 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18882/statm: 1339 232 193 169 0 50 0
[pid=18883] ppid=18882 vsize=798396 CPUtime=64.39
/proc/18883/stat : 18883 (picosat) R 18882 18855 18658 0 -1 4194304 164496 0 0 0 2944 3495 0 0 25 0 1 0 20947911 817557504 164482 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 1 0 0
/proc/18883/statm: 199599 164482 40 102 0 199494 0
Current children cumulated CPU time (s) 873.68
Current children cumulated vsize (KiB) 820620



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+905.102 s]
/proc/loadavg: 2.90 2.52 2.20 3/78 18891
/proc/meminfo: memFree=423056/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=809.29
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1365 74301 0 3 7 1 80345 576 16 0 1 0 20866165 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1113 409 3 0 796 0
[pid=18882] ppid=18855 vsize=5356 CPUtime=0
/proc/18882/stat : 18882 (sh) S 18855 18855 18658 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 20947910 5484544 232 996147200 4194304 4889804 548682068832 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18882/statm: 1339 232 193 169 0 50 0
[pid=18883] ppid=18882 vsize=899524 CPUtime=87.1
/proc/18883/stat : 18883 (picosat) R 18882 18855 18658 0 -1 4194304 188333 0 0 0 3982 4728 0 0 25 0 1 0 20947911 921112576 188319 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 1 0 0
/proc/18883/statm: 224881 188319 40 102 0 224776 0
Current children cumulated CPU time (s) 896.39
Current children cumulated vsize (KiB) 921748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (809.29 s) is less than in the last sample (896.39 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (87.1 s) to the 'lost time'.

[startup+905.102 s]
/proc/loadavg: 2.90 2.52 2.20 3/78 18891
/proc/meminfo: memFree=423056/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=809.29
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1365 74301 0 3 7 1 80345 576 16 0 1 0 20866165 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/18855/statm: 4217 1113 409 3 0 796 0
[pid=18882] ppid=18855 vsize=5356 CPUtime=0
/proc/18882/stat : 18882 (sh) S 18855 18855 18658 0 -1 4194304 277 0 0 0 0 0 0 0 18 0 1 0 20947910 5484544 232 996147200 4194304 4889804 548682068832 18446744073709551615 251279237956 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18882/statm: 1339 232 193 169 0 50 0
[pid=18883] ppid=18882 vsize=899524 CPUtime=87.1
/proc/18883/stat : 18883 (picosat) R 18882 18855 18658 0 -1 4194304 188333 0 0 0 3982 4728 0 0 25 0 1 0 20947911 921112576 188319 996147200 134512640 134931368 4294956256 18446744073709551615 134605937 0 0 4096 0 0 0 0 17 1 0 0
/proc/18883/statm: 224881 188319 40 102 0 224776 0
Current children cumulated CPU time (s) 896.39
Current children cumulated vsize (KiB) 921748

[startup+905.22 s]
/proc/loadavg: 2.90 2.52 2.20 3/79 18892
/proc/meminfo: memFree=1105480/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=809.29
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1394 74301 0 3 7 1 80345 576 16 0 1 0 20866165 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 16384 4224 0 18446744071563648864 0 0 17 1 0 0
/proc/18855/statm: 4217 1113 409 3 0 796 0
[pid=18882] ppid=18855 vsize=0 CPUtime=0
/proc/18882/stat : 18882 (sh) Z 18855 18855 18658 0 -1 4195340 277 0 0 0 0 0 0 0 16 0 1 0 20947910 0 0 996147200 0 0 0 0 0 0 65536 4100 65538 18446744071563351923 0 0 17 1 0 0
/proc/18882/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 809.29
Current children cumulated vsize (KiB) 16868
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+905.22 s]
/proc/loadavg: 2.90 2.52 2.20 3/79 18892
/proc/meminfo: memFree=1105480/2055920 swapFree=4192812/4192956
[pid=18855] ppid=18853 vsize=16868 CPUtime=809.29
/proc/18855/stat : 18855 (sugar) S 18853 18855 18658 0 -1 4194304 1394 74301 0 3 7 1 80345 576 16 0 1 0 20866165 17272832 1113 996147200 4194304 4206940 548682068608 18446744073709551615 251288137826 0 16384 4224 0 18446744071563648864 0 0 17 1 0 0
/proc/18855/statm: 4217 1113 409 3 0 796 0
[pid=18882] ppid=18855 vsize=0 CPUtime=0
/proc/18882/stat : 18882 (sh) Z 18855 18855 18658 0 -1 4195340 277 0 0 0 0 0 0 0 16 0 1 0 20947910 0 0 996147200 0 0 0 0 0 0 65536 4100 65538 18446744071563351923 0 0 17 1 0 0
/proc/18882/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 809.29
Current children cumulated vsize (KiB) 16868

Child status: 0

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 87.1
#  lost CPU user time (s): 39.82
#  lost CPU system time (s): 47.28

Real time (s): 905.245
CPU time (s): 896.426
CPU user time (s): 843.358
CPU system time (s): 53.0681
CPU usage (%): 99.0258
Max. virtual memory (cumulated for all children) (KiB): 921748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 803.538
system time used= 5.78812
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 76060
page faults= 3
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 189949
involuntary context switches= 200405

runsolver used 1.21481 second user time and 2.87056 second system time

The end

Launcher Data 

Begin job on node92 at 2009-07-11 20:46:51
IDJOB=2065185
IDBENCH=54323
IDSOLVER=738
FILE ID=node92/2065185-1247338011
PBS_JOBID= 9506784
Free space on /tmp= 66260 MiB

SOLVER NAME= Sugar v1.14.6+picosat
BENCH NAME= CPAI08/csp/fischer/normalized-fischer-11-9-fair.xml
COMMAND LINE= DIR/sugar -c -vv -memlimit=MEMLIMIT -jar="DIR/sugar-v1-14-6.jar" -solver="DIR/picosat" -tmp="TMPDIR/temp" BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2065185-1247338011/watcher-2065185-1247338011 -o /tmp/evaluation-result-2065185-1247338011/solver-2065185-1247338011 -C 1800 -W 2000 -M 900  HOME/sugar -c -vv -memlimit=900 -jar="HOME/sugar-v1-14-6.jar" -solver="HOME/picosat" -tmp="HOME/temp" HOME/instance-2065185-1247338011.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 6fa7172765415230a524481a7e5679c2
RANDOM SEED=2080925721

node92.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1845408 kB
Buffers:          9904 kB
Cached:          72172 kB
SwapCached:          0 kB
Active:         133160 kB
Inactive:        24024 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1845408 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            5664 kB
Writeback:           0 kB
Mapped:          85828 kB
Slab:            38556 kB
Committed_AS:   272504 kB
PageTables:       2036 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66260 MiB
End job on node92 at 2009-07-11 21:01:59