Trace number 229683

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.02 1812.74

General information on the benchmark

Namerandom/rand-2-50-23-fcd/
rand-2-50-23-587-230-fcd-25_ext.xml
MD5SUMf7bc68ca25c5cfa4d7c359c11a8a7969
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of constraints471
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension471
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
1.25	c start processing
1.25	c start relation processing
1.28	c start cnf exporting
3.39	c parsing time : 1.076
3.39	c preprocessing time : 3.215
3.39	
3.39	c Nary constraints - conflicts : 0 supports : 0
3.39	c Binary constraints - conflicts : 453 supports :18
3.39	c max arity constraint : 2
3.39	c Max Tuples generated 0
3.39	c relations : 471
3.39	c relations BDD: 0
3.39	c vars : 1151 - clauses :  75596
3.39	
3.42	 
3.42	c --- Minisat Stats ---
3.42	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node5/watcher-229683-1168308992 -o ROOT/results/node5/solver-229683-1168308992 -C 1800 -M 900 /tmp/evaluation/229683-1168308992/galac.sh /tmp/evaluation/229683-1168308992/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.01 2.01 1.91 5/95 31515
/proc/meminfo: memFree=1082592/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=8560 CPUtime=0
/proc/31514/stat : 31514 (galac.sh) R 31512 31514 30638 0 -1 4194304 308 0 0 0 0 0 0 0 20 0 1 0 159513668 8765440 253 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913666959 0 0 4096 8192 0 0 0 17 1 0 0
/proc/31514/statm: 2140 253 197 79 0 133 0

[startup+0.110174 s]
/proc/loadavg: 2.01 2.01 1.91 5/95 31515
/proc/meminfo: memFree=1082592/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=0.01
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47560

[startup+0.518217 s]
/proc/loadavg: 2.01 2.01 1.91 5/95 31515
/proc/meminfo: memFree=1082592/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=0.01
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47560

[startup+1.34331 s]
/proc/loadavg: 2.01 2.01 1.91 4/103 31535
/proc/meminfo: memFree=1012064/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=0.01
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31528] ppid=31514 vsize=861064 CPUtime=1.27
/proc/31528/stat : 31528 (java) S 31514 31514 30638 0 -1 0 19683 0 1 0 116 11 0 0 18 0 8 0 159513672 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/31528/statm: 215266 19437 1992 14 0 201471 0
[pid=31528/tid=31529] ppid=31514 vsize=861064 CPUtime=0.03
/proc/31528/task/31529/stat : 31529 (java) S 31514 31514 30638 0 -1 64 3785 0 0 0 2 1 0 0 16 0 8 0 159513676 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31530] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31530/stat : 31530 (java) S 31514 31514 30638 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 159513676 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31531] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31531/stat : 31531 (java) S 31514 31514 30638 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 159513676 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31532] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31532/stat : 31532 (java) S 31514 31514 30638 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 159513680 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31533] ppid=31514 vsize=861064 CPUtime=0.24
/proc/31528/task/31533/stat : 31533 (java) R 31514 31514 30638 0 -1 64 983 0 0 0 24 0 0 0 21 0 8 0 159513680 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4152982233 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31534] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31534/stat : 31534 (java) S 31514 31514 30638 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 159513681 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31535] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31535/stat : 31535 (java) S 31514 31514 30638 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 159513681 881729536 19437 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 908624

[startup+2.98916 s]
/proc/loadavg: 2.01 2.01 1.91 3/103 31535
/proc/meminfo: memFree=1003552/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=0.01
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31528] ppid=31514 vsize=861064 CPUtime=2.9
/proc/31528/stat : 31528 (java) R 31514 31514 30638 0 -1 0 21664 0 1 0 277 13 0 0 25 0 8 0 159513672 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4074049911 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/31528/statm: 215266 21415 1995 14 0 201471 0
[pid=31528/tid=31529] ppid=31514 vsize=861064 CPUtime=0.07
/proc/31528/task/31529/stat : 31529 (java) S 31514 31514 30638 0 -1 64 5718 0 0 0 5 2 0 0 16 0 8 0 159513676 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31530] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31530/stat : 31530 (java) S 31514 31514 30638 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 159513676 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31531] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31531/stat : 31531 (java) S 31514 31514 30638 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 159513676 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31532] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31532/stat : 31532 (java) S 31514 31514 30638 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 159513680 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31533] ppid=31514 vsize=861064 CPUtime=0.31
/proc/31528/task/31533/stat : 31533 (java) S 31514 31514 30638 0 -1 64 1024 0 0 0 30 1 0 0 16 0 8 0 159513680 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31534] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31534/stat : 31534 (java) S 31514 31514 30638 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 159513681 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31528/tid=31535] ppid=31514 vsize=861064 CPUtime=0
/proc/31528/task/31535/stat : 31535 (java) S 31514 31514 30638 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 159513681 881729536 21415 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.91
Current children cumulated vsize (KiB) 908624

[startup+6.19752 s]
/proc/loadavg: 2.01 2.01 1.91 3/96 31536
/proc/meminfo: memFree=1070424/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=12240 CPUtime=2.74
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 2907 0 0 0 273 1 0 0 25 0 1 0 159514011 12533760 2889 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529453 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 3060 2889 54 142 0 2916 0
Current children cumulated CPU time (s) 6.06
Current children cumulated vsize (KiB) 59800

[startup+12.6873 s]
/proc/loadavg: 2.01 2.01 1.91 3/96 31536
/proc/meminfo: memFree=1040088/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=19940 CPUtime=9.16
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 4854 0 0 0 913 3 0 0 25 0 1 0 159514011 20418560 4836 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 4985 4836 54 142 0 4841 0
Current children cumulated CPU time (s) 12.48
Current children cumulated vsize (KiB) 67500

[startup+25.5777 s]
/proc/loadavg: 2.01 2.01 1.91 3/96 31536
/proc/meminfo: memFree=1031000/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=29212 CPUtime=21.94
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 7156 0 0 0 2189 5 0 0 25 0 1 0 159514011 29913088 7138 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 7303 7138 54 142 0 7159 0
Current children cumulated CPU time (s) 25.26
Current children cumulated vsize (KiB) 76772

[startup+51.2486 s]
/proc/loadavg: 2.00 2.00 1.91 3/96 31536
/proc/meminfo: memFree=1017560/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=42276 CPUtime=47.37
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 10436 0 0 0 4727 10 0 0 25 0 1 0 159514011 43290624 10418 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 10569 10418 54 142 0 10425 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 89836

[startup+102.488 s]
/proc/loadavg: 2.05 2.02 1.92 3/96 31536
/proc/meminfo: memFree=1003096/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=56860 CPUtime=98.15
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 14070 0 0 0 9801 14 0 0 25 0 1 0 159514011 58224640 14052 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 14215 14052 54 142 0 14071 0
Current children cumulated CPU time (s) 101.47
Current children cumulated vsize (KiB) 104420

[startup+162.585 s]
/proc/loadavg: 2.01 2.01 1.92 3/96 31536
/proc/meminfo: memFree=990424/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=69640 CPUtime=157.7
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 17191 0 0 0 15752 18 0 0 25 0 1 0 159514011 71311360 17173 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 17410 17173 54 142 0 17266 0
Current children cumulated CPU time (s) 161.02
Current children cumulated vsize (KiB) 117200

[startup+222.686 s]
/proc/loadavg: 2.05 2.02 1.93 3/96 31536
/proc/meminfo: memFree=990424/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=69640 CPUtime=217.25
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 17197 0 0 0 21707 18 0 0 25 0 1 0 159514011 71311360 17179 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 17410 17179 54 142 0 17266 0
Current children cumulated CPU time (s) 220.57
Current children cumulated vsize (KiB) 117200

[startup+282.786 s]
/proc/loadavg: 2.15 2.05 1.94 3/96 31536
/proc/meminfo: memFree=990360/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=69640 CPUtime=276.8
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 17216 0 0 0 27662 18 0 0 25 0 1 0 159514011 71311360 17198 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 17410 17198 54 142 0 17266 0
Current children cumulated CPU time (s) 280.12
Current children cumulated vsize (KiB) 117200

[startup+342.786 s]
/proc/loadavg: 2.05 2.04 1.94 3/96 31536
/proc/meminfo: memFree=969112/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=70104 CPUtime=336.25
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 17295 0 0 0 33607 18 0 0 25 0 1 0 159514011 71786496 17277 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 17526 17277 54 142 0 17382 0
Current children cumulated CPU time (s) 339.57
Current children cumulated vsize (KiB) 117664

[startup+402.883 s]
/proc/loadavg: 2.02 2.03 1.94 3/96 31536
/proc/meminfo: memFree=963864/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0

################
# More data... #
################

/proc/loadavg: 2.00 2.00 1.94 3/96 31536
/proc/meminfo: memFree=913176/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=108604 CPUtime=1110.75
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 26516 0 0 0 111043 32 0 0 25 0 1 0 159514011 111210496 26498 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 27151 26498 54 142 0 27007 0
Current children cumulated CPU time (s) 1114.07
Current children cumulated vsize (KiB) 156164

[startup+1184.03 s]
/proc/loadavg: 2.03 2.01 1.94 3/96 31536
/proc/meminfo: memFree=912920/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=108848 CPUtime=1170.54
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 26590 0 0 0 117022 32 0 0 25 0 1 0 159514011 111460352 26572 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 27212 26572 54 142 0 27068 0
Current children cumulated CPU time (s) 1173.86
Current children cumulated vsize (KiB) 156408

[startup+1244.1 s]
/proc/loadavg: 2.01 2.01 1.94 3/96 31536
/proc/meminfo: memFree=911704/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=110460 CPUtime=1230.34
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 26908 0 0 0 123001 33 0 0 25 0 1 0 159514011 113111040 26890 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 27615 26890 54 142 0 27471 0
Current children cumulated CPU time (s) 1233.66
Current children cumulated vsize (KiB) 158020

[startup+1304.18 s]
/proc/loadavg: 2.00 2.00 1.94 3/96 31536
/proc/meminfo: memFree=911192/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=110780 CPUtime=1290.14
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 27022 0 0 0 128981 33 0 0 25 0 1 0 159514011 113438720 27004 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 27695 27004 54 142 0 27551 0
Current children cumulated CPU time (s) 1293.46
Current children cumulated vsize (KiB) 158340

[startup+1364.26 s]
/proc/loadavg: 2.00 2.00 1.94 3/96 31536
/proc/meminfo: memFree=882584/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=115620 CPUtime=1349.92
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 28194 0 0 0 134958 34 0 0 25 0 1 0 159514011 118394880 28176 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 28905 28176 54 142 0 28761 0
Current children cumulated CPU time (s) 1353.24
Current children cumulated vsize (KiB) 163180

[startup+1424.33 s]
/proc/loadavg: 2.11 2.03 1.95 3/96 31536
/proc/meminfo: memFree=882520/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=115620 CPUtime=1409.72
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 28194 0 0 0 140937 35 0 0 25 0 1 0 159514011 118394880 28176 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 28905 28176 54 142 0 28761 0
Current children cumulated CPU time (s) 1413.04
Current children cumulated vsize (KiB) 163180

[startup+1484.4 s]
/proc/loadavg: 2.04 2.02 1.95 3/96 31536
/proc/meminfo: memFree=882456/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=115620 CPUtime=1469.51
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 28194 0 0 0 146916 35 0 0 25 0 1 0 159514011 118394880 28176 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 28905 28176 54 142 0 28761 0
Current children cumulated CPU time (s) 1472.83
Current children cumulated vsize (KiB) 163180

[startup+1544.47 s]
/proc/loadavg: 2.01 2.02 1.95 3/96 31536
/proc/meminfo: memFree=882392/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=115620 CPUtime=1529.3
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 28200 0 0 0 152895 35 0 0 25 0 1 0 159514011 118394880 28182 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 28905 28182 54 142 0 28761 0
Current children cumulated CPU time (s) 1532.62
Current children cumulated vsize (KiB) 163180

[startup+1604.54 s]
/proc/loadavg: 2.00 2.01 1.95 3/96 31536
/proc/meminfo: memFree=882264/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=115784 CPUtime=1589.09
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 28237 0 0 0 158874 35 0 0 25 0 1 0 159514011 118562816 28219 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 28946 28219 54 142 0 28802 0
Current children cumulated CPU time (s) 1592.41
Current children cumulated vsize (KiB) 163344

[startup+1664.62 s]
/proc/loadavg: 2.00 2.01 1.95 3/96 31536
/proc/meminfo: memFree=875224/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=122788 CPUtime=1648.88
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 29995 0 0 0 164851 37 0 0 25 0 1 0 159514011 125734912 29977 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 30697 29977 54 142 0 30553 0
Current children cumulated CPU time (s) 1652.2
Current children cumulated vsize (KiB) 170348

[startup+1724.68 s]
/proc/loadavg: 2.00 2.00 1.95 3/89 31624
/proc/meminfo: memFree=1031248/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=124960 CPUtime=1708.68
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 30516 0 0 0 170829 39 0 0 25 0 1 0 159514011 127959040 30498 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 31240 30498 54 142 0 31096 0
Current children cumulated CPU time (s) 1712
Current children cumulated vsize (KiB) 172520

[startup+1784.78 s]
/proc/loadavg: 2.00 2.00 1.95 3/89 31624
/proc/meminfo: memFree=1031248/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=124960 CPUtime=1768.76
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 30517 0 0 0 176837 39 0 0 25 0 1 0 159514011 127959040 30499 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 31240 30499 54 142 0 31096 0
Current children cumulated CPU time (s) 1772.08
Current children cumulated vsize (KiB) 172520



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1812.72 s]
/proc/loadavg: 2.00 2.00 1.95 3/89 31624
/proc/meminfo: memFree=1031248/2055920 swapFree=4192812/4192956
[pid=31514] ppid=31512 vsize=47560 CPUtime=3.32
/proc/31514/stat : 31514 (galac.sh) S 31512 31514 30638 0 -1 4194304 800 23380 0 1 0 0 316 16 17 0 1 0 159513668 48701440 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31514/statm: 11890 363 245 79 0 218 0
[pid=31536] ppid=31514 vsize=124960 CPUtime=1796.7
/proc/31536/stat : 31536 (minisat) R 31514 31514 30638 0 -1 4194304 30519 0 0 0 179631 39 0 0 25 0 1 0 159514011 127959040 30501 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/31536/statm: 31240 30501 54 142 0 31096 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 172520

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 31514 and gives childrusage.ru_utime.tv_sec=3 childrusage.ru_utime.tv_usec=173517 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=173973
CPU time returned by wait4() is 3.34749
while last known CPU time is 1800.02

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1812.74
CPU time (s): 1800.02
CPU user time (s): 1799.47
CPU system time (s): 0.55
CPU usage (%): 99.2985
Max. virtual memory (cumulated for all children) (KiB): 908624

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.17352
system time used= 0.173973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24180
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 954
involuntary context switches= 1056

runsolver used 2.34064 s user time and 5.64314 s system time

The end

Launcher Data (download as text)

Begin job on node5 on Tue Jan  9 02:16:32 UTC 2007


IDJOB= 229683
IDBENCH= 6349
FILE ID= node5/229683-1168308992

PBS_JOBID= 3502320

Free space on /tmp= 66351 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-50-23-fcd/rand-2-50-23-587-230-fcd-25_ext.xml
COMMAND LINE= /tmp/evaluation/229683-1168308992/galac.sh /tmp/evaluation/229683-1168308992/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node5/watcher-229683-1168308992 -o ROOT/results/node5/solver-229683-1168308992 -C 1800 -M 900  /tmp/evaluation/229683-1168308992/galac.sh /tmp/evaluation/229683-1168308992/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  f7bc68ca25c5cfa4d7c359c11a8a7969

RANDOM SEED= 40560871

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1083008 kB
Buffers:         80604 kB
Cached:         701396 kB
SwapCached:          0 kB
Active:         428112 kB
Inactive:       478384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1083008 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3244 kB
Writeback:           0 kB
Mapped:         152400 kB
Slab:            51048 kB
Committed_AS:  5132648 kB
PageTables:       2416 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66353 MiB



End job on node5 on Tue Jan  9 02:46:45 UTC 2007