Trace number 229664

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.05 1813.74

General information on the benchmark

Namerandom/rand-2-50-23-fcd/
rand-2-50-23-587-230-fcd-15_ext.xml
MD5SUM5cc12fe96e96e3e2b22efc716ea94d96
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark468.835
SatisfiableYES
(Un)Satisfiability was proved
Number of variables50
Number of constraints469
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension469
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.09	c --- Preproc Stats ---
1.29	c start processing
1.29	c start relation processing
1.32	c start cnf exporting
3.45	c parsing time : 1.06
3.45	c preprocessing time : 3.224
3.45	
3.45	c Nary constraints - conflicts : 0 supports : 0
3.45	c Binary constraints - conflicts : 457 supports :12
3.45	c max arity constraint : 2
3.45	c Max Tuples generated 0
3.45	c relations : 469
3.45	c relations BDD: 0
3.45	c vars : 1151 - clauses :  77039
3.45	
3.47	 
3.47	c --- Minisat Stats ---
3.47	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node9/watcher-229664-1168307975 -o ROOT/results/node9/solver-229664-1168307975 -C 1800 -M 900 /tmp/evaluation/229664-1168307975/galac.sh /tmp/evaluation/229664-1168307975/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.00 2.00 1.88 5/98 26944
/proc/meminfo: memFree=1448336/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=18540 CPUtime=0
/proc/26943/stat : 26943 (runsolver) R 26941 26943 26501 0 -1 4194368 16 0 0 0 0 0 0 0 20 0 1 0 179192619 18984960 279 18446744073709551615 4194304 4267372 548682069072 18446744073709551615 215418989863 0 0 4096 24578 0 0 0 17 1 0 0
/proc/26943/statm: 4635 279 244 17 0 2626 0

[startup+0.111057 s]
/proc/loadavg: 2.00 2.00 1.88 5/98 26944
/proc/meminfo: memFree=1448336/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=0.01
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 761 1704 0 0 0 1 0 0 19 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+0.519072 s]
/proc/loadavg: 2.00 2.00 1.88 5/98 26944
/proc/meminfo: memFree=1448336/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=0.01
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 761 1704 0 0 0 1 0 0 19 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+1.34017 s]
/proc/loadavg: 2.00 2.00 1.88 4/106 26964
/proc/meminfo: memFree=1377872/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=0.01
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 761 1704 0 0 0 1 0 0 19 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26957] ppid=26943 vsize=861064 CPUtime=1.21
/proc/26957/stat : 26957 (java) R 26943 26943 26501 0 -1 0 19671 0 1 0 111 10 0 0 18 0 8 0 179192629 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4072929937 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26957/statm: 215266 19425 1992 14 0 201471 0
[pid=26957/tid=26958] ppid=26943 vsize=861064 CPUtime=0.03
/proc/26957/task/26958/stat : 26958 (java) S 26943 26943 26501 0 -1 64 3784 0 0 0 2 1 0 0 16 0 8 0 179192633 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26959] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26959/stat : 26959 (java) S 26943 26943 26501 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 179192633 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26960] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26960/stat : 26960 (java) S 26943 26943 26501 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 179192633 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26961] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26961/stat : 26961 (java) S 26943 26943 26501 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 179192637 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26962] ppid=26943 vsize=861064 CPUtime=0.23
/proc/26957/task/26962/stat : 26962 (java) R 26943 26943 26501 0 -1 64 972 0 0 0 22 1 0 0 21 0 8 0 179192637 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26963] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26963/stat : 26963 (java) S 26943 26943 26501 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 179192637 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26964] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26964/stat : 26964 (java) S 26943 26943 26501 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 179192637 881729536 19425 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 908640

[startup+2.97736 s]
/proc/loadavg: 2.08 2.02 1.89 3/106 26964
/proc/meminfo: memFree=1369360/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=0.01
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 761 1704 0 0 0 1 0 0 19 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26957] ppid=26943 vsize=861064 CPUtime=2.83
/proc/26957/stat : 26957 (java) R 26943 26943 26501 0 -1 0 21659 0 1 0 271 12 0 0 25 0 8 0 179192629 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4073514688 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26957/statm: 215266 21410 1995 14 0 201471 0
[pid=26957/tid=26958] ppid=26943 vsize=861064 CPUtime=0.07
/proc/26957/task/26958/stat : 26958 (java) S 26943 26943 26501 0 -1 64 5713 0 0 0 5 2 0 0 16 0 8 0 179192633 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26959] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26959/stat : 26959 (java) S 26943 26943 26501 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 179192633 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26960] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26960/stat : 26960 (java) S 26943 26943 26501 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 179192633 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26961] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26961/stat : 26961 (java) S 26943 26943 26501 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 179192637 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26962] ppid=26943 vsize=861064 CPUtime=0.31
/proc/26957/task/26962/stat : 26962 (java) S 26943 26943 26501 0 -1 64 1023 0 0 0 30 1 0 0 16 0 8 0 179192637 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26963] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26963/stat : 26963 (java) S 26943 26943 26501 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 179192637 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26957/tid=26964] ppid=26943 vsize=861064 CPUtime=0
/proc/26957/task/26964/stat : 26964 (java) S 26943 26943 26501 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 179192637 881729536 21410 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 908640

[startup+6.25873 s]
/proc/loadavg: 2.08 2.02 1.89 3/99 26965
/proc/meminfo: memFree=1436936/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=11248 CPUtime=2.74
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 2688 0 0 0 274 0 0 0 25 0 1 0 179192967 11517952 2670 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529658 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 2812 2670 54 142 0 2668 0
Current children cumulated CPU time (s) 6.09
Current children cumulated vsize (KiB) 58824

[startup+12.7365 s]
/proc/loadavg: 2.07 2.02 1.89 3/99 26965
/proc/meminfo: memFree=1429832/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=17756 CPUtime=9.17
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 4311 0 0 0 915 2 0 0 25 0 1 0 179192967 18182144 4293 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 4439 4293 54 142 0 4295 0
Current children cumulated CPU time (s) 12.52
Current children cumulated vsize (KiB) 65332

[startup+25.6029 s]
/proc/loadavg: 2.06 2.01 1.89 3/99 26965
/proc/meminfo: memFree=1423112/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=24684 CPUtime=21.91
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 6035 0 0 0 2186 5 0 0 25 0 1 0 179192967 25276416 6017 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 6171 6017 54 142 0 6027 0
Current children cumulated CPU time (s) 25.26
Current children cumulated vsize (KiB) 72260

[startup+51.2928 s]
/proc/loadavg: 2.04 2.01 1.89 3/99 26965
/proc/meminfo: memFree=1412808/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=34884 CPUtime=47.36
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 8562 0 0 0 4728 8 0 0 25 0 1 0 179192967 35721216 8544 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529388 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 8721 8544 54 142 0 8577 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 82460

[startup+102.567 s]
/proc/loadavg: 2.01 2.01 1.90 3/105 27047
/proc/meminfo: memFree=1398760/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=47932 CPUtime=98.08
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 11800 0 0 0 9796 12 0 0 25 0 1 0 179192967 49082368 11782 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529611 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 11983 11782 54 142 0 11839 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 95508

[startup+162.636 s]
/proc/loadavg: 2.00 2.00 1.91 4/105 27133
/proc/meminfo: memFree=1383424/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=63280 CPUtime=157.45
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 15613 0 0 0 15728 17 0 0 25 0 1 0 179192967 64798720 15595 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 15820 15595 54 142 0 15676 0
Current children cumulated CPU time (s) 160.8
Current children cumulated vsize (KiB) 110856

[startup+222.736 s]
/proc/loadavg: 2.00 2.00 1.91 3/99 27162
/proc/meminfo: memFree=1383240/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=64228 CPUtime=216.94
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 15851 0 0 0 21676 18 0 0 25 0 1 0 179192967 65769472 15833 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529506 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 16057 15833 54 142 0 15913 0
Current children cumulated CPU time (s) 220.29
Current children cumulated vsize (KiB) 111804

[startup+282.798 s]
/proc/loadavg: 2.06 2.01 1.91 3/99 27162
/proc/meminfo: memFree=1383240/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=64228 CPUtime=276.42
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 15854 0 0 0 27624 18 0 0 25 0 1 0 179192967 65769472 15836 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 16057 15836 54 142 0 15913 0
Current children cumulated CPU time (s) 279.77
Current children cumulated vsize (KiB) 111804

[startup+342.881 s]
/proc/loadavg: 2.09 2.03 1.92 3/99 27162
/proc/meminfo: memFree=1382152/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=65416 CPUtime=335.94
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 16156 0 0 0 33575 19 0 0 25 0 1 0 179192967 66985984 16138 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529506 0 0 4096 3 0 0 0 17 1 0 0
/proc/26965/statm: 16354 16138 54 142 0 16210 0
Current children cumulated CPU time (s) 339.29
Current children cumulated vsize (KiB) 112992

[startup+402.957 s]
/proc/loadavg: 2.03 2.02 1.92 3/99 27162
/proc/meminfo: memFree=1373448/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0

################
# More data... #
################

/proc/loadavg: 1.99 2.00 1.94 4/95 27235
/proc/meminfo: memFree=1506656/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=106056 CPUtime=1112.91
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 26046 0 0 0 111258 33 0 0 25 0 1 0 179192967 108601344 26028 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 26514 26028 54 142 0 26370 0
Current children cumulated CPU time (s) 1116.26
Current children cumulated vsize (KiB) 153632

[startup+1183.7 s]
/proc/loadavg: 2.11 2.03 1.95 3/95 27235
/proc/meminfo: memFree=1496992/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=115660 CPUtime=1172.43
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28463 0 0 0 117207 36 0 0 25 0 1 0 179192967 118435840 28445 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134522150 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 28915 28445 54 142 0 28771 0
Current children cumulated CPU time (s) 1175.78
Current children cumulated vsize (KiB) 163236

[startup+1243.78 s]
/proc/loadavg: 2.09 2.04 1.95 3/95 27237
/proc/meminfo: memFree=1496800/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=115660 CPUtime=1231.98
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28464 0 0 0 123161 37 0 0 25 0 1 0 179192967 118435840 28446 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 28915 28446 54 142 0 28771 0
Current children cumulated CPU time (s) 1235.33
Current children cumulated vsize (KiB) 163236

[startup+1303.83 s]
/proc/loadavg: 2.03 2.03 1.95 3/95 27237
/proc/meminfo: memFree=1496736/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=115660 CPUtime=1291.47
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28466 0 0 0 129110 37 0 0 25 0 1 0 179192967 118435840 28448 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 28915 28448 54 142 0 28771 0
Current children cumulated CPU time (s) 1294.82
Current children cumulated vsize (KiB) 163236

[startup+1363.9 s]
/proc/loadavg: 2.01 2.02 1.95 3/95 27237
/proc/meminfo: memFree=1496672/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=115660 CPUtime=1351
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28468 0 0 0 135063 37 0 0 25 0 1 0 179192967 118435840 28450 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 28915 28450 54 142 0 28771 0
Current children cumulated CPU time (s) 1354.35
Current children cumulated vsize (KiB) 163236

[startup+1423.99 s]
/proc/loadavg: 2.00 2.02 1.95 3/95 27237
/proc/meminfo: memFree=1496608/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=116052 CPUtime=1410.54
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28536 0 0 0 141017 37 0 0 25 0 1 0 179192967 118837248 28518 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 29013 28518 54 142 0 28869 0
Current children cumulated CPU time (s) 1413.89
Current children cumulated vsize (KiB) 163628

[startup+1484.05 s]
/proc/loadavg: 2.00 2.01 1.95 3/95 27237
/proc/meminfo: memFree=1496416/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=116052 CPUtime=1470.03
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28567 0 0 0 146966 37 0 0 25 0 1 0 179192967 118837248 28549 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 29013 28549 54 142 0 28869 0
Current children cumulated CPU time (s) 1473.38
Current children cumulated vsize (KiB) 163628

[startup+1544.13 s]
/proc/loadavg: 2.00 2.00 1.95 3/95 27237
/proc/meminfo: memFree=1495904/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=116692 CPUtime=1529.58
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28696 0 0 0 152920 38 0 0 25 0 1 0 179192967 119492608 28678 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 29173 28678 54 142 0 29029 0
Current children cumulated CPU time (s) 1532.93
Current children cumulated vsize (KiB) 164268

[startup+1604.15 s]
/proc/loadavg: 2.00 2.00 1.95 3/95 27237
/proc/meminfo: memFree=1495328/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=117400 CPUtime=1589.04
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 28838 0 0 0 158866 38 0 0 25 0 1 0 179192967 120217600 28820 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 29350 28820 54 142 0 29206 0
Current children cumulated CPU time (s) 1592.39
Current children cumulated vsize (KiB) 164976

[startup+1664.22 s]
/proc/loadavg: 2.00 2.00 1.95 3/95 27237
/proc/meminfo: memFree=1491040/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=121524 CPUtime=1648.55
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 29886 0 0 0 164816 39 0 0 25 0 1 0 179192967 124440576 29868 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 30381 29868 54 142 0 30237 0
Current children cumulated CPU time (s) 1651.9
Current children cumulated vsize (KiB) 169100

[startup+1724.29 s]
/proc/loadavg: 2.00 2.00 1.95 3/95 27237
/proc/meminfo: memFree=1490976/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=121524 CPUtime=1708.08
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 29888 0 0 0 170769 39 0 0 25 0 1 0 179192967 124440576 29870 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 30381 29870 54 142 0 30237 0
Current children cumulated CPU time (s) 1711.43
Current children cumulated vsize (KiB) 169100

[startup+1784.34 s]
/proc/loadavg: 2.08 2.02 1.96 3/95 27237
/proc/meminfo: memFree=1490912/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=121740 CPUtime=1767.59
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 29913 0 0 0 176720 39 0 0 25 0 1 0 179192967 124661760 29895 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 30435 29895 54 142 0 30291 0
Current children cumulated CPU time (s) 1770.94
Current children cumulated vsize (KiB) 169316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1813.72 s]
/proc/loadavg: 2.05 2.01 1.96 3/95 27237
/proc/meminfo: memFree=1490848/2055920 swapFree=4191880/4192956
[pid=26943] ppid=26941 vsize=47576 CPUtime=3.35
/proc/26943/stat : 26943 (galac.sh) S 26941 26943 26501 0 -1 4194304 799 23371 0 1 0 1 319 15 17 0 1 0 179192619 48717824 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26943/statm: 11894 363 245 79 0 218 0
[pid=26965] ppid=26943 vsize=121740 CPUtime=1796.7
/proc/26965/stat : 26965 (minisat) R 26943 26943 26501 0 -1 4194304 29915 0 0 0 179631 39 0 0 25 0 1 0 179192967 124661760 29897 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/26965/statm: 30435 29897 54 142 0 30291 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 169316

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 26943 and gives childrusage.ru_utime.tv_sec=3 childrusage.ru_utime.tv_usec=193514 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=163975
CPU time returned by wait4() is 3.35749
while last known CPU time is 1800.05

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1813.74
CPU time (s): 1800.05
CPU user time (s): 1799.5
CPU system time (s): 0.55
CPU usage (%): 99.2451
Max. virtual memory (cumulated for all children) (KiB): 908640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.19351
system time used= 0.163975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24170
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 947
involuntary context switches= 992

runsolver used 1.81872 s user time and 5.40818 s system time

The end

Launcher Data (download as text)

Begin job on node9 on Tue Jan  9 01:59:35 UTC 2007


IDJOB= 229664
IDBENCH= 6344
FILE ID= node9/229664-1168307975

PBS_JOBID= 3502302

Free space on /tmp= 66543 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-50-23-fcd/rand-2-50-23-587-230-fcd-15_ext.xml
COMMAND LINE= /tmp/evaluation/229664-1168307975/galac.sh /tmp/evaluation/229664-1168307975/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node9/watcher-229664-1168307975 -o ROOT/results/node9/solver-229664-1168307975 -C 1800 -M 900  /tmp/evaluation/229664-1168307975/galac.sh /tmp/evaluation/229664-1168307975/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  5cc12fe96e96e3e2b22efc716ea94d96

RANDOM SEED= 184152751

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1448752 kB
Buffers:         43420 kB
Cached:         287748 kB
SwapCached:        264 kB
Active:         368824 kB
Inactive:       185160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1448752 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:            3232 kB
Writeback:           0 kB
Mapped:         244452 kB
Slab:            37528 kB
Committed_AS:  5949180 kB
PageTables:       2676 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66544 MiB



End job on node9 on Tue Jan  9 02:29:49 UTC 2007