Trace number 195121

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.06 1802.3

General information on the benchmark

Namerandom/rand-2-50-23/
rand-2-50-23-587-230-21_ext.xml
MD5SUMec3a38c5bcff9670d4ef63107bc6cb5e
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1298.57
SatisfiableYES
(Un)Satisfiability was proved
Number of variables50
Number of constraints477
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension477
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
1.23	c start processing
1.23	c start relation processing
1.25	c start cnf exporting
3.36	c parsing time : 1.058
3.36	c preprocessing time : 3.19
3.36	
3.36	c Nary constraints - conflicts : 0 supports : 0
3.36	c Binary constraints - conflicts : 462 supports :15
3.36	c max arity constraint : 2
3.36	c Max Tuples generated 0
3.36	c relations : 477
3.36	c relations BDD: 0
3.36	c vars : 1151 - clauses :  76472
3.36	
3.42	 
3.42	c --- Minisat Stats ---
3.42	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node15/watcher-195121-1168110978 -o ROOT/results/node15/solver-195121-1168110978 -C 1800 -M 900 /tmp/evaluation/195121-1168110978/galac.sh /tmp/evaluation/195121-1168110978/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.00 2.00 2.00 5/88 27987
/proc/meminfo: memFree=1662128/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=18540 CPUtime=0
/proc/27986/stat : 27986 (runsolver) R 27984 27986 27578 0 -1 4194368 16 0 0 0 0 0 0 0 20 0 1 0 159492680 18984960 279 18446744073709551615 4194304 4267372 548682069072 18446744073709551615 240472616231 0 0 4096 24578 0 0 0 17 1 0 0
/proc/27986/statm: 4635 279 244 17 0 2626 0

[startup+0.108992 s]
/proc/loadavg: 2.00 2.00 2.00 5/88 27987
/proc/meminfo: memFree=1662128/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=0.01
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 763 1704 0 0 0 0 0 1 23 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47560

[startup+0.519065 s]
/proc/loadavg: 2.00 2.00 2.00 5/88 27987
/proc/meminfo: memFree=1662128/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=0.01
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 763 1704 0 0 0 0 0 1 23 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47560

[startup+1.3412 s]
/proc/loadavg: 2.00 2.00 2.00 4/96 28007
/proc/meminfo: memFree=1591664/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=0.01
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 763 1704 0 0 0 0 0 1 23 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28000] ppid=27986 vsize=860856 CPUtime=1.28
/proc/28000/stat : 28000 (java) R 27986 27986 27578 0 -1 0 19696 0 1 0 114 14 0 0 18 0 8 0 159492684 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4074043387 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28000/statm: 215214 19450 1994 14 0 201471 0
[pid=28000/tid=28001] ppid=27986 vsize=860856 CPUtime=0.03
/proc/28000/task/28001/stat : 28001 (java) S 27986 27986 27578 0 -1 64 3785 0 0 0 2 1 0 0 16 0 8 0 159492688 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28002] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28002/stat : 28002 (java) S 27986 27986 27578 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 159492688 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28003] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28003/stat : 28003 (java) S 27986 27986 27578 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 159492688 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28004] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28004/stat : 28004 (java) S 27986 27986 27578 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 159492692 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28005] ppid=27986 vsize=860856 CPUtime=0.26
/proc/28000/task/28005/stat : 28005 (java) R 27986 27986 27578 0 -1 64 993 0 0 0 25 1 0 0 21 0 8 0 159492692 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28006] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28006/stat : 28006 (java) S 27986 27986 27578 0 -1 64 2 0 0 0 0 0 0 0 19 0 8 0 159492692 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28007] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28007/stat : 28007 (java) S 27986 27986 27578 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 159492692 881516544 19450 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 908416

[startup+2.9865 s]
/proc/loadavg: 2.00 2.00 2.00 4/96 28007
/proc/meminfo: memFree=1582960/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=0.01
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 763 1704 0 0 0 0 0 1 23 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28000] ppid=27986 vsize=860856 CPUtime=2.92
/proc/28000/stat : 28000 (java) R 27986 27986 27578 0 -1 0 21666 0 1 0 275 17 0 0 25 0 8 0 159492684 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4073663415 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28000/statm: 215214 21417 1997 14 0 201471 0
[pid=28000/tid=28001] ppid=27986 vsize=860856 CPUtime=0.07
/proc/28000/task/28001/stat : 28001 (java) S 27986 27986 27578 0 -1 64 5718 0 0 0 5 2 0 0 16 0 8 0 159492688 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28002] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28002/stat : 28002 (java) S 27986 27986 27578 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 159492688 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28003] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28003/stat : 28003 (java) S 27986 27986 27578 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 159492688 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28004] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28004/stat : 28004 (java) S 27986 27986 27578 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 159492692 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28005] ppid=27986 vsize=860856 CPUtime=0.3
/proc/28000/task/28005/stat : 28005 (java) S 27986 27986 27578 0 -1 64 1023 0 0 0 29 1 0 0 16 0 8 0 159492692 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28006] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28006/stat : 28006 (java) S 27986 27986 27578 0 -1 64 2 0 0 0 0 0 0 0 19 0 8 0 159492692 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28000/tid=28007] ppid=27986 vsize=860856 CPUtime=0
/proc/28000/task/28007/stat : 28007 (java) S 27986 27986 27578 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 159492692 881516544 21417 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 908416

[startup+6.27906 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 28008
/proc/meminfo: memFree=1650280/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=11356 CPUtime=2.83
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 2716 0 0 0 283 0 0 0 25 0 1 0 159493022 11628544 2698 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/28008/statm: 2839 2698 54 142 0 2695 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 58916

[startup+12.7482 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 28008
/proc/meminfo: memFree=1642920/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=17872 CPUtime=9.27
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 4352 0 0 0 925 2 0 0 25 0 1 0 159493022 18300928 4334 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/28008/statm: 4468 4334 54 142 0 4324 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 65432

[startup+25.5944 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 28008
/proc/meminfo: memFree=1636712/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=23476 CPUtime=22.06
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 5732 0 0 0 2202 4 0 0 25 0 1 0 159493022 24039424 5714 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/28008/statm: 5869 5714 54 142 0 5725 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 71036

[startup+51.2628 s]
/proc/loadavg: 1.94 1.98 1.99 3/88 28072
/proc/meminfo: memFree=1677936/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=32108 CPUtime=47.68
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 7876 0 0 0 4760 8 0 0 25 0 1 0 159493022 32878592 7858 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529318 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 8027 7858 54 142 0 7883 0
Current children cumulated CPU time (s) 51
Current children cumulated vsize (KiB) 79668

[startup+102.507 s]
/proc/loadavg: 2.04 2.00 2.00 3/88 28072
/proc/meminfo: memFree=1664240/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=46064 CPUtime=98.87
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 11336 0 0 0 9875 12 0 0 25 0 1 0 159493022 47169536 11318 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 11516 11318 54 142 0 11372 0
Current children cumulated CPU time (s) 102.19
Current children cumulated vsize (KiB) 93624

[startup+162.583 s]
/proc/loadavg: 2.01 2.00 2.00 3/88 28074
/proc/meminfo: memFree=1653104/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=57264 CPUtime=158.86
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 14079 0 0 0 15870 16 0 0 25 0 1 0 159493022 58638336 14061 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 14316 14061 54 142 0 14172 0
Current children cumulated CPU time (s) 162.18
Current children cumulated vsize (KiB) 104824

[startup+222.656 s]
/proc/loadavg: 2.03 2.01 2.00 3/88 28074
/proc/meminfo: memFree=1646384/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=64004 CPUtime=218.88
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 15716 0 0 0 21870 18 0 0 25 0 1 0 159493022 65540096 15698 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 16001 15698 54 142 0 15857 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 111564

[startup+282.731 s]
/proc/loadavg: 2.01 2.01 2.00 3/88 28074
/proc/meminfo: memFree=1645552/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=65036 CPUtime=278.89
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 15934 0 0 0 27871 18 0 0 25 0 1 0 159493022 66596864 15916 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 16259 15916 54 142 0 16115 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 112596

[startup+342.809 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 28074
/proc/meminfo: memFree=1645104/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=65428 CPUtime=338.88
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 16039 0 0 0 33870 18 0 0 25 0 1 0 159493022 66998272 16021 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 16357 16021 54 142 0 16213 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 112988

[startup+402.886 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 28074
/proc/meminfo: memFree=1641648/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0

################
# More data... #
################

/proc/loadavg: 2.04 2.02 2.00 3/89 28075
/proc/meminfo: memFree=1594344/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=117292 CPUtime=1118.97
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 28589 0 0 0 111865 32 0 0 25 0 1 0 159493022 120107008 28563 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 29323 28563 54 142 0 29179 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 164852

[startup+1183.83 s]
/proc/loadavg: 2.01 2.02 2.00 3/89 28075
/proc/meminfo: memFree=1591528/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=119968 CPUtime=1178.99
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29254 0 0 0 117866 33 0 0 25 0 1 0 159493022 122847232 29228 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134533571 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 29992 29228 54 142 0 29848 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 167528

[startup+1243.9 s]
/proc/loadavg: 2.00 2.01 2.00 3/89 28075
/proc/meminfo: memFree=1591464/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=119968 CPUtime=1238.97
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29257 0 0 0 123864 33 0 0 25 0 1 0 159493022 122847232 29231 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 29992 29231 54 142 0 29848 0
Current children cumulated CPU time (s) 1242.29
Current children cumulated vsize (KiB) 167528

[startup+1303.97 s]
/proc/loadavg: 2.00 2.01 2.00 3/89 28075
/proc/meminfo: memFree=1590632/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=120960 CPUtime=1299
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29460 0 0 0 129866 34 0 0 25 0 1 0 159493022 123863040 29434 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 30240 29434 54 142 0 30096 0
Current children cumulated CPU time (s) 1302.32
Current children cumulated vsize (KiB) 168520

[startup+1364.05 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 28075
/proc/meminfo: memFree=1590248/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=121384 CPUtime=1359.01
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29561 0 0 0 135867 34 0 0 25 0 1 0 159493022 124297216 29535 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529340 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 30346 29535 54 142 0 30202 0
Current children cumulated CPU time (s) 1362.33
Current children cumulated vsize (KiB) 168944

[startup+1424.13 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 28076
/proc/meminfo: memFree=1589600/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=122192 CPUtime=1419
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29732 0 0 0 141866 34 0 0 25 0 1 0 159493022 125124608 29706 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 30548 29706 54 142 0 30404 0
Current children cumulated CPU time (s) 1422.32
Current children cumulated vsize (KiB) 169752

[startup+1484.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 28076
/proc/meminfo: memFree=1588896/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=122872 CPUtime=1479
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29877 0 0 0 147865 35 0 0 25 0 1 0 159493022 125820928 29843 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529304 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 30718 29843 54 142 0 30574 0
Current children cumulated CPU time (s) 1482.32
Current children cumulated vsize (KiB) 170432

[startup+1544.28 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 28076
/proc/meminfo: memFree=1588576/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=123244 CPUtime=1539.02
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 29938 0 0 0 153867 35 0 0 25 0 1 0 159493022 126201856 29904 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 30811 29904 54 142 0 30667 0
Current children cumulated CPU time (s) 1542.34
Current children cumulated vsize (KiB) 170804

[startup+1604.35 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 28076
/proc/meminfo: memFree=1581536/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=130528 CPUtime=1599.01
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 31725 0 0 0 159864 37 0 0 25 0 1 0 159493022 133660672 31691 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529364 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 32632 31691 54 142 0 32488 0
Current children cumulated CPU time (s) 1602.33
Current children cumulated vsize (KiB) 178088

[startup+1664.41 s]
/proc/loadavg: 2.06 2.02 2.00 3/90 28076
/proc/meminfo: memFree=1578272/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=133760 CPUtime=1659.01
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 32507 0 0 0 165863 38 0 0 25 0 1 0 159493022 136970240 32473 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529327 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 33440 32473 54 142 0 33296 0
Current children cumulated CPU time (s) 1662.33
Current children cumulated vsize (KiB) 181320

[startup+1724.49 s]
/proc/loadavg: 2.02 2.01 2.00 3/90 28076
/proc/meminfo: memFree=1578272/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=133760 CPUtime=1719.03
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 32508 0 0 0 171865 38 0 0 25 0 1 0 159493022 136970240 32474 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 33440 32474 54 142 0 33296 0
Current children cumulated CPU time (s) 1722.35
Current children cumulated vsize (KiB) 181320

[startup+1784.51 s]
/proc/loadavg: 2.01 2.00 2.00 3/90 28076
/proc/meminfo: memFree=1577760/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=134352 CPUtime=1778.97
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 32623 0 0 0 177859 38 0 0 25 0 1 0 159493022 137576448 32589 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 33588 32589 54 142 0 33444 0
Current children cumulated CPU time (s) 1782.29
Current children cumulated vsize (KiB) 181912



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1802.29 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 28076
/proc/meminfo: memFree=1577696/2055920 swapFree=4174172/4192956
[pid=27986] ppid=27984 vsize=47560 CPUtime=3.32
/proc/27986/stat : 27986 (galac.sh) S 27984 27986 27578 0 -1 4194304 801 23378 0 1 0 0 313 19 17 0 1 0 159492680 48701440 365 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 240472222554 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27986/statm: 11890 365 247 79 0 218 0
[pid=28008] ppid=27986 vsize=134352 CPUtime=1796.74
/proc/28008/stat : 28008 (minisat) R 27986 27986 27578 0 -1 4194304 32638 0 0 0 179635 39 0 0 25 0 1 0 159493022 137576448 32604 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529340 0 0 4096 3 0 0 0 17 0 0 0
/proc/28008/statm: 33588 32604 54 142 0 33444 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 181912

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 27986 and gives childrusage.ru_utime.tv_sec=3 childrusage.ru_utime.tv_usec=136523 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=206968
CPU time returned by wait4() is 3.34349
while last known CPU time is 1800.06

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1802.3
CPU time (s): 1800.06
CPU user time (s): 1799.48
CPU system time (s): 0.58
CPU usage (%): 99.8758
Max. virtual memory (cumulated for all children) (KiB): 908416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.13652
system time used= 0.206968
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24179
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 947
involuntary context switches= 904

runsolver used 2.08468 s user time and 5.9041 s system time

The end

Launcher Data (download as text)

Begin job on node15 on Sat Jan  6 19:16:18 UTC 2007


IDJOB= 195121
IDBENCH= 3250
FILE ID= node15/195121-1168110978

PBS_JOBID= 3477086

Free space on /tmp= 66271 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-50-23/rand-2-50-23-587-230-21_ext.xml
COMMAND LINE= /tmp/evaluation/195121-1168110978/galac.sh /tmp/evaluation/195121-1168110978/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node15/watcher-195121-1168110978 -o ROOT/results/node15/solver-195121-1168110978 -C 1800 -M 900  /tmp/evaluation/195121-1168110978/galac.sh /tmp/evaluation/195121-1168110978/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  ec3a38c5bcff9670d4ef63107bc6cb5e

RANDOM SEED= 768264894

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.276
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.276
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1662608 kB
Buffers:         28832 kB
Cached:         217524 kB
SwapCached:       6400 kB
Active:         189756 kB
Inactive:       151952 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1662608 kB
SwapTotal:     4192956 kB
SwapFree:      4174172 kB
Dirty:            3260 kB
Writeback:           0 kB
Mapped:         105516 kB
Slab:            36168 kB
Committed_AS:  4420340 kB
PageTables:       2516 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66281 MiB



End job on node15 on Sat Jan  6 19:46:23 UTC 2007