Trace number 207994

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.07 1800.8

General information on the benchmark

Namerandom/rand-2-26/
rand-26-26-325-155-60021_ext.xml
MD5SUM80893c07fc9c8f130d0db081ff853b98
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark318.1
SatisfiableNO
(Un)Satisfiability was provedNO
Number of variables26
Number of constraints325
Maximum constraint arity2
Maximum domain size26
Number of constraints which are defined in extension325
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
1.06	c start processing
1.06	c start relation processing
1.08	c start cnf exporting
2.53	c parsing time : 0.831
2.53	c preprocessing time : 2.295
2.53	
2.53	c Nary constraints - conflicts : 0 supports : 0
2.53	c Binary constraints - conflicts : 325 supports :0
2.53	c max arity constraint : 2
2.53	c Max Tuples generated 0
2.53	c relations : 325
2.53	c relations BDD: 0
2.53	c vars : 677 - clauses :  58851
2.53	
2.59	 
2.59	c --- Minisat Stats ---
2.59	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node52/watcher-207994-1168184017 -o ROOT/results/node52/solver-207994-1168184017 -C 1800 -M 900 /tmp/evaluation/207994-1168184017/galac.sh /tmp/evaluation/207994-1168184017/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.65 1.97 1.97 2/65 27332
/proc/meminfo: memFree=1818448/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=8652 CPUtime=0
/proc/27331/stat : 27331 (galac.sh) R 27329 27331 26360 0 -1 4194304 335 0 0 0 0 0 0 0 17 0 1 0 166800223 8859648 279 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653754527 0 65538 4096 73728 0 0 0 17 1 0 0
/proc/27331/statm: 2163 279 207 79 0 156 0
[pid=27333] ppid=27331 vsize=8688 CPUtime=0
/proc/27333/stat : 27333 (galac.sh) R 27331 27331 26360 0 -1 4194368 27 0 0 0 0 0 0 0 17 0 1 0 166800223 8896512 286 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653754527 0 65536 4096 73728 0 0 0 17 1 0 0
/proc/27333/statm: 2172 286 209 79 0 165 0
[pid=27334] ppid=27333 vsize=8728 CPUtime=0
/proc/27334/stat : 27334 (galac.sh) R 27333 27331 26360 0 -1 4194368 25 0 0 0 0 0 0 0 17 0 1 0 166800223 8937472 290 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 4425384 0 0 3674112 73728 0 0 0 17 1 0 0
/proc/27334/statm: 2182 290 209 79 0 175 0

[startup+0.102797 s]
/proc/loadavg: 1.65 1.97 1.97 2/65 27332
/proc/meminfo: memFree=1818448/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=0.01
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 761 1704 0 0 0 0 0 1 18 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47556

[startup+0.510814 s]
/proc/loadavg: 1.65 1.97 1.97 2/65 27332
/proc/meminfo: memFree=1818448/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=0.01
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 761 1704 0 0 0 0 0 1 18 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47556

[startup+1.33087 s]
/proc/loadavg: 1.60 1.96 1.96 2/73 27352
/proc/meminfo: memFree=1747856/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=0.01
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 761 1704 0 0 0 0 0 1 18 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27345] ppid=27331 vsize=861076 CPUtime=1.19
/proc/27345/stat : 27345 (java) R 27331 27331 26360 0 -1 0 19693 0 1 0 111 8 0 0 17 0 8 0 166800226 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4074014411 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27345/statm: 215269 19447 1988 14 0 201474 0
[pid=27345/tid=27346] ppid=27331 vsize=861076 CPUtime=0.02
/proc/27345/task/27346/stat : 27346 (java) S 27331 27331 26360 0 -1 64 3785 0 0 0 1 1 0 0 16 0 8 0 166800237 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27345/tid=27347] ppid=27331 vsize=861076 CPUtime=0
/proc/27345/task/27347/stat : 27347 (java) S 27331 27331 26360 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 166800238 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27345/tid=27348] ppid=27331 vsize=861076 CPUtime=0
/proc/27345/task/27348/stat : 27348 (java) S 27331 27331 26360 0 -1 64 4 0 0 0 0 0 0 0 21 0 8 0 166800238 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27345/tid=27349] ppid=27331 vsize=861076 CPUtime=0
/proc/27345/task/27349/stat : 27349 (java) S 27331 27331 26360 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 166800241 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27345/tid=27350] ppid=27331 vsize=861076 CPUtime=0.26
/proc/27345/task/27350/stat : 27350 (java) S 27331 27331 26360 0 -1 64 1010 0 0 0 26 0 0 0 16 0 8 0 166800241 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27345/tid=27351] ppid=27331 vsize=861076 CPUtime=0
/proc/27345/task/27351/stat : 27351 (java) S 27331 27331 26360 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 166800241 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27345/tid=27352] ppid=27331 vsize=861076 CPUtime=0
/proc/27345/task/27352/stat : 27352 (java) S 27331 27331 26360 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166800241 881741824 19447 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 908632

[startup+2.96698 s]
/proc/loadavg: 1.60 1.96 1.96 2/73 27352
/proc/meminfo: memFree=1740368/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
Current children cumulated CPU time (s) 2.43
Current children cumulated vsize (KiB) 47556

[startup+6.2432 s]
/proc/loadavg: 1.60 1.96 1.96 2/66 27353
/proc/meminfo: memFree=1807560/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=10980 CPUtime=3.63
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 2580 0 0 0 362 1 0 0 25 0 1 0 166800482 11243520 2562 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529453 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 2745 2562 54 142 0 2601 0
Current children cumulated CPU time (s) 6.06
Current children cumulated vsize (KiB) 58536

[startup+12.7036 s]
/proc/loadavg: 1.51 1.93 1.95 2/66 27353
/proc/meminfo: memFree=1801872/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=16272 CPUtime=10.08
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 3888 0 0 0 1006 2 0 0 25 0 1 0 166800482 16662528 3870 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529435 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 4068 3870 54 142 0 3924 0
Current children cumulated CPU time (s) 12.51
Current children cumulated vsize (KiB) 63828

[startup+25.5145 s]
/proc/loadavg: 1.43 1.89 1.94 2/66 27353
/proc/meminfo: memFree=1795792/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=22588 CPUtime=22.9
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 5445 0 0 0 2286 4 0 0 25 0 1 0 166800482 23130112 5427 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529368 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 5647 5427 54 142 0 5503 0
Current children cumulated CPU time (s) 25.33
Current children cumulated vsize (KiB) 70144

[startup+51.1342 s]
/proc/loadavg: 1.26 1.81 1.91 2/66 27353
/proc/meminfo: memFree=1786832/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=31544 CPUtime=48.51
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 7664 0 0 0 4845 6 0 0 25 0 1 0 166800482 32301056 7646 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 7886 7646 54 142 0 7742 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 79100

[startup+102.37 s]
/proc/loadavg: 1.11 1.68 1.86 2/66 27353
/proc/meminfo: memFree=1775056/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=43500 CPUtime=99.73
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 10622 0 0 0 9964 9 0 0 25 0 1 0 166800482 44544000 10604 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 10875 10604 54 142 0 10731 0
Current children cumulated CPU time (s) 102.16
Current children cumulated vsize (KiB) 91056

[startup+162.424 s]
/proc/loadavg: 1.04 1.55 1.80 2/66 27353
/proc/meminfo: memFree=1771280/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=47076 CPUtime=159.77
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 11524 0 0 0 15968 9 0 0 25 0 1 0 166800482 48205824 11506 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 11769 11506 54 142 0 11625 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 94632

[startup+222.475 s]
/proc/loadavg: 1.07 1.47 1.76 2/66 27353
/proc/meminfo: memFree=1770960/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=47480 CPUtime=219.81
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 11610 0 0 0 21971 10 0 0 25 0 1 0 166800482 48619520 11592 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 11870 11592 54 142 0 11726 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 95036

[startup+282.527 s]
/proc/loadavg: 1.02 1.38 1.70 2/66 27353
/proc/meminfo: memFree=1761424/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=56904 CPUtime=279.84
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 14001 0 0 0 27972 12 0 0 25 0 1 0 166800482 58269696 13983 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134715850 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 14226 13983 54 142 0 14082 0
Current children cumulated CPU time (s) 282.27
Current children cumulated vsize (KiB) 104460

[startup+342.575 s]
/proc/loadavg: 1.01 1.31 1.66 2/66 27353
/proc/meminfo: memFree=1760528/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=57696 CPUtime=339.88
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 14197 0 0 0 33976 12 0 0 25 0 1 0 166800482 59080704 14179 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 14424 14179 54 142 0 14280 0
Current children cumulated CPU time (s) 342.31
Current children cumulated vsize (KiB) 105252

[startup+402.625 s]
/proc/loadavg: 1.00 1.25 1.61 2/66 27353
/proc/meminfo: memFree=1760272/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=58008 CPUtime=399.91
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 14252 0 0 0 39979 12 0 0 25 0 1 0 166800482 59400192 14234 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 14502 14234 54 142 0 14358 0
Current children cumulated CPU time (s) 402.34
Current children cumulated vsize (KiB) 105564

[startup+462.673 s]
/proc/loadavg: 1.00 1.20 1.57 2/66 27353
/proc/meminfo: memFree=1753232/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0

################
# More data... #
################

/proc/loadavg: 1.00 1.01 1.26 2/66 27353
/proc/meminfo: memFree=1731408/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87248 CPUtime=1120.32
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21381 0 0 0 112012 20 0 0 25 0 1 0 166800482 89341952 21363 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529446 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21812 21363 54 142 0 21668 0
Current children cumulated CPU time (s) 1122.75
Current children cumulated vsize (KiB) 134804

[startup+1183.26 s]
/proc/loadavg: 1.00 1.00 1.24 2/66 27353
/proc/meminfo: memFree=1731472/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87248 CPUtime=1180.36
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21382 0 0 0 118016 20 0 0 25 0 1 0 166800482 89341952 21364 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529767 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21812 21364 54 142 0 21668 0
Current children cumulated CPU time (s) 1182.79
Current children cumulated vsize (KiB) 134804

[startup+1243.31 s]
/proc/loadavg: 1.00 1.00 1.22 2/66 27353
/proc/meminfo: memFree=1731408/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87248 CPUtime=1240.4
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21382 0 0 0 124020 20 0 0 25 0 1 0 166800482 89341952 21364 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529506 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21812 21364 54 142 0 21668 0
Current children cumulated CPU time (s) 1242.83
Current children cumulated vsize (KiB) 134804

[startup+1303.33 s]
/proc/loadavg: 1.00 1.00 1.21 2/66 27353
/proc/meminfo: memFree=1731024/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87644 CPUtime=1300.39
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21474 0 0 0 130019 20 0 0 25 0 1 0 166800482 89747456 21456 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21911 21456 54 142 0 21767 0
Current children cumulated CPU time (s) 1302.82
Current children cumulated vsize (KiB) 135200

[startup+1363.38 s]
/proc/loadavg: 1.00 1.00 1.19 2/66 27353
/proc/meminfo: memFree=1730960/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87644 CPUtime=1360.43
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21474 0 0 0 136023 20 0 0 25 0 1 0 166800482 89747456 21456 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21911 21456 54 142 0 21767 0
Current children cumulated CPU time (s) 1362.86
Current children cumulated vsize (KiB) 135200

[startup+1423.43 s]
/proc/loadavg: 1.00 1.00 1.17 2/66 27353
/proc/meminfo: memFree=1731024/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87644 CPUtime=1420.46
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21475 0 0 0 142026 20 0 0 25 0 1 0 166800482 89747456 21457 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529435 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21911 21457 54 142 0 21767 0
Current children cumulated CPU time (s) 1422.89
Current children cumulated vsize (KiB) 135200

[startup+1483.48 s]
/proc/loadavg: 1.00 1.00 1.16 2/66 27353
/proc/meminfo: memFree=1730704/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=87920 CPUtime=1480.51
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21534 0 0 0 148030 21 0 0 25 0 1 0 166800482 90030080 21516 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 21980 21516 54 142 0 21836 0
Current children cumulated CPU time (s) 1482.94
Current children cumulated vsize (KiB) 135476

[startup+1543.53 s]
/proc/loadavg: 1.00 1.00 1.15 2/66 27353
/proc/meminfo: memFree=1730640/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=88060 CPUtime=1540.55
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 21552 0 0 0 154034 21 0 0 25 0 1 0 166800482 90173440 21534 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 22015 21534 54 142 0 21871 0
Current children cumulated CPU time (s) 1542.98
Current children cumulated vsize (KiB) 135616

[startup+1603.58 s]
/proc/loadavg: 1.00 1.00 1.14 2/66 27353
/proc/meminfo: memFree=1728016/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=90616 CPUtime=1600.58
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 22202 0 0 0 160036 22 0 0 25 0 1 0 166800482 92790784 22184 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 22654 22184 54 142 0 22510 0
Current children cumulated CPU time (s) 1603.01
Current children cumulated vsize (KiB) 138172

[startup+1663.64 s]
/proc/loadavg: 1.00 1.00 1.13 2/72 27437
/proc/meminfo: memFree=1721432/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=96296 CPUtime=1660.58
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 23572 0 0 0 166035 23 0 0 25 0 1 0 166800482 98607104 23554 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 24074 23554 54 142 0 23930 0
Current children cumulated CPU time (s) 1663.01
Current children cumulated vsize (KiB) 143852

[startup+1723.72 s]
/proc/loadavg: 1.00 1.00 1.12 2/72 27523
/proc/meminfo: memFree=1715808/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=101848 CPUtime=1720.6
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 24943 0 0 0 172035 25 0 0 25 0 1 0 166800482 104292352 24925 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 25462 24925 54 142 0 25318 0
Current children cumulated CPU time (s) 1723.03
Current children cumulated vsize (KiB) 149404

[startup+1783.78 s]
/proc/loadavg: 1.00 1.00 1.10 2/66 27551
/proc/meminfo: memFree=1716304/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=102244 CPUtime=1780.63
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 25052 0 0 0 178038 25 0 0 25 0 1 0 166800482 104697856 25034 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 25561 25034 54 142 0 25417 0
Current children cumulated CPU time (s) 1783.06
Current children cumulated vsize (KiB) 149800



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.79 s]
/proc/loadavg: 1.00 1.00 1.10 2/66 27551
/proc/meminfo: memFree=1716304/2055920 swapFree=4192812/4192956
[pid=27331] ppid=27329 vsize=47556 CPUtime=2.43
/proc/27331/stat : 27331 (galac.sh) S 27329 27331 26360 0 -1 4194304 799 23082 0 1 0 0 231 12 17 0 1 0 166800223 48697344 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 273653361498 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/27331/statm: 11889 363 245 79 0 218 0
[pid=27353] ppid=27331 vsize=102392 CPUtime=1797.64
/proc/27353/stat : 27353 (minisat) R 27331 27331 26360 0 -1 4194304 25066 0 0 0 179739 25 0 0 25 0 1 0 166800482 104849408 25048 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/27353/statm: 25598 25048 54 142 0 25454 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 149948

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 27331 and gives childrusage.ru_utime.tv_sec=2 childrusage.ru_utime.tv_usec=315647 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=126980
CPU time returned by wait4() is 2.44263
while last known CPU time is 1800.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1800.8
CPU time (s): 1800.07
CPU user time (s): 1799.7
CPU system time (s): 0.37
CPU usage (%): 99.9594
Max. virtual memory (cumulated for all children) (KiB): 908632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.31565
system time used= 0.12698
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23881
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 859
involuntary context switches= 111

runsolver used 1.34979 s user time and 3.62045 s system time

The end

Launcher Data (download as text)

Begin job on node52 on Sun Jan  7 15:33:37 UTC 2007


IDJOB= 207994
IDBENCH= 4348
FILE ID= node52/207994-1168184017

PBS_JOBID= 3479149

Free space on /tmp= 66550 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-26/rand-26-26-325-155-60021_ext.xml
COMMAND LINE= /tmp/evaluation/207994-1168184017/galac.sh /tmp/evaluation/207994-1168184017/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node52/watcher-207994-1168184017 -o ROOT/results/node52/solver-207994-1168184017 -C 1800 -M 900  /tmp/evaluation/207994-1168184017/galac.sh /tmp/evaluation/207994-1168184017/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  80893c07fc9c8f130d0db081ff853b98

RANDOM SEED= 534596771

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1818936 kB
Buffers:         15476 kB
Cached:         154320 kB
SwapCached:          0 kB
Active:         108364 kB
Inactive:        77108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1818936 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3316 kB
Writeback:           0 kB
Mapped:          25824 kB
Slab:            37492 kB
Committed_AS:  3567416 kB
PageTables:       1484 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66550 MiB



End job on node52 on Sun Jan  7 16:03:39 UTC 2007