Trace number 221890

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.01 1808.16

General information on the benchmark

Namerandom/rand-2-24/
rand-24-24-276-139-52021_ext.xml
MD5SUM71cffa533269446990ab132413efce2d
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark55.4766
SatisfiableNO
(Un)Satisfiability was provedNO
Number of variables24
Number of constraints276
Maximum constraint arity2
Maximum domain size24
Number of constraints which are defined in extension276
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.05	c --- Preproc Stats ---
0.95	c start processing
0.95	c start relation processing
0.96	c start cnf exporting
2.10	c parsing time : 0.771
2.10	c preprocessing time : 1.923
2.10	
2.10	c Nary constraints - conflicts : 0 supports : 0
2.10	c Binary constraints - conflicts : 276 supports :0
2.10	c max arity constraint : 2
2.10	c Max Tuples generated 0
2.10	c relations : 276
2.10	c relations BDD: 0
2.10	c vars : 577 - clauses :  45012
2.10	
2.12	 
2.12	c --- Minisat Stats ---
2.12	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node40/watcher-221890-1168263233 -o ROOT/results/node40/solver-221890-1168263233 -C 1800 -M 900 /tmp/evaluation/221890-1168263233/galac.sh /tmp/evaluation/221890-1168263233/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 0.92 1.10 1.50 6/73 22368
/proc/meminfo: memFree=1605040/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=18540 CPUtime=0
/proc/22367/stat : 22367 (runsolver) R 22362 22367 22240 0 -1 4194368 16 0 0 0 0 0 0 0 18 0 1 0 174722692 18984960 279 18446744073709551615 4194304 4267372 548682069088 18446744073709551615 264519609639 0 0 4096 24578 0 0 0 17 1 0 0
/proc/22367/statm: 4635 279 244 17 0 2626 0

[startup+0.107374 s]
/proc/loadavg: 0.92 1.10 1.50 6/73 22368
/proc/meminfo: memFree=1605040/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=0
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 762 1704 0 0 0 0 0 0 19 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 47564

[startup+0.515426 s]
/proc/loadavg: 0.92 1.10 1.50 6/73 22368
/proc/meminfo: memFree=1605040/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=0
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 762 1704 0 0 0 0 0 0 19 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 47564

[startup+1.33653 s]
/proc/loadavg: 0.92 1.10 1.50 3/81 22388
/proc/meminfo: memFree=1532064/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=0
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 762 1704 0 0 0 0 0 0 19 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22381] ppid=22367 vsize=861064 CPUtime=1.25
/proc/22381/stat : 22381 (java) R 22367 22367 22240 0 -1 0 19695 0 1 0 115 10 0 0 25 0 8 0 174722697 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4074023695 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22381/statm: 215266 19449 1988 14 0 201471 0
[pid=22381/tid=22382] ppid=22367 vsize=861064 CPUtime=0.03
/proc/22381/task/22382/stat : 22382 (java) S 22367 22367 22240 0 -1 64 3784 0 0 0 2 1 0 0 16 0 8 0 174722701 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22381/tid=22383] ppid=22367 vsize=861064 CPUtime=0
/proc/22381/task/22383/stat : 22383 (java) S 22367 22367 22240 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 174722701 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22381/tid=22384] ppid=22367 vsize=861064 CPUtime=0
/proc/22381/task/22384/stat : 22384 (java) S 22367 22367 22240 0 -1 64 4 0 0 0 0 0 0 0 23 0 8 0 174722701 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22381/tid=22385] ppid=22367 vsize=861064 CPUtime=0
/proc/22381/task/22385/stat : 22385 (java) S 22367 22367 22240 0 -1 64 2 0 0 0 0 0 0 0 24 0 8 0 174722704 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22381/tid=22386] ppid=22367 vsize=861064 CPUtime=0.26
/proc/22381/task/22386/stat : 22386 (java) S 22367 22367 22240 0 -1 64 1013 0 0 0 25 1 0 0 16 0 8 0 174722704 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22381/tid=22387] ppid=22367 vsize=861064 CPUtime=0
/proc/22381/task/22387/stat : 22387 (java) S 22367 22367 22240 0 -1 64 0 0 0 0 0 0 0 0 25 0 8 0 174722704 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22381/tid=22388] ppid=22367 vsize=861064 CPUtime=0
/proc/22381/task/22388/stat : 22388 (java) S 22367 22367 22240 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 174722704 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 908628

[startup+2.97374 s]
/proc/loadavg: 0.92 1.10 1.50 3/74 22389
/proc/meminfo: memFree=1598552/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=6180 CPUtime=0.84
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 1309 0 0 0 84 0 0 0 24 0 1 0 174722904 6328320 1291 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134715850 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 1545 1291 54 142 0 1401 0
Current children cumulated CPU time (s) 2.88
Current children cumulated vsize (KiB) 53744

[startup+6.25816 s]
/proc/loadavg: 1.01 1.12 1.50 3/74 22389
/proc/meminfo: memFree=1592344/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=10932 CPUtime=4.12
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 2485 0 0 0 411 1 0 0 25 0 1 0 174722904 11194368 2467 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 2733 2467 54 142 0 2589 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 58496

[startup+12.715 s]
/proc/loadavg: 1.09 1.13 1.50 3/74 22389
/proc/meminfo: memFree=1587360/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=15596 CPUtime=10.58
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 3655 0 0 0 1055 3 0 0 25 0 1 0 174722904 15970304 3637 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 3899 3637 54 142 0 3755 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 63160

[startup+25.5367 s]
/proc/loadavg: 1.29 1.18 1.51 3/74 22389
/proc/meminfo: memFree=1582560/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=20656 CPUtime=23.39
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 4919 0 0 0 2335 4 0 0 25 0 1 0 174722904 21151744 4901 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 5164 4901 54 142 0 5020 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 68220

[startup+51.172 s]
/proc/loadavg: 1.61 1.26 1.53 3/74 22389
/proc/meminfo: memFree=1574752/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=28456 CPUtime=49.03
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 6868 0 0 0 4897 6 0 0 25 0 1 0 174722904 29138944 6850 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529464 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 7114 6850 54 142 0 6970 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 76020

[startup+102.444 s]
/proc/loadavg: 1.83 1.37 1.55 3/74 22616
/proc/meminfo: memFree=1570832/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=30032 CPUtime=100.08
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 7232 0 0 0 10001 7 0 0 25 0 1 0 174722904 30752768 7214 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 7508 7214 54 142 0 7364 0
Current children cumulated CPU time (s) 102.12
Current children cumulated vsize (KiB) 77596

[startup+162.534 s]
/proc/loadavg: 1.93 1.48 1.57 3/74 22616
/proc/meminfo: memFree=1566608/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=34492 CPUtime=159.92
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 8292 0 0 0 15984 8 0 0 25 0 1 0 174722904 35319808 8274 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 8623 8274 54 142 0 8479 0
Current children cumulated CPU time (s) 161.96
Current children cumulated vsize (KiB) 82056

[startup+222.62 s]
/proc/loadavg: 1.97 1.57 1.60 3/74 22616
/proc/meminfo: memFree=1557008/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=44184 CPUtime=219.75
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 10708 0 0 0 21964 11 0 0 25 0 1 0 174722904 45244416 10690 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 11046 10690 54 142 0 10902 0
Current children cumulated CPU time (s) 221.79
Current children cumulated vsize (KiB) 91748

[startup+282.706 s]
/proc/loadavg: 1.99 1.65 1.62 3/74 22616
/proc/meminfo: memFree=1554640/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=46932 CPUtime=279.58
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 11289 0 0 0 27947 11 0 0 25 0 1 0 174722904 48058368 11271 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/22389/statm: 11733 11271 54 142 0 11589 0
Current children cumulated CPU time (s) 281.62
Current children cumulated vsize (KiB) 94496

[startup+342.806 s]
/proc/loadavg: 1.99 1.71 1.64 3/74 22653
/proc/meminfo: memFree=1540368/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=48728 CPUtime=339.41
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 11777 0 0 0 33929 12 0 0 25 0 1 0 174722904 49897472 11759 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 12182 11759 54 142 0 12038 0
Current children cumulated CPU time (s) 341.45
Current children cumulated vsize (KiB) 96292

[startup+402.855 s]
/proc/loadavg: 1.99 1.76 1.66 3/74 22653
/proc/meminfo: memFree=1539856/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=49640 CPUtime=399.2
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 11975 0 0 0 39907 13 0 0 25 0 1 0 174722904 50831360 11957 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 12410 11957 54 142 0 12266 0
Current children cumulated CPU time (s) 401.24
Current children cumulated vsize (KiB) 97204

[startup+462.9 s]
/proc/loadavg: 1.99 1.80 1.68 3/74 22653
/proc/meminfo: memFree=1539408/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=50120 CPUtime=458.97
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 12070 0 0 0 45884 13 0 0 25 0 1 0 174722904 51322880 12052 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 0 0 0

################
# More data... #
################

/proc/loadavg: 2.00 1.97 1.82 3/74 22653
/proc/meminfo: memFree=1532240/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=57588 CPUtime=1116.51
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 13816 0 0 0 111636 15 0 0 25 0 1 0 174722904 58970112 13798 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529456 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 14397 13798 54 142 0 14253 0
Current children cumulated CPU time (s) 1118.55
Current children cumulated vsize (KiB) 105152

[startup+1183.48 s]
/proc/loadavg: 2.00 1.97 1.83 3/74 22653
/proc/meminfo: memFree=1531408/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=58512 CPUtime=1176.28
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 14052 0 0 0 117612 16 0 0 25 0 1 0 174722904 59916288 14034 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 14628 14034 54 142 0 14484 0
Current children cumulated CPU time (s) 1178.32
Current children cumulated vsize (KiB) 106076

[startup+1243.53 s]
/proc/loadavg: 2.00 1.97 1.83 3/74 22653
/proc/meminfo: memFree=1528720/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=61016 CPUtime=1236.07
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 14694 0 0 0 123590 17 0 0 25 0 1 0 174722904 62480384 14676 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 15254 14676 54 142 0 15110 0
Current children cumulated CPU time (s) 1238.11
Current children cumulated vsize (KiB) 108580

[startup+1303.58 s]
/proc/loadavg: 2.00 1.97 1.84 3/74 22653
/proc/meminfo: memFree=1527376/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=62556 CPUtime=1295.84
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 15032 0 0 0 129567 17 0 0 25 0 1 0 174722904 64057344 15014 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 15639 15014 54 142 0 15495 0
Current children cumulated CPU time (s) 1297.88
Current children cumulated vsize (KiB) 110120

[startup+1363.63 s]
/proc/loadavg: 2.00 1.97 1.85 3/74 22653
/proc/meminfo: memFree=1526928/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=63124 CPUtime=1355.61
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 15142 0 0 0 135544 17 0 0 25 0 1 0 174722904 64638976 15124 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 15781 15124 54 142 0 15637 0
Current children cumulated CPU time (s) 1357.65
Current children cumulated vsize (KiB) 110688

[startup+1423.69 s]
/proc/loadavg: 2.07 1.99 1.86 3/74 22653
/proc/meminfo: memFree=1525264/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=64720 CPUtime=1415.4
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 15557 0 0 0 141522 18 0 0 25 0 1 0 174722904 66273280 15539 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 16180 15539 54 142 0 16036 0
Current children cumulated CPU time (s) 1417.44
Current children cumulated vsize (KiB) 112284

[startup+1483.73 s]
/proc/loadavg: 2.02 1.99 1.86 3/74 22653
/proc/meminfo: memFree=1521232/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=68728 CPUtime=1475.18
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 16563 0 0 0 147498 20 0 0 25 0 1 0 174722904 70377472 16545 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 17182 16545 54 142 0 17038 0
Current children cumulated CPU time (s) 1477.22
Current children cumulated vsize (KiB) 116292

[startup+1543.78 s]
/proc/loadavg: 2.01 1.99 1.87 4/74 22653
/proc/meminfo: memFree=1521168/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=68728 CPUtime=1534.95
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 16564 0 0 0 153475 20 0 0 25 0 1 0 174722904 70377472 16546 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529492 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 17182 16546 54 142 0 17038 0
Current children cumulated CPU time (s) 1536.99
Current children cumulated vsize (KiB) 116292

[startup+1603.83 s]
/proc/loadavg: 2.07 2.00 1.88 3/74 22653
/proc/meminfo: memFree=1520208/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=69932 CPUtime=1594.74
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 16851 0 0 0 159454 20 0 0 25 0 1 0 174722904 71610368 16833 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 17483 16833 54 142 0 17339 0
Current children cumulated CPU time (s) 1596.78
Current children cumulated vsize (KiB) 117496

[startup+1663.9 s]
/proc/loadavg: 2.02 2.00 1.89 3/80 22777
/proc/meminfo: memFree=1512856/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=75608 CPUtime=1654.48
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 18269 0 0 0 165414 34 0 0 25 0 1 0 174722904 77422592 18251 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 18902 18251 54 142 0 18758 0
Current children cumulated CPU time (s) 1656.52
Current children cumulated vsize (KiB) 123172

[startup+1723.98 s]
/proc/loadavg: 2.01 2.00 1.89 3/74 22851
/proc/meminfo: memFree=1513608/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=75808 CPUtime=1714.18
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 18315 0 0 0 171375 43 0 0 25 0 1 0 174722904 77627392 18297 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529506 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 18952 18297 54 142 0 18808 0
Current children cumulated CPU time (s) 1716.22
Current children cumulated vsize (KiB) 123372

[startup+1784.03 s]
/proc/loadavg: 2.00 2.00 1.90 3/74 22851
/proc/meminfo: memFree=1513488/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=75976 CPUtime=1773.97
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 18360 0 0 0 177354 43 0 0 25 0 1 0 174722904 77799424 18342 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 18994 18342 54 142 0 18850 0
Current children cumulated CPU time (s) 1776.01
Current children cumulated vsize (KiB) 123540



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.15 s]
/proc/loadavg: 2.00 2.00 1.90 3/74 22851
/proc/meminfo: memFree=1513232/2055920 swapFree=4192812/4192956
[pid=22367] ppid=22362 vsize=47564 CPUtime=2.04
/proc/22367/stat : 22367 (galac.sh) S 22362 22367 22240 0 -1 4194304 800 22912 0 1 0 0 191 13 17 0 1 0 174722692 48705536 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 264519215962 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/22367/statm: 11891 363 245 79 0 218 0
[pid=22389] ppid=22367 vsize=76332 CPUtime=1797.97
/proc/22389/stat : 22389 (minisat) R 22367 22367 22240 0 -1 4194304 18424 0 0 0 179754 43 0 0 25 0 1 0 174722904 78163968 18406 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/22389/statm: 19083 18406 54 142 0 18939 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 123896

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 22367 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=922707 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=139978
CPU time returned by wait4() is 2.06269
while last known CPU time is 1800.01

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1808.16
CPU time (s): 1800.01
CPU user time (s): 1799.45
CPU system time (s): 0.56
CPU usage (%): 99.5493
Max. virtual memory (cumulated for all children) (KiB): 908628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.92271
system time used= 0.139978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23712
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1142
involuntary context switches= 1109

runsolver used 1.71574 s user time and 4.78327 s system time

The end

Launcher Data (download as text)

Begin job on node40 on Mon Jan  8 13:33:54 UTC 2007


IDJOB= 221890
IDBENCH= 5471
FILE ID= node40/221890-1168263233

PBS_JOBID= 3482662

Free space on /tmp= 66551 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-24/rand-24-24-276-139-52021_ext.xml
COMMAND LINE= /tmp/evaluation/221890-1168263233/galac.sh /tmp/evaluation/221890-1168263233/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node40/watcher-221890-1168263233 -o ROOT/results/node40/solver-221890-1168263233 -C 1800 -M 900  /tmp/evaluation/221890-1168263233/galac.sh /tmp/evaluation/221890-1168263233/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  71cffa533269446990ab132413efce2d

RANDOM SEED= 877554826

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.239
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.239
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1605800 kB
Buffers:         43732 kB
Cached:         312112 kB
SwapCached:          0 kB
Active:         136856 kB
Inactive:       239356 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1605800 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            3656 kB
Writeback:           0 kB
Mapped:          31028 kB
Slab:            59576 kB
Committed_AS:  3773748 kB
PageTables:       1704 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66551 MiB



End job on node40 on Mon Jan  8 14:04:09 UTC 2007