Trace number 229816

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.09 1807.56

General information on the benchmark

Namerandom/rand-2-50-23-fcd/
rand-2-50-23-587-230-fcd-37_ext.xml
MD5SUM2eeb2adecc305b0db93e86ea3cbf860e
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark477.599
SatisfiableYES
(Un)Satisfiability was proved
Number of variables50
Number of constraints485
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension485
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
1.24	c start processing
1.24	c start relation processing
1.27	c start cnf exporting
3.40	c parsing time : 1.071
3.40	c preprocessing time : 3.237
3.40	
3.40	c Nary constraints - conflicts : 0 supports : 0
3.40	c Binary constraints - conflicts : 475 supports :10
3.40	c max arity constraint : 2
3.40	c Max Tuples generated 0
3.40	c relations : 485
3.41	c relations BDD: 0
3.41	c vars : 1151 - clauses :  78110
3.41	
3.46	 
3.46	c --- Minisat Stats ---
3.46

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node50/watcher-229816-1168311327 -o ROOT/results/node50/solver-229816-1168311327 -C 1800 -M 900 /tmp/evaluation/229816-1168311327/galac.sh /tmp/evaluation/229816-1168311327/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.00 1.97 1.91 3/75 28054
/proc/meminfo: memFree=1483104/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=8652 CPUtime=0
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 347 0 0 0 0 0 0 0 16 0 1 0 179531248 8859648 280 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/28053/statm: 2163 280 208 79 0 156 0
[pid=28055] ppid=28053 vsize=8688 CPUtime=0
/proc/28055/stat : 28055 (galac.sh) S 28053 28053 27002 0 -1 4194368 38 0 0 0 0 0 0 0 16 0 1 0 179531248 8896512 286 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577642578 0 0 4096 73728 18446744071563648864 0 0 17 0 0 0
/proc/28055/statm: 2172 286 209 79 0 165 0
[pid=28056] ppid=28055 vsize=6864 CPUtime=0
/proc/28056/stat : 28056 (id) R 28055 28053 27002 0 -1 4194304 242 0 0 0 0 0 0 0 19 0 1 0 179531249 7028736 184 18446744073709551615 4194304 4211724 548682069312 18446744073709551615 240577642450 0 0 3674112 0 0 0 0 17 0 0 0
/proc/28056/statm: 1717 186 156 4 0 47 0

[startup+0.111156 s]
/proc/loadavg: 2.00 1.97 1.91 3/75 28054
/proc/meminfo: memFree=1483104/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=0.01
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+0.523225 s]
/proc/loadavg: 2.00 1.97 1.91 3/75 28054
/proc/meminfo: memFree=1483104/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=0.01
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+1.34536 s]
/proc/loadavg: 2.00 1.97 1.91 4/83 28074
/proc/meminfo: memFree=1412696/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=0.01
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28067] ppid=28053 vsize=861064 CPUtime=1.28
/proc/28067/stat : 28067 (java) S 28053 28053 27002 0 -1 0 19695 0 1 0 115 13 0 0 18 0 8 0 179531252 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28067/statm: 215266 19449 1993 14 0 201471 0
[pid=28067/tid=28068] ppid=28053 vsize=861064 CPUtime=0.03
/proc/28067/task/28068/stat : 28068 (java) S 28053 28053 27002 0 -1 64 3786 0 0 0 2 1 0 0 16 0 8 0 179531256 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28069] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28069/stat : 28069 (java) S 28053 28053 27002 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 179531256 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28070] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28070/stat : 28070 (java) S 28053 28053 27002 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 179531256 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28071] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28071/stat : 28071 (java) S 28053 28053 27002 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 179531260 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28072] ppid=28053 vsize=861064 CPUtime=0.28
/proc/28067/task/28072/stat : 28072 (java) R 28053 28053 27002 0 -1 64 992 0 0 0 26 2 0 0 20 0 8 0 179531260 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28073] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28073/stat : 28073 (java) S 28053 28053 27002 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 179531260 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28074] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28074/stat : 28074 (java) S 28053 28053 27002 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 179531260 881729536 19449 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 908640

[startup+2.98464 s]
/proc/loadavg: 2.00 1.97 1.91 3/83 28074
/proc/meminfo: memFree=1404120/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=0.01
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28067] ppid=28053 vsize=861064 CPUtime=2.9
/proc/28067/stat : 28067 (java) R 28053 28053 27002 0 -1 0 21670 0 1 0 275 15 0 0 25 0 8 0 179531252 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4073658277 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28067/statm: 215266 21421 1996 14 0 201471 0
[pid=28067/tid=28068] ppid=28053 vsize=861064 CPUtime=0.08
/proc/28067/task/28068/stat : 28068 (java) S 28053 28053 27002 0 -1 64 5724 0 0 0 6 2 0 0 16 0 8 0 179531256 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28069] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28069/stat : 28069 (java) S 28053 28053 27002 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 179531256 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28070] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28070/stat : 28070 (java) S 28053 28053 27002 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 179531256 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28071] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28071/stat : 28071 (java) S 28053 28053 27002 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 179531260 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28072] ppid=28053 vsize=861064 CPUtime=0.32
/proc/28067/task/28072/stat : 28072 (java) S 28053 28053 27002 0 -1 64 1022 0 0 0 30 2 0 0 16 0 8 0 179531260 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28073] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28073/stat : 28073 (java) S 28053 28053 27002 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 179531260 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28067/tid=28074] ppid=28053 vsize=861064 CPUtime=0
/proc/28067/task/28074/stat : 28074 (java) S 28053 28053 27002 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 179531260 881729536 21421 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.91
Current children cumulated vsize (KiB) 908640

[startup+6.2802 s]
/proc/loadavg: 2.00 1.97 1.91 3/76 28075
/proc/meminfo: memFree=1471312/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=12020 CPUtime=2.78
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 2886 0 0 0 277 1 0 0 25 0 1 0 179531595 12308480 2868 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 3005 2868 54 142 0 2861 0
Current children cumulated CPU time (s) 6.14
Current children cumulated vsize (KiB) 59596

[startup+12.7493 s]
/proc/loadavg: 2.00 1.97 1.91 3/76 28075
/proc/meminfo: memFree=1464080/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=18480 CPUtime=9.18
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 4481 0 0 0 915 3 0 0 25 0 1 0 179531595 18923520 4463 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134525858 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 4620 4463 54 142 0 4476 0
Current children cumulated CPU time (s) 12.54
Current children cumulated vsize (KiB) 66056

[startup+25.5844 s]
/proc/loadavg: 2.00 1.97 1.91 3/76 28075
/proc/meminfo: memFree=1456528/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=25132 CPUtime=21.9
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 6159 0 0 0 2185 5 0 0 25 0 1 0 179531595 25735168 6141 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529616 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 6283 6141 54 142 0 6139 0
Current children cumulated CPU time (s) 25.26
Current children cumulated vsize (KiB) 72708

[startup+51.2667 s]
/proc/loadavg: 2.07 1.99 1.91 3/76 28075
/proc/meminfo: memFree=1445264/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=34124 CPUtime=47.34
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 8378 0 0 0 4727 7 0 0 25 0 1 0 179531595 34942976 8360 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529456 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 8531 8360 54 142 0 8387 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 81700

[startup+102.505 s]
/proc/loadavg: 2.03 1.99 1.91 3/76 28075
/proc/meminfo: memFree=1430928/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=47376 CPUtime=98.11
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 11686 0 0 0 9801 10 0 0 25 0 1 0 179531595 48513024 11668 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 11844 11668 54 142 0 11700 0
Current children cumulated CPU time (s) 101.47
Current children cumulated vsize (KiB) 94952

[startup+162.586 s]
/proc/loadavg: 2.01 1.99 1.91 3/76 28075
/proc/meminfo: memFree=1419152/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=59112 CPUtime=157.65
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 14586 0 0 0 15751 14 0 0 25 0 1 0 179531595 60530688 14568 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529382 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 14778 14568 54 142 0 14634 0
Current children cumulated CPU time (s) 161.01
Current children cumulated vsize (KiB) 106688

[startup+222.666 s]
/proc/loadavg: 2.00 1.99 1.91 3/76 28075
/proc/meminfo: memFree=1408080/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=70244 CPUtime=217.17
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 17293 0 0 0 21700 17 0 0 25 0 1 0 179531595 71929856 17275 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 17561 17275 54 142 0 17417 0
Current children cumulated CPU time (s) 220.53
Current children cumulated vsize (KiB) 117820

[startup+282.759 s]
/proc/loadavg: 2.00 1.99 1.91 3/76 28075
/proc/meminfo: memFree=1399568/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=78600 CPUtime=276.71
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 19414 0 0 0 27652 19 0 0 25 0 1 0 179531595 80486400 19396 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 19650 19396 54 142 0 19506 0
Current children cumulated CPU time (s) 280.07
Current children cumulated vsize (KiB) 126176

[startup+342.845 s]
/proc/loadavg: 2.08 2.00 1.92 3/82 28141
/proc/meminfo: memFree=1396616/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=79976 CPUtime=336.18
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 19746 0 0 0 33598 20 0 0 25 0 1 0 179531595 81895424 19728 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529435 0 0 4096 3 0 0 0 17 1 0 0
/proc/28075/statm: 19994 19728 54 142 0 19850 0
Current children cumulated CPU time (s) 339.54
Current children cumulated vsize (KiB) 127552


################
# More data... #
################

/proc/loadavg: 2.00 2.01 1.97 3/82 28820
/proc/meminfo: memFree=1412960/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=111588 CPUtime=1113.32
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 27440 0 0 0 111301 31 0 0 25 0 1 0 179531595 114266112 27422 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 27897 27422 54 142 0 27753 0
Current children cumulated CPU time (s) 1116.68
Current children cumulated vsize (KiB) 159164

[startup+1183.49 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28820
/proc/meminfo: memFree=1408480/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=116016 CPUtime=1173.31
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28537 0 0 0 117299 32 0 0 25 0 1 0 179531595 118800384 28519 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29004 28519 54 142 0 28860 0
Current children cumulated CPU time (s) 1176.67
Current children cumulated vsize (KiB) 163592

[startup+1243.57 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28820
/proc/meminfo: memFree=1408160/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=116280 CPUtime=1233.35
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28601 0 0 0 123302 33 0 0 25 0 1 0 179531595 119070720 28583 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29070 28583 54 142 0 28926 0
Current children cumulated CPU time (s) 1236.71
Current children cumulated vsize (KiB) 163856

[startup+1303.64 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28820
/proc/meminfo: memFree=1407840/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=116636 CPUtime=1293.34
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28687 0 0 0 129301 33 0 0 25 0 1 0 179531595 119435264 28669 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29159 28669 54 142 0 29015 0
Current children cumulated CPU time (s) 1296.7
Current children cumulated vsize (KiB) 164212

[startup+1363.7 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28820
/proc/meminfo: memFree=1407840/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=116636 CPUtime=1353.35
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28690 0 0 0 135302 33 0 0 25 0 1 0 179531595 119435264 28672 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29159 28672 54 142 0 29015 0
Current children cumulated CPU time (s) 1356.71
Current children cumulated vsize (KiB) 164212

[startup+1423.75 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28822
/proc/meminfo: memFree=1407392/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=117008 CPUtime=1413.31
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28760 0 0 0 141298 33 0 0 25 0 1 0 179531595 119816192 28742 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529453 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29252 28742 54 142 0 29108 0
Current children cumulated CPU time (s) 1416.67
Current children cumulated vsize (KiB) 164584

[startup+1483.83 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28822
/proc/meminfo: memFree=1407136/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=117384 CPUtime=1473.34
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28829 0 0 0 147301 33 0 0 25 0 1 0 179531595 120201216 28811 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29346 28811 54 142 0 29202 0
Current children cumulated CPU time (s) 1476.7
Current children cumulated vsize (KiB) 164960

[startup+1543.88 s]
/proc/loadavg: 2.00 2.00 1.97 4/82 28822
/proc/meminfo: memFree=1406624/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=117760 CPUtime=1533.34
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 28958 0 0 0 153301 33 0 0 25 0 1 0 179531595 120586240 28940 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29440 28940 54 142 0 29296 0
Current children cumulated CPU time (s) 1536.7
Current children cumulated vsize (KiB) 165336

[startup+1603.9 s]
/proc/loadavg: 2.00 2.00 1.97 3/82 28822
/proc/meminfo: memFree=1406112/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=118512 CPUtime=1593.31
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 29096 0 0 0 159298 33 0 0 25 0 1 0 179531595 121356288 29078 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529374 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29628 29078 54 142 0 29484 0
Current children cumulated CPU time (s) 1596.67
Current children cumulated vsize (KiB) 166088

[startup+1663.93 s]
/proc/loadavg: 2.04 2.01 1.98 3/82 28822
/proc/meminfo: memFree=1405856/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=118840 CPUtime=1653.26
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 29172 0 0 0 165292 34 0 0 25 0 1 0 179531595 121692160 29154 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29710 29154 54 142 0 29566 0
Current children cumulated CPU time (s) 1656.62
Current children cumulated vsize (KiB) 166416

[startup+1723.96 s]
/proc/loadavg: 2.13 2.04 1.99 3/82 28822
/proc/meminfo: memFree=1405664/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=119052 CPUtime=1713.23
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 29221 0 0 0 171289 34 0 0 25 0 1 0 179531595 121909248 29203 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29763 29203 54 142 0 29619 0
Current children cumulated CPU time (s) 1716.59
Current children cumulated vsize (KiB) 166628

[startup+1783.98 s]
/proc/loadavg: 2.04 2.03 1.99 3/82 28822
/proc/meminfo: memFree=1405408/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=119216 CPUtime=1773.2
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 29264 0 0 0 177286 34 0 0 25 0 1 0 179531595 122077184 29246 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29804 29246 54 142 0 29660 0
Current children cumulated CPU time (s) 1776.56
Current children cumulated vsize (KiB) 166792



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1807.54 s]
/proc/loadavg: 2.03 2.03 1.99 4/82 28822
/proc/meminfo: memFree=1404896/2055920 swapFree=4191892/4192956
[pid=28053] ppid=28051 vsize=47576 CPUtime=3.36
/proc/28053/stat : 28053 (galac.sh) S 28051 28053 27002 0 -1 4194304 800 23383 0 1 0 0 318 18 17 0 1 0 179531248 48717824 364 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 240577080154 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/28053/statm: 11894 364 246 79 0 218 0
[pid=28075] ppid=28053 vsize=119748 CPUtime=1796.73
/proc/28075/stat : 28075 (minisat) R 28053 28053 27002 0 -1 4194304 29403 0 0 0 179639 34 0 0 25 0 1 0 179531595 122621952 29385 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529318 0 0 4096 3 0 0 0 17 0 0 0
/proc/28075/statm: 29937 29385 54 142 0 29793 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 167324

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 28053 and gives childrusage.ru_utime.tv_sec=3 childrusage.ru_utime.tv_usec=184515 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=196970
CPU time returned by wait4() is 3.38149
while last known CPU time is 1800.09

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1807.56
CPU time (s): 1800.09
CPU user time (s): 1799.57
CPU system time (s): 0.52
CPU usage (%): 99.587
Max. virtual memory (cumulated for all children) (KiB): 908640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.18452
system time used= 0.19697
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 24183
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 972
involuntary context switches= 931

runsolver used 2.20866 s user time and 5.58015 s system time

The end

Launcher Data (download as text)

Begin job on node50 on Tue Jan  9 02:55:27 UTC 2007


IDJOB= 229816
IDBENCH= 6361
FILE ID= node50/229816-1168311327

PBS_JOBID= 3502388

Free space on /tmp= 66545 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-50-23-fcd/rand-2-50-23-587-230-fcd-37_ext.xml
COMMAND LINE= /tmp/evaluation/229816-1168311327/galac.sh /tmp/evaluation/229816-1168311327/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node50/watcher-229816-1168311327 -o ROOT/results/node50/solver-229816-1168311327 -C 1800 -M 900  /tmp/evaluation/229816-1168311327/galac.sh /tmp/evaluation/229816-1168311327/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  2eeb2adecc305b0db93e86ea3cbf860e

RANDOM SEED= 954321937

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.263
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.263
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1483776 kB
Buffers:         65976 kB
Cached:         362572 kB
SwapCached:        396 kB
Active:         230008 kB
Inactive:       286716 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1483776 kB
SwapTotal:     4192956 kB
SwapFree:      4191892 kB
Dirty:            3304 kB
Writeback:           0 kB
Mapped:          97736 kB
Slab:            40712 kB
Committed_AS:  4462660 kB
PageTables:       1992 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66558 MiB



End job on node50 on Tue Jan  9 03:25:35 UTC 2007