Trace number 232623

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
buggy_2_5_s 2007-01-08? (TO) 1800.04 1811.95

General information on the benchmark

Nametaillard/js-taillard-20/
js-taillard-20-105-1.xml
MD5SUMab07e163281424af8d5ceae6e2460409
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark109.911
SatisfiableYES
(Un)Satisfiability was proved
Number of variables400
Number of constraints4180
Maximum constraint arity2
Maximum domain size1707
Number of constraints which are defined in extension0
Number of constraints which are defined in intension4180
Global constraints used (with number of constraints)

Solver Data (download as text)



Verifier Data (download as text)




ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 



Watcher Data (download as text)




runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node5/watcher-232623-1168323756 -o ROOT/results/node5/solver-232623-1168323756 -C 1800 -M 900 /tmp/evaluation/232623-1168323756/solver2 /tmp/evaluation/232623-1168323756/unknown 1800 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.93 1.98 1.99 3/87 9714
/proc/meminfo: memFree=1126112/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=880 CPUtime=0
/proc/9713/stat : 9713 (solver2) R 9711 9713 8465 0 -1 4194304 41 0 0 0 0 0 0 0 20 0 1 0 160990156 901120 25 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226910860565 0 0 4096 0 0 0 0 17 1 0 0
/proc/9713/statm: 220 25 18 169 0 8 0

[startup+0.102925 s]
/proc/loadavg: 1.93 1.98 1.99 3/87 9714
/proc/meminfo: memFree=1126112/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=0.07
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 376 2300 0 0 0 0 6 1 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 5352

[startup+0.511968 s]
/proc/loadavg: 1.93 1.98 1.99 3/87 9714
/proc/meminfo: memFree=1126112/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=0.07
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 376 2300 0 0 0 0 6 1 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 5352

[startup+1.33706 s]
/proc/loadavg: 1.93 1.98 1.99 3/88 9726
/proc/meminfo: memFree=1090392/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=0.07
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 376 2300 0 0 0 0 6 1 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9726] ppid=9713 vsize=32420 CPUtime=1.22
/proc/9726/stat : 9726 (bordewijk) R 9713 9713 8465 0 -1 4194304 7860 0 0 0 115 7 0 0 25 0 1 0 160990166 33198080 7835 18446744073709551615 134512640 134912576 4294956752 18446744073709551615 134769317 0 0 4096 0 0 0 0 17 1 0 0
/proc/9726/statm: 8105 7835 167 97 0 7683 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 37772

[startup+2.98124 s]
/proc/loadavg: 2.01 2.00 2.00 3/88 9726
/proc/meminfo: memFree=1054680/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=0.07
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 376 2300 0 0 0 0 6 1 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9726] ppid=9713 vsize=133000 CPUtime=2.84
/proc/9726/stat : 9726 (bordewijk) R 9713 9713 8465 0 -1 4194304 35833 0 0 0 208 76 0 0 25 0 1 0 160990166 136192000 32073 18446744073709551615 134512640 134912576 4294956752 18446744073709551615 4294960144 0 0 4096 0 0 0 0 17 1 0 0
/proc/9726/statm: 33250 32073 217 97 0 32531 0
Current children cumulated CPU time (s) 2.91
Current children cumulated vsize (KiB) 138352

[startup+6.26062 s]
/proc/loadavg: 2.01 2.00 2.00 3/88 9726
/proc/meminfo: memFree=977496/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=0.07
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 376 2300 0 0 0 0 6 1 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9726] ppid=9713 vsize=133000 CPUtime=6.08
/proc/9726/stat : 9726 (bordewijk) R 9713 9713 8465 0 -1 4194304 35833 0 0 0 226 382 0 0 25 0 1 0 160990166 136192000 32073 18446744073709551615 134512640 134912576 4294956752 18446744073709551615 4294960144 0 0 4096 0 0 0 0 17 1 0 0
/proc/9726/statm: 33250 32073 217 97 0 32531 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 138352

[startup+12.7334 s]
/proc/loadavg: 2.01 2.00 2.00 3/88 9727
/proc/meminfo: memFree=1018968/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=5.07
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 22677 0 0 0 379 128 0 0 25 0 1 0 160990917 97312768 22537 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071262466 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22537 136 64 0 23073 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 100384

[startup+25.5508 s]
/proc/loadavg: 2.01 2.00 2.00 3/88 9727
/proc/meminfo: memFree=1018968/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=17.77
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 22732 0 0 0 1649 128 0 0 25 0 1 0 160990917 97312768 22592 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071787589 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22592 137 64 0 23073 0
Current children cumulated CPU time (s) 25.28
Current children cumulated vsize (KiB) 100384

[startup+51.2047 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 9727
/proc/meminfo: memFree=1017752/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=43.22
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 4193 129 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071231273 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 50.73
Current children cumulated vsize (KiB) 100384

[startup+102.485 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 9727
/proc/meminfo: memFree=1017880/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=94.12
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 9283 129 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071556830 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 101.63
Current children cumulated vsize (KiB) 100384

[startup+162.486 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 9727
/proc/meminfo: memFree=1017816/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=153.68
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 15238 130 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071232616 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 161.19
Current children cumulated vsize (KiB) 100384

[startup+222.49 s]
/proc/loadavg: 2.04 2.01 2.00 3/88 9727
/proc/meminfo: memFree=1017880/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=213.23
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 21193 130 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071287444 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 220.74
Current children cumulated vsize (KiB) 100384

[startup+282.591 s]
/proc/loadavg: 2.01 2.01 2.00 3/88 9727
/proc/meminfo: memFree=1017880/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=272.9
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 27159 131 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071256276 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 280.41
Current children cumulated vsize (KiB) 100384

[startup+342.692 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 9727
/proc/meminfo: memFree=1017816/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=332.55
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 33124 131 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071514639 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 340.06
Current children cumulated vsize (KiB) 100384

[startup+402.794 s]
/proc/loadavg: 2.03 2.01 2.00 3/88 9727
/proc/meminfo: memFree=1017880/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=392.22
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 39090 132 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071223126 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 399.73
Current children cumulated vsize (KiB) 100384

[startup+462.797 s]
/proc/loadavg: 2.06 2.02 2.00 3/88 9727
/proc/meminfo: memFree=1017816/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=451.77
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 45045 132 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134555360 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 459.28
Current children cumulated vsize (KiB) 100384

[startup+522.8 s]
/proc/loadavg: 2.02 2.02 2.00 3/88 9727
/proc/meminfo: memFree=1017880/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95032 CPUtime=511.33
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23062 0 0 0 51000 133 0 0 25 0 1 0 160990917 97312768 22922 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071220376 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23758 22922 137 64 0 23073 0
Current children cumulated CPU time (s) 518.84

################
# More data... #
################

/proc/loadavg: 2.08 2.02 2.00 3/90 9729
/proc/meminfo: memFree=1016456/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1107.37
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 110599 138 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554232 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1114.88
Current children cumulated vsize (KiB) 100392

[startup+1183.49 s]
/proc/loadavg: 2.03 2.02 2.00 3/90 9729
/proc/meminfo: memFree=1016328/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1167.15
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 116576 139 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071279049 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1174.66
Current children cumulated vsize (KiB) 100392

[startup+1243.54 s]
/proc/loadavg: 2.01 2.01 2.00 3/90 9729
/proc/meminfo: memFree=1016328/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1226.92
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 122553 139 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134548959 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1234.43
Current children cumulated vsize (KiB) 100392

[startup+1303.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 9729
/proc/meminfo: memFree=1016328/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1286.69
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 128530 139 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554175 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1294.2
Current children cumulated vsize (KiB) 100392

[startup+1363.65 s]
/proc/loadavg: 2.07 2.02 2.00 3/90 9729
/proc/meminfo: memFree=1016264/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1346.46
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 134506 140 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554283 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1353.97
Current children cumulated vsize (KiB) 100392

[startup+1423.71 s]
/proc/loadavg: 2.02 2.01 2.00 3/90 9729
/proc/meminfo: memFree=1016264/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1406.24
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 140484 140 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071787697 0 0 4096 0 0 0 0 17 1 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1413.75
Current children cumulated vsize (KiB) 100392

[startup+1483.77 s]
/proc/loadavg: 1.93 1.99 1.99 3/95 9803
/proc/meminfo: memFree=713120/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1466
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 146458 142 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071449373 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1473.51
Current children cumulated vsize (KiB) 100392

[startup+1543.77 s]
/proc/loadavg: 2.21 2.06 2.02 4/95 9928
/proc/meminfo: memFree=1008104/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1524.65
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 152321 144 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071458756 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1532.16
Current children cumulated vsize (KiB) 100392

[startup+1603.82 s]
/proc/loadavg: 2.03 2.03 2.01 3/87 10189
/proc/meminfo: memFree=993640/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1584.62
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 158316 146 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071300562 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1592.13
Current children cumulated vsize (KiB) 100392

[startup+1663.85 s]
/proc/loadavg: 2.01 2.02 2.00 3/87 10189
/proc/meminfo: memFree=993768/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1644.59
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 164313 146 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071782723 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1652.1
Current children cumulated vsize (KiB) 100392

[startup+1723.88 s]
/proc/loadavg: 2.00 2.02 2.00 3/87 10189
/proc/meminfo: memFree=993768/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1704.57
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 170310 147 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4071369228 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1712.08
Current children cumulated vsize (KiB) 100392

[startup+1783.92 s]
/proc/loadavg: 2.00 2.01 2.00 3/87 10189
/proc/meminfo: memFree=993832/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1764.53
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 176306 147 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134525689 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1772.04
Current children cumulated vsize (KiB) 100392



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1811.93 s]
/proc/loadavg: 2.00 2.01 2.00 3/87 10189
/proc/meminfo: memFree=993768/2055920 swapFree=4192812/4192956
[pid=9713] ppid=9711 vsize=5352 CPUtime=7.51
/proc/9713/stat : 9713 (solver2) S 9711 9713 8465 0 -1 4194304 397 38134 0 0 0 0 241 510 16 0 1 0 160990156 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 226913477444 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/9713/statm: 1338 242 203 169 0 49 0
[pid=9727] ppid=9713 vsize=95040 CPUtime=1792.53
/proc/9727/stat : 9727 (standalone) R 9713 9713 8465 0 -1 4194304 23301 0 0 0 179106 147 0 0 25 0 1 0 160990917 97320960 23161 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554181 0 0 4096 0 0 0 0 17 0 0 0
/proc/9727/statm: 23760 23161 138 64 0 23075 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 100392

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 9713 and gives childrusage.ru_utime.tv_sec=2 childrusage.ru_utime.tv_usec=413633 childrusage.ru_stime.tv_sec=5 childrusage.ru_stime.tv_usec=107223
CPU time returned by wait4() is 7.52086
while last known CPU time is 1800.04

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1811.95
CPU time (s): 1800.04
CPU user time (s): 1793.47
CPU system time (s): 6.57
CPU usage (%): 99.3428
Max. virtual memory (cumulated for all children) (KiB): 138352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.41363
system time used= 5.10722
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 38531
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 203
involuntary context switches= 332

runsolver used 1.9607 s user time and 5.08423 s system time

The end



Launcher Data (download as text)




Begin job on node5 on Tue Jan  9 06:22:37 UTC 2007


IDJOB= 232623
IDBENCH= 6538
FILE ID= node5/232623-1168323756

PBS_JOBID= 3502696

Free space on /tmp= 66547 MiB

BENCH NAME= HOME/pub/bench/CPAI06/taillard/js-taillard-20/js-taillard-20-105-1.xml
COMMAND LINE= /tmp/evaluation/232623-1168323756/solver2 /tmp/evaluation/232623-1168323756/unknown 1800
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node5/watcher-232623-1168323756 -o ROOT/results/node5/solver-232623-1168323756 -C 1800 -M 900  /tmp/evaluation/232623-1168323756/solver2 /tmp/evaluation/232623-1168323756/unknown 1800

META MD5SUM SOLVER= 2182e29fee250f6e45b9a85a6429fa3a
MD5SUM BENCH=  ab07e163281424af8d5ceae6e2460409

RANDOM SEED= 364372841

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1126592 kB
Buffers:         83076 kB
Cached:         719664 kB
SwapCached:          0 kB
Active:         407508 kB
Inactive:       455484 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1126592 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:           10660 kB
Writeback:           0 kB
Mapped:          80424 kB
Slab:            51264 kB
Committed_AS:  4566160 kB
PageTables:       2172 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66528 MiB



End job on node5 on Tue Jan  9 06:52:49 UTC 2007