Trace number 233060

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
buggy_2_5_s 2007-01-08? (TO) 1800.07 1811.92

General information on the benchmark

Nametaillard/
os-taillard-20/os-taillard-20-95-3.xml
MD5SUM5ec20206a8a3a2922b1b6c486df1b43e
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of constraints7600
Maximum constraint arity2
Maximum domain size1245
Number of constraints which are defined in extension0
Number of constraints which are defined in intension7600
Global constraints used (with number of constraints)

Solver Data (download as text)

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node18/watcher-233060-1168324607 -o ROOT/results/node18/solver-233060-1168324607 -C 1800 -M 900 /tmp/evaluation/233060-1168324607/solver2 /tmp/evaluation/233060-1168324607/unknown 1800 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.41 1.98 1.88 3/94 27930
/proc/meminfo: memFree=1030272/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=18540 CPUtime=0
/proc/27929/stat : 27929 (runsolver) R 27927 27929 27061 0 -1 4194368 16 0 0 0 0 0 0 0 21 0 1 0 180855522 18984960 279 18446744073709551615 4194304 4267372 548682069072 18446744073709551615 227848809767 0 0 4096 24578 0 0 0 17 1 0 0
/proc/27929/statm: 4635 279 244 17 0 2626 0

[startup+0.102613 s]
/proc/loadavg: 2.41 1.98 1.88 3/94 27930
/proc/meminfo: memFree=1030272/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=0
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 353 334 0 0 0 0 0 0 22 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+0.511655 s]
/proc/loadavg: 2.41 1.98 1.88 3/94 27930
/proc/meminfo: memFree=1030272/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=0.16
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 376 2352 0 0 0 0 14 2 15 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 5352

[startup+1.33274 s]
/proc/loadavg: 2.41 1.98 1.88 4/95 27942
/proc/meminfo: memFree=999088/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=0.16
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 376 2352 0 0 0 0 14 2 15 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27942] ppid=27929 vsize=24372 CPUtime=1.13
/proc/27942/stat : 27942 (bordewijk) R 27929 27929 27061 0 -1 4194304 6112 0 0 0 105 8 0 0 25 0 1 0 180855540 24956928 5571 18446744073709551615 134512640 134912576 4294956752 18446744073709551615 8132754 0 0 4096 0 0 0 0 17 1 0 0
/proc/27942/statm: 6093 5571 204 97 0 5374 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 29724

[startup+2.96989 s]
/proc/loadavg: 2.41 1.98 1.88 4/95 27942
/proc/meminfo: memFree=956272/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=0.16
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 376 2352 0 0 0 0 14 2 15 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27942] ppid=27929 vsize=144276 CPUtime=2.75
/proc/27942/stat : 27942 (bordewijk) R 27929 27929 27061 0 -1 4194304 37940 0 0 0 199 76 0 0 25 0 1 0 180855540 147738624 35035 18446744073709551615 134512640 134912576 4294956752 18446744073709551615 4294960144 0 0 4096 0 0 0 0 17 1 0 0
/proc/27942/statm: 36069 35035 217 97 0 35350 0
Current children cumulated CPU time (s) 2.91
Current children cumulated vsize (KiB) 149628

[startup+6.25021 s]
/proc/loadavg: 2.45 2.00 1.88 4/95 27942
/proc/meminfo: memFree=847928/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=0.16
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 376 2352 0 0 0 0 14 2 15 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27942] ppid=27929 vsize=144276 CPUtime=6.01
/proc/27942/stat : 27942 (bordewijk) R 27929 27929 27061 0 -1 4194304 37940 0 0 0 217 384 0 0 25 0 1 0 180855540 147738624 35035 18446744073709551615 134512640 134912576 4294956752 18446744073709551615 4294960144 0 0 4096 0 0 0 0 17 1 0 0
/proc/27942/statm: 36069 35035 217 97 0 35350 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 149628

[startup+12.7278 s]
/proc/loadavg: 2.42 2.00 1.88 4/95 27943
/proc/meminfo: memFree=875704/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=6.08
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 507 101 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060610416 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 108672

[startup+25.5611 s]
/proc/loadavg: 2.48 2.03 1.90 4/95 27943
/proc/meminfo: memFree=830776/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=18.86
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 1785 101 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060543596 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 108672

[startup+51.2115 s]
/proc/loadavg: 2.58 2.09 1.92 3/95 27943
/proc/meminfo: memFree=732344/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=44.36
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 4335 101 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060544378 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 50.9
Current children cumulated vsize (KiB) 108672

[startup+102.509 s]
/proc/loadavg: 2.78 2.21 1.97 4/95 27943
/proc/meminfo: memFree=652280/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=95.41
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 9439 102 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060543124 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 101.95
Current children cumulated vsize (KiB) 108672

[startup+162.574 s]
/proc/loadavg: 2.57 2.25 1.99 4/95 28016
/proc/meminfo: memFree=962368/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=155.22
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 15419 103 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4061195486 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 161.76
Current children cumulated vsize (KiB) 108672

[startup+222.581 s]
/proc/loadavg: 2.65 2.32 2.03 4/95 28016
/proc/meminfo: memFree=750464/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=214.72
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 21368 104 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060548521 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 221.26
Current children cumulated vsize (KiB) 108672

[startup+282.589 s]
/proc/loadavg: 2.50 2.35 2.06 3/95 28123
/proc/meminfo: memFree=1306672/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=274.19
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 27313 106 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4061278775 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 280.73
Current children cumulated vsize (KiB) 108672

[startup+342.627 s]
/proc/loadavg: 2.57 2.39 2.09 3/95 28123
/proc/meminfo: memFree=902400/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=333.73
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 33266 107 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060562338 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 340.27
Current children cumulated vsize (KiB) 108672

[startup+402.725 s]
/proc/loadavg: 2.72 2.47 2.13 4/95 28123
/proc/meminfo: memFree=704128/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=393.27
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 39220 107 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060541109 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 399.81
Current children cumulated vsize (KiB) 108672

[startup+462.727 s]
/proc/loadavg: 2.55 2.48 2.16 3/95 28193
/proc/meminfo: memFree=709696/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103320 CPUtime=452.77
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 24973 0 0 0 45169 108 0 0 25 0 1 0 180856182 105799680 24768 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134555362 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25830 24768 137 64 0 25145 0
Current children cumulated CPU time (s) 459.31
Current children cumulated vsize (KiB) 108672

[startup+522.74 s]
/proc/loadavg: 2.25 2.41 2.15 3/88 28874
/proc/meminfo: memFree=1237816/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103336 CPUtime=512.52
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25345 0 0 0 51141 111 0 0 25 0 1 0 180856182 105816064 25140 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554283 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25834 25140 138 64 0 25149 0
Current children cumulated CPU time (s) 519.06

################
# More data... #
################

/proc/loadavg: 2.48 2.20 2.12 4/95 29020
/proc/meminfo: memFree=880464/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1109.82
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 110868 114 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554272 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1116.36
Current children cumulated vsize (KiB) 108692

[startup+1183.37 s]
/proc/loadavg: 2.76 2.34 2.17 4/95 29020
/proc/meminfo: memFree=676624/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1169.31
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 116817 114 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4061362546 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1175.85
Current children cumulated vsize (KiB) 108692

[startup+1243.46 s]
/proc/loadavg: 2.59 2.37 2.19 3/95 29124
/proc/meminfo: memFree=692512/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1228.84
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 122769 115 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554280 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1235.38
Current children cumulated vsize (KiB) 108692

[startup+1303.53 s]
/proc/loadavg: 2.48 2.35 2.19 3/98 29176
/proc/meminfo: memFree=644040/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1287.62
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 128646 116 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4061236110 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1294.16
Current children cumulated vsize (KiB) 108692

[startup+1363.63 s]
/proc/loadavg: 2.69 2.43 2.23 3/98 29176
/proc/meminfo: memFree=637896/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1347.27
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 134611 116 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060578378 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1353.81
Current children cumulated vsize (KiB) 108692

[startup+1423.66 s]
/proc/loadavg: 2.25 2.35 2.21 3/98 29176
/proc/meminfo: memFree=637960/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1407.28
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 140612 116 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4061251090 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1413.82
Current children cumulated vsize (KiB) 108692

[startup+1483.7 s]
/proc/loadavg: 2.14 2.30 2.20 3/104 29292
/proc/meminfo: memFree=636600/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1467.18
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 146602 116 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554181 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1473.72
Current children cumulated vsize (KiB) 108692

[startup+1543.71 s]
/proc/loadavg: 2.09 2.26 2.19 3/104 29352
/proc/meminfo: memFree=636616/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1527.11
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 152594 117 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4061258029 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1533.65
Current children cumulated vsize (KiB) 108692

[startup+1603.74 s]
/proc/loadavg: 2.03 2.21 2.17 3/98 29374
/proc/meminfo: memFree=637640/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1587.08
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 158591 117 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554206 0 0 4096 0 0 0 0 17 1 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1593.62
Current children cumulated vsize (KiB) 108692

[startup+1663.83 s]
/proc/loadavg: 2.23 2.22 2.18 4/95 29448
/proc/meminfo: memFree=1136920/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1646.94
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 164575 119 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 4060776036 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1653.48
Current children cumulated vsize (KiB) 108692

[startup+1723.89 s]
/proc/loadavg: 2.64 2.34 2.22 4/95 29448
/proc/meminfo: memFree=932632/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1706.39
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 170520 119 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554209 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1712.93
Current children cumulated vsize (KiB) 108692

[startup+1783.96 s]
/proc/loadavg: 2.78 2.43 2.26 4/95 29448
/proc/meminfo: memFree=755992/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1765.88
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 176468 120 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554178 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1772.42
Current children cumulated vsize (KiB) 108692



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1811.9 s]
/proc/loadavg: 2.78 2.46 2.27 4/95 29448
/proc/meminfo: memFree=674648/2055920 swapFree=4192812/4192956
[pid=27929] ppid=27927 vsize=5352 CPUtime=6.54
/proc/27929/stat : 27929 (solver2) S 27927 27929 27061 0 -1 4194304 397 40293 0 0 0 0 235 419 16 0 1 0 180855522 5480448 242 18446744073709551615 4194304 4889804 548682069328 18446744073709551615 227848807236 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/27929/statm: 1338 242 203 169 0 49 0
[pid=27943] ppid=27929 vsize=103340 CPUtime=1793.53
/proc/27943/stat : 27943 (standalone) R 27929 27929 27061 0 -1 4194304 25377 0 0 0 179233 120 0 0 25 0 1 0 180856182 105820160 25172 18446744073709551615 134512640 134775488 4294956880 18446744073709551615 134554283 0 0 4096 0 0 0 0 17 0 0 0
/proc/27943/statm: 25835 25172 138 64 0 25150 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 108692

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 27929 and gives childrusage.ru_utime.tv_sec=2 childrusage.ru_utime.tv_usec=352642 childrusage.ru_stime.tv_sec=4 childrusage.ru_stime.tv_usec=194362
CPU time returned by wait4() is 6.547
while last known CPU time is 1800.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1811.92
CPU time (s): 1800.07
CPU user time (s): 1794.68
CPU system time (s): 5.39
CPU usage (%): 99.3461
Max. virtual memory (cumulated for all children) (KiB): 149628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.35264
system time used= 4.19436
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40690
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 208
involuntary context switches= 484

runsolver used 1.79873 s user time and 5.36318 s system time

The end

Launcher Data (download as text)

Begin job on node18 on Tue Jan  9 06:36:48 UTC 2007


IDJOB= 233060
IDBENCH= 6579
FILE ID= node18/233060-1168324607

PBS_JOBID= 3502745

Free space on /tmp= 66538 MiB

BENCH NAME= HOME/pub/bench/CPAI06/taillard/os-taillard-20/os-taillard-20-95-3.xml
COMMAND LINE= /tmp/evaluation/233060-1168324607/solver2 /tmp/evaluation/233060-1168324607/unknown 1800
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node18/watcher-233060-1168324607 -o ROOT/results/node18/solver-233060-1168324607 -C 1800 -M 900  /tmp/evaluation/233060-1168324607/solver2 /tmp/evaluation/233060-1168324607/unknown 1800

META MD5SUM SOLVER= 2182e29fee250f6e45b9a85a6429fa3a
MD5SUM BENCH=  5ec20206a8a3a2922b1b6c486df1b43e

RANDOM SEED= 480572304

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1030752 kB
Buffers:         75360 kB
Cached:         365416 kB
SwapCached:          0 kB
Active:         614384 kB
Inactive:       348156 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1030752 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:           11028 kB
Writeback:           0 kB
Mapped:         549708 kB
Slab:            46560 kB
Committed_AS:  6224940 kB
PageTables:       3076 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66524 MiB



End job on node18 on Tue Jan  9 07:07:01 UTC 2007