Trace number 2083265

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pcs-restart 0.3.2? (TO) 1800.17 1810.36

General information on the benchmark

Namecsp/fapp/fapp39/
normalized-fapp39-2750-3.xml
MD5SUM19abf0750b237395707bd7efde90eb33
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark643.335
Satisfiable
(Un)Satisfiability was proved
Number of variables2750
Number of constraints23154
Maximum constraint arity2
Maximum domain size502
Number of constraints which are defined in extension0
Number of constraints which are defined in intension23154
Global constraints used (with number of constraints)

Solver Data 

0.00/0.02	c has big domains
0.00/0.02	c big-domain mode
0.00/0.04	c Seed is 256019767
0.00/0.04	c Constructing HOME/instance-2083265-1247722846.xml  with 144295 constraints
2.55/2.70	c Solving

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2083265-1247722846/watcher-2083265-1247722846 -o /tmp/evaluation-result-2083265-1247722846/solver-2083265-1247722846 -C 1800 -W 2000 -M 900 HOME/pcssolve -s 256019767 HOME/instance-2083265-1247722846.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 1.99 1.99 4/72 19640
/proc/meminfo: memFree=1164376/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=18576 CPUtime=0
/proc/19640/stat : 19640 (runsolver) R 19638 19640 18013 0 -1 4194368 13 0 0 0 0 0 0 0 19 0 1 0 59348550 19021824 283 996147200 4194304 4302564 548682068496 18446744073709551615 4212365 0 0 4096 24578 0 0 0 17 1 0 0
/proc/19640/statm: 4644 283 248 26 0 2626 0

[startup+0.083388 s]
/proc/loadavg: 2.00 1.99 1.99 4/72 19640
/proc/meminfo: memFree=1164376/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=6476 CPUtime=0.05
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1263 662 0 0 5 0 0 0 18 0 1 0 59348550 6631424 853 996147200 134512640 135215973 4294956304 18446744073709551615 2410364 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 1619 853 386 171 0 544 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 6476

[startup+0.101389 s]
/proc/loadavg: 2.00 1.99 1.99 4/72 19640
/proc/meminfo: memFree=1164376/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=7124 CPUtime=0.07
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1426 662 0 0 7 0 0 0 18 0 1 0 59348550 7294976 962 996147200 134512640 135215973 4294956304 18446744073709551615 134689427 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 1781 962 386 171 0 706 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 7124

[startup+0.301411 s]
/proc/loadavg: 2.00 1.99 1.99 4/72 19640
/proc/meminfo: memFree=1164376/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=12408 CPUtime=0.27
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 2830 662 0 0 26 1 0 0 19 0 1 0 59348550 12705792 1953 996147200 134512640 135215973 4294956304 18446744073709551615 134533194 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 3102 1953 386 171 0 2027 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 12408

[startup+0.701445 s]
/proc/loadavg: 2.00 1.99 1.99 4/72 19640
/proc/meminfo: memFree=1164376/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=22008 CPUtime=0.67
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 6206 662 0 0 64 3 0 0 23 0 1 0 59348550 22536192 3864 996147200 134512640 135215973 4294956304 18446744073709551615 134761770 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 5502 3864 386 171 0 4427 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 22008

[startup+1.50152 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19645
/proc/meminfo: memFree=1144720/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=39672 CPUtime=1.46
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 12201 662 0 0 140 6 0 0 25 0 1 0 59348550 40624128 7493 996147200 134512640 135215973 4294956304 18446744073709551615 2420381 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 9918 7493 386 171 0 8843 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 39672

[startup+3.10165 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19645
/proc/meminfo: memFree=1124624/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=70200 CPUtime=3.05
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 24851 662 0 0 293 12 0 0 25 0 1 0 59348550 71884800 15762 996147200 134512640 135215973 4294956304 18446744073709551615 134590075 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 17550 15762 410 171 0 16475 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 70200

[startup+6.30194 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19645
/proc/meminfo: memFree=1101712/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=70648 CPUtime=6.21
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 25028 662 0 0 609 12 0 0 25 0 1 0 59348550 72343552 15870 996147200 134512640 135215973 4294956304 18446744073709551615 134591470 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 17662 15870 410 171 0 16587 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 70648

[startup+12.7015 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19645
/proc/meminfo: memFree=1101008/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=71896 CPUtime=12.55
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 25491 662 0 0 1243 12 0 0 25 0 1 0 59348550 73621504 16019 996147200 134512640 135215973 4294956304 18446744073709551615 134585786 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 17974 16019 410 171 0 16899 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 71896

[startup+25.5017 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19645
/proc/meminfo: memFree=1096208/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=77388 CPUtime=25.24
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 27141 662 0 0 2511 13 0 0 25 0 1 0 59348550 79245312 17252 996147200 134512640 135215973 4294956304 18446744073709551615 4158960018 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 19347 17252 410 171 0 18272 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 77388

[startup+51.102 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19645
/proc/meminfo: memFree=1090000/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=81744 CPUtime=50.63
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 28463 662 0 0 5049 14 0 0 25 0 1 0 59348550 83705856 18574 996147200 134512640 135215973 4294956304 18446744073709551615 134600888 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 20436 18574 410 171 0 19361 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 81744

[startup+102.307 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19677
/proc/meminfo: memFree=1180440/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=87316 CPUtime=101.77
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 30467 662 0 0 10162 15 0 0 25 0 1 0 59348550 89411584 19745 996147200 134512640 135215973 4294956304 18446744073709551615 4158960128 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 21829 19745 410 171 0 20754 0
Current children cumulated CPU time (s) 101.77
Current children cumulated vsize (KiB) 87316

[startup+162.302 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19677
/proc/meminfo: memFree=1162904/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=100704 CPUtime=161.74
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 35055 662 0 0 16157 17 0 0 25 0 1 0 59348550 103120896 22424 996147200 134512640 135215973 4294956304 18446744073709551615 134597297 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 25176 22424 412 171 0 24101 0
Current children cumulated CPU time (s) 161.74
Current children cumulated vsize (KiB) 100704

[startup+222.301 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19677
/proc/meminfo: memFree=1155800/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=100704 CPUtime=221.72
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 35545 662 0 0 22154 18 0 0 25 0 1 0 59348550 103120896 22426 996147200 134512640 135215973 4294956304 18446744073709551615 134585880 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 25176 22426 413 171 0 24101 0
Current children cumulated CPU time (s) 221.72
Current children cumulated vsize (KiB) 100704

[startup+282.302 s]
/proc/loadavg: 2.00 1.99 1.99 3/73 19677
/proc/meminfo: memFree=1152600/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=101764 CPUtime=281.7
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 36555 662 0 0 28152 18 0 0 25 0 1 0 59348550 104206336 22704 996147200 134512640 135215973 4294956304 18446744073709551615 135094982 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 25441 22704 413 171 0 24366 0
Current children cumulated CPU time (s) 281.7
Current children cumulated vsize (KiB) 101764

[startup+342.301 s]
/proc/loadavg: 2.00 1.99 1.99 2/68 19694
/proc/meminfo: memFree=1195456/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=103476 CPUtime=341.68
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 106900 662 0 0 34129 39 0 0 25 0 1 0 59348550 105959424 23143 996147200 134512640 135215973 4294956304 18446744073709551615 134589811 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 25869 23143 413 171 0 24794 0
Current children cumulated CPU time (s) 341.68
Current children cumulated vsize (KiB) 103476

[startup+402.302 s]
/proc/loadavg: 2.03 2.00 2.00 3/82 19716
/proc/meminfo: memFree=1115088/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=116412 CPUtime=401.1
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 197725 662 0 0 40038 72 0 0 25 0 1 0 59348550 119205888 26372 996147200 134512640 135215973 4294956304 18446744073709551615 134585681 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 29103 26372 413 171 0 28028 0
Current children cumulated CPU time (s) 401.1
Current children cumulated vsize (KiB) 116412

[startup+462.301 s]
/proc/loadavg: 2.01 2.00 2.00 3/82 19716
/proc/meminfo: memFree=1087248/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=128808 CPUtime=460.53
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 256217 662 0 0 45961 92 0 0 25 0 1 0 59348550 131899392 29476 996147200 134512640 135215973 4294956304 18446744073709551615 134583660 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 32202 29476 413 171 0 31127 0
Current children cumulated CPU time (s) 460.53
Current children cumulated vsize (KiB) 128808

[startup+522.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/82 19716
/proc/meminfo: memFree=1062416/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=140148 CPUtime=519.98
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 331900 662 0 0 51880 118 0 0 25 0 1 0 59348550 143511552 32325 996147200 134512640 135215973 4294956304 18446744073709551615 134600809 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 35037 32325 413 171 0 33962 0
Current children cumulated CPU time (s) 519.98
Current children cumulated vsize (KiB) 140148

[startup+582.302 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 19717
/proc/meminfo: memFree=1026248/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=147804 CPUtime=579.42
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 405047 662 0 0 57799 143 0 0 25 0 1 0 59348550 151351296 34224 996147200 134512640 135215973 4294956304 18446744073709551615 134524388 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 36951 34224 413 171 0 35876 0
Current children cumulated CPU time (s) 579.42
Current children cumulated vsize (KiB) 147804

[startup+642.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 19717
/proc/meminfo: memFree=995784/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=153608 CPUtime=638.87
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 450175 662 0 0 63728 159 0 0 25 0 1 0 59348550 157294592 35676 996147200 134512640 135215973 4294956304 18446744073709551615 134585786 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 38402 35676 413 171 0 37327 0
Current children cumulated CPU time (s) 638.87
Current children cumulated vsize (KiB) 153608

[startup+702.302 s]

################
# More data... #
################

[startup+882.302 s]
/proc/loadavg: 2.10 2.06 2.01 3/83 19719
/proc/meminfo: memFree=358088/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=189764 CPUtime=876.68
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 782428 662 0 0 87405 263 0 0 25 0 1 0 59348550 194318336 44751 996147200 134512640 135215973 4294956304 18446744073709551615 134600785 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 47441 44751 413 171 0 46366 0
Current children cumulated CPU time (s) 876.68
Current children cumulated vsize (KiB) 189764

[startup+942.301 s]
/proc/loadavg: 2.16 2.09 2.02 4/83 19720
/proc/meminfo: memFree=310720/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=203492 CPUtime=936.13
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 873096 662 0 0 93320 293 0 0 25 0 1 0 59348550 208375808 48189 996147200 134512640 135215973 4294956304 18446744073709551615 134585666 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 50873 48189 413 171 0 49798 0
Current children cumulated CPU time (s) 936.13
Current children cumulated vsize (KiB) 203492

[startup+1002.3 s]
/proc/loadavg: 2.58 2.21 2.06 4/83 19720
/proc/meminfo: memFree=305088/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=209036 CPUtime=995.57
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 928165 662 0 0 99245 312 0 0 25 0 1 0 59348550 214052864 49578 996147200 134512640 135215973 4294956304 18446744073709551615 134591443 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 52259 49578 413 171 0 51184 0
Current children cumulated CPU time (s) 995.57
Current children cumulated vsize (KiB) 209036

[startup+1062.3 s]
/proc/loadavg: 2.55 2.29 2.10 3/83 19720
/proc/meminfo: memFree=299008/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=215104 CPUtime=1055
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 995676 662 0 0 105165 335 0 0 25 0 1 0 59348550 220266496 51087 996147200 134512640 135215973 4294956304 18446744073709551615 135096346 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 53776 51087 413 171 0 52701 0
Current children cumulated CPU time (s) 1055
Current children cumulated vsize (KiB) 215104

[startup+1122.3 s]
/proc/loadavg: 2.20 2.23 2.09 3/83 19720
/proc/meminfo: memFree=295168/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=218800 CPUtime=1114.44
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1045058 662 0 0 111090 354 0 0 25 0 1 0 59348550 224051200 52035 996147200 134512640 135215973 4294956304 18446744073709551615 134583607 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 54700 52035 413 171 0 53625 0
Current children cumulated CPU time (s) 1114.44
Current children cumulated vsize (KiB) 218800

[startup+1182.3 s]
/proc/loadavg: 2.07 2.19 2.08 3/83 19720
/proc/meminfo: memFree=293312/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=220644 CPUtime=1173.88
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1089446 662 0 0 117018 370 0 0 25 0 1 0 59348550 225939456 52503 996147200 134512640 135215973 4294956304 18446744073709551615 134585786 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 55161 52503 413 171 0 54086 0
Current children cumulated CPU time (s) 1173.88
Current children cumulated vsize (KiB) 220644

[startup+1242.3 s]
/proc/loadavg: 2.07 2.16 2.08 3/83 19726
/proc/meminfo: memFree=288568/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=225124 CPUtime=1233.31
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1146687 662 0 0 122943 388 0 0 25 0 1 0 59348550 230526976 53624 996147200 134512640 135215973 4294956304 18446744073709551615 134600888 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 56281 53624 413 171 0 55206 0
Current children cumulated CPU time (s) 1233.31
Current children cumulated vsize (KiB) 225124

[startup+1302.3 s]
/proc/loadavg: 2.06 2.15 2.08 3/83 19726
/proc/meminfo: memFree=287032/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=226704 CPUtime=1292.74
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1188306 662 0 0 128870 404 0 0 25 0 1 0 59348550 232144896 54007 996147200 134512640 135215973 4294956304 18446744073709551615 4158960180 0 0 4096 0 0 0 0 17 1 0 0
/proc/19640/statm: 56676 54007 413 171 0 55601 0
Current children cumulated CPU time (s) 1292.74
Current children cumulated vsize (KiB) 226704

[startup+1362.3 s]
/proc/loadavg: 2.00 2.12 2.07 3/82 19799
/proc/meminfo: memFree=1020752/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=232248 CPUtime=1352.26
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1250456 662 0 0 134801 425 0 0 25 0 1 0 59348550 237821952 55401 996147200 134512640 135215973 4294956304 18446744073709551615 134585720 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 58062 55401 413 171 0 56987 0
Current children cumulated CPU time (s) 1352.26
Current children cumulated vsize (KiB) 232248

[startup+1422.31 s]
/proc/loadavg: 2.17 2.14 2.08 3/82 19799
/proc/meminfo: memFree=987536/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=242760 CPUtime=1412.23
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1343629 662 0 0 140773 450 0 0 25 0 1 0 59348550 248586240 58050 996147200 134512640 135215973 4294956304 18446744073709551615 134599858 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 60690 58050 413 171 0 59615 0
Current children cumulated CPU time (s) 1412.23
Current children cumulated vsize (KiB) 242760

[startup+1482.3 s]
/proc/loadavg: 2.06 2.11 2.08 3/82 19799
/proc/meminfo: memFree=964880/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=253484 CPUtime=1472.21
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1433762 662 0 0 146745 476 0 0 25 0 1 0 59348550 259567616 60709 996147200 134512640 135215973 4294956304 18446744073709551615 134597628 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 63371 60709 413 171 0 62296 0
Current children cumulated CPU time (s) 1472.21
Current children cumulated vsize (KiB) 253484

[startup+1542.3 s]
/proc/loadavg: 2.02 2.09 2.07 3/82 19799
/proc/meminfo: memFree=941072/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=264696 CPUtime=1532.19
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1523465 662 0 0 152717 502 0 0 25 0 1 0 59348550 271048704 63515 996147200 134512640 135215973 4294956304 18446744073709551615 135097822 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 66174 63515 413 171 0 65099 0
Current children cumulated CPU time (s) 1532.19
Current children cumulated vsize (KiB) 264696

[startup+1602.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/82 19799
/proc/meminfo: memFree=921552/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=275896 CPUtime=1592.17
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1610964 662 0 0 158689 528 0 0 25 0 1 0 59348550 282517504 66281 996147200 134512640 135215973 4294956304 18446744073709551615 134585720 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 68974 66281 413 171 0 67899 0
Current children cumulated CPU time (s) 1592.17
Current children cumulated vsize (KiB) 275896

[startup+1662.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/83 19800
/proc/meminfo: memFree=886344/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=285120 CPUtime=1652.14
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1697362 662 0 0 164660 554 0 0 25 0 1 0 59348550 291962880 68621 996147200 134512640 135215973 4294956304 18446744073709551615 134589777 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 71280 68621 413 171 0 70205 0
Current children cumulated CPU time (s) 1652.14
Current children cumulated vsize (KiB) 285120

[startup+1722.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/83 19800
/proc/meminfo: memFree=874312/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=293952 CPUtime=1712.11
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1784973 662 0 0 170632 579 0 0 25 0 1 0 59348550 301006848 70832 996147200 134512640 135215973 4294956304 18446744073709551615 134589769 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 73488 70832 413 171 0 72413 0
Current children cumulated CPU time (s) 1712.11
Current children cumulated vsize (KiB) 293952

[startup+1782.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/83 19800
/proc/meminfo: memFree=809224/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=308200 CPUtime=1772.1
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1874951 662 0 0 176605 605 0 0 25 0 1 0 59348550 315596800 74434 996147200 134512640 135215973 4294956304 18446744073709551615 134585720 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 77050 74434 413 171 0 75975 0
Current children cumulated CPU time (s) 1772.1
Current children cumulated vsize (KiB) 308200



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1810.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/83 19800
/proc/meminfo: memFree=786760/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=310048 CPUtime=1800.09
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1905657 662 0 0 179395 614 0 0 25 0 1 0 59348550 317489152 74884 996147200 134512640 135215973 4294956304 18446744073709551615 134585880 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 77512 74884 413 171 0 76437 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 310048

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1810.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/83 19800
/proc/meminfo: memFree=786760/2055920 swapFree=4192812/4192956
[pid=19640] ppid=19638 vsize=310048 CPUtime=1800.09
/proc/19640/stat : 19640 (pcs.big) R 19638 19640 18013 0 -1 4194304 1905657 662 0 0 179395 614 0 0 25 0 1 0 59348550 317489152 74884 996147200 134512640 135215973 4294956304 18446744073709551615 134585880 0 0 4096 0 0 0 0 17 0 0 0
/proc/19640/statm: 77512 74884 413 171 0 76437 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 310048

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1810.36
CPU time (s): 1800.17
CPU user time (s): 1793.96
CPU system time (s): 6.20306
CPU usage (%): 99.4372
Max. virtual memory (cumulated for all children) (KiB): 310536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.96
system time used= 6.20306
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1906319
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20
involuntary context switches= 44088

runsolver used 2.25766 second user time and 5.59115 second system time

The end

Launcher Data 

Begin job on node43 at 2009-07-16 07:40:47
IDJOB=2083265
IDBENCH=57759
IDSOLVER=734
FILE ID=node43/2083265-1247722846
PBS_JOBID= 9521312
Free space on /tmp= 66168 MiB

SOLVER NAME= pcs-restart 0.2.restart
BENCH NAME= CPAI08/csp/fapp/fapp39/normalized-fapp39-2750-3.xml
COMMAND LINE= HOME/pcssolve -s RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2083265-1247722846/watcher-2083265-1247722846 -o /tmp/evaluation-result-2083265-1247722846/solver-2083265-1247722846 -C 1800 -W 2000 -M 900  HOME/pcssolve -s 256019767 HOME/instance-2083265-1247722846.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 19abf0750b237395707bd7efde90eb33
RANDOM SEED=256019767

node43.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1164856 kB
Buffers:         99456 kB
Cached:         574832 kB
SwapCached:          0 kB
Active:         218172 kB
Inactive:       570460 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1164856 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            5004 kB
Writeback:           0 kB
Mapped:         125780 kB
Slab:            87672 kB
Committed_AS:   632732 kB
PageTables:       2096 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66180 MiB
End job on node43 at 2009-07-16 08:10:59