Trace number 4407683

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
(reference) PicatSAT 2019-09-12? (TO) 2400.03 2400.13

General information on the benchmark

NameMagicSquare/MagicSquare-sum-s1/
MagicSquare-27-sum.xml
MD5SUMd104f54931e81c640cdf77e394aea107
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables729
Number of constraints57
Number of domains1
Minimum domain size729
Maximum domain size729
Distribution of domain sizes[{"size":729,"count":729}]
Minimum variable degree3
Maximum variable degree5
Distribution of variable degrees[{"degree":3,"count":676},{"degree":4,"count":52},{"degree":5,"count":1}]
Minimum constraint arity27
Maximum constraint arity729
Distribution of constraint arities[{"arity":27,"count":56},{"arity":729,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":56}]
Optimization problemNO
Type of objective

Solver Data 

80.38/80.41	c xcsp_picat version 2.7b12 (9/12/2019)

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10591 MiB free)
  memory of node 1: 16384 MiB (11987 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407683-1569512053/watcher-4407683-1569512053 -o /var/tmp/evaluation-result-4407683-1569512053/solver-4407683-1569512053 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node126-1569509603-1619 --watchdog 2560 xcsp_picat HOME/instance-4407683-1569512053.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2209, runsolver pid=2206
Current StackSize limit: 8192 KiB


[startup+0.100185 s]*
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=23083116/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2031716 memory=43172 CPUtime=0.09 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1750 0 0 0 9 0 0 0 20 0 1 0 527473027 2080477184 10793 33554432000 4194304 5870510 140732846161296 140732846158440 4804553 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 507929 10793 875 410 0 503402 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 43172 KiB

[startup+0.209904 s]*
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=23044112/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2084400 memory=83856 CPUtime=0.21 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 2219 0 0 0 20 1 0 0 20 0 1 0 527473027 2134425600 20964 33554432000 4194304 5870510 140732846161296 140732846158440 5245088 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 521100 20964 880 410 0 516573 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2084400 KiB
Current children cumulated memory: 83856 KiB

[startup+0.309905 s]*
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=23023632/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2084400 memory=102288 CPUtime=0.3 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 2228 0 0 0 29 1 0 0 20 0 1 0 527473027 2134425600 25572 33554432000 4194304 5870510 140732846161296 140732846158440 4693348 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 521100 25572 880 410 0 516573 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2084400 KiB
Current children cumulated memory: 102288 KiB

[startup+0.7004 s]
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=22983844/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2119844 memory=186900 CPUtime=0.69 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 2859 0 0 0 65 4 0 0 20 0 1 0 527473027 2170720256 46725 33554432000 4194304 5870510 140732846161296 140732846160264 4456112 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 529961 46725 880 410 0 525434 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2119844 KiB
Current children cumulated memory: 186900 KiB

[startup+1.5004 s]
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=22919176/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2285036 memory=362748 CPUtime=1.49 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 16310 0 0 0 140 9 0 0 20 0 1 0 527473027 2339876864 90687 33554432000 4194304 5870510 140732846161296 140732846160264 140711313485035 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 571259 90687 887 410 0 566732 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2285036 KiB
Current children cumulated memory: 362748 KiB

[startup+3.10985 s]
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=22520172/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2539392 memory=610556 CPUtime=3.1 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 48321 0 0 0 294 16 0 0 20 0 1 0 527473027 2600337408 152639 33554432000 4194304 5870510 140732846161296 140732846160184 4470136 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 634848 152639 945 410 0 630321 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2539392 KiB
Current children cumulated memory: 610556 KiB

[startup+6.30039 s]
/proc/loadavg: 2.01 2.03 1.87 3/200 2210
/proc/meminfo: memFree=22225820/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=2882204 memory=919232 CPUtime=6.29 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 98302 0 0 0 604 25 0 0 20 0 1 0 527473027 2951376896 229808 33554432000 4194304 5870510 140732846161296 140732846160472 4475058 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 720551 229808 945 410 0 716024 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2882204 KiB
Current children cumulated memory: 919232 KiB

[startup+12.7004 s]
/proc/loadavg: 2.01 2.03 1.87 3/200 2211
/proc/meminfo: memFree=22031436/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3126780 memory=1090188 CPUtime=12.69 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 241620 0 0 0 1233 36 0 0 20 0 1 0 527473027 3201822720 272547 33554432000 4194304 5870510 140732846161296 140732846160472 5337297 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 781695 272547 949 410 0 777168 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 3126780 KiB
Current children cumulated memory: 1090188 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.03 1.87 3/200 2211
/proc/meminfo: memFree=22030536/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3126780 memory=1091088 CPUtime=25.49 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 272702 0 0 0 2511 38 0 0 20 0 1 0 527473027 3201822720 272772 33554432000 4194304 5870510 140732846161296 140732846159800 5337257 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 781695 272772 952 410 0 777168 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 3126780 KiB
Current children cumulated memory: 1091088 KiB

[startup+51.1097 s]
/proc/loadavg: 2.01 2.02 1.88 3/200 2274
/proc/meminfo: memFree=24194176/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3065480 memory=1001832 CPUtime=51.09 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 441126 0 0 0 5055 54 0 0 20 0 1 0 527473027 3139051520 250458 33554432000 4194304 5870510 140732846161296 140732846160552 5282429 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 766370 250458 975 410 0 761843 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1001832 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.02 1.88 3/199 2278
/proc/meminfo: memFree=24172880/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3065480 memory=1024364 CPUtime=102.28 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 500037 0 0 0 10168 60 0 0 20 0 1 0 527473027 3139051520 256091 33554432000 4194304 5870510 140732846161296 140732846160408 140711319114291 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 766370 256091 976 410 0 761843 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1024364 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 1.89 3/199 2282
/proc/meminfo: memFree=23901972/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1292348 CPUtime=162.25 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 546640 0 0 0 16156 69 0 0 20 0 1 0 527473027 3359133696 323087 33554432000 4194304 5870510 140732846161296 140732846160248 5283133 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 323087 976 410 0 815574 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1292348 KiB

[startup+222.3 s]
/proc/loadavg: 2.05 2.03 1.90 3/199 2286
/proc/meminfo: memFree=24024624/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1171032 CPUtime=222.25 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 607747 0 0 0 22142 83 0 0 20 0 1 0 527473027 3359133696 292758 33554432000 4194304 5870510 140732846161296 140732846160248 5258212 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 292758 976 410 0 815574 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1171032 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.02 1.90 3/199 2353
/proc/meminfo: memFree=24113344/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3065480 memory=1086220 CPUtime=282.24 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 654428 0 0 0 28124 100 0 0 20 0 1 0 527473027 3139051520 271555 33554432000 4194304 5870510 140732846161296 140732846160312 5258670 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 766370 271555 976 410 0 761843 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1086220 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 1.91 3/199 2357
/proc/meminfo: memFree=23917116/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1278828 CPUtime=342.23 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 665650 0 0 0 34117 106 0 0 20 0 1 0 527473027 3359133696 319707 33554432000 4194304 5870510 140732846161296 140732846160248 5288765 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 319707 976 410 0 815574 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1278828 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 1.92 3/199 2442
/proc/meminfo: memFree=23910264/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1229676 CPUtime=402.22 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 715888 0 0 0 40105 117 0 0 20 0 1 0 527473027 3359133696 307419 33554432000 4194304 5870510 140732846161296 140732846160248 5276683 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 307419 976 410 0 815574 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1229676 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 1.92 3/200 2449
/proc/meminfo: memFree=24056116/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3065480 memory=1082524 CPUtime=462.22 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 780735 0 0 0 46094 128 0 0 20 0 1 0 527473027 3139051520 270631 33554432000 4194304 5870510 140732846161296 140732846160312 5306820 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 766370 270631 976 410 0 761843 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1082524 KiB


################
# More data... #
################

/proc/2209/statm: 766370 275614 976 410 0 761843 0
Current children cumulated CPU time: 1662.21 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1102456 KiB

[startup+1722.3 s]
/proc/loadavg: 2.05 2.07 2.01 3/200 2587
/proc/meminfo: memFree=23627960/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1286776 CPUtime=1722.21 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1275342 0 0 0 171908 313 0 0 20 0 1 0 527473027 3359133696 321694 33554432000 4194304 5870510 140732846161296 140732846160248 5262793 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 321694 976 410 0 815574 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1286776 KiB

[startup+1782.3 s]
/proc/loadavg: 2.02 2.06 2.01 3/200 2591
/proc/meminfo: memFree=23473880/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3629652 memory=1437064 CPUtime=1782.21 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1277550 0 0 0 177905 316 0 0 20 0 1 0 527473027 3716763648 359266 33554432000 4194304 5870510 140732846161296 140732846160248 5262672 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 907413 359266 976 410 0 902886 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 3629652 KiB
Current children cumulated memory: 1437064 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.05 2.01 3/200 2595
/proc/meminfo: memFree=23324804/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3629652 memory=1586568 CPUtime=1842.2 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1306688 0 0 0 183900 320 0 0 20 0 1 0 527473027 3716763648 396642 33554432000 4194304 5870510 140732846161296 140732846160248 5263058 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 907413 396642 976 410 0 902886 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 3629652 KiB
Current children cumulated memory: 1586568 KiB

[startup+1902.3 s]
/proc/loadavg: 2.04 2.05 2.02 3/199 2623
/proc/meminfo: memFree=23186844/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=4197180 memory=1723784 CPUtime=1902.21 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1332878 0 0 0 189896 325 0 0 20 0 1 0 527473027 4297912320 430946 33554432000 4194304 5870510 140732846161296 140732846160248 5262779 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 1049295 430946 976 410 0 1044768 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 4197180 KiB
Current children cumulated memory: 1723784 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.04 2.02 3/199 2627
/proc/meminfo: memFree=23047696/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=4197180 memory=1846664 CPUtime=1962.2 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1350169 0 0 0 195892 328 0 0 20 0 1 0 527473027 4297912320 461666 33554432000 4194304 5870510 140732846161296 140732846160248 5282759 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 1049295 461666 976 410 0 1044768 0
Current children cumulated CPU time: 1962.2 s
Current children cumulated vsize: 4197180 KiB
Current children cumulated memory: 1846664 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.04 2.02 3/199 2631
/proc/meminfo: memFree=23351596/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3629652 memory=1540248 CPUtime=2022.2 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1422132 0 0 0 201872 348 0 0 20 0 1 0 527473027 3716763648 385062 33554432000 4194304 5870510 140732846161296 140732846160312 5262777 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 907413 385062 976 410 0 902886 0
Current children cumulated CPU time: 2022.2 s
Current children cumulated vsize: 3629652 KiB
Current children cumulated memory: 1540248 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 2.02 3/199 2637
/proc/meminfo: memFree=23204308/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3629652 memory=1689752 CPUtime=2082.2 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1422674 0 0 0 207870 350 0 0 20 0 1 0 527473027 3716763648 422438 33554432000 4194304 5870510 140732846161296 140732846160312 5282736 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 907413 422438 976 410 0 902886 0
Current children cumulated CPU time: 2082.2 s
Current children cumulated vsize: 3629652 KiB
Current children cumulated memory: 1689752 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.02 3/199 2641
/proc/meminfo: memFree=23031104/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=4197180 memory=1826968 CPUtime=2142.19 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1424206 0 0 0 213867 352 0 0 20 0 1 0 527473027 4297912320 456742 33554432000 4194304 5870510 140732846161296 140732846160248 5262793 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 1049295 456742 976 410 0 1044768 0
Current children cumulated CPU time: 2142.19 s
Current children cumulated vsize: 4197180 KiB
Current children cumulated memory: 1826968 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.02 3/200 2653
/proc/meminfo: memFree=22907556/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=4197180 memory=1951896 CPUtime=2202.19 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1425308 0 0 0 219865 354 0 0 20 0 1 0 527473027 4297912320 487974 33554432000 4194304 5870510 140732846161296 140732846160248 5282759 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 1049295 487974 976 410 0 1044768 0
Current children cumulated CPU time: 2202.19 s
Current children cumulated vsize: 4197180 KiB
Current children cumulated memory: 1951896 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/200 2659
/proc/meminfo: memFree=23369984/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3629652 memory=1521408 CPUtime=2262.19 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1429216 0 0 0 225853 366 0 0 20 0 1 0 527473027 3716763648 380352 33554432000 4194304 5870510 140732846161296 140732846160312 5288765 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 907413 380352 976 410 0 902886 0
Current children cumulated CPU time: 2262.19 s
Current children cumulated vsize: 3629652 KiB
Current children cumulated memory: 1521408 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/200 2663
/proc/meminfo: memFree=23848512/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3065480 memory=1043252 CPUtime=2322.19 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1433004 0 0 0 231842 377 0 0 20 0 1 0 527473027 3139051520 260813 33554432000 4194304 5870510 140732846161296 140732846160312 5258344 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 766370 260813 976 410 0 761843 0
Current children cumulated CPU time: 2322.19 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1043252 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/200 2667
/proc/meminfo: memFree=23748012/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3065480 memory=1143604 CPUtime=2382.19 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1434752 0 0 0 237840 379 0 0 20 0 1 0 527473027 3139051520 285901 33554432000 4194304 5870510 140732846161296 140732846160312 5258735 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 766370 285901 976 410 0 761843 0
Current children cumulated CPU time: 2382.19 s
Current children cumulated vsize: 3065480 KiB
Current children cumulated memory: 1143604 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.00 2.01 2.02 3/200 2669
/proc/meminfo: memFree=23731744/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1159536 CPUtime=2400 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1435733 0 0 0 239620 380 0 0 20 0 1 0 527473027 3359133696 289884 33554432000 4194304 5870510 140732846161296 140732846160248 5282382 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 289884 976 410 0 815574 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1159536 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.13 s]
# the end of solver process 2209 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2396.21 s, system=3.82793 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.00 2.01 2.02 3/200 2669
/proc/meminfo: memFree=23731744/32770624 swapFree=66997700/67108860
[pid=2209] ppid=2206 vsize=3280404 memory=1159536 CPUtime=2400 cores=1,3,5,7
/proc/2209/stat : 2209 (xcsp_picat) R 2206 2209 1583 0 -1 4202496 1435733 0 0 0 239620 380 0 0 20 0 1 0 527473027 3359133696 289884 33554432000 4194304 5870510 140732846161296 140732846160248 5282382 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 21131264 140732846162951 140732846163033 140732846163033 140732846165958 0
/proc/2209/statm: 820101 289884 976 410 0 815574 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 3280404 KiB
Current children cumulated memory: 1159536 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.13
CPU time (s): 2400.03
CPU user time (s): 2396.21
CPU system time (s): 3.82793
CPU usage (%): 99.9959
Max. virtual memory (cumulated for all children) (KiB): 5105228
Max. memory (cumulated for all children) (KiB): 2685832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2396.21
system time used= 3.82793
maximum resident set size= 2685832
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1435733
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 118
involuntary context switches= 1747


# summary of solver processes directly reported to runsolver:
#   pid: 2209
#   total CPU time (s): 2400.03
#   total CPU user time (s): 2396.21
#   total CPU system time (s): 3.82793

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0569 second user time and 17.5154 second system time

The end

Launcher Data 

Begin job on node126 at 2019-09-26 17:33:35
IDJOB=4407683
IDBENCH=133249
IDSOLVER=2873
FILE ID=node126/4407683-1569512053
RUNJOBID= node126-1569509603-1619
PBS_JOBID= 21705789
Free space on /var/tmp= 13512 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/MagicSquare/MagicSquare-sum-s1/MagicSquare-27-sum.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407683-1569512053/watcher-4407683-1569512053 -o /var/tmp/evaluation-result-4407683-1569512053/solver-4407683-1569512053 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node126-1569509603-1619 --watchdog 2560  xcsp_picat HOME/instance-4407683-1569512053.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d104f54931e81c640cdf77e394aea107
RANDOM SEED=939791797

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23120716 kB
MemAvailable:   29727808 kB
Buffers:          127748 kB
Cached:          6695484 kB
SwapCached:         7368 kB
Active:          5442380 kB
Inactive:        3486476 kB
Active(anon):    2110976 kB
Inactive(anon):    62172 kB
Active(file):    3331404 kB
Inactive(file):  3424304 kB
Unevictable:      109404 kB
Mlocked:          109404 kB
SwapTotal:      67108860 kB
SwapFree:       66997700 kB
Dirty:              3412 kB
Writeback:             0 kB
AnonPages:       2209072 kB
Mapped:            23792 kB
Shmem:             58648 kB
Slab:             309252 kB
SReclaimable:     279844 kB
SUnreclaim:        29408 kB
KernelStack:        3552 kB
PageTables:         9648 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    4816180 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1949696 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /var/tmp at the end= 13508 MiB
End job on node126 at 2019-09-26 18:13:35