Trace number 4303334

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2519.82 2520.02

General information on the benchmark

NameQuasigroups/
QuasiGroup-7-14_c18.xml
MD5SUM4dff686a8a5225f7abc28d59168fc0d9
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables392
Number of constraints366
Number of domains1
Minimum domain size14
Maximum domain size14
Distribution of domain sizes[{"size":14,"count":378}]
Minimum variable degree0
Maximum variable degree29
Distribution of variable degrees[{"degree":0,"count":14},{"degree":2,"count":182},{"degree":28,"count":14},{"degree":29,"count":182}]
Minimum constraint arity14
Maximum constraint arity196
Distribution of constraint arities[{"arity":14,"count":1},{"arity":16,"count":364},{"arity":196,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":364}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10697 MiB free)
  memory of node 1: 16384 MiB (6402 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303334-1534029581/watcher-4303334-1534029581 -o /tmp/evaluation-result-4303334-1534029581/solver-4303334-1534029581 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1534027058-25371 --watchdog 2580 xcsp_picat HOME/instance-4303334-1534029581.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=25691, runsolver pid=25688

[startup+0.100192 s]*
/proc/loadavg: 2.03 2.15 2.05 3/187 25692
/proc/meminfo: memFree=17495512/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2034000 memory=18188 CPUtime=0.09 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 2155 0 0 0 9 0 0 0 20 0 1 0 220521266 2082816000 4547 33554432000 4194304 5849708 140730187807056 140730187806280 139954466705287 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 508500 4547 689 405 0 505445 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 2034000 KiB
Current children cumulated memory: 18188 KiB

[startup+0.209381 s]*
/proc/loadavg: 2.03 2.15 2.05 3/187 25692
/proc/meminfo: memFree=17495140/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2034132 memory=18188 CPUtime=0.2 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 2188 0 0 0 20 0 0 0 20 0 1 0 220521266 2082951168 4547 33554432000 4194304 5849708 140730187807056 140730187806280 139954466705287 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 508533 4547 689 405 0 505478 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2034132 KiB
Current children cumulated memory: 18188 KiB

[startup+0.308664 s]*
/proc/loadavg: 2.03 2.15 2.05 3/187 25692
/proc/meminfo: memFree=17495140/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2034264 memory=18448 CPUtime=0.31 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 2221 0 0 0 30 1 0 0 20 0 1 0 220521266 2083086336 4612 33554432000 4194304 5849708 140730187807056 140730187806280 139954466705287 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 508566 4612 689 405 0 505511 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2034264 KiB
Current children cumulated memory: 18448 KiB

[startup+0.700226 s]
/proc/loadavg: 2.03 2.15 2.05 3/187 25692
/proc/meminfo: memFree=17495140/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2034520 memory=18516 CPUtime=0.69 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 2285 0 0 0 68 1 0 0 20 0 1 0 220521266 2083348480 4629 33554432000 4194304 5849708 140730187807056 140730187806280 139954466243159 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 508630 4629 689 405 0 505575 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2034520 KiB
Current children cumulated memory: 18516 KiB

[startup+1.50023 s]
/proc/loadavg: 2.03 2.15 2.05 3/187 25692
/proc/meminfo: memFree=17495028/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2035032 memory=19028 CPUtime=1.48 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 2413 0 0 0 146 2 0 0 20 0 1 0 220521266 2083872768 4757 33554432000 4194304 5849708 140730187807056 140730187806280 5605554 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 508758 4757 689 405 0 505703 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 2035032 KiB
Current children cumulated memory: 19028 KiB

[startup+3.10881 s]
/proc/loadavg: 2.03 2.15 2.05 3/187 25692
/proc/meminfo: memFree=17492840/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2036056 memory=20308 CPUtime=3.09 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 2907 0 0 0 305 4 0 0 20 0 1 0 220521266 2084921344 5077 33554432000 4194304 5849708 140730187807056 140730187806024 5472660 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 509014 5077 689 405 0 505959 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 2036056 KiB
Current children cumulated memory: 20308 KiB

[startup+6.30023 s]
/proc/loadavg: 2.03 2.14 2.05 3/187 25692
/proc/meminfo: memFree=17485968/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2041176 memory=25328 CPUtime=6.28 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 6435 0 0 0 622 6 0 0 20 0 1 0 220521266 2090164224 6332 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 510294 6332 722 405 0 507239 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 2041176 KiB
Current children cumulated memory: 25328 KiB

[startup+12.7003 s]
/proc/loadavg: 2.02 2.14 2.05 3/187 25692
/proc/meminfo: memFree=17482012/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2043160 memory=27416 CPUtime=12.68 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 10058 0 0 0 1254 14 0 0 20 0 1 0 220521266 2092195840 6854 33554432000 4194304 5849708 140730187807056 140730187806056 4211607 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 510790 6854 722 405 0 507735 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 2043160 KiB
Current children cumulated memory: 27416 KiB

[startup+25.5004 s]
/proc/loadavg: 2.02 2.13 2.05 3/187 25699
/proc/meminfo: memFree=17474084/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2046068 memory=30184 CPUtime=25.48 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 22374 0 0 0 2520 28 0 0 20 0 1 0 220521266 2095173632 7546 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 511517 7546 722 405 0 508462 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 2046068 KiB
Current children cumulated memory: 30184 KiB

[startup+51.1095 s]
/proc/loadavg: 2.01 2.12 2.05 3/187 25760
/proc/meminfo: memFree=17467256/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2054192 memory=40624 CPUtime=51.09 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 39625 0 0 0 5054 55 0 0 20 0 1 0 220521266 2103492608 10156 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 513548 10156 722 405 0 510493 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2054192 KiB
Current children cumulated memory: 40624 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.10 2.05 3/187 25761
/proc/meminfo: memFree=17466068/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2054588 memory=43324 CPUtime=102.27 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 72518 0 0 0 10126 101 0 0 20 0 1 0 220521266 2103898112 10831 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 513647 10831 722 405 0 510592 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 2054588 KiB
Current children cumulated memory: 43324 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.09 2.05 3/187 25762
/proc/meminfo: memFree=17448296/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2065268 memory=53884 CPUtime=162.27 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 106709 0 0 0 16085 142 0 0 20 0 1 0 220521266 2114834432 13471 33554432000 4194304 5849708 140730187807056 140730187805784 5359170 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 516317 13471 722 405 0 513262 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2065268 KiB
Current children cumulated memory: 53884 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.07 2.05 3/187 25763
/proc/meminfo: memFree=17447100/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2060608 memory=49292 CPUtime=222.27 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 124449 0 0 0 22049 178 0 0 20 0 1 0 220521266 2110062592 12323 33554432000 4194304 5849708 140730187807056 140730187806056 5438278 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 515152 12323 722 405 0 512097 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2060608 KiB
Current children cumulated memory: 49292 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 25764
/proc/meminfo: memFree=17450440/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2061360 memory=49844 CPUtime=282.26 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 143376 0 0 0 28021 205 0 0 20 0 1 0 220521266 2110832640 12461 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 515340 12461 722 405 0 512285 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 2061360 KiB
Current children cumulated memory: 49844 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 25766
/proc/meminfo: memFree=17427952/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2081544 memory=70172 CPUtime=342.26 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 164385 0 0 0 33996 230 0 0 20 0 1 0 220521266 2131501056 17543 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 520386 17543 722 405 0 517331 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 2081544 KiB
Current children cumulated memory: 70172 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 25767
/proc/meminfo: memFree=17455876/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2056836 memory=45324 CPUtime=402.25 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 182951 0 0 0 39969 256 0 0 20 0 1 0 220521266 2106200064 11331 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 514209 11331 722 405 0 511154 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 2056836 KiB
Current children cumulated memory: 45324 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 25768
/proc/meminfo: memFree=17442124/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2066820 memory=55324 CPUtime=462.25 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 199919 0 0 0 45944 281 0 0 20 0 1 0 220521266 2116423680 13831 33554432000 4194304 5849708 140730187807056 140730187806216 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 516705 13831 722 405 0 513650 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 2066820 KiB
Current children cumulated memory: 55324 KiB


################
# More data... #
################

/proc/25691/statm: 521857 19024 722 405 0 518802 0
Current children cumulated CPU time: 1722.16 s
Current children cumulated vsize: 2087428 KiB
Current children cumulated memory: 76096 KiB

[startup+1782.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 25867
/proc/meminfo: memFree=16197420/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2125692 memory=114164 CPUtime=1782.16 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 538614 0 0 0 177490 726 0 0 20 0 1 0 220521266 2176708608 28541 33554432000 4194304 5849708 140730187807056 140730187806056 5335584 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 531423 28541 722 405 0 528368 0
Current children cumulated CPU time: 1782.16 s
Current children cumulated vsize: 2125692 KiB
Current children cumulated memory: 114164 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/188 25876
/proc/meminfo: memFree=15684432/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2091136 memory=79796 CPUtime=1842.15 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 553699 0 0 0 183470 745 0 0 20 0 1 0 220521266 2141323264 19949 33554432000 4194304 5849708 140730187807056 140730187806056 5437714 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 522784 19949 722 405 0 519729 0
Current children cumulated CPU time: 1842.15 s
Current children cumulated vsize: 2091136 KiB
Current children cumulated memory: 79796 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 25877
/proc/meminfo: memFree=15679652/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2096200 memory=84844 CPUtime=1902.14 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 568690 0 0 0 189448 766 0 0 20 0 1 0 220521266 2146508800 21211 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 524050 21211 722 405 0 520995 0
Current children cumulated CPU time: 1902.14 s
Current children cumulated vsize: 2096200 KiB
Current children cumulated memory: 84844 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 25878
/proc/meminfo: memFree=15680244/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2095916 memory=84484 CPUtime=1962.14 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 583910 0 0 0 195429 785 0 0 20 0 1 0 220521266 2146217984 21121 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 523979 21121 722 405 0 520924 0
Current children cumulated CPU time: 1962.14 s
Current children cumulated vsize: 2095916 KiB
Current children cumulated memory: 84484 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 25879
/proc/meminfo: memFree=15679140/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2096932 memory=85592 CPUtime=2022.13 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 599823 0 0 0 201410 803 0 0 20 0 1 0 220521266 2147258368 21398 33554432000 4194304 5849708 140730187807056 140730187806056 5335588 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 524233 21398 722 405 0 521178 0
Current children cumulated CPU time: 2022.13 s
Current children cumulated vsize: 2096932 KiB
Current children cumulated memory: 85592 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 25880
/proc/meminfo: memFree=15680044/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2095972 memory=84648 CPUtime=2082.13 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 614348 0 0 0 207392 821 0 0 20 0 1 0 220521266 2146275328 21162 33554432000 4194304 5849708 140730187807056 140730187806056 5438075 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 523993 21162 722 405 0 520938 0
Current children cumulated CPU time: 2082.13 s
Current children cumulated vsize: 2095972 KiB
Current children cumulated memory: 84648 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25882
/proc/meminfo: memFree=16174444/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2125980 memory=114700 CPUtime=2142.13 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 628250 0 0 0 213378 835 0 0 20 0 1 0 220521266 2177003520 28675 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 531495 28675 722 405 0 528440 0
Current children cumulated CPU time: 2142.13 s
Current children cumulated vsize: 2125980 KiB
Current children cumulated memory: 114700 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25883
/proc/meminfo: memFree=16225644/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2117464 memory=106120 CPUtime=2202.13 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 645198 0 0 0 219360 853 0 0 20 0 1 0 220521266 2168283136 26530 33554432000 4194304 5849708 140730187807056 140730187806056 5335584 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 529366 26530 722 405 0 526311 0
Current children cumulated CPU time: 2202.13 s
Current children cumulated vsize: 2117464 KiB
Current children cumulated memory: 106120 KiB

[startup+2262.3 s]
/proc/loadavg: 2.16 2.05 2.06 3/187 25884
/proc/meminfo: memFree=15370504/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2101544 memory=90096 CPUtime=2262.12 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 650511 0 0 0 225345 867 0 0 20 0 1 0 220521266 2151981056 22524 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 525386 22524 722 405 0 522331 0
Current children cumulated CPU time: 2262.12 s
Current children cumulated vsize: 2101544 KiB
Current children cumulated memory: 90096 KiB

[startup+2322.3 s]
/proc/loadavg: 2.41 2.16 2.09 3/187 25886
/proc/meminfo: memFree=15367256/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2104824 memory=93316 CPUtime=2322.12 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 663374 0 0 0 231329 883 0 0 20 0 1 0 220521266 2155339776 23329 33554432000 4194304 5849708 140730187807056 140730187806216 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 526206 23329 722 405 0 523151 0
Current children cumulated CPU time: 2322.12 s
Current children cumulated vsize: 2104824 KiB
Current children cumulated memory: 93316 KiB

[startup+2382.3 s]
/proc/loadavg: 2.15 2.13 2.09 3/187 25887
/proc/meminfo: memFree=15375272/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2097608 memory=86296 CPUtime=2382.11 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 678933 0 0 0 237312 899 0 0 20 0 1 0 220521266 2147950592 21574 33554432000 4194304 5849708 140730187807056 140730187806056 139954466705287 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 524402 21574 722 405 0 521347 0
Current children cumulated CPU time: 2382.11 s
Current children cumulated vsize: 2097608 KiB
Current children cumulated memory: 86296 KiB

[startup+2442.3 s]
/proc/loadavg: 2.05 2.10 2.08 3/187 25895
/proc/meminfo: memFree=15336396/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2135468 memory=124044 CPUtime=2442.1 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 683804 0 0 0 243292 918 0 0 20 0 1 0 220521266 2186719232 31011 33554432000 4194304 5849708 140730187807056 140730187806216 5437714 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 533867 31011 722 405 0 530812 0
Current children cumulated CPU time: 2442.1 s
Current children cumulated vsize: 2135468 KiB
Current children cumulated memory: 124044 KiB

[startup+2502.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/188 25922
/proc/meminfo: memFree=15872888/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2122476 memory=111196 CPUtime=2502.1 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 702487 0 0 0 249274 936 0 0 20 0 1 0 220521266 2173415424 27799 33554432000 4194304 5849708 140730187807056 140730187806056 5335530 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 530619 27799 722 405 0 527564 0
Current children cumulated CPU time: 2502.1 s
Current children cumulated vsize: 2122476 KiB
Current children cumulated memory: 111196 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.08 2.07 3/188 25922
/proc/meminfo: memFree=16206176/32770624 swapFree=67108796/67108860
[pid=25691] ppid=25688 vsize=2138840 memory=127316 CPUtime=2519.81 cores=0,2,4,6
/proc/25691/stat : 25691 (xcsp_picat) R 25688 25691 25340 0 -1 4202496 703007 0 0 0 251041 940 0 0 20 0 1 0 220521266 2190172160 31829 33554432000 4194304 5849708 140730187807056 140730187806056 5437714 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 20086784 140730187809974 140730187810052 140730187810052 140730187812810 0
/proc/25691/statm: 534710 31829 722 405 0 531655 0
Current children cumulated CPU time: 2519.81 s
Current children cumulated vsize: 2138840 KiB
Current children cumulated memory: 127316 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 25691 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2510.42 s, system=9.40631 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2519.82
CPU user time (s): 2510.42
CPU system time (s): 9.40631
CPU usage (%): 99.9924
Max. virtual memory (cumulated for all children) (KiB): 2142836
Max. memory (cumulated for all children) (KiB): 131508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2510.42
system time used= 9.40631
maximum resident set size= 131556
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 703007
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 3187


# summary of solver processes directly reported to runsolver:
#   pid: 25691
#   total CPU time (s): 2519.82
#   total CPU user time (s): 2510.42
#   total CPU system time (s): 9.40631

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.3909 second user time and 18.7481 second system time

The end

Launcher Data 

Begin job on node138 at 2018-08-12 01:19:41
IDJOB=4303334
IDBENCH=141615
IDSOLVER=2778
FILE ID=node138/4303334-1534029581
RUNJOBID= node138-1534027058-25371
PBS_JOBID= 21036965
Free space on /tmp= 24252 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-7-14_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303334-1534029581/watcher-4303334-1534029581 -o /tmp/evaluation-result-4303334-1534029581/solver-4303334-1534029581 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1534027058-25371 --watchdog 2580  xcsp_picat HOME/instance-4303334-1534029581.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4dff686a8a5225f7abc28d59168fc0d9
RANDOM SEED=1265572091

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        17511292 kB
MemAvailable:   31884852 kB
Buffers:          101480 kB
Cached:         14342524 kB
SwapCached:           12 kB
Active:          7170244 kB
Inactive:        7349476 kB
Active(anon):      19820 kB
Inactive(anon):   108460 kB
Active(file):    7150424 kB
Inactive(file):  7241016 kB
Unevictable:        7276 kB
Mlocked:            7276 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:              6388 kB
Writeback:             0 kB
AnonPages:         82780 kB
Mapped:            51984 kB
Shmem:             49740 kB
Slab:             438556 kB
SReclaimable:     410580 kB
SUnreclaim:        27976 kB
KernelStack:        3360 kB
PageTables:         5276 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2401572 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     22528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 24248 MiB
End job on node138 at 2018-08-12 02:01:41