Trace number 4309750

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2519.88 2520.08

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-16-17_c18.xml
MD5SUM23da8342a2898ede5001de7625d13c59
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark368.785
Satisfiable
(Un)Satisfiability was proved
Number of variables272
Number of constraints33
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":272}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":272}]
Minimum constraint arity16
Maximum constraint arity17
Distribution of constraint arities[{"arity":16,"count":17},{"arity":17,"count":16}]
Number of extensional constraints33
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":33}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11087 MiB free)
  memory of node 1: 16384 MiB (12341 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309750-1534308620/watcher-4309750-1534308620 -o /tmp/evaluation-result-4309750-1534308620/solver-4309750-1534308620 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1534293053-323 --watchdog 2580 xcsp_picat HOME/instance-4309750-1534308620.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=3435, runsolver pid=3432


[startup+0.100149 s]*
/proc/loadavg: 2.03 2.04 2.05 3/187 3436
/proc/meminfo: memFree=23977116/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2025744 memory=16948 CPUtime=0.1 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 1338 0 0 0 10 0 0 0 20 0 1 0 248425185 2074361856 4237 33554432000 4194304 5849940 140722761717968 140722761717968 4786768 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 506436 4237 591 405 0 503380 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 16948 KiB

[startup+0.209545 s]*
/proc/loadavg: 2.03 2.04 2.05 3/187 3436
/proc/meminfo: memFree=23973020/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2025744 memory=23092 CPUtime=0.21 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 1346 0 0 0 21 0 0 0 20 0 1 0 248425185 2074361856 5773 33554432000 4194304 5849940 140722761717968 140722761717968 140051828096000 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 506436 5773 591 405 0 503380 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 23092 KiB

[startup+0.30946 s]*
/proc/loadavg: 2.03 2.04 2.05 3/187 3436
/proc/meminfo: memFree=23968924/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2025744 memory=25140 CPUtime=0.31 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 1348 0 0 0 31 0 0 0 20 0 1 0 248425185 2074361856 6285 33554432000 4194304 5849940 140722761717968 140722761717272 4873459 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 506436 6285 591 405 0 503380 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 25140 KiB

[startup+0.700361 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 3436
/proc/meminfo: memFree=23896376/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2025744 memory=196180 CPUtime=0.7 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 1669 0 0 0 66 4 0 0 20 0 1 0 248425185 2074361856 49045 33554432000 4194304 5849940 140722761717968 140722761717272 4536865 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 506436 49045 623 405 0 503380 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 196180 KiB

[startup+1.50037 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 3436
/proc/meminfo: memFree=23667744/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2246096 memory=334268 CPUtime=1.49 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 3110 0 0 0 142 7 0 0 20 0 1 0 248425185 2300002304 83567 33554432000 4194304 5849940 140722761717968 140722761716936 5270424 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 561524 83567 629 405 0 558468 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2246096 KiB
Current children cumulated memory: 334268 KiB

[startup+3.10935 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 3436
/proc/meminfo: memFree=23438448/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2478940 memory=583472 CPUtime=3.1 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 11269 0 0 0 298 12 0 0 20 0 1 0 248425185 2538434560 145868 33554432000 4194304 5849940 140722761717968 140722761716936 5406239 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 619735 145868 673 405 0 616679 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2478940 KiB
Current children cumulated memory: 583472 KiB

[startup+6.30036 s]
/proc/loadavg: 2.11 2.06 2.05 3/187 3436
/proc/meminfo: memFree=22945540/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=2937692 memory=1042488 CPUtime=6.29 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 13119 0 0 0 609 20 0 0 20 0 1 0 248425185 3008196608 260622 33554432000 4194304 5849940 140722761717968 140722761717144 5406286 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 734423 260622 673 405 0 731367 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2937692 KiB
Current children cumulated memory: 1042488 KiB

[startup+12.7004 s]
/proc/loadavg: 2.10 2.06 2.05 3/187 3436
/proc/meminfo: memFree=22025500/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=3855196 memory=1959808 CPUtime=12.69 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 17635 0 0 0 1235 34 0 0 20 0 1 0 248425185 3947720704 489952 33554432000 4194304 5849940 140722761717968 140722761717144 5300255 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 963799 489952 673 405 0 960743 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 3855196 KiB
Current children cumulated memory: 1959808 KiB

[startup+25.5004 s]
/proc/loadavg: 2.08 2.06 2.05 3/187 3436
/proc/meminfo: memFree=18348724/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515896 memory=3620712 CPUtime=25.48 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 82780 0 0 0 2453 95 0 0 20 0 1 0 248425185 5648277504 905178 33554432000 4194304 5849940 140722761717968 140722761717144 5303992 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378974 905178 678 405 0 1375918 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 5515896 KiB
Current children cumulated memory: 3620712 KiB

[startup+51.1094 s]
/proc/loadavg: 2.05 2.05 2.05 3/187 3436
/proc/meminfo: memFree=20355804/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515896 memory=3620784 CPUtime=51.09 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 537249 0 0 0 4996 113 0 0 20 0 1 0 248425185 5648277504 905196 33554432000 4194304 5849940 140722761717968 140722761716680 5312804 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378974 905196 696 405 0 1375918 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 5515896 KiB
Current children cumulated memory: 3620784 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/187 3437
/proc/meminfo: memFree=20354376/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515896 memory=3620800 CPUtime=102.29 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 1076932 0 0 0 10091 138 0 0 20 0 1 0 248425185 5648277504 905200 33554432000 4194304 5849940 140722761717968 140722761716968 140051828117383 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378974 905200 700 405 0 1375918 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 5515896 KiB
Current children cumulated memory: 3620800 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/187 3438
/proc/meminfo: memFree=20353424/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515896 memory=3620800 CPUtime=162.29 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 1696705 0 0 0 16063 166 0 0 20 0 1 0 248425185 5648277504 905200 33554432000 4194304 5849940 140722761717968 140722761716968 140051828117383 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378974 905200 700 405 0 1375918 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 5515896 KiB
Current children cumulated memory: 3620800 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 3439
/proc/meminfo: memFree=20352792/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515896 memory=3620800 CPUtime=222.29 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 2263444 0 0 0 22035 194 0 0 20 0 1 0 248425185 5648277504 905200 33554432000 4194304 5849940 140722761717968 140722761716968 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378974 905200 700 405 0 1375918 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 5515896 KiB
Current children cumulated memory: 3620800 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 3441
/proc/meminfo: memFree=20334356/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515892 memory=3620796 CPUtime=282.28 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 2956366 0 0 0 28001 227 0 0 20 0 1 0 248425185 5648273408 905199 33554432000 4194304 5849940 140722761717968 140722761716968 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378973 905199 700 405 0 1375917 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 5515892 KiB
Current children cumulated memory: 3620796 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 3442
/proc/meminfo: memFree=20320964/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515892 memory=3620796 CPUtime=342.28 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 3278883 0 0 0 33980 248 0 0 20 0 1 0 248425185 5648273408 905199 33554432000 4194304 5849940 140722761717968 140722761716968 5438033 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378973 905199 700 405 0 1375917 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 5515892 KiB
Current children cumulated memory: 3620796 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3443
/proc/meminfo: memFree=20354204/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515892 memory=3620796 CPUtime=402.27 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 3996419 0 0 0 39949 278 0 0 20 0 1 0 248425185 5648273408 905199 33554432000 4194304 5849940 140722761717968 140722761716840 5360645 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378973 905199 700 405 0 1375917 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 5515892 KiB
Current children cumulated memory: 3620796 KiB

[startup+462.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 3445
/proc/meminfo: memFree=20342628/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=5515892 memory=3620796 CPUtime=462.28 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 4679470 0 0 0 45915 313 0 0 20 0 1 0 248425185 5648273408 905199 33554432000 4194304 5849940 140722761717968 140722761716968 5335727 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1378973 905199 700 405 0 1375917 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 5515892 KiB
Current children cumulated memory: 3620796 KiB


################
# More data... #
################

/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 1722.18 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/186 3512
/proc/meminfo: memFree=19294872/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=1782.18 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 21140546 0 0 0 177060 1158 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5438036 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 1782.18 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3514
/proc/meminfo: memFree=19267560/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=1842.17 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 21558339 0 0 0 183036 1181 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 1842.17 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3515
/proc/meminfo: memFree=19259632/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=1902.17 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 22155519 0 0 0 189008 1209 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437808 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 1902.17 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+1962.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 3516
/proc/meminfo: memFree=19238348/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=1962.16 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 22709475 0 0 0 194976 1240 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5335774 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 1962.16 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 3517
/proc/meminfo: memFree=19247980/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2022.14 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 23310254 0 0 0 200942 1272 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5438047 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2022.14 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 3519
/proc/meminfo: memFree=19257564/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2082.14 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 23660645 0 0 0 206918 1296 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437990 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2082.14 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3520
/proc/meminfo: memFree=19245272/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2142.13 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 24194611 0 0 0 212888 1325 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2142.13 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3521
/proc/meminfo: memFree=19250200/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2202.13 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 24600459 0 0 0 218860 1353 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5438453 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2202.13 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3523
/proc/meminfo: memFree=19288968/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2262.13 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 25066384 0 0 0 224835 1378 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2262.13 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 3585
/proc/meminfo: memFree=19262304/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2322.12 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 25213837 0 0 0 230820 1392 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437808 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2322.12 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3594
/proc/meminfo: memFree=19261556/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2382.11 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 25698362 0 0 0 236792 1419 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2382.11 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3595
/proc/meminfo: memFree=19259456/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2442.11 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 25908213 0 0 0 242778 1433 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5335774 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2442.11 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3596
/proc/meminfo: memFree=19257744/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2502.09 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 26170680 0 0 0 248756 1453 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716968 5437990 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2502.09 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 3596
/proc/meminfo: memFree=19257152/32770624 swapFree=67108196/67108860
[pid=3435] ppid=3432 vsize=6564468 memory=4669372 CPUtime=2519.8 cores=0,2,4,6
/proc/3435/stat : 3435 (xcsp_picat) R 3432 3435 32759 0 -1 4202496 26243591 0 0 0 250524 1456 0 0 20 0 1 0 248425185 6722015232 1167343 33554432000 4194304 5849940 140722761717968 140722761716840 5313090 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 47611904 140722761721014 140722761721092 140722761721092 140722761723850 0
/proc/3435/statm: 1641117 1167343 700 405 0 1638061 0
Current children cumulated CPU time: 2519.8 s
Current children cumulated vsize: 6564468 KiB
Current children cumulated memory: 4669372 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.08 s]
# the end of solver process 3435 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2505.24 s, system=14.6396 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.08
CPU time (s): 2519.88
CPU user time (s): 2505.24
CPU system time (s): 14.6396
CPU usage (%): 99.9921
Max. virtual memory (cumulated for all children) (KiB): 7525212
Max. memory (cumulated for all children) (KiB): 5630008

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2505.24
system time used= 14.6396
maximum resident set size= 5630008
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26243591
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 224
involuntary context switches= 663


# summary of solver processes directly reported to runsolver:
#   pid: 3435
#   total CPU time (s): 2519.88
#   total CPU user time (s): 2505.24
#   total CPU system time (s): 14.6396

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.64134 second user time and 18.2952 second system time

The end

Launcher Data 

Begin job on node151 at 2018-08-15 06:50:20
IDJOB=4309750
IDBENCH=141435
IDSOLVER=2794
FILE ID=node151/4309750-1534308620
RUNJOBID= node151-1534293053-323
PBS_JOBID= 21038135
Free space on /tmp= 43896 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-16-17_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309750-1534308620/watcher-4309750-1534308620 -o /tmp/evaluation-result-4309750-1534308620/solver-4309750-1534308620 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1534293053-323 --watchdog 2580  xcsp_picat HOME/instance-4309750-1534308620.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 23da8342a2898ede5001de7625d13c59
RANDOM SEED=1668754356

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23991568 kB
MemAvailable:   31849560 kB
Buffers:          170668 kB
Cached:          7918296 kB
SwapCached:           12 kB
Active:          4175588 kB
Inactive:        4013440 kB
Active(anon):      49968 kB
Inactive(anon):   110776 kB
Active(file):    4125620 kB
Inactive(file):  3902664 kB
Unevictable:        7820 kB
Mlocked:            7820 kB
SwapTotal:      67108860 kB
SwapFree:       67108196 kB
Dirty:              4764 kB
Writeback:             0 kB
AnonPages:        107996 kB
Mapped:            58788 kB
Shmem:             57716 kB
Slab:             286760 kB
SReclaimable:     258168 kB
SUnreclaim:        28592 kB
KernelStack:        3312 kB
PageTables:         5812 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2430328 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     32768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 43896 MiB
End job on node151 at 2018-08-15 07:32:20