Trace number 4294928

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2519.77 2520.1

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-11-12_c18.xml
MD5SUM996bcdf4a135147c7f2ba7242cc18cd5
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables132
Number of constraints23
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":132}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":132}]
Minimum constraint arity11
Maximum constraint arity12
Distribution of constraint arities[{"arity":11,"count":12},{"arity":12,"count":11}]
Number of extensional constraints23
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":23}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (7020 MiB free)
  memory of node 1: 16384 MiB (10468 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4294928-1532458515/watcher-4294928-1532458515 -o /tmp/evaluation-result-4294928-1532458515/solver-4294928-1532458515 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node132-1532432860-27368 --watchdog 2580 xcsp_picat HOME/instance-4294928-1532458515.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1441, runsolver pid=1438

[startup+0.100203 s]*
/proc/loadavg: 2.01 2.04 2.05 3/190 1442
/proc/meminfo: memFree=17893784/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=111688 memory=16684 CPUtime=0.1 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 1252 0 0 0 10 0 0 0 20 0 1 0 63414670 114368512 4171 33554432000 4194304 5849740 140734765887776 140734765887776 140009621249024 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 27922 4171 591 405 0 24866 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 16684 KiB

[startup+0.20992 s]*
/proc/loadavg: 2.01 2.04 2.05 3/190 1442
/proc/meminfo: memFree=17887640/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=111688 memory=22828 CPUtime=0.21 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 1255 0 0 0 21 0 0 0 20 0 1 0 63414670 114368512 5707 33554432000 4194304 5849740 140734765887776 140734765887776 140009621249024 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 27922 5707 591 405 0 24866 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 22828 KiB

[startup+0.309782 s]*
/proc/loadavg: 2.01 2.04 2.05 3/190 1442
/proc/meminfo: memFree=17881496/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=111688 memory=28972 CPUtime=0.31 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 1258 0 0 0 31 0 0 0 20 0 1 0 63414670 114368512 7243 33554432000 4194304 5849740 140734765887776 140734765887776 140009621249024 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 27922 7243 591 405 0 24866 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 28972 KiB

[startup+0.700377 s]
/proc/loadavg: 2.01 2.04 2.05 3/190 1442
/proc/meminfo: memFree=17858972/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=149080 memory=51500 CPUtime=0.7 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 2307 0 0 0 69 1 0 0 20 0 1 0 63414670 152657920 12875 33554432000 4194304 5849740 140734765887776 140734765887776 140009621249024 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 37270 12875 595 405 0 34214 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 149080 KiB
Current children cumulated memory: 51500 KiB

[startup+1.50058 s]
/proc/loadavg: 2.01 2.04 2.05 3/190 1442
/proc/meminfo: memFree=17846956/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=166980 memory=94884 CPUtime=1.49 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 4515 0 0 0 147 2 0 0 20 0 1 0 63414670 170987520 23721 33554432000 4194304 5849740 140734765887776 140734765887096 5246310 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 41745 23721 621 405 0 38689 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 166980 KiB
Current children cumulated memory: 94884 KiB

[startup+3.11025 s]
/proc/loadavg: 2.01 2.04 2.05 3/190 1442
/proc/meminfo: memFree=17591596/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=505068 memory=322076 CPUtime=3.1 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 9811 0 0 0 301 9 0 0 20 0 1 0 63414670 517189632 80519 33554432000 4194304 5849740 140734765887776 140734765886776 5260751 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 126267 80519 622 405 0 123211 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 505068 KiB
Current children cumulated memory: 322076 KiB

[startup+6.30046 s]
/proc/loadavg: 2.09 2.05 2.05 3/190 1442
/proc/meminfo: memFree=17559676/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=486240 memory=357216 CPUtime=6.29 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 14103 0 0 0 616 13 0 0 20 0 1 0 63414670 497909760 89304 33554432000 4194304 5849740 140734765887776 140734765887096 5256353 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 121560 89304 625 405 0 118504 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 486240 KiB
Current children cumulated memory: 357216 KiB

[startup+12.7004 s]
/proc/loadavg: 2.08 2.05 2.05 3/190 1442
/proc/meminfo: memFree=17111164/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=1258816 memory=1027396 CPUtime=12.68 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 23507 0 0 0 1239 29 0 0 20 0 1 0 63414670 1289027584 256849 33554432000 4194304 5849740 140734765887776 140734765886344 5432443 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 314704 256849 673 405 0 311648 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 1258816 KiB
Current children cumulated memory: 1027396 KiB

[startup+25.5005 s]
/proc/loadavg: 2.07 2.05 2.05 3/190 1442
/proc/meminfo: memFree=14582960/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=3552576 memory=3321348 CPUtime=25.48 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 27779 0 0 0 2478 70 0 0 20 0 1 0 63414670 3637837824 830337 33554432000 4194304 5849740 140734765887776 140734765886952 5300450 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 888144 830337 673 405 0 885088 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 3552576 KiB
Current children cumulated memory: 3321348 KiB

[startup+51.1098 s]
/proc/loadavg: 2.04 2.04 2.05 3/190 1442
/proc/meminfo: memFree=12675384/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=5455800 memory=5224616 CPUtime=51.09 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 250480 0 0 0 4985 124 0 0 20 0 1 0 63414670 5586739200 1306154 33554432000 4194304 5849740 140734765887776 140734765886648 5391904 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1363950 1306154 684 405 0 1360894 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 5455800 KiB
Current children cumulated memory: 5224616 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/190 1443
/proc/meminfo: memFree=12675164/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=5455800 memory=5224672 CPUtime=102.28 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 793763 0 0 0 10082 146 0 0 20 0 1 0 63414670 5586739200 1306168 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1363950 1306168 698 405 0 1360894 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 5455800 KiB
Current children cumulated memory: 5224672 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/190 1444
/proc/meminfo: memFree=11625736/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=162.28 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 1331217 0 0 0 16037 191 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/190 1446
/proc/meminfo: memFree=10575644/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=222.28 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 2280779 0 0 0 21991 237 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886648 5312827 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/190 1447
/proc/meminfo: memFree=10575720/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=282.27 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 3127521 0 0 0 27950 277 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/190 1455
/proc/meminfo: memFree=10575776/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=342.27 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 3987406 0 0 0 33906 321 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437560 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 1487
/proc/meminfo: memFree=10574844/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=402.26 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 4745764 0 0 0 39866 360 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5335566 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 1488
/proc/meminfo: memFree=10575056/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=462.26 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 5775526 0 0 0 45818 408 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437695 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB


################
# More data... #
################

/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+1782.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/191 1588
/proc/meminfo: memFree=9760812/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=1782.1 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 22810906 0 0 0 176948 1262 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 1782.1 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/190 1590
/proc/meminfo: memFree=9760772/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=1842.09 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 23313361 0 0 0 182921 1288 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 140009621270407 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 1842.09 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/190 1591
/proc/meminfo: memFree=9760620/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=1902.08 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 23814629 0 0 0 188891 1317 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5335566 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 1902.08 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1592
/proc/meminfo: memFree=9760708/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=1962.07 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 24248594 0 0 0 194871 1336 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886936 5335552 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 1962.07 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1594
/proc/meminfo: memFree=9759688/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2022.06 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 24875337 0 0 0 200832 1374 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 140009621270407 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2022.06 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1595
/proc/meminfo: memFree=9759404/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2082.05 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 25349076 0 0 0 206803 1402 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2082.05 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2142.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/191 1604
/proc/meminfo: memFree=9759308/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2142.04 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 25980571 0 0 0 212769 1435 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5335598 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2142.04 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/191 1605
/proc/meminfo: memFree=9759524/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2202.03 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 26448738 0 0 0 218743 1460 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886936 5335566 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2202.03 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/191 1606
/proc/meminfo: memFree=9759728/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2262 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 26765278 0 0 0 224721 1479 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886936 5335566 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2262 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/191 1607
/proc/meminfo: memFree=9759696/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2322 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 27143490 0 0 0 230699 1501 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886488 5322657 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2322 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/190 1608
/proc/meminfo: memFree=9760932/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2381.99 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 27372580 0 0 0 236683 1516 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886648 5392246 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2381.99 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1610
/proc/meminfo: memFree=9759776/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2441.98 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 27825206 0 0 0 242660 1538 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2441.98 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

[startup+2502.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/191 1612
/proc/meminfo: memFree=9759840/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2501.98 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 28002443 0 0 0 248642 1556 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886776 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2501.98 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.04 2.03 2.05 3/191 1613
/proc/meminfo: memFree=9760004/32770624 swapFree=67108860/67108860
[pid=1441] ppid=1438 vsize=6504376 memory=6273256 CPUtime=2519.67 cores=0,2,4,6
/proc/1441/stat : 1441 (xcsp_picat) R 1438 1441 27337 0 -1 4202496 28133209 0 0 0 250404 1563 0 0 20 0 1 0 63414670 6660481024 1568314 33554432000 4194304 5849740 140734765887776 140734765886648 5313159 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46940160 140734765888694 140734765888772 140734765888772 140734765891530 0
/proc/1441/statm: 1626094 1568314 700 405 0 1623038 0
Current children cumulated CPU time: 2519.67 s
Current children cumulated vsize: 6504376 KiB
Current children cumulated memory: 6273256 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.1 s]
# the end of solver process 1441 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2504.05 s, system=15.7219 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.1
CPU time (s): 2519.77
CPU user time (s): 2504.05
CPU system time (s): 15.7219
CPU usage (%): 99.9871
Max. virtual memory (cumulated for all children) (KiB): 6639176
Max. memory (cumulated for all children) (KiB): 6407984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2504.05
system time used= 15.7219
maximum resident set size= 6407984
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28133209
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 297
involuntary context switches= 4191


# summary of solver processes directly reported to runsolver:
#   pid: 1441
#   total CPU time (s): 2519.77
#   total CPU user time (s): 2504.05
#   total CPU system time (s): 15.7219

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.2446 second user time and 18.898 second system time

The end

Launcher Data 

Begin job on node132 at 2018-07-24 20:55:15
IDJOB=4294928
IDBENCH=141445
IDSOLVER=2754
FILE ID=node132/4294928-1532458515
RUNJOBID= node132-1532432860-27368
PBS_JOBID= 21021577
Free space on /tmp= 52464 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-11-12_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4294928-1532458515/watcher-4294928-1532458515 -o /tmp/evaluation-result-4294928-1532458515/solver-4294928-1532458515 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node132-1532432860-27368 --watchdog 2580  xcsp_picat HOME/instance-4294928-1532458515.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 996bcdf4a135147c7f2ba7242cc18cd5
RANDOM SEED=381553588

node132.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        17908296 kB
MemAvailable:   28478168 kB
Buffers:          186668 kB
Cached:         10547528 kB
SwapCached:            0 kB
Active:          6020660 kB
Inactive:        8222840 kB
Active(anon):    3458096 kB
Inactive(anon):    70696 kB
Active(file):    2562564 kB
Inactive(file):  8152144 kB
Unevictable:        7020 kB
Mlocked:            7020 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              8476 kB
Writeback:             0 kB
AnonPages:       3663492 kB
Mapped:            40556 kB
Shmem:             17056 kB
Slab:             311088 kB
SReclaimable:     283624 kB
SUnreclaim:        27464 kB
KernelStack:        3408 kB
PageTables:        11776 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    3889524 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1480704 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 52464 MiB
End job on node132 at 2018-07-24 21:37:15