Trace number 4407832

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
(reference) PicatSAT 2019-09-12? (TO) 2400.04 2400.21

General information on the benchmark

NameCrossword/Crossword-m1c-lex-herald/
Crossword-m1c-lex-h2304.xml
MD5SUM2b17aa29d465407901b3bf5b8794b9ea
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark5.61632
Satisfiable
(Un)Satisfiability was proved
Number of variables529
Number of constraints170
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":449}]
Minimum variable degree0
Maximum variable degree2
Distribution of variable degrees[{"degree":0,"count":80},{"degree":2,"count":449}]
Minimum constraint arity3
Maximum constraint arity9
Distribution of constraint arities[{"arity":3,"count":20},{"arity":4,"count":20},{"arity":5,"count":84},{"arity":6,"count":12},{"arity":7,"count":14},{"arity":8,"count":12},{"arity":9,"count":8}]
Number of extensional constraints170
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":170}]
Optimization problemNO
Type of objective

Solver Data 

36.49/36.58	c xcsp_picat version 2.7b12 (9/12/2019)

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12998 MiB free)
  memory of node 1: 16384 MiB (11485 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4407832-1569513214/watcher-4407832-1569513214 -o /tmp/evaluation-result-4407832-1569513214/solver-4407832-1569513214 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node139-1569509779-15648 --watchdog 2560 xcsp_picat HOME/instance-4407832-1569513214.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=16426, runsolver pid=16423

[startup+0.100162 s]*
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=25051040/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2031716 memory=22384 CPUtime=0.1 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1206 0 0 0 10 0 0 0 20 0 1 0 527592685 2080477184 5596 33554432000 4194304 5870510 140724855515824 140724855512968 4456121 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 507929 5596 834 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 22384 KiB

[startup+0.209658 s]*
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=25042848/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2031716 memory=32624 CPUtime=0.21 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1211 0 0 0 21 0 0 0 20 0 1 0 527592685 2080477184 8156 33554432000 4194304 5870510 140724855515824 140724855512968 4459457 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 507929 8156 834 410 0 503402 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 32624 KiB

[startup+0.309697 s]*
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=25032608/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2031716 memory=41040 CPUtime=0.31 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1218 0 0 0 31 0 0 0 20 0 1 0 527592685 2080477184 10260 33554432000 4194304 5870510 140724855515824 140724855512968 4466490 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 507929 10260 840 410 0 503402 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 41040 KiB

[startup+0.700409 s]
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=25001764/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2031716 memory=114768 CPUtime=0.69 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1276 0 0 0 68 1 0 0 20 0 1 0 527592685 2080477184 28692 33554432000 4194304 5870510 140724855515824 140724855512968 4461503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 507929 28692 840 410 0 503402 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 114768 KiB

[startup+1.5004 s]
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=24884908/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2031716 memory=305332 CPUtime=1.49 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1369 0 0 0 144 5 0 0 20 0 1 0 527592685 2080477184 76333 33554432000 4194304 5870510 140724855515824 140724855515192 4515453 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 507929 76333 863 410 0 503402 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 305332 KiB

[startup+3.10972 s]
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=24389716/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2421900 memory=678392 CPUtime=3.1 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 4613 0 0 0 299 11 0 0 20 0 1 0 527592685 2480025600 169598 33554432000 4194304 5870510 140724855515824 140724855515192 4463475 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 605475 169598 878 410 0 600948 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2421900 KiB
Current children cumulated memory: 678392 KiB

[startup+6.30028 s]
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=24318672/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2520812 memory=769772 CPUtime=6.29 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 16711 0 0 0 615 14 0 0 20 0 1 0 527592685 2581311488 192443 33554432000 4194304 5870510 140724855515824 140724855514712 5337379 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 630203 192443 883 410 0 625676 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2520812 KiB
Current children cumulated memory: 769772 KiB

[startup+12.7003 s]
/proc/loadavg: 2.02 2.13 2.05 3/197 16427
/proc/meminfo: memFree=24296064/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2520812 memory=765960 CPUtime=12.69 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 33706 0 0 0 1254 15 0 0 20 0 1 0 527592685 2581311488 191490 33554432000 4194304 5870510 140724855515824 140724855514712 5282432 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 630203 191490 910 410 0 625676 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2520812 KiB
Current children cumulated memory: 765960 KiB

[startup+25.5004 s]
/proc/loadavg: 2.01 2.12 2.05 3/198 16430
/proc/meminfo: memFree=24274760/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2520812 memory=775244 CPUtime=25.49 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 51375 0 0 0 2530 19 0 0 20 0 1 0 527592685 2581311488 193811 33554432000 4194304 5870510 140724855515824 140724855514840 5282694 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 630203 193811 910 410 0 625676 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2520812 KiB
Current children cumulated memory: 775244 KiB

[startup+51.1097 s]
/proc/loadavg: 2.01 2.11 2.05 3/197 16430
/proc/meminfo: memFree=24245256/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2568612 memory=798436 CPUtime=51.1 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 75072 0 0 0 5083 27 0 0 20 0 1 0 527592685 2630258688 199609 33554432000 4194304 5870510 140724855515824 140724855514184 5283126 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 642153 199609 910 410 0 637626 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2568612 KiB
Current children cumulated memory: 798436 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.10 2.05 3/198 16435
/proc/meminfo: memFree=24264336/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2544236 memory=796292 CPUtime=102.29 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 113632 0 0 0 10190 39 0 0 20 0 1 0 527592685 2605297664 199073 33554432000 4194304 5870510 140724855515824 140724855514392 5283116 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 636059 199073 910 410 0 631532 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 2544236 KiB
Current children cumulated memory: 796292 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.08 2.05 3/198 16442
/proc/meminfo: memFree=24238844/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2588224 memory=821748 CPUtime=162.29 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 142149 0 0 0 16175 54 0 0 20 0 1 0 527592685 2650341376 205437 33554432000 4194304 5870510 140724855515824 140724855514376 5272638 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 647056 205437 910 410 0 642529 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 2588224 KiB
Current children cumulated memory: 821748 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/198 16446
/proc/meminfo: memFree=24243116/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2615724 memory=846492 CPUtime=222.29 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 220305 0 0 0 22157 72 0 0 20 0 1 0 527592685 2678501376 211623 33554432000 4194304 5870510 140724855515824 140724855514776 5282721 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 653931 211623 910 410 0 649404 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2615724 KiB
Current children cumulated memory: 846492 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/200 16459
/proc/meminfo: memFree=24199180/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2615724 memory=854720 CPUtime=282.29 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 275553 0 0 0 28145 84 0 0 20 0 1 0 527592685 2678501376 213680 33554432000 4194304 5870510 140724855515824 140724855514776 140110162635340 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 653931 213680 910 410 0 649404 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2615724 KiB
Current children cumulated memory: 854720 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 16487
/proc/meminfo: memFree=24197520/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2620588 memory=858660 CPUtime=342.28 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 324172 0 0 0 34134 94 0 0 20 0 1 0 527592685 2683482112 214665 33554432000 4194304 5870510 140724855515824 140724855514840 5283024 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 655147 214665 910 410 0 650620 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 2620588 KiB
Current children cumulated memory: 858660 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 16491
/proc/meminfo: memFree=24175724/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2631096 memory=862772 CPUtime=402.28 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 354692 0 0 0 40124 104 0 0 20 0 1 0 527592685 2694242304 215693 33554432000 4194304 5870510 140724855515824 140724855514840 5282606 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 657774 215693 910 410 0 653247 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 2631096 KiB
Current children cumulated memory: 862772 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 16495
/proc/meminfo: memFree=24212852/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2631096 memory=869132 CPUtime=462.26 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 391475 0 0 0 46110 116 0 0 20 0 1 0 527592685 2694242304 217283 33554432000 4194304 5870510 140724855515824 140724855514840 5282759 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 657774 217283 910 410 0 653247 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 2631096 KiB
Current children cumulated memory: 869132 KiB


################
# More data... #
################

/proc/16426/statm: 673381 239659 910 410 0 668854 0
Current children cumulated CPU time: 1602.18 s
Current children cumulated vsize: 2693524 KiB
Current children cumulated memory: 958636 KiB

[startup+1662.3 s]
/proc/loadavg: 1.06 1.58 1.88 2/190 16648
/proc/meminfo: memFree=24276888/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2756360 memory=980912 CPUtime=1662.18 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 821041 0 0 0 165869 349 0 0 20 0 1 0 527592685 2822512640 245228 33554432000 4194304 5870510 140724855515824 140724855514776 5282505 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 689090 245228 910 410 0 684563 0
Current children cumulated CPU time: 1662.18 s
Current children cumulated vsize: 2756360 KiB
Current children cumulated memory: 980912 KiB

[startup+1722.3 s]
/proc/loadavg: 1.02 1.48 1.82 2/190 16652
/proc/meminfo: memFree=24276668/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2756360 memory=980992 CPUtime=1722.17 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 851777 0 0 0 171857 360 0 0 20 0 1 0 527592685 2822512640 245248 33554432000 4194304 5870510 140724855515824 140724855514776 5282759 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 689090 245248 910 410 0 684563 0
Current children cumulated CPU time: 1722.17 s
Current children cumulated vsize: 2756360 KiB
Current children cumulated memory: 980992 KiB

[startup+1782.3 s]
/proc/loadavg: 1.01 1.39 1.77 2/190 16659
/proc/meminfo: memFree=24264012/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2756360 memory=993356 CPUtime=1782.17 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 896373 0 0 0 177846 371 0 0 20 0 1 0 527592685 2822512640 248339 33554432000 4194304 5870510 140724855515824 140724855514776 5282505 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 689090 248339 910 410 0 684563 0
Current children cumulated CPU time: 1782.17 s
Current children cumulated vsize: 2756360 KiB
Current children cumulated memory: 993356 KiB

[startup+1842.3 s]
/proc/loadavg: 1.00 1.32 1.72 2/190 16663
/proc/meminfo: memFree=24269404/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2756360 memory=987272 CPUtime=1842.17 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 919427 0 0 0 183835 382 0 0 20 0 1 0 527592685 2822512640 246818 33554432000 4194304 5870510 140724855515824 140724855514776 5282505 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 689090 246818 910 410 0 684563 0
Current children cumulated CPU time: 1842.17 s
Current children cumulated vsize: 2756360 KiB
Current children cumulated memory: 987272 KiB

[startup+1902.3 s]
/proc/loadavg: 1.00 1.26 1.68 2/190 16667
/proc/meminfo: memFree=24283608/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2756360 memory=974212 CPUtime=1902.17 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 972915 0 0 0 189818 399 0 0 20 0 1 0 527592685 2822512640 243553 33554432000 4194304 5870510 140724855515824 140724855514776 5272880 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 689090 243553 910 410 0 684563 0
Current children cumulated CPU time: 1902.17 s
Current children cumulated vsize: 2756360 KiB
Current children cumulated memory: 974212 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.21 1.63 2/190 16674
/proc/meminfo: memFree=24250656/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2768532 memory=1006604 CPUtime=1962.16 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 996465 0 0 0 195807 409 0 0 20 0 1 0 527592685 2834976768 251651 33554432000 4194304 5870510 140724855515824 140724855514616 5283094 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 692133 251651 910 410 0 687606 0
Current children cumulated CPU time: 1962.16 s
Current children cumulated vsize: 2768532 KiB
Current children cumulated memory: 1006604 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.18 1.59 2/190 16678
/proc/meminfo: memFree=24260408/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2768532 memory=996408 CPUtime=2022.17 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1007099 0 0 0 201798 419 0 0 20 0 1 0 527592685 2834976768 249102 33554432000 4194304 5870510 140724855515824 140724855514840 5282759 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 692133 249102 910 410 0 687606 0
Current children cumulated CPU time: 2022.17 s
Current children cumulated vsize: 2768532 KiB
Current children cumulated memory: 996408 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.14 1.56 2/191 16690
/proc/meminfo: memFree=24259984/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2768532 memory=996472 CPUtime=2082.17 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1019227 0 0 0 207788 429 0 0 20 0 1 0 527592685 2834976768 249118 33554432000 4194304 5870510 140724855515824 140724855514840 5282574 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 692133 249118 910 410 0 687606 0
Current children cumulated CPU time: 2082.17 s
Current children cumulated vsize: 2768532 KiB
Current children cumulated memory: 996472 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.12 1.52 2/191 16696
/proc/meminfo: memFree=24263936/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2768532 memory=992456 CPUtime=2142.16 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1032974 0 0 0 213779 437 0 0 20 0 1 0 527592685 2834976768 248114 33554432000 4194304 5870510 140724855515824 140724855514840 5289467 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 692133 248114 910 410 0 687606 0
Current children cumulated CPU time: 2142.16 s
Current children cumulated vsize: 2768532 KiB
Current children cumulated memory: 992456 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.10 1.49 2/191 16700
/proc/meminfo: memFree=24256604/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2768532 memory=998792 CPUtime=2202.14 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1051361 0 0 0 219768 446 0 0 20 0 1 0 527592685 2834976768 249698 33554432000 4194304 5870510 140724855515824 140724855514840 5281934 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 692133 249698 910 410 0 687606 0
Current children cumulated CPU time: 2202.14 s
Current children cumulated vsize: 2768532 KiB
Current children cumulated memory: 998792 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.08 1.46 2/191 16704
/proc/meminfo: memFree=24233796/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2785464 memory=1022844 CPUtime=2262.13 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1066895 0 0 0 225756 457 0 0 20 0 1 0 527592685 2852315136 255711 33554432000 4194304 5870510 140724855515824 140724855514376 5283116 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 696366 255711 910 410 0 691839 0
Current children cumulated CPU time: 2262.13 s
Current children cumulated vsize: 2785464 KiB
Current children cumulated memory: 1022844 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.06 1.43 2/191 16710
/proc/meminfo: memFree=24240124/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2788052 memory=1015148 CPUtime=2322.13 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1076286 0 0 0 231748 465 0 0 20 0 1 0 527592685 2854965248 253787 33554432000 4194304 5870510 140724855515824 140724855514840 5283116 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 697013 253787 910 410 0 692486 0
Current children cumulated CPU time: 2322.13 s
Current children cumulated vsize: 2788052 KiB
Current children cumulated memory: 1015148 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.05 1.40 2/190 16714
/proc/meminfo: memFree=24232612/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2788052 memory=1023340 CPUtime=2382.13 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1079668 0 0 0 237742 471 0 0 20 0 1 0 527592685 2854965248 255835 33554432000 4194304 5870510 140724855515824 140724855514840 5283106 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 697013 255835 910 410 0 692486 0
Current children cumulated CPU time: 2382.13 s
Current children cumulated vsize: 2788052 KiB
Current children cumulated memory: 1023340 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 1.00 1.05 1.39 2/190 16715
/proc/meminfo: memFree=24230732/32770624 swapFree=66941828/67108860
[pid=16426] ppid=16423 vsize=2788052 memory=1024544 CPUtime=2400.02 cores=1,3,5,7
/proc/16426/stat : 16426 (xcsp_picat) R 16423 16426 15616 0 -1 4202496 1080045 0 0 0 239529 473 0 0 20 0 1 0 527592685 2854965248 256136 33554432000 4194304 5870510 140724855515824 140724855514840 5283135 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41684992 140724855518239 140724855518317 140724855518317 140724855521226 0
/proc/16426/statm: 697013 256136 910 410 0 692486 0
Current children cumulated CPU time: 2400.02 s
Current children cumulated vsize: 2788052 KiB
Current children cumulated memory: 1024544 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.21 s]
# the end of solver process 16426 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2395.3 s, system=4.7388 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.21
CPU time (s): 2400.04
CPU user time (s): 2395.3
CPU system time (s): 4.7388
CPU usage (%): 99.993
Max. virtual memory (cumulated for all children) (KiB): 2918280
Max. memory (cumulated for all children) (KiB): 1126568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2395.3
system time used= 4.7388
maximum resident set size= 1126568
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1080045
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 93
involuntary context switches= 1943


# summary of solver processes directly reported to runsolver:
#   pid: 16426
#   total CPU time (s): 2400.04
#   total CPU user time (s): 2395.3
#   total CPU system time (s): 4.7388

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.70219 second user time and 18.0483 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-26 17:55:52
IDJOB=4407832
IDBENCH=139816
IDSOLVER=2873
FILE ID=node139/4407832-1569513214
RUNJOBID= node139-1569509779-15648
PBS_JOBID= 21705785
Free space on /tmp= 5140 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/Crossword/Crossword-m1c-lex-herald/Crossword-m1c-lex-h2304.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4407832-1569513214/watcher-4407832-1569513214 -o /tmp/evaluation-result-4407832-1569513214/solver-4407832-1569513214 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node139-1569509779-15648 --watchdog 2560  xcsp_picat HOME/instance-4407832-1569513214.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2b17aa29d465407901b3bf5b8794b9ea
RANDOM SEED=1028482073

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25072020 kB
MemAvailable:   31586884 kB
Buffers:          145812 kB
Cached:          6473640 kB
SwapCached:        64664 kB
Active:          3501220 kB
Inactive:        3363900 kB
Active(anon):     199212 kB
Inactive(anon):   119364 kB
Active(file):    3302008 kB
Inactive(file):  3244536 kB
Unevictable:      109012 kB
Mlocked:          109012 kB
SwapTotal:      67108860 kB
SwapFree:       66941828 kB
Dirty:              3532 kB
Writeback:             0 kB
AnonPages:        291940 kB
Mapped:            24464 kB
Shmem:             63924 kB
Slab:             426168 kB
SReclaimable:     396780 kB
SUnreclaim:        29388 kB
KernelStack:        3472 kB
PageTables:         5724 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2726896 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    233472 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 5140 MiB
End job on node139 at 2019-09-26 18:35:53