Trace number 4391834

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
miniBTD 19.06.16? (TO) 2400.08 2400.2

General information on the benchmark

NameLatinSquare/LatinSquare-xcsp2-qcp25/
qcp-25-264-09_X2.xml
MD5SUM9027aa50623a7bf75cd9351701a12dc2
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark14.0602
Satisfiable
(Un)Satisfiability was proved
Number of variables625
Number of constraints15000
Number of domains26
Minimum domain size1
Maximum domain size25
Distribution of domain sizes[{"size":1,"count":361},{"size":25,"count":264}]
Minimum variable degree48
Maximum variable degree48
Distribution of variable degrees[{"degree":48,"count":625}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":15000}]
Number of extensional constraints15000
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":15000}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 19.06.16

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8468 MiB free)
  memory of node 1: 16384 MiB (15757 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391834-1568320671/watcher-4391834-1568320671 -o /tmp/evaluation-result-4391834-1568320671/solver-4391834-1568320671 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568306885-1655 --watchdog 2560 miniBTD 2400 HOME/instance-4391834-1568320671.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=5840, runsolver pid=5837

[startup+0.100146 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 5841
/proc/meminfo: memFree=24803984/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=30132 memory=6100 CPUtime=0.1 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 1746 0 0 0 10 0 0 0 20 0 1 0 408339721 30855168 1525 33554432000 4194304 5326806 140724117619680 140724117616328 140690348207077 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 7533 1525 589 277 0 1054 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30132 KiB
Current children cumulated memory: 6100 KiB

[startup+0.209528 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 5841
/proc/meminfo: memFree=24801752/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=32508 memory=8740 CPUtime=0.21 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 2358 0 0 0 21 0 0 0 20 0 1 0 408339721 33288192 2185 33554432000 4194304 5326806 140724117619680 140724117616328 140690348207077 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 8127 2185 589 277 0 1648 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32508 KiB
Current children cumulated memory: 8740 KiB

[startup+0.309123 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 5841
/proc/meminfo: memFree=24800440/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=34028 memory=10292 CPUtime=0.31 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 2780 0 0 0 31 0 0 0 20 0 1 0 408339721 34844672 2573 33554432000 4194304 5326806 140724117619680 140724117616328 4239240 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 8507 2573 589 277 0 2028 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 34028 KiB
Current children cumulated memory: 10292 KiB

[startup+0.700334 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 5841
/proc/meminfo: memFree=24793680/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=46208 memory=22436 CPUtime=0.69 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 5824 0 0 0 68 1 0 0 20 0 1 0 408339721 47316992 5609 33554432000 4194304 5326806 140724117619680 140724117614488 140690348207077 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 11552 5609 589 277 0 5073 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 46208 KiB
Current children cumulated memory: 22436 KiB

[startup+1.50033 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 5841
/proc/meminfo: memFree=24782520/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=59288 memory=35372 CPUtime=1.49 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 9094 0 0 0 148 1 0 0 20 0 1 0 408339721 60710912 8843 33554432000 4194304 5326806 140724117619680 140724117614488 140690348207077 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 14822 8843 589 277 0 8343 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 59288 KiB
Current children cumulated memory: 35372 KiB

[startup+3.10958 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 5841
/proc/meminfo: memFree=24766916/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43656 CPUtime=3.1 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 20028 0 0 0 308 2 0 0 20 0 1 0 408339721 69140480 10914 33554432000 4194304 5326806 140724117619680 140724117618888 4674121 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10914 641 277 0 10401 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43656 KiB

[startup+6.30033 s]
/proc/loadavg: 1.84 1.98 2.03 3/199 5842
/proc/meminfo: memFree=24766424/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43656 CPUtime=6.29 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 28962 0 0 0 626 3 0 0 20 0 1 0 408339721 69140480 10914 33554432000 4194304 5326806 140724117619680 140724117618888 4432699 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10914 641 277 0 10401 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43656 KiB

[startup+12.7004 s]
/proc/loadavg: 1.86 1.98 2.03 3/199 5842
/proc/meminfo: memFree=24766424/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43656 CPUtime=12.69 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 37899 0 0 0 1265 4 0 0 20 0 1 0 408339721 69140480 10914 33554432000 4194304 5326806 140724117619680 140724117618888 4400880 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10914 641 277 0 10401 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43656 KiB

[startup+25.5004 s]
/proc/loadavg: 1.89 1.98 2.03 3/199 5844
/proc/meminfo: memFree=24765792/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43656 CPUtime=25.48 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 55763 0 0 0 2541 7 0 0 20 0 1 0 408339721 69140480 10914 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10914 641 277 0 10401 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43656 KiB

[startup+51.1097 s]
/proc/loadavg: 1.93 1.99 2.03 3/199 5844
/proc/meminfo: memFree=24765764/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43656 CPUtime=51.09 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 64726 0 0 0 5097 12 0 0 20 0 1 0 408339721 69140480 10914 33554432000 4194304 5326806 140724117619680 140724117618888 4432692 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10914 641 277 0 10401 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43656 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/199 5848
/proc/meminfo: memFree=24764796/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43676 CPUtime=102.27 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 66070 0 0 0 10204 23 0 0 20 0 1 0 408339721 69140480 10919 33554432000 4194304 5326806 140724117619680 140724117618888 4427622 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10919 641 277 0 10401 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43676 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/199 5854
/proc/meminfo: memFree=24763756/32770624 swapFree=67017820/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43684 CPUtime=162.27 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 66278 0 0 0 16188 39 0 0 20 0 1 0 408339721 69140480 10921 33554432000 4194304 5326806 140724117619680 140724117618888 4432692 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10921 643 277 0 10401 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43684 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 5865
/proc/meminfo: memFree=24763880/32770624 swapFree=67017828/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43684 CPUtime=222.27 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 66478 0 0 0 22175 52 0 0 20 0 1 0 408339721 69140480 10921 33554432000 4194304 5326806 140724117619680 140724117618888 4400976 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10921 643 277 0 10401 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43684 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 5869
/proc/meminfo: memFree=24764536/32770624 swapFree=67017828/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43684 CPUtime=282.27 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 66684 0 0 0 28163 64 0 0 20 0 1 0 408339721 69140480 10921 33554432000 4194304 5326806 140724117619680 140724117618888 140690357654023 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10921 643 277 0 10401 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43684 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 5875
/proc/meminfo: memFree=24764704/32770624 swapFree=67017828/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43684 CPUtime=342.26 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 66883 0 0 0 34149 77 0 0 20 0 1 0 408339721 69140480 10921 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10921 643 277 0 10401 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43684 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 5879
/proc/meminfo: memFree=24764220/32770624 swapFree=67017828/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43684 CPUtime=402.25 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 67092 0 0 0 40136 89 0 0 20 0 1 0 408339721 69140480 10921 33554432000 4194304 5326806 140724117619680 140724117618888 4432692 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10921 643 277 0 10401 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43684 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 5883
/proc/meminfo: memFree=24764532/32770624 swapFree=67017828/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43684 CPUtime=462.25 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 67291 0 0 0 46122 103 0 0 20 0 1 0 408339721 69140480 10921 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10921 643 277 0 10401 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43684 KiB


################
# More data... #
################

/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1602.2 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6710
/proc/meminfo: memFree=24726580/32770624 swapFree=67017892/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=1662.21 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 71332 0 0 0 165856 365 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1662.21 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6714
/proc/meminfo: memFree=24726684/32770624 swapFree=67017892/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=1722.2 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 71533 0 0 0 171843 377 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 4674176 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1722.2 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6720
/proc/meminfo: memFree=24726796/32770624 swapFree=67017892/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=1782.2 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 71733 0 0 0 177830 390 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1782.2 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6724
/proc/meminfo: memFree=24727092/32770624 swapFree=67017892/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=1842.19 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 71934 0 0 0 183818 401 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 4432703 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1842.19 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6728
/proc/meminfo: memFree=24727324/32770624 swapFree=67017892/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=1902.19 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 72140 0 0 0 189806 413 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1902.19 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6734
/proc/meminfo: memFree=24726724/32770624 swapFree=67017892/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=1962.19 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 72341 0 0 0 195792 427 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 1962.19 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 6746
/proc/meminfo: memFree=24727116/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2022.19 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 72543 0 0 0 201776 443 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690357654028 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2022.19 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 6750
/proc/meminfo: memFree=24727332/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2082.18 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 72743 0 0 0 207763 455 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2082.18 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 6756
/proc/meminfo: memFree=24727672/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2142.18 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 72943 0 0 0 213749 469 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 4432699 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2142.18 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 6760
/proc/meminfo: memFree=24728120/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2202.18 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 73145 0 0 0 219735 483 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2202.18 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 6764
/proc/meminfo: memFree=24727468/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2262.17 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 73347 0 0 0 225722 495 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 140690348470652 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2262.17 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6770
/proc/meminfo: memFree=24727588/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2322.18 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 73546 0 0 0 231707 511 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 4674121 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2322.18 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 6774
/proc/meminfo: memFree=24728432/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2382.17 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 73747 0 0 0 237692 525 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 4674125 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2382.17 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 6776
/proc/meminfo: memFree=24726860/32770624 swapFree=67017904/67108860
[pid=5840] ppid=5837 vsize=67520 memory=43696 CPUtime=2400.08 cores=0,2,4,6
/proc/5840/stat : 5840 (miniBTD) R 5837 5840 1622 0 -1 4202496 73947 0 0 0 239479 529 0 0 20 0 1 0 408339721 69140480 10924 33554432000 4194304 5326806 140724117619680 140724117618888 4432699 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 7427920 7432256 26992640 140724117627936 140724117628016 140724117628016 140724117630925 0
/proc/5840/statm: 16880 10924 646 277 0 10401 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 67520 KiB
Current children cumulated memory: 43696 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.2 s]
# the end of solver process 5840 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2394.79 s, system=5.29278 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.2
CPU time (s): 2400.08
CPU user time (s): 2394.79
CPU system time (s): 5.29278
CPU usage (%): 99.9951
Max. virtual memory (cumulated for all children) (KiB): 67520
Max. memory (cumulated for all children) (KiB): 43696

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2394.79
system time used= 5.29278
maximum resident set size= 43696
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 73947
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 26
involuntary context switches= 629


# summary of solver processes directly reported to runsolver:
#   pid: 5840
#   total CPU time (s): 2400.08
#   total CPU user time (s): 2394.79
#   total CPU system time (s): 5.29278

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.51256 second user time and 17.1544 second system time

The end

Launcher Data 

Begin job on node150 at 2019-09-12 22:37:12
IDJOB=4391834
IDBENCH=139104
IDSOLVER=2836
FILE ID=node150/4391834-1568320671
RUNJOBID= node150-1568306885-1655
PBS_JOBID= 21701119
Free space on /tmp= 55024 MiB

SOLVER NAME= miniBTD 19.06.16
BENCH NAME= XCSP17/LatinSquare/LatinSquare-xcsp2-qcp25/qcp-25-264-09_X2.xml
COMMAND LINE= miniBTD TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391834-1568320671/watcher-4391834-1568320671 -o /tmp/evaluation-result-4391834-1568320671/solver-4391834-1568320671 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node150-1568306885-1655 --watchdog 2560  miniBTD 2400 HOME/instance-4391834-1568320671.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9027aa50623a7bf75cd9351701a12dc2
RANDOM SEED=1167036082

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24807788 kB
MemAvailable:   31840660 kB
Buffers:          155784 kB
Cached:          7025820 kB
SwapCached:         9612 kB
Active:          1151140 kB
Inactive:        6074412 kB
Active(anon):      12216 kB
Inactive(anon):    53680 kB
Active(file):    1138924 kB
Inactive(file):  6020732 kB
Unevictable:      109328 kB
Mlocked:          109328 kB
SwapTotal:      67108860 kB
SwapFree:       67017820 kB
Dirty:              8072 kB
Writeback:             0 kB
AnonPages:        144200 kB
Mapped:            36320 kB
Shmem:             13168 kB
Slab:             332040 kB
SReclaimable:     301676 kB
SUnreclaim:        30364 kB
KernelStack:        3584 kB
PageTables:         5348 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     528236 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       99712 kB
DirectMap2M:    33445888 kB

Free space on /tmp at the end= 55016 MiB
End job on node150 at 2019-09-12 23:17:12