Trace number 4295879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2018.06.11_3? (TO) 2520.06 2519.9

General information on the benchmark

NameQuasigroups/
QuasiGroup-4-14_c18.xml
MD5SUM0e107aeb1163eb9d4573d4ca0ed1edf8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables392
Number of constraints366
Number of domains2
Minimum domain size14
Maximum domain size196
Distribution of domain sizes[{"size":14,"count":196},{"size":196,"count":182}]
Minimum variable degree0
Maximum variable degree185
Distribution of variable degrees[{"degree":0,"count":14},{"degree":2,"count":182},{"degree":184,"count":14},{"degree":185,"count":182}]
Minimum constraint arity3
Maximum constraint arity197
Distribution of constraint arities[{"arity":3,"count":182},{"arity":14,"count":1},{"arity":196,"count":1},{"arity":197,"count":182}]
Number of extensional constraints0
Number of intensional constraints182
Distribution of constraint types[{"type":"intension","count":182},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":182}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.06.11_3
0.00/0.01	
0.00/0.01	    instantiation constraint
0.00/0.01	        list:x[0][0] x[1][1] x[2][2]  ... x[10][10] x[11][11] x[12][12] x[13][13] 
0.00/0.01	        values:0 1 2  ... 10 11 12 13

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8491 MiB free)
  memory of node 1: 16384 MiB (11517 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4295879-1532598336/watcher-4295879-1532598336 -o /tmp/evaluation-result-4295879-1532598336/solver-4295879-1532598336 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1532598327-8113 --watchdog 2580 BTD 3 2520 HOME/instance-4295879-1532598336.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=8512, runsolver pid=8509

[startup+0.10016 s]*
/proc/loadavg: 2.16 2.06 2.04 3/191 8513
/proc/meminfo: memFree=20480492/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=41348 memory=11068 CPUtime=0.1 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 2941 0 0 0 10 0 0 0 20 0 1 0 77396817 42340352 2767 33554432000 4194304 36388972 140736304630128 140736304630128 7657238 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 10337 2767 440 7861 0 2441 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 41348 KiB
Current children cumulated memory: 11068 KiB

[startup+0.20983 s]*
/proc/loadavg: 2.16 2.06 2.04 3/191 8513
/proc/meminfo: memFree=20471192/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=50192 memory=20308 CPUtime=0.21 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 5205 0 0 0 21 0 0 0 20 0 1 0 77396817 51396608 5077 33554432000 4194304 36388972 140736304630128 140736304630128 7657238 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 12548 5077 481 7861 0 4652 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 50192 KiB
Current children cumulated memory: 20308 KiB

[startup+0.309789 s]*
/proc/loadavg: 2.16 2.06 2.04 3/191 8513
/proc/meminfo: memFree=20468588/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=53360 memory=23476 CPUtime=0.31 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 6009 0 0 0 31 0 0 0 20 0 1 0 77396817 54640640 5869 33554432000 4194304 36388972 140736304630128 140736304630128 7657238 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 13340 5869 492 7861 0 5444 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 53360 KiB
Current children cumulated memory: 23476 KiB

[startup+0.700384 s]
/proc/loadavg: 2.16 2.06 2.04 3/191 8513
/proc/meminfo: memFree=20466484/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=35860 CPUtime=0.7 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 9127 0 0 0 69 1 0 0 20 0 1 0 77396817 67858432 8965 33554432000 4194304 36388972 140736304630128 140736304628616 4658325 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 8965 511 7861 0 8671 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 35860 KiB

[startup+1.50028 s]
/proc/loadavg: 2.16 2.06 2.04 3/191 8513
/proc/meminfo: memFree=20455696/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=35860 CPUtime=1.5 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 9127 0 0 0 149 1 0 0 20 0 1 0 77396817 67858432 8965 33554432000 4194304 36388972 140736304630128 140736304628616 4658325 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 8965 511 7861 0 8671 0
Current children cumulated CPU time: 1.5 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 35860 KiB

[startup+3.1093 s]
/proc/loadavg: 2.23 2.08 2.05 3/191 8513
/proc/meminfo: memFree=20455648/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=36004 CPUtime=3.1 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 11950 0 0 0 309 1 0 0 20 0 1 0 77396817 67858432 9001 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 9001 517 7861 0 8671 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 36004 KiB

[startup+6.30027 s]
/proc/loadavg: 2.23 2.08 2.05 3/191 8513
/proc/meminfo: memFree=20456044/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=36004 CPUtime=6.29 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 14679 0 0 0 628 1 0 0 20 0 1 0 77396817 67858432 9001 33554432000 4194304 36388972 140736304630128 140736304628968 4560639 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 9001 517 7861 0 8671 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 36004 KiB

[startup+12.7003 s]
/proc/loadavg: 2.19 2.08 2.05 3/191 8513
/proc/meminfo: memFree=20456664/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=36008 CPUtime=12.69 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 17336 0 0 0 1268 1 0 0 20 0 1 0 77396817 67858432 9002 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 9002 517 7861 0 8671 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 36008 KiB

[startup+25.5003 s]
/proc/loadavg: 2.16 2.07 2.05 3/191 8513
/proc/meminfo: memFree=20457188/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=36092 CPUtime=25.49 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 23098 0 0 0 2548 1 0 0 20 0 1 0 77396817 67858432 9023 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 9023 520 7861 0 8671 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 36092 KiB

[startup+51.1093 s]
/proc/loadavg: 2.11 2.07 2.05 3/191 8513
/proc/meminfo: memFree=20455876/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66268 memory=36120 CPUtime=51.09 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 26148 0 0 0 5108 1 0 0 20 0 1 0 77396817 67858432 9030 33554432000 4194304 36388972 140736304630128 140736304628968 4658325 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16567 9030 520 7861 0 8671 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 66268 KiB
Current children cumulated memory: 36120 KiB

[startup+102.3 s]
/proc/loadavg: 2.04 2.06 2.05 3/191 8514
/proc/meminfo: memFree=20457692/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36252 CPUtime=102.29 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 26490 0 0 0 10227 2 0 0 20 0 1 0 77396817 67993600 9063 33554432000 4194304 36388972 140736304630128 140736304628968 4658333 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9063 520 7861 0 8704 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36252 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 2.05 2.05 3/191 8515
/proc/meminfo: memFree=20457768/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36272 CPUtime=162.3 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 26736 0 0 0 16228 2 0 0 20 0 1 0 77396817 67993600 9068 33554432000 4194304 36388972 140736304630128 140736304628968 4658325 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9068 520 7861 0 8704 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36272 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/191 8516
/proc/meminfo: memFree=20457892/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36284 CPUtime=222.3 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 26985 0 0 0 22228 2 0 0 20 0 1 0 77396817 67993600 9071 33554432000 4194304 36388972 140736304630128 140736304628968 4658349 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9071 520 7861 0 8704 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36284 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/192 8525
/proc/meminfo: memFree=20457976/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36284 CPUtime=282.3 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 26987 0 0 0 28228 2 0 0 20 0 1 0 77396817 67993600 9071 33554432000 4194304 36388972 140736304630128 140736304628968 4582943 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9071 520 7861 0 8704 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36284 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 8526
/proc/meminfo: memFree=20458296/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36316 CPUtime=342.3 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 27243 0 0 0 34228 2 0 0 20 0 1 0 77396817 67993600 9079 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9079 520 7861 0 8704 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36316 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 8527
/proc/meminfo: memFree=20458048/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36316 CPUtime=402.31 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 27245 0 0 0 40228 3 0 0 20 0 1 0 77396817 67993600 9079 33554432000 4194304 36388972 140736304630128 140736304628968 4658315 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9079 520 7861 0 8704 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36316 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 8528
/proc/meminfo: memFree=20458296/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66400 memory=36328 CPUtime=462.32 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 27501 0 0 0 46229 3 0 0 20 0 1 0 77396817 67993600 9082 33554432000 4194304 36388972 140736304630128 140736304628968 4658333 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16600 9082 520 7861 0 8704 0
Current children cumulated CPU time: 462.32 s
Current children cumulated vsize: 66400 KiB
Current children cumulated memory: 36328 KiB


################
# More data... #
################

/proc/8512/statm: 16633 9135 520 7861 0 8737 0
Current children cumulated CPU time: 1782.4 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36540 KiB

[startup+1842.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 8594
/proc/meminfo: memFree=20457552/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36540 CPUtime=1842.41 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 29743 0 0 0 184232 9 0 0 20 0 1 0 77396817 68128768 9135 33554432000 4194304 36388972 140736304630128 140736304628968 4658323 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9135 520 7861 0 8737 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36540 KiB

[startup+1902.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 8595
/proc/meminfo: memFree=20457676/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36548 CPUtime=1902.41 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 29895 0 0 0 190232 9 0 0 20 0 1 0 77396817 68128768 9137 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9137 520 7861 0 8737 0
Current children cumulated CPU time: 1902.41 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36548 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 8596
/proc/meminfo: memFree=20457552/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36548 CPUtime=1962.42 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 29895 0 0 0 196232 10 0 0 20 0 1 0 77396817 68128768 9137 33554432000 4194304 36388972 140736304630128 140736304628968 4658325 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9137 520 7861 0 8737 0
Current children cumulated CPU time: 1962.42 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36548 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 8597
/proc/meminfo: memFree=20457800/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36552 CPUtime=2022.42 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30080 0 0 0 202232 10 0 0 20 0 1 0 77396817 68128768 9138 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9138 520 7861 0 8737 0
Current children cumulated CPU time: 2022.42 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36552 KiB

[startup+2082.3 s]
/proc/loadavg: 2.28 2.06 2.06 3/188 8606
/proc/meminfo: memFree=20456876/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36552 CPUtime=2082.42 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30083 0 0 0 208232 10 0 0 20 0 1 0 77396817 68128768 9138 33554432000 4194304 36388972 140736304630128 140736304628968 4658323 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9138 520 7861 0 8737 0
Current children cumulated CPU time: 2082.42 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36552 KiB

[startup+2142.3 s]
/proc/loadavg: 2.29 2.12 2.08 3/188 8607
/proc/meminfo: memFree=20457124/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36552 CPUtime=2142.42 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30236 0 0 0 214232 10 0 0 20 0 1 0 77396817 68128768 9138 33554432000 4194304 36388972 140736304630128 140736304628968 4658381 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9138 520 7861 0 8737 0
Current children cumulated CPU time: 2142.42 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36552 KiB

[startup+2202.3 s]
/proc/loadavg: 2.11 2.10 2.08 3/188 8608
/proc/meminfo: memFree=20457496/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36552 CPUtime=2202.43 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30273 0 0 0 220233 10 0 0 20 0 1 0 77396817 68128768 9138 33554432000 4194304 36388972 140736304630128 140736304628968 4658343 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9138 520 7861 0 8737 0
Current children cumulated CPU time: 2202.43 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36552 KiB

[startup+2262.3 s]
/proc/loadavg: 2.04 2.08 2.07 3/188 8609
/proc/meminfo: memFree=20457256/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36560 CPUtime=2262.44 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30430 0 0 0 226233 11 0 0 20 0 1 0 77396817 68128768 9140 33554432000 4194304 36388972 140736304630128 140736304628968 4658329 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9140 520 7861 0 8737 0
Current children cumulated CPU time: 2262.44 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36560 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/188 8610
/proc/meminfo: memFree=20457628/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36560 CPUtime=2322.44 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30432 0 0 0 232233 11 0 0 20 0 1 0 77396817 68128768 9140 33554432000 4194304 36388972 140736304630128 140736304628968 4658333 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9140 520 7861 0 8737 0
Current children cumulated CPU time: 2322.44 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36560 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/187 8612
/proc/meminfo: memFree=20457776/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36568 CPUtime=2382.44 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30614 0 0 0 238233 11 0 0 20 0 1 0 77396817 68128768 9142 33554432000 4194304 36388972 140736304630128 140736304628968 4658325 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9142 520 7861 0 8737 0
Current children cumulated CPU time: 2382.44 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36568 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 8613
/proc/meminfo: memFree=20457860/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36568 CPUtime=2442.44 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30614 0 0 0 244233 11 0 0 20 0 1 0 77396817 68128768 9142 33554432000 4194304 36388972 140736304630128 140736304628968 4560624 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9142 520 7861 0 8737 0
Current children cumulated CPU time: 2442.44 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36568 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 8614
/proc/meminfo: memFree=20457448/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36568 CPUtime=2502.45 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30763 0 0 0 250233 12 0 0 20 0 1 0 77396817 68128768 9142 33554432000 4194304 36388972 140736304630128 140736304628968 4658381 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9142 520 7861 0 8737 0
Current children cumulated CPU time: 2502.45 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36568 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 1.93 2.02 2.04 3/187 8736
/proc/meminfo: memFree=20377268/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36568 CPUtime=2520.06 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30763 0 0 0 251994 12 0 0 20 0 1 0 77396817 68128768 9142 33554432000 4194304 36388972 140736304630128 140736304628968 4658323 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9142 520 7861 0 8737 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36568 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 8512 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.94 s, system=0.123008 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 1.93 2.02 2.04 3/187 8736
/proc/meminfo: memFree=20377268/32770624 swapFree=67108860/67108860
[pid=8512] ppid=8509 vsize=66532 memory=36568 CPUtime=2520.06 cores=1,3,5,7
/proc/8512/stat : 8512 (BTD) R 8509 8512 8081 0 -1 4202496 30763 0 0 0 251994 12 0 0 20 0 1 0 77396817 68128768 9142 33554432000 4194304 36388972 140736304630128 140736304628968 4658323 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 68481024 140736304633021 140736304633099 140736304633099 140736304635857 0
/proc/8512/statm: 16633 9142 520 7861 0 8737 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 66532 KiB
Current children cumulated memory: 36568 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.9
CPU time (s): 2520.06
CPU user time (s): 2519.94
CPU system time (s): 0.123008
CPU usage (%): 100.007
Max. virtual memory (cumulated for all children) (KiB): 66532
Max. memory (cumulated for all children) (KiB): 36568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.94
system time used= 0.123008
maximum resident set size= 36568
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30763
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11
involuntary context switches= 734


# summary of solver processes directly reported to runsolver:
#   pid: 8512
#   total CPU time (s): 2520.06
#   total CPU user time (s): 2519.94
#   total CPU system time (s): 0.123008

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.31265 second user time and 16.7323 second system time

The end

Launcher Data 

Begin job on node105 at 2018-07-26 11:45:36
IDJOB=4295879
IDBENCH=141612
IDSOLVER=2749
FILE ID=node105/4295879-1532598336
RUNJOBID= node105-1532598327-8113
PBS_JOBID= 21021977
Free space on /tmp= 44572 MiB

SOLVER NAME= BTD 2018.06.11_3
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-4-14_c18.xml
COMMAND LINE= BTD 3 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4295879-1532598336/watcher-4295879-1532598336 -o /tmp/evaluation-result-4295879-1532598336/solver-4295879-1532598336 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1532598327-8113 --watchdog 2580  BTD 3 2520 HOME/instance-4295879-1532598336.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0e107aeb1163eb9d4573d4ca0ed1edf8
RANDOM SEED=1476416978

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20490416 kB
MemAvailable:   31910856 kB
Buffers:          244388 kB
Cached:         11317728 kB
SwapCached:            0 kB
Active:          2390720 kB
Inactive:        9241472 kB
Active(anon):      24828 kB
Inactive(anon):    73432 kB
Active(file):    2365892 kB
Inactive(file):  9168040 kB
Unevictable:        7328 kB
Mlocked:            7328 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             53204 kB
Writeback:             0 kB
AnonPages:         79380 kB
Mapped:            42716 kB
Shmem:             25228 kB
Slab:             342400 kB
SReclaimable:     314968 kB
SUnreclaim:        27432 kB
KernelStack:        3520 kB
PageTables:         5112 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     370892 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 44520 MiB
End job on node105 at 2018-07-26 12:27:37