Trace number 4309676

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.07 2520.01

General information on the benchmark

NameQuasigroups/
QuasiGroup-7-20_c18.xml
MD5SUM5f66fd9d375fc47cd589a0d8fc089b8f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables800
Number of constraints762
Number of domains1
Minimum domain size20
Maximum domain size20
Distribution of domain sizes[{"size":20,"count":780}]
Minimum variable degree0
Maximum variable degree41
Distribution of variable degrees[{"degree":0,"count":20},{"degree":2,"count":380},{"degree":40,"count":20},{"degree":41,"count":380}]
Minimum constraint arity20
Maximum constraint arity400
Distribution of constraint arities[{"arity":20,"count":1},{"arity":22,"count":760},{"arity":400,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":760}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14352 MiB free)
  memory of node 1: 16384 MiB (13906 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309676-1534316215/watcher-4309676-1534316215 -o /tmp/evaluation-result-4309676-1534316215/solver-4309676-1534316215 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1534292346-18984 --watchdog 2580 xcsp_picat HOME/instance-4309676-1534316215.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=21715, runsolver pid=21712
Current StackSize limit: 8192 KiB


[startup+0.100156 s]*
/proc/loadavg: 1.92 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28918112/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2034316 memory=21960 CPUtime=0.1 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2080 0 0 0 9 1 0 0 20 0 1 0 249184715 2083139584 5490 33554432000 4194304 5849940 140724014348224 140724014348224 5472038 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508579 5490 688 405 0 505523 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2034316 KiB
Current children cumulated memory: 21960 KiB

[startup+0.209746 s]*
/proc/loadavg: 1.92 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28917832/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2034316 memory=21960 CPUtime=0.21 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2080 0 0 0 20 1 0 0 20 0 1 0 249184715 2083139584 5490 33554432000 4194304 5849940 140724014348224 140724014348224 140618049617579 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508579 5490 688 405 0 505523 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2034316 KiB
Current children cumulated memory: 21960 KiB

[startup+0.308814 s]*
/proc/loadavg: 1.92 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28917832/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2034316 memory=21960 CPUtime=0.31 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2080 0 0 0 30 1 0 0 20 0 1 0 249184715 2083139584 5490 33554432000 4194304 5849940 140724014348224 140724014348224 140618049617710 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508579 5490 688 405 0 505523 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2034316 KiB
Current children cumulated memory: 21960 KiB

[startup+0.700272 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28917832/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2034448 memory=21960 CPUtime=0.7 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2113 0 0 0 69 1 0 0 20 0 1 0 249184715 2083274752 5490 33554432000 4194304 5849940 140724014348224 140724014348224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508612 5490 688 405 0 505556 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 2034448 KiB
Current children cumulated memory: 21960 KiB

[startup+1.50027 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28917236/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2034836 memory=22352 CPUtime=1.49 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2210 0 0 0 148 1 0 0 20 0 1 0 249184715 2083672064 5588 33554432000 4194304 5849940 140724014348224 140724014347448 5472680 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508709 5588 688 405 0 505653 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2034836 KiB
Current children cumulated memory: 22352 KiB

[startup+3.10905 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28916432/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2035348 memory=22992 CPUtime=3.1 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2432 0 0 0 309 1 0 0 20 0 1 0 249184715 2084196352 5748 33554432000 4194304 5849940 140724014348224 140724014347448 5473545 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508837 5748 688 405 0 505781 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2035348 KiB
Current children cumulated memory: 22992 KiB

[startup+6.30027 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28915012/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2035860 memory=23508 CPUtime=6.29 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 2717 0 0 0 627 2 0 0 20 0 1 0 249184715 2084720640 5877 33554432000 4194304 5849940 140724014348224 140724014347448 5534964 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 508965 5877 689 405 0 505909 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2035860 KiB
Current children cumulated memory: 23508 KiB

[startup+12.7003 s]
/proc/loadavg: 1.94 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28913400/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2037396 memory=25044 CPUtime=12.69 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 3662 0 0 0 1265 4 0 0 20 0 1 0 249184715 2086293504 6261 33554432000 4194304 5849940 140724014348224 140724014347448 140618049622729 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 509349 6261 689 405 0 506293 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2037396 KiB
Current children cumulated memory: 25044 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28909960/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2040468 memory=28116 CPUtime=25.49 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 5047 0 0 0 2542 7 0 0 20 0 1 0 249184715 2089439232 7029 33554432000 4194304 5849940 140724014348224 140724014347448 140618049622543 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 510117 7029 689 405 0 507061 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2040468 KiB
Current children cumulated memory: 28116 KiB

[startup+51.109 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 21716
/proc/meminfo: memFree=28896372/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2046612 memory=34260 CPUtime=51.1 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 7574 0 0 0 5098 12 0 0 20 0 1 0 249184715 2095730688 8565 33554432000 4194304 5849940 140724014348224 140724014347448 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 511653 8565 689 405 0 508597 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2046612 KiB
Current children cumulated memory: 34260 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 21718
/proc/meminfo: memFree=28880708/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2063104 memory=49736 CPUtime=102.3 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 25604 0 0 0 10187 43 0 0 20 0 1 0 249184715 2112618496 12434 33554432000 4194304 5849940 140724014348224 140724014347384 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 515776 12434 722 405 0 512720 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 2063104 KiB
Current children cumulated memory: 49736 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/186 21719
/proc/meminfo: memFree=28870376/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2071932 memory=58432 CPUtime=162.3 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 34744 0 0 0 16153 77 0 0 20 0 1 0 249184715 2121658368 14608 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 517983 14608 722 405 0 514927 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 2071932 KiB
Current children cumulated memory: 58432 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 21728
/proc/meminfo: memFree=28869348/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2069172 memory=56764 CPUtime=222.3 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 42652 0 0 0 22113 117 0 0 20 0 1 0 249184715 2118832128 14191 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 517293 14191 722 405 0 514237 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 2069172 KiB
Current children cumulated memory: 56764 KiB

[startup+282.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/189 21753
/proc/meminfo: memFree=28783160/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2074812 memory=62368 CPUtime=282.3 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 50876 0 0 0 28074 156 0 0 20 0 1 0 249184715 2124607488 15592 33554432000 4194304 5849940 140724014348224 140724014347096 5357936 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 518703 15592 722 405 0 515647 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 2074812 KiB
Current children cumulated memory: 62368 KiB

[startup+342.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/189 21754
/proc/meminfo: memFree=28766492/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2076964 memory=64476 CPUtime=342.3 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 67424 0 0 0 34039 191 0 0 20 0 1 0 249184715 2126811136 16119 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 519241 16119 722 405 0 516185 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 2076964 KiB
Current children cumulated memory: 64476 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/189 21755
/proc/meminfo: memFree=28767980/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2075524 memory=63008 CPUtime=402.3 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 88109 0 0 0 40002 228 0 0 20 0 1 0 249184715 2125336576 15752 33554432000 4194304 5849940 140724014348224 140724014347384 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 518881 15752 722 405 0 515825 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 2075524 KiB
Current children cumulated memory: 63008 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 21756
/proc/meminfo: memFree=28752848/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2090196 memory=77976 CPUtime=462.31 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 107508 0 0 0 45966 265 0 0 20 0 1 0 249184715 2140360704 19494 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 522549 19494 722 405 0 519493 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 2090196 KiB
Current children cumulated memory: 77976 KiB


################
# More data... #
################

/proc/21715/statm: 523798 21980 722 405 0 520742 0
Current children cumulated CPU time: 1722.34 s
Current children cumulated vsize: 2095192 KiB
Current children cumulated memory: 87920 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21920
/proc/meminfo: memFree=28962832/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2126200 memory=118964 CPUtime=1782.33 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 565689 0 0 0 177258 975 0 0 20 0 1 0 249184715 2177228800 29741 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 531550 29741 722 405 0 528494 0
Current children cumulated CPU time: 1782.33 s
Current children cumulated vsize: 2126200 KiB
Current children cumulated memory: 118964 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21921
/proc/meminfo: memFree=28964128/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2120860 memory=113572 CPUtime=1842.33 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 573610 0 0 0 183232 1001 0 0 20 0 1 0 249184715 2171760640 28393 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 530215 28393 722 405 0 527159 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 2120860 KiB
Current children cumulated memory: 113572 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21923
/proc/meminfo: memFree=28922432/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2134216 memory=126672 CPUtime=1902.34 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 590630 0 0 0 189209 1025 0 0 20 0 1 0 249184715 2185437184 31668 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 533554 31668 722 405 0 530498 0
Current children cumulated CPU time: 1902.34 s
Current children cumulated vsize: 2134216 KiB
Current children cumulated memory: 126672 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21924
/proc/meminfo: memFree=28863060/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2117552 memory=109928 CPUtime=1962.34 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 600416 0 0 0 195187 1047 0 0 20 0 1 0 249184715 2168373248 27482 33554432000 4194304 5849940 140724014348224 140724014347384 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 529388 27482 722 405 0 526332 0
Current children cumulated CPU time: 1962.34 s
Current children cumulated vsize: 2117552 KiB
Current children cumulated memory: 109928 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 21933
/proc/meminfo: memFree=28887988/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2122392 memory=114736 CPUtime=2022.34 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 617970 0 0 0 201162 1072 0 0 20 0 1 0 249184715 2173329408 28684 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 530598 28684 722 405 0 527542 0
Current children cumulated CPU time: 2022.34 s
Current children cumulated vsize: 2122392 KiB
Current children cumulated memory: 114736 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 21934
/proc/meminfo: memFree=28860880/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2095888 memory=88736 CPUtime=2082.34 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 624846 0 0 0 207143 1091 0 0 20 0 1 0 249184715 2146189312 22184 33554432000 4194304 5849940 140724014348224 140724014347384 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 523972 22184 722 405 0 520916 0
Current children cumulated CPU time: 2082.34 s
Current children cumulated vsize: 2095888 KiB
Current children cumulated memory: 88736 KiB

[startup+2142.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/188 21935
/proc/meminfo: memFree=28791560/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2095368 memory=88324 CPUtime=2142.34 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 643267 0 0 0 213121 1113 0 0 20 0 1 0 249184715 2145656832 22081 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 523842 22081 722 405 0 520786 0
Current children cumulated CPU time: 2142.34 s
Current children cumulated vsize: 2095368 KiB
Current children cumulated memory: 88324 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/188 21936
/proc/meminfo: memFree=28888376/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2096424 memory=89396 CPUtime=2202.34 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 650027 0 0 0 219102 1132 0 0 20 0 1 0 249184715 2146738176 22349 33554432000 4194304 5849940 140724014348224 140724014347224 5438027 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 524106 22349 722 405 0 521050 0
Current children cumulated CPU time: 2202.34 s
Current children cumulated vsize: 2096424 KiB
Current children cumulated memory: 89396 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 21937
/proc/meminfo: memFree=28835688/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2105472 memory=98576 CPUtime=2262.35 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 672910 0 0 0 225077 1158 0 0 20 0 1 0 249184715 2156003328 24644 33554432000 4194304 5849940 140724014348224 140724014347096 5356114 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 526368 24644 722 405 0 523312 0
Current children cumulated CPU time: 2262.35 s
Current children cumulated vsize: 2105472 KiB
Current children cumulated memory: 98576 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21938
/proc/meminfo: memFree=28689676/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2114000 memory=106952 CPUtime=2322.35 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 682699 0 0 0 231055 1180 0 0 20 0 1 0 249184715 2164736000 26738 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 528500 26738 722 405 0 525444 0
Current children cumulated CPU time: 2322.35 s
Current children cumulated vsize: 2114000 KiB
Current children cumulated memory: 106952 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21939
/proc/meminfo: memFree=28705168/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2098780 memory=91680 CPUtime=2382.35 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 700034 0 0 0 237036 1199 0 0 20 0 1 0 249184715 2149150720 22920 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 524695 22920 722 405 0 521639 0
Current children cumulated CPU time: 2382.35 s
Current children cumulated vsize: 2098780 KiB
Current children cumulated memory: 91680 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21940
/proc/meminfo: memFree=28606256/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2142724 memory=133340 CPUtime=2442.35 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 706141 0 0 0 243018 1217 0 0 20 0 1 0 249184715 2194149376 33335 33554432000 4194304 5849940 140724014348224 140724014347224 140618050084743 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 535681 33335 722 405 0 532625 0
Current children cumulated CPU time: 2442.35 s
Current children cumulated vsize: 2142724 KiB
Current children cumulated memory: 133340 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21941
/proc/meminfo: memFree=28586560/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2159900 memory=152876 CPUtime=2502.35 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 721909 0 0 0 248994 1241 0 0 20 0 1 0 249184715 2211737600 38219 33554432000 4194304 5849940 140724014348224 140724014347224 5437906 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 539975 38219 722 405 0 536919 0
Current children cumulated CPU time: 2502.35 s
Current children cumulated vsize: 2159900 KiB
Current children cumulated memory: 152876 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 21941
/proc/meminfo: memFree=28626192/32770624 swapFree=67030680/67108860
[pid=21715] ppid=21712 vsize=2120428 memory=113212 CPUtime=2520.06 cores=1,3,5,7
/proc/21715/stat : 21715 (xcsp_picat) R 21712 21715 18952 0 -1 4202496 725490 0 0 0 250759 1247 0 0 20 0 1 0 249184715 2171318272 28303 33554432000 4194304 5849940 140724014348224 140724014347224 5437824 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9396308 46391296 140724014355638 140724014355716 140724014355716 140724014358474 0
/proc/21715/statm: 530107 28303 722 405 0 527051 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 2120428 KiB
Current children cumulated memory: 113212 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 21715 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2507.6 s, system=12.4764 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2520.07
CPU user time (s): 2507.6
CPU system time (s): 12.4764
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 2169788
Max. memory (cumulated for all children) (KiB): 162764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2507.6
system time used= 12.4764
maximum resident set size= 162764
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 725490
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 1195


# summary of solver processes directly reported to runsolver:
#   pid: 21715
#   total CPU time (s): 2520.07
#   total CPU user time (s): 2507.6
#   total CPU system time (s): 12.4764

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.3656 second user time and 19.5416 second system time

The end

Launcher Data 

Begin job on node102 at 2018-08-15 08:56:55
IDJOB=4309676
IDBENCH=141608
IDSOLVER=2794
FILE ID=node102/4309676-1534316215
RUNJOBID= node102-1534292346-18984
PBS_JOBID= 21038132
Free space on /tmp= 39516 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-7-20_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309676-1534316215/watcher-4309676-1534316215 -o /tmp/evaluation-result-4309676-1534316215/solver-4309676-1534316215 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1534292346-18984 --watchdog 2580  xcsp_picat HOME/instance-4309676-1534316215.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f66fd9d375fc47cd589a0d8fc089b8f
RANDOM SEED=485757248

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28937188 kB
MemAvailable:   31597356 kB
Buffers:          154000 kB
Cached:          2771400 kB
SwapCached:        51224 kB
Active:          1714672 kB
Inactive:        1569128 kB
Active(anon):     281228 kB
Inactive(anon):   136804 kB
Active(file):    1433444 kB
Inactive(file):  1432324 kB
Unevictable:        7348 kB
Mlocked:            7348 kB
SwapTotal:      67108860 kB
SwapFree:       67030680 kB
Dirty:              3236 kB
Writeback:             0 kB
AnonPages:        317320 kB
Mapped:            56144 kB
Shmem:             57196 kB
Slab:             249144 kB
SReclaimable:     220468 kB
SUnreclaim:        28676 kB
KernelStack:        3408 kB
PageTables:         5820 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2629160 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    165888 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 39516 MiB
End job on node102 at 2018-08-15 09:38:56