Trace number 4309664

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2519.88 2520.01

General information on the benchmark

NameQuasigroups/
QuasiGroup-4-10_c18.xml
MD5SUM13340ae912518807f9e2f6bcededa797
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints182
Number of domains2
Minimum domain size10
Maximum domain size100
Distribution of domain sizes[{"size":10,"count":100},{"size":100,"count":90}]
Minimum variable degree0
Maximum variable degree93
Distribution of variable degrees[{"degree":0,"count":10},{"degree":2,"count":90},{"degree":92,"count":10},{"degree":93,"count":90}]
Minimum constraint arity3
Maximum constraint arity101
Distribution of constraint arities[{"arity":3,"count":90},{"arity":10,"count":1},{"arity":100,"count":1},{"arity":101,"count":90}]
Number of extensional constraints0
Number of intensional constraints90
Distribution of constraint types[{"type":"intension","count":90},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":90}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (6742 MiB free)
  memory of node 1: 16384 MiB (11104 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309664-1534316159/watcher-4309664-1534316159 -o /tmp/evaluation-result-4309664-1534316159/solver-4309664-1534316159 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1534293054-21341 --watchdog 2580 xcsp_picat HOME/instance-4309664-1534316159.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=24099, runsolver pid=24096

[startup+0.100165 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18259804/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2036044 memory=18672 CPUtime=0.1 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 1812 0 0 0 10 0 0 0 20 0 1 0 249179128 2084909056 4668 33554432000 4194304 5849940 140735704386848 140735704386848 5432576 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 509011 4668 692 405 0 505955 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2036044 KiB
Current children cumulated memory: 18672 KiB

[startup+0.209562 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18257088/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2037456 memory=20440 CPUtime=0.21 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 2411 0 0 0 21 0 0 0 20 0 1 0 249179128 2086354944 5110 33554432000 4194304 5849940 140735704386848 140735704386848 5399765 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 509364 5110 710 405 0 506308 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2037456 KiB
Current children cumulated memory: 20440 KiB

[startup+0.309226 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18257088/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2037456 memory=20440 CPUtime=0.31 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 2411 0 0 0 31 0 0 0 20 0 1 0 249179128 2086354944 5110 33554432000 4194304 5849940 140735704386848 140735704386848 5392217 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 509364 5110 710 405 0 506308 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2037456 KiB
Current children cumulated memory: 20440 KiB

[startup+0.700295 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18255268/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2039708 memory=22448 CPUtime=0.69 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 3030 0 0 0 69 0 0 0 20 0 1 0 249179128 2088660992 5612 33554432000 4194304 5849940 140735704386848 140735704385256 5317718 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 509927 5612 713 405 0 506871 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2039708 KiB
Current children cumulated memory: 22448 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18255268/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2041108 memory=24028 CPUtime=1.49 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 3384 0 0 0 149 0 0 0 20 0 1 0 249179128 2090094592 6007 33554432000 4194304 5849940 140735704386848 140735704385256 4211660 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 510277 6007 722 405 0 507221 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2041108 KiB
Current children cumulated memory: 24028 KiB

[startup+3.10896 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18253904/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2041108 memory=24048 CPUtime=3.1 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 4427 0 0 0 310 0 0 0 20 0 1 0 249179128 2090094592 6012 33554432000 4194304 5849940 140735704386848 140735704385256 4212035 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 510277 6012 722 405 0 507221 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2041108 KiB
Current children cumulated memory: 24048 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18252452/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2041108 memory=24048 CPUtime=6.29 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 5816 0 0 0 629 0 0 0 20 0 1 0 249179128 2090094592 6012 33554432000 4194304 5849940 140735704386848 140735704385256 4212525 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 510277 6012 722 405 0 507221 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2041108 KiB
Current children cumulated memory: 24048 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18251584/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2041024 memory=24044 CPUtime=12.69 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 9959 0 0 0 1264 5 0 0 20 0 1 0 249179128 2090008576 6011 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 510256 6011 726 405 0 507200 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2041024 KiB
Current children cumulated memory: 24044 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18250120/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2043212 memory=25900 CPUtime=25.49 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 23320 0 0 0 2534 15 0 0 20 0 1 0 249179128 2092249088 6475 33554432000 4194304 5849940 140735704386848 140735704385720 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 510803 6475 726 405 0 507747 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2043212 KiB
Current children cumulated memory: 25900 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24100
/proc/meminfo: memFree=18248232/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2043216 memory=26136 CPUtime=51.1 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 39613 0 0 0 5077 33 0 0 20 0 1 0 249179128 2092253184 6534 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 510804 6534 726 405 0 507748 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2043216 KiB
Current children cumulated memory: 26136 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24101
/proc/meminfo: memFree=18228720/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2063360 memory=46284 CPUtime=102.28 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 70727 0 0 0 10170 58 0 0 20 0 1 0 249179128 2112880640 11571 33554432000 4194304 5849940 140735704386848 140735704385720 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 515840 11571 726 405 0 512784 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2063360 KiB
Current children cumulated memory: 46284 KiB

[startup+162.3 s]
/proc/loadavg: 2.29 2.08 2.07 3/187 24103
/proc/meminfo: memFree=18281384/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2051260 memory=34184 CPUtime=162.28 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 97668 0 0 0 16143 85 0 0 20 0 1 0 249179128 2100490240 8546 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 512815 8546 726 405 0 509759 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2051260 KiB
Current children cumulated memory: 34184 KiB

[startup+222.3 s]
/proc/loadavg: 2.34 2.15 2.09 3/187 24104
/proc/meminfo: memFree=18264332/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2059100 memory=42152 CPUtime=222.27 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 117943 0 0 0 22121 106 0 0 20 0 1 0 249179128 2108518400 10538 33554432000 4194304 5849940 140735704386848 140735704385720 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 514775 10538 726 405 0 511719 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2059100 KiB
Current children cumulated memory: 42152 KiB

[startup+282.3 s]
/proc/loadavg: 2.12 2.12 2.09 3/187 24113
/proc/meminfo: memFree=18233096/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2073656 memory=56580 CPUtime=282.27 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 137507 0 0 0 28100 127 0 0 20 0 1 0 249179128 2123423744 14145 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 518414 14145 726 405 0 515358 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 2073656 KiB
Current children cumulated memory: 56580 KiB

[startup+342.3 s]
/proc/loadavg: 2.08 2.11 2.09 3/189 24138
/proc/meminfo: memFree=18229380/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2075464 memory=58172 CPUtime=342.27 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 155192 0 0 0 34079 148 0 0 20 0 1 0 249179128 2125275136 14543 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 518866 14543 726 405 0 515810 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 2075464 KiB
Current children cumulated memory: 58172 KiB

[startup+402.3 s]
/proc/loadavg: 2.03 2.09 2.08 3/189 24139
/proc/meminfo: memFree=18237304/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2068456 memory=51380 CPUtime=402.26 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 172368 0 0 0 40060 166 0 0 20 0 1 0 249179128 2118098944 12845 33554432000 4194304 5849940 140735704386848 140735704385848 5339286 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 517114 12845 726 405 0 514058 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 2068456 KiB
Current children cumulated memory: 51380 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.08 2.07 3/189 24140
/proc/meminfo: memFree=18230784/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2074296 memory=57220 CPUtime=462.26 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 187058 0 0 0 46042 184 0 0 20 0 1 0 249179128 2124079104 14305 33554432000 4194304 5849940 140735704386848 140735704385848 5437906 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 518574 14305 726 405 0 515518 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 2074296 KiB
Current children cumulated memory: 57220 KiB


################
# More data... #
################

/proc/24099/statm: 530308 28020 726 405 0 527252 0
Current children cumulated CPU time: 1722.19 s
Current children cumulated vsize: 2121232 KiB
Current children cumulated memory: 112080 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24240
/proc/meminfo: memFree=18290420/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2113296 memory=103964 CPUtime=1782.19 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 475194 0 0 0 177662 557 0 0 20 0 1 0 249179128 2164015104 25991 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 528324 25991 726 405 0 525268 0
Current children cumulated CPU time: 1782.19 s
Current children cumulated vsize: 2113296 KiB
Current children cumulated memory: 103964 KiB

[startup+1842.3 s]
/proc/loadavg: 2.53 2.15 2.09 3/187 24241
/proc/meminfo: memFree=18260628/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2117948 memory=108860 CPUtime=1842.19 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 492036 0 0 0 183645 574 0 0 20 0 1 0 249179128 2168778752 27215 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 529487 27215 726 405 0 526431 0
Current children cumulated CPU time: 1842.19 s
Current children cumulated vsize: 2117948 KiB
Current children cumulated memory: 108860 KiB

[startup+1902.3 s]
/proc/loadavg: 2.19 2.12 2.08 3/187 24242
/proc/meminfo: memFree=18215524/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2111516 memory=102292 CPUtime=1902.19 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 500728 0 0 0 189630 589 0 0 20 0 1 0 249179128 2162192384 25573 33554432000 4194304 5849940 140735704386848 140735704385848 5438453 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 527879 25573 726 405 0 524823 0
Current children cumulated CPU time: 1902.19 s
Current children cumulated vsize: 2111516 KiB
Current children cumulated memory: 102292 KiB

[startup+1962.3 s]
/proc/loadavg: 2.07 2.10 2.08 3/187 24244
/proc/meminfo: memFree=18326872/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2103856 memory=94704 CPUtime=1962.18 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 512060 0 0 0 195614 604 0 0 20 0 1 0 249179128 2154348544 23676 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 525964 23676 726 405 0 522908 0
Current children cumulated CPU time: 1962.18 s
Current children cumulated vsize: 2103856 KiB
Current children cumulated memory: 94704 KiB

[startup+2022.3 s]
/proc/loadavg: 2.03 2.08 2.07 3/187 24245
/proc/meminfo: memFree=18296856/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2112852 memory=103700 CPUtime=2022.18 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 521707 0 0 0 201598 620 0 0 20 0 1 0 249179128 2163560448 25925 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 528213 25925 726 405 0 525157 0
Current children cumulated CPU time: 2022.18 s
Current children cumulated vsize: 2112852 KiB
Current children cumulated memory: 103700 KiB

[startup+2082.3 s]
/proc/loadavg: 2.05 2.08 2.07 3/188 24254
/proc/meminfo: memFree=18186788/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2147160 memory=137788 CPUtime=2082.17 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 526222 0 0 0 207581 636 0 0 20 0 1 0 249179128 2198691840 34447 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 536790 34447 726 405 0 533734 0
Current children cumulated CPU time: 2082.17 s
Current children cumulated vsize: 2147160 KiB
Current children cumulated memory: 137788 KiB

[startup+2142.3 s]
/proc/loadavg: 2.06 2.08 2.07 3/188 24255
/proc/meminfo: memFree=18248520/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2137392 memory=128240 CPUtime=2142.17 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 536694 0 0 0 213565 652 0 0 20 0 1 0 249179128 2188689408 32060 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 534348 32060 726 405 0 531292 0
Current children cumulated CPU time: 2142.17 s
Current children cumulated vsize: 2137392 KiB
Current children cumulated memory: 128240 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/188 24256
/proc/meminfo: memFree=18264560/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2115312 memory=106024 CPUtime=2202.17 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 540911 0 0 0 219550 667 0 0 20 0 1 0 249179128 2166079488 26506 33554432000 4194304 5849940 140735704386848 140735704385848 5335776 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 528828 26506 726 405 0 525772 0
Current children cumulated CPU time: 2202.17 s
Current children cumulated vsize: 2115312 KiB
Current children cumulated memory: 106024 KiB

[startup+2262.3 s]
/proc/loadavg: 2.05 2.07 2.06 3/188 24257
/proc/meminfo: memFree=18201380/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2104292 memory=95268 CPUtime=2262.17 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 550755 0 0 0 225534 683 0 0 20 0 1 0 249179128 2154795008 23817 33554432000 4194304 5849940 140735704386848 140735704385848 5437906 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 526073 23817 726 405 0 523017 0
Current children cumulated CPU time: 2262.17 s
Current children cumulated vsize: 2104292 KiB
Current children cumulated memory: 95268 KiB

[startup+2322.3 s]
/proc/loadavg: 2.06 2.07 2.06 3/188 24258
/proc/meminfo: memFree=18126844/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2114864 memory=105712 CPUtime=2322.16 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 562887 0 0 0 231519 697 0 0 20 0 1 0 249179128 2165620736 26428 33554432000 4194304 5849940 140735704386848 140735704385848 5438057 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 528716 26428 726 405 0 525660 0
Current children cumulated CPU time: 2322.16 s
Current children cumulated vsize: 2114864 KiB
Current children cumulated memory: 105712 KiB

[startup+2382.3 s]
/proc/loadavg: 2.06 2.07 2.06 3/187 24259
/proc/meminfo: memFree=18114872/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2160948 memory=151796 CPUtime=2382.16 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 569460 0 0 0 237506 710 0 0 20 0 1 0 249179128 2212810752 37949 33554432000 4194304 5849940 140735704386848 140735704385848 5438372 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 540237 37949 726 405 0 537181 0
Current children cumulated CPU time: 2382.16 s
Current children cumulated vsize: 2160948 KiB
Current children cumulated memory: 151796 KiB

[startup+2442.3 s]
/proc/loadavg: 2.02 2.06 2.06 3/187 24260
/proc/meminfo: memFree=18146572/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2129596 memory=120444 CPUtime=2442.16 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 576709 0 0 0 243491 725 0 0 20 0 1 0 249179128 2180706304 30111 33554432000 4194304 5849940 140735704386848 140735704385848 5437768 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 532399 30111 726 405 0 529343 0
Current children cumulated CPU time: 2442.16 s
Current children cumulated vsize: 2129596 KiB
Current children cumulated memory: 120444 KiB

[startup+2502.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/187 24261
/proc/meminfo: memFree=18089792/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2128704 memory=119432 CPUtime=2502.16 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 581964 0 0 0 249474 742 0 0 20 0 1 0 249179128 2179792896 29858 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 532176 29858 726 405 0 529120 0
Current children cumulated CPU time: 2502.16 s
Current children cumulated vsize: 2128704 KiB
Current children cumulated memory: 119432 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.04 2.05 3/187 24261
/proc/meminfo: memFree=18089708/32770624 swapFree=67108792/67108860
[pid=24099] ppid=24096 vsize=2128704 memory=119552 CPUtime=2519.86 cores=1,3,5,7
/proc/24099/stat : 24099 (xcsp_picat) R 24096 24099 21309 0 -1 4202496 582358 0 0 0 251242 744 0 0 20 0 1 0 249179128 2179792896 29888 33554432000 4194304 5849940 140735704386848 140735704385848 140211501719431 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 28020736 140735704392886 140735704392964 140735704392964 140735704395722 0
/proc/24099/statm: 532176 29888 726 405 0 529120 0
Current children cumulated CPU time: 2519.86 s
Current children cumulated vsize: 2128704 KiB
Current children cumulated memory: 119552 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 24099 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2512.43 s, system=7.45363 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.88
CPU user time (s): 2512.43
CPU system time (s): 7.45363
CPU usage (%): 99.9947
Max. virtual memory (cumulated for all children) (KiB): 2160948
Max. memory (cumulated for all children) (KiB): 151796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2512.43
system time used= 7.45363
maximum resident set size= 151796
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 582359
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 1767


# summary of solver processes directly reported to runsolver:
#   pid: 24099
#   total CPU time (s): 2519.88
#   total CPU user time (s): 2512.43
#   total CPU system time (s): 7.45363

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.88725 second user time and 18.2106 second system time

The end

Launcher Data 

Begin job on node150 at 2018-08-15 08:55:59
IDJOB=4309664
IDBENCH=141604
IDSOLVER=2794
FILE ID=node150/4309664-1534316159
RUNJOBID= node150-1534293054-21341
PBS_JOBID= 21038136
Free space on /tmp= 38000 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-4-10_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309664-1534316159/watcher-4309664-1534316159 -o /tmp/evaluation-result-4309664-1534316159/solver-4309664-1534316159 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1534293054-21341 --watchdog 2580  xcsp_picat HOME/instance-4309664-1534316159.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 13340ae912518807f9e2f6bcededa797
RANDOM SEED=819373352

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18275184 kB
MemAvailable:   31595444 kB
Buffers:          246872 kB
Cached:         13240832 kB
SwapCached:           32 kB
Active:          6580080 kB
Inactive:        7262528 kB
Active(anon):     306348 kB
Inactive(anon):   109136 kB
Active(file):    6273732 kB
Inactive(file):  7153392 kB
Unevictable:        7740 kB
Mlocked:            7740 kB
SwapTotal:      67108860 kB
SwapFree:       67108792 kB
Dirty:              3188 kB
Writeback:             0 kB
AnonPages:        370752 kB
Mapped:            58604 kB
Shmem:             57924 kB
Slab:             350032 kB
SReclaimable:     321596 kB
SUnreclaim:        28436 kB
KernelStack:        3568 kB
PageTables:         5972 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2648144 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    290816 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 37996 MiB
End job on node150 at 2018-08-15 09:37:59