Trace number 4303335

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.04 2519.91

General information on the benchmark

NameQuasigroups/
QuasiGroup-7-16_c18.xml
MD5SUMfff017207be5e3895e33195d340205a8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables512
Number of constraints482
Number of domains1
Minimum domain size16
Maximum domain size16
Distribution of domain sizes[{"size":16,"count":496}]
Minimum variable degree0
Maximum variable degree33
Distribution of variable degrees[{"degree":0,"count":16},{"degree":2,"count":240},{"degree":32,"count":16},{"degree":33,"count":240}]
Minimum constraint arity16
Maximum constraint arity256
Distribution of constraint arities[{"arity":16,"count":1},{"arity":18,"count":480},{"arity":256,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":480}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (6686 MiB free)
  memory of node 1: 16384 MiB (9375 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303335-1534029113/watcher-4303335-1534029113 -o /tmp/evaluation-result-4303335-1534029113/solver-4303335-1534029113 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1534026591-4844 --watchdog 2580 xcsp_picat HOME/instance-4303335-1534029113.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=5167, runsolver pid=5164
Current StackSize limit: 8192 KiB


[startup+0.100856 s]*
/proc/loadavg: 2.00 2.12 2.05 3/188 5168
/proc/meminfo: memFree=16430708/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2033964 memory=19432 CPUtime=0.1 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 1445 0 0 0 10 0 0 0 20 0 1 0 220474429 2082779136 4858 33554432000 4194304 5849708 140726910851072 140726910850168 139699284615047 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 508491 4858 687 405 0 505436 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2033964 KiB
Current children cumulated memory: 19432 KiB

[startup+0.209434 s]*
/proc/loadavg: 2.00 2.12 2.05 3/188 5168
/proc/meminfo: memFree=16430336/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2033964 memory=19432 CPUtime=0.21 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 1445 0 0 0 21 0 0 0 20 0 1 0 220474429 2082779136 4858 33554432000 4194304 5849708 140726910851072 140726910850168 5472592 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 508491 4858 687 405 0 505436 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2033964 KiB
Current children cumulated memory: 19432 KiB

[startup+0.308835 s]*
/proc/loadavg: 2.00 2.12 2.05 3/188 5168
/proc/meminfo: memFree=16429964/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2034228 memory=19692 CPUtime=0.3 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 1511 0 0 0 30 0 0 0 20 0 1 0 220474429 2083049472 4923 33554432000 4194304 5849708 140726910851072 140726910850168 139699284615047 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 508557 4923 688 405 0 505502 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2034228 KiB
Current children cumulated memory: 19692 KiB

[startup+0.700224 s]
/proc/loadavg: 2.00 2.12 2.05 3/188 5168
/proc/meminfo: memFree=16429624/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2034484 memory=19764 CPUtime=0.69 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 1575 0 0 0 69 0 0 0 20 0 1 0 220474429 2083311616 4941 33554432000 4194304 5849708 140726910851072 140726910850296 5605550 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 508621 4941 688 405 0 505566 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2034484 KiB
Current children cumulated memory: 19764 KiB

[startup+1.50022 s]
/proc/loadavg: 2.00 2.12 2.05 5/201 5197
/proc/meminfo: memFree=16413188/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2034996 memory=20276 CPUtime=1.49 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 1703 0 0 0 147 2 0 0 20 0 1 0 220474429 2083835904 5069 33554432000 4194304 5849708 140726910851072 140726910850168 139699284152944 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 508749 5069 688 405 0 505694 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2034996 KiB
Current children cumulated memory: 20276 KiB

[startup+3.10906 s]
/proc/loadavg: 1.92 2.10 2.05 3/188 5229
/proc/meminfo: memFree=16394708/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2036020 memory=21556 CPUtime=3.1 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 2158 0 0 0 306 4 0 0 20 0 1 0 220474429 2084884480 5389 33554432000 4194304 5849708 140726910851072 140726910850152 5470987 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 509005 5389 688 405 0 505950 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2036020 KiB
Current children cumulated memory: 21556 KiB

[startup+6.3003 s]
/proc/loadavg: 1.92 2.10 2.05 3/188 5229
/proc/meminfo: memFree=16389472/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2045104 memory=30340 CPUtime=6.29 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 6279 0 0 0 623 6 0 0 20 0 1 0 220474429 2094186496 7585 33554432000 4194304 5849708 140726910851072 140726910850152 5360453 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 511276 7585 708 405 0 508221 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2045104 KiB
Current children cumulated memory: 30340 KiB

[startup+12.7003 s]
/proc/loadavg: 1.93 2.10 2.05 3/188 5229
/proc/meminfo: memFree=16384324/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2046688 memory=32192 CPUtime=12.69 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 9375 0 0 0 1258 11 0 0 20 0 1 0 220474429 2095808512 8048 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 511672 8048 722 405 0 508617 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2046688 KiB
Current children cumulated memory: 32192 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.09 2.05 3/188 5229
/proc/meminfo: memFree=16378000/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2052456 memory=41696 CPUtime=25.48 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 12955 0 0 0 2525 23 0 0 20 0 1 0 220474429 2101714944 10424 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 513114 10424 722 405 0 510059 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 2052456 KiB
Current children cumulated memory: 41696 KiB

[startup+51.1094 s]
/proc/loadavg: 1.96 2.08 2.05 3/188 5229
/proc/meminfo: memFree=16367752/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2056308 memory=49076 CPUtime=51.09 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 21098 0 0 0 5062 47 0 0 20 0 1 0 220474429 2105659392 12269 33554432000 4194304 5849708 140726910851072 140726910850072 5437592 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 514077 12269 722 405 0 511022 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2056308 KiB
Current children cumulated memory: 49076 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.07 2.05 3/188 5230
/proc/meminfo: memFree=16351468/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2063820 memory=56500 CPUtime=102.27 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 54890 0 0 0 10131 96 0 0 20 0 1 0 220474429 2113351680 14125 33554432000 4194304 5849708 140726910851072 140726910850232 139699284615047 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 515955 14125 722 405 0 512900 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 2063820 KiB
Current children cumulated memory: 56500 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.06 2.05 3/188 5231
/proc/meminfo: memFree=16344080/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2071732 memory=64564 CPUtime=162.27 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 93419 0 0 0 16083 144 0 0 20 0 1 0 220474429 2121453568 16141 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 517933 16141 722 405 0 514878 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2071732 KiB
Current children cumulated memory: 64564 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 5232
/proc/meminfo: memFree=16326356/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2075036 memory=67780 CPUtime=222.27 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 119535 0 0 0 22036 191 0 0 20 0 1 0 220474429 2124836864 16945 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 518759 16945 722 405 0 515704 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2075036 KiB
Current children cumulated memory: 67780 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 5233
/proc/meminfo: memFree=16286188/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2088992 memory=81604 CPUtime=282.27 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 138978 0 0 0 27991 236 0 0 20 0 1 0 220474429 2139127808 20401 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 522248 20401 722 405 0 519193 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 2088992 KiB
Current children cumulated memory: 81604 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 5234
/proc/meminfo: memFree=16293328/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2090488 memory=83332 CPUtime=342.27 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 157649 0 0 0 33952 275 0 0 20 0 1 0 220474429 2140659712 20833 33554432000 4194304 5849708 140726910851072 140726910850072 5312881 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 522622 20833 722 405 0 519567 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 2090488 KiB
Current children cumulated memory: 83332 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 5235
/proc/meminfo: memFree=16276696/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2097052 memory=89872 CPUtime=402.28 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 173412 0 0 0 39917 311 0 0 20 0 1 0 220474429 2147381248 22468 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 524263 22468 722 405 0 521208 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 2097052 KiB
Current children cumulated memory: 89872 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 5236
/proc/meminfo: memFree=16291792/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2091272 memory=83972 CPUtime=462.29 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 193205 0 0 0 45890 339 0 0 20 0 1 0 220474429 2141462528 20993 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 522818 20993 722 405 0 519763 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2091272 KiB
Current children cumulated memory: 83972 KiB


################
# More data... #
################

/proc/5167/statm: 531327 29542 722 405 0 528272 0
Current children cumulated CPU time: 1782.38 s
Current children cumulated vsize: 2125308 KiB
Current children cumulated memory: 118168 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5282
/proc/meminfo: memFree=16207308/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2112764 memory=105544 CPUtime=1842.38 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 417313 0 0 0 183408 830 0 0 20 0 1 0 220474429 2163470336 26386 33554432000 4194304 5849708 140726910851072 140726910849944 5437714 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 528191 26386 722 405 0 525136 0
Current children cumulated CPU time: 1842.38 s
Current children cumulated vsize: 2112764 KiB
Current children cumulated memory: 105544 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5283
/proc/meminfo: memFree=16203588/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2099132 memory=91768 CPUtime=1902.38 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 421612 0 0 0 189390 848 0 0 20 0 1 0 220474429 2149511168 22942 33554432000 4194304 5849708 140726910851072 140726910850072 5335584 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 524783 22942 722 405 0 521728 0
Current children cumulated CPU time: 1902.38 s
Current children cumulated vsize: 2099132 KiB
Current children cumulated memory: 91768 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5284
/proc/meminfo: memFree=16206680/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2091428 memory=84180 CPUtime=1962.39 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 426169 0 0 0 195372 867 0 0 20 0 1 0 220474429 2141622272 21045 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 522857 21045 722 405 0 519802 0
Current children cumulated CPU time: 1962.39 s
Current children cumulated vsize: 2091428 KiB
Current children cumulated memory: 84180 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5285
/proc/meminfo: memFree=16109448/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2182032 memory=170068 CPUtime=2022.39 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 443211 0 0 0 201351 888 0 0 20 0 1 0 220474429 2234400768 42517 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 545508 42517 722 405 0 542453 0
Current children cumulated CPU time: 2022.39 s
Current children cumulated vsize: 2182032 KiB
Current children cumulated memory: 170068 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5286
/proc/meminfo: memFree=16154476/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2161724 memory=154332 CPUtime=2082.4 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 445443 0 0 0 207334 906 0 0 20 0 1 0 220474429 2213605376 38583 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 540431 38583 722 405 0 537376 0
Current children cumulated CPU time: 2082.4 s
Current children cumulated vsize: 2161724 KiB
Current children cumulated memory: 154332 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5287
/proc/meminfo: memFree=16117056/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2166232 memory=154704 CPUtime=2142.4 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 446898 0 0 0 213314 926 0 0 20 0 1 0 220474429 2218221568 38676 33554432000 4194304 5849708 140726910851072 140726910850072 5312900 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 541558 38676 722 405 0 538503 0
Current children cumulated CPU time: 2142.4 s
Current children cumulated vsize: 2166232 KiB
Current children cumulated memory: 154704 KiB

[startup+2202.3 s]
/proc/loadavg: 2.34 2.09 2.07 3/187 5288
/proc/meminfo: memFree=16169984/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2124324 memory=116992 CPUtime=2202.41 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 451577 0 0 0 219298 943 0 0 20 0 1 0 220474429 2175307776 29248 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 531081 29248 722 405 0 528026 0
Current children cumulated CPU time: 2202.41 s
Current children cumulated vsize: 2124324 KiB
Current children cumulated memory: 116992 KiB

[startup+2262.3 s]
/proc/loadavg: 2.27 2.13 2.09 3/187 5289
/proc/meminfo: memFree=16098460/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2131560 memory=124276 CPUtime=2262.41 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 464234 0 0 0 225279 962 0 0 20 0 1 0 220474429 2182717440 31069 33554432000 4194304 5849708 140726910851072 140726910850072 5437868 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 532890 31069 722 405 0 529835 0
Current children cumulated CPU time: 2262.41 s
Current children cumulated vsize: 2131560 KiB
Current children cumulated memory: 124276 KiB

[startup+2322.3 s]
/proc/loadavg: 2.10 2.11 2.08 3/187 5297
/proc/meminfo: memFree=16131060/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2130760 memory=117300 CPUtime=2322.42 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 467880 0 0 0 231261 981 0 0 20 0 1 0 220474429 2181898240 29325 33554432000 4194304 5849708 140726910851072 140726910850232 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 532690 29325 722 405 0 529635 0
Current children cumulated CPU time: 2322.42 s
Current children cumulated vsize: 2130760 KiB
Current children cumulated memory: 117300 KiB

[startup+2382.3 s]
/proc/loadavg: 2.04 2.09 2.07 3/187 5298
/proc/meminfo: memFree=16130272/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2127788 memory=120532 CPUtime=2382.41 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 469830 0 0 0 237241 1000 0 0 20 0 1 0 220474429 2178854912 30133 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 531947 30133 722 405 0 528892 0
Current children cumulated CPU time: 2382.41 s
Current children cumulated vsize: 2127788 KiB
Current children cumulated memory: 120532 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/187 5299
/proc/meminfo: memFree=16015552/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2167784 memory=154420 CPUtime=2442.43 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 471141 0 0 0 243225 1018 0 0 20 0 1 0 220474429 2219810816 38605 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 541946 38605 722 405 0 538891 0
Current children cumulated CPU time: 2442.43 s
Current children cumulated vsize: 2167784 KiB
Current children cumulated memory: 154420 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 5300
/proc/meminfo: memFree=15885864/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2156440 memory=143160 CPUtime=2502.42 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 488374 0 0 0 249208 1034 0 0 20 0 1 0 220474429 2208194560 35790 33554432000 4194304 5849708 140726910851072 140726910850232 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 539110 35790 722 405 0 536055 0
Current children cumulated CPU time: 2502.42 s
Current children cumulated vsize: 2156440 KiB
Current children cumulated memory: 143160 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 5300
/proc/meminfo: memFree=15860176/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2178808 memory=169240 CPUtime=2520.03 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 490393 0 0 0 250964 1039 0 0 20 0 1 0 220474429 2231099392 42310 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 544702 42310 722 405 0 541647 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 2178808 KiB
Current children cumulated memory: 169240 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.91 s]
# the end of solver process 5167 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2509.65 s, system=10.3986 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 5300
/proc/meminfo: memFree=15860176/32770624 swapFree=67108504/67108860
[pid=5167] ppid=5164 vsize=2178808 memory=169240 CPUtime=2520.03 cores=0,2,4,6
/proc/5167/stat : 5167 (xcsp_picat) R 5164 5167 4813 0 -1 4202496 490393 0 0 0 250964 1039 0 0 20 0 1 0 220474429 2231099392 42310 33554432000 4194304 5849708 140726910851072 140726910850072 139699284615047 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 43667456 140726910858422 140726910858500 140726910858500 140726910861258 0
/proc/5167/statm: 544702 42310 722 405 0 541647 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 2178808 KiB
Current children cumulated memory: 169240 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.91
CPU time (s): 2520.04
CPU user time (s): 2509.65
CPU system time (s): 10.3986
CPU usage (%): 100.005
Max. virtual memory (cumulated for all children) (KiB): 2182616
Max. memory (cumulated for all children) (KiB): 170960

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2509.65
system time used= 10.3986
maximum resident set size= 171164
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 490393
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 4101


# summary of solver processes directly reported to runsolver:
#   pid: 5167
#   total CPU time (s): 2520.04
#   total CPU user time (s): 2509.65
#   total CPU system time (s): 10.3986

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.6663 second user time and 18.2731 second system time

The end

Launcher Data 

Begin job on node104 at 2018-08-12 01:11:53
IDJOB=4303335
IDBENCH=141611
IDSOLVER=2778
FILE ID=node104/4303335-1534029113
RUNJOBID= node104-1534026591-4844
PBS_JOBID= 21036963
Free space on /tmp= 37256 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-7-16_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303335-1534029113/watcher-4303335-1534029113 -o /tmp/evaluation-result-4303335-1534029113/solver-4303335-1534029113 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1534026591-4844 --watchdog 2580  xcsp_picat HOME/instance-4303335-1534029113.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fff017207be5e3895e33195d340205a8
RANDOM SEED=1615881506

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        16447436 kB
MemAvailable:   31891788 kB
Buffers:          151788 kB
Cached:         15327248 kB
SwapCached:            8 kB
Active:          7633860 kB
Inactive:        7912356 kB
Active(anon):      18260 kB
Inactive(anon):   101252 kB
Active(file):    7615600 kB
Inactive(file):  7811104 kB
Unevictable:        7360 kB
Mlocked:            7360 kB
SwapTotal:      67108860 kB
SwapFree:       67108504 kB
Dirty:              6388 kB
Writeback:             0 kB
AnonPages:         74052 kB
Mapped:            53288 kB
Shmem:             49636 kB
Slab:             473896 kB
SReclaimable:     446108 kB
SUnreclaim:        27788 kB
KernelStack:        3376 kB
PageTables:         5392 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2400336 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     16384 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 37252 MiB
End job on node104 at 2018-08-12 01:53:53