Trace number 4303024

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.09 2519.8

General information on the benchmark

NameTravelingTournament/
TravelingTournament-a2-galaxy08_c18.xml
MD5SUM909adc3d6f12c1302971d5fd30a3af0f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark3179
Best CPU time to get the best result obtained on this benchmark2520.05
Satisfiable
(Un)Satisfiability was proved
Number of variables456
Number of constraints1111
Number of domains3
Minimum domain size2
Maximum domain size24
Distribution of domain sizes[{"size":2,"count":224},{"size":8,"count":112},{"size":24,"count":120}]
Minimum variable degree2
Maximum variable degree26
Distribution of variable degrees[{"degree":2,"count":232},{"degree":23,"count":96},{"degree":24,"count":112},{"degree":25,"count":14},{"degree":26,"count":2}]
Minimum constraint arity2
Maximum constraint arity14
Distribution of constraint arities[{"arity":2,"count":113},{"arity":3,"count":16},{"arity":4,"count":624},{"arity":5,"count":104},{"arity":8,"count":126},{"arity":10,"count":112},{"arity":14,"count":16}]
Number of extensional constraints120
Number of intensional constraints737
Distribution of constraint types[{"type":"extension","count":120},{"type":"intension","count":737},{"type":"regular","count":8},{"type":"allDifferent","count":14},{"type":"cardinality","count":8},{"type":"element","count":224}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (6690 MiB free)
  memory of node 1: 16384 MiB (8448 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303024-1534024070/watcher-4303024-1534024070 -o /tmp/evaluation-result-4303024-1534024070/solver-4303024-1534024070 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1533991815-32497 --watchdog 2580 xcsp_picat HOME/instance-4303024-1534024070.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=4598, runsolver pid=4595

[startup+0.101059 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15475736/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2033560 memory=30268 CPUtime=0.1 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 1612 0 0 0 10 0 0 0 20 0 1 0 219970125 2082365440 7567 33554432000 4194304 5849708 140726074471520 140726074470824 4572157 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 508390 7567 628 405 0 505335 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 30268 KiB

[startup+0.209694 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15454640/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2033560 memory=49204 CPUtime=0.2 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 1738 0 0 0 20 0 0 0 20 0 1 0 219970125 2082365440 12301 33554432000 4194304 5849708 140726074471520 140726074470824 4828468 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 508390 12301 628 405 0 505335 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 49204 KiB

[startup+0.30956 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15442352/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2033560 memory=61492 CPUtime=0.3 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 1759 0 0 0 30 0 0 0 20 0 1 0 219970125 2082365440 15373 33554432000 4194304 5849708 140726074471520 140726074470824 4489807 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 508390 15373 628 405 0 505335 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 61492 KiB

[startup+0.700403 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15426120/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2038496 memory=81492 CPUtime=0.69 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 3232 0 0 0 62 7 0 0 20 0 1 0 219970125 2087419904 20373 33554432000 4194304 5849708 140726074471520 140726074470760 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 509624 20373 704 405 0 506569 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2038496 KiB
Current children cumulated memory: 81492 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15422524/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2039008 memory=81884 CPUtime=1.49 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 3378 0 0 0 139 10 0 0 20 0 1 0 219970125 2087944192 20471 33554432000 4194304 5849708 140726074471520 140726074470760 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 509752 20471 721 405 0 506697 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2039008 KiB
Current children cumulated memory: 81884 KiB

[startup+3.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15411052/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2050468 memory=93580 CPUtime=3.1 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 7596 0 0 0 299 11 0 0 20 0 1 0 219970125 2099679232 23395 33554432000 4194304 5849708 140726074471520 140726074469784 4203940 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 512617 23395 749 405 0 509562 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2050468 KiB
Current children cumulated memory: 93580 KiB

[startup+6.30037 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15400432/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2055968 memory=98376 CPUtime=6.29 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 11245 0 0 0 607 22 0 0 20 0 1 0 219970125 2105311232 24594 33554432000 4194304 5849708 140726074471520 140726074469784 5360453 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 513992 24594 760 405 0 510937 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2055968 KiB
Current children cumulated memory: 98376 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15393044/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2055968 memory=98504 CPUtime=12.69 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 15412 0 0 0 1243 26 0 0 20 0 1 0 219970125 2105311232 24626 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 513992 24626 762 405 0 510937 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2055968 KiB
Current children cumulated memory: 98504 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15375348/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2073368 memory=116532 CPUtime=25.49 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 24120 0 0 0 2514 35 0 0 20 0 1 0 219970125 2123128832 29133 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 518342 29133 762 405 0 515287 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2073368 KiB
Current children cumulated memory: 116532 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4599
/proc/meminfo: memFree=15370932/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2077244 memory=120408 CPUtime=51.11 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 31821 0 0 0 5063 48 0 0 20 0 1 0 219970125 2127097856 30102 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 519311 30102 762 405 0 516256 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 2077244 KiB
Current children cumulated memory: 120408 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4600
/proc/meminfo: memFree=15356288/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2091352 memory=134516 CPUtime=102.3 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 39905 0 0 0 10149 81 0 0 20 0 1 0 219970125 2141544448 33629 33554432000 4194304 5849708 140726074471520 140726074470520 5360453 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 522838 33629 762 405 0 519783 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 2091352 KiB
Current children cumulated memory: 134516 KiB

[startup+162.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 4609
/proc/meminfo: memFree=15339512/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2109020 memory=152088 CPUtime=162.32 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 51862 0 0 0 16115 117 0 0 20 0 1 0 219970125 2159636480 38022 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 527255 38022 762 405 0 524200 0
Current children cumulated CPU time: 162.32 s
Current children cumulated vsize: 2109020 KiB
Current children cumulated memory: 152088 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/188 4610
/proc/meminfo: memFree=15369592/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2081372 memory=120796 CPUtime=222.32 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 64384 0 0 0 22085 147 0 0 20 0 1 0 219970125 2131324928 30199 33554432000 4194304 5849708 140726074471520 140726074470392 5307610 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 520343 30199 762 405 0 517288 0
Current children cumulated CPU time: 222.32 s
Current children cumulated vsize: 2081372 KiB
Current children cumulated memory: 120796 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 4611
/proc/meminfo: memFree=15353040/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2090832 memory=133784 CPUtime=282.33 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 68575 0 0 0 28060 173 0 0 20 0 1 0 219970125 2141011968 33446 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 522708 33446 762 405 0 519653 0
Current children cumulated CPU time: 282.33 s
Current children cumulated vsize: 2090832 KiB
Current children cumulated memory: 133784 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4625
/proc/meminfo: memFree=15318236/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2123600 memory=166728 CPUtime=342.33 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 73199 0 0 0 34039 194 0 0 20 0 1 0 219970125 2174566400 41682 33554432000 4194304 5849708 140726074471520 140726074470392 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 530900 41682 762 405 0 527845 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 2123600 KiB
Current children cumulated memory: 166728 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 4626
/proc/meminfo: memFree=15300736/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2141132 memory=184260 CPUtime=402.34 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 79847 0 0 0 40015 219 0 0 20 0 1 0 219970125 2192519168 46065 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 535283 46065 762 405 0 532228 0
Current children cumulated CPU time: 402.34 s
Current children cumulated vsize: 2141132 KiB
Current children cumulated memory: 184260 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4628
/proc/meminfo: memFree=15318556/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2123412 memory=166576 CPUtime=462.35 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 91050 0 0 0 45996 239 0 0 20 0 1 0 219970125 2174373888 41644 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 530853 41644 762 405 0 527798 0
Current children cumulated CPU time: 462.35 s
Current children cumulated vsize: 2123412 KiB
Current children cumulated memory: 166576 KiB


################
# More data... #
################

/proc/4598/statm: 550101 62224 762 405 0 547046 0
Current children cumulated CPU time: 1722.49 s
Current children cumulated vsize: 2200404 KiB
Current children cumulated memory: 248896 KiB

[startup+1782.3 s]
/proc/loadavg: 1.00 1.17 1.58 2/180 4740
/proc/meminfo: memFree=16240436/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2184020 memory=232512 CPUtime=1782.49 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 199006 0 0 0 177564 685 0 0 20 0 1 0 219970125 2236436480 58128 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 546005 58128 762 405 0 542950 0
Current children cumulated CPU time: 1782.49 s
Current children cumulated vsize: 2184020 KiB
Current children cumulated memory: 232512 KiB

[startup+1842.3 s]
/proc/loadavg: 1.00 1.14 1.55 2/180 4741
/proc/meminfo: memFree=16227284/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2196968 memory=245460 CPUtime=1842.5 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 201181 0 0 0 183549 701 0 0 20 0 1 0 219970125 2249695232 61365 33554432000 4194304 5849708 140726074471520 140726074470680 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 549242 61365 762 405 0 546187 0
Current children cumulated CPU time: 1842.5 s
Current children cumulated vsize: 2196968 KiB
Current children cumulated memory: 245460 KiB

[startup+1902.3 s]
/proc/loadavg: 1.00 1.11 1.51 2/180 4742
/proc/meminfo: memFree=16210932/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2213352 memory=261844 CPUtime=1902.51 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 204605 0 0 0 189531 720 0 0 20 0 1 0 219970125 2266472448 65461 33554432000 4194304 5849708 140726074471520 140726074470520 5437592 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 553338 65461 762 405 0 550283 0
Current children cumulated CPU time: 1902.51 s
Current children cumulated vsize: 2213352 KiB
Current children cumulated memory: 261844 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.09 1.48 2/180 4750
/proc/meminfo: memFree=16210824/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2213352 memory=261844 CPUtime=1962.52 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 205656 0 0 0 195514 738 0 0 20 0 1 0 219970125 2266472448 65461 33554432000 4194304 5849708 140726074471520 140726074470680 5339785 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 553338 65461 762 405 0 550283 0
Current children cumulated CPU time: 1962.52 s
Current children cumulated vsize: 2213352 KiB
Current children cumulated memory: 261844 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.07 1.45 2/180 4751
/proc/meminfo: memFree=16212804/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2211648 memory=260012 CPUtime=2022.53 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 209761 0 0 0 201495 758 0 0 20 0 1 0 219970125 2264727552 65003 33554432000 4194304 5849708 140726074471520 140726074470520 5394489 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 552912 65003 762 405 0 549857 0
Current children cumulated CPU time: 2022.53 s
Current children cumulated vsize: 2211648 KiB
Current children cumulated memory: 260012 KiB

[startup+2082.3 s]
/proc/loadavg: 1.50 1.21 1.47 2/180 4752
/proc/meminfo: memFree=16207480/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2216376 memory=264868 CPUtime=2082.53 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 213708 0 0 0 207480 773 0 0 20 0 1 0 219970125 2269569024 66217 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 554094 66217 762 405 0 551039 0
Current children cumulated CPU time: 2082.53 s
Current children cumulated vsize: 2216376 KiB
Current children cumulated memory: 264868 KiB

[startup+2142.3 s]
/proc/loadavg: 1.18 1.17 1.45 2/180 4753
/proc/meminfo: memFree=16238096/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2186828 memory=235072 CPUtime=2142.53 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 217737 0 0 0 213463 790 0 0 20 0 1 0 219970125 2239311872 58768 33554432000 4194304 5849708 140726074471520 140726074470680 5335618 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 546707 58768 762 405 0 543652 0
Current children cumulated CPU time: 2142.53 s
Current children cumulated vsize: 2186828 KiB
Current children cumulated memory: 235072 KiB

[startup+2202.3 s]
/proc/loadavg: 1.07 1.14 1.42 2/180 4754
/proc/meminfo: memFree=16228940/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2195020 memory=243512 CPUtime=2202.55 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 222094 0 0 0 219446 809 0 0 20 0 1 0 219970125 2247700480 60878 33554432000 4194304 5849708 140726074471520 140726074470520 5307534 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 548755 60878 762 405 0 545700 0
Current children cumulated CPU time: 2202.55 s
Current children cumulated vsize: 2195020 KiB
Current children cumulated memory: 243512 KiB

[startup+2262.3 s]
/proc/loadavg: 1.02 1.12 1.39 2/180 4756
/proc/meminfo: memFree=16181040/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2243052 memory=291544 CPUtime=2262.55 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 225282 0 0 0 225426 829 0 0 20 0 1 0 219970125 2296885248 72886 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 560763 72886 762 405 0 557708 0
Current children cumulated CPU time: 2262.55 s
Current children cumulated vsize: 2243052 KiB
Current children cumulated memory: 291544 KiB

[startup+2322.3 s]
/proc/loadavg: 1.01 1.10 1.37 2/180 4757
/proc/meminfo: memFree=16148552/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2276800 memory=325280 CPUtime=2322.56 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 229333 0 0 0 231410 846 0 0 20 0 1 0 219970125 2331443200 81320 33554432000 4194304 5849708 140726074471520 140726074470520 5312614 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 569200 81320 762 405 0 566145 0
Current children cumulated CPU time: 2322.56 s
Current children cumulated vsize: 2276800 KiB
Current children cumulated memory: 325280 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.08 1.34 2/180 4758
/proc/meminfo: memFree=16167436/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2257056 memory=305548 CPUtime=2382.56 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 237169 0 0 0 237393 863 0 0 20 0 1 0 219970125 2311225344 76387 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 564264 76387 762 405 0 561209 0
Current children cumulated CPU time: 2382.56 s
Current children cumulated vsize: 2257056 KiB
Current children cumulated memory: 305548 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.06 1.32 2/180 4760
/proc/meminfo: memFree=16153336/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2271920 memory=320240 CPUtime=2442.57 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 240610 0 0 0 243377 880 0 0 20 0 1 0 219970125 2326446080 80060 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 567980 80060 762 405 0 564925 0
Current children cumulated CPU time: 2442.57 s
Current children cumulated vsize: 2271920 KiB
Current children cumulated memory: 320240 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.05 1.30 2/180 4761
/proc/meminfo: memFree=16031296/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2394036 memory=442344 CPUtime=2502.58 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 246283 0 0 0 249362 896 0 0 20 0 1 0 219970125 2451492864 110586 33554432000 4194304 5849708 140726074471520 140726074470392 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 598509 110586 762 405 0 595454 0
Current children cumulated CPU time: 2502.58 s
Current children cumulated vsize: 2394036 KiB
Current children cumulated memory: 442344 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 1.00 1.05 1.30 2/180 4761
/proc/meminfo: memFree=16138348/32770624 swapFree=67108504/67108860
[pid=4598] ppid=4595 vsize=2287028 memory=335420 CPUtime=2520.08 cores=0,2,4,6
/proc/4598/stat : 4598 (xcsp_picat) R 4595 4598 32466 0 -1 4202496 250206 0 0 0 251107 901 0 0 20 0 1 0 219970125 2341916672 83855 33554432000 4194304 5849708 140726074471520 140726074470520 139981642555271 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38359040 140726074475702 140726074475780 140726074475780 140726074478538 0
/proc/4598/statm: 571757 83855 762 405 0 568702 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 2287028 KiB
Current children cumulated memory: 335420 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 4598 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2511.08 s, system=9.01706 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.8
CPU time (s): 2520.09
CPU user time (s): 2511.08
CPU system time (s): 9.01706
CPU usage (%): 100.011
Max. virtual memory (cumulated for all children) (KiB): 2430408
Max. memory (cumulated for all children) (KiB): 478704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2511.08
system time used= 9.01706
maximum resident set size= 478900
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 250206
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 819


# summary of solver processes directly reported to runsolver:
#   pid: 4598
#   total CPU time (s): 2520.09
#   total CPU user time (s): 2511.08
#   total CPU system time (s): 9.01706

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.94232 second user time and 17.7137 second system time

The end

Launcher Data 

Begin job on node104 at 2018-08-11 23:47:50
IDJOB=4303024
IDBENCH=141554
IDSOLVER=2778
FILE ID=node104/4303024-1534024070
RUNJOBID= node104-1533991815-32497
PBS_JOBID= 21036946
Free space on /tmp= 37256 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/TravelingTournament/TravelingTournament-a2-galaxy08_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303024-1534024070/watcher-4303024-1534024070 -o /tmp/evaluation-result-4303024-1534024070/solver-4303024-1534024070 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1533991815-32497 --watchdog 2580  xcsp_picat HOME/instance-4303024-1534024070.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 909adc3d6f12c1302971d5fd30a3af0f
RANDOM SEED=1937073838

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        15503196 kB
MemAvailable:   30943588 kB
Buffers:          150396 kB
Cached:         15324900 kB
SwapCached:            8 kB
Active:          8577640 kB
Inactive:        7911992 kB
Active(anon):     963996 kB
Inactive(anon):   102836 kB
Active(file):    7613644 kB
Inactive(file):  7809156 kB
Unevictable:        7360 kB
Mlocked:            7360 kB
SwapTotal:      67108860 kB
SwapFree:       67108504 kB
Dirty:              3108 kB
Writeback:             0 kB
AnonPages:        932748 kB
Mapped:            53472 kB
Shmem:             49636 kB
Slab:             474044 kB
SReclaimable:     446052 kB
SUnreclaim:        27992 kB
KernelStack:        3360 kB
PageTables:         7536 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2818728 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    776192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 37256 MiB
End job on node104 at 2018-08-12 00:29:50