Trace number 4299082

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.5 2520.02

General information on the benchmark

NameQuasigroups_mini/
QuasiGroup-v4-10_mini_c18.xml
MD5SUMe8ea5ce8f134a5c516ecbdbf10fc886b
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.952588
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints210
Number of domains2
Minimum domain size10
Maximum domain size100
Distribution of domain sizes[{"size":10,"count":100},{"size":100,"count":90}]
Minimum variable degree0
Maximum variable degree94
Distribution of variable degrees[{"degree":0,"count":10},{"degree":2,"count":90},{"degree":93,"count":10},{"degree":94,"count":90}]
Minimum constraint arity1
Maximum constraint arity101
Distribution of constraint arities[{"arity":1,"count":10},{"arity":3,"count":90},{"arity":10,"count":20},{"arity":101,"count":90}]
Number of extensional constraints90
Number of intensional constraints10
Distribution of constraint types[{"type":"extension","count":90},{"type":"intension","count":10},{"type":"allDifferent","count":20},{"type":"element","count":90}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.48/2520.01	c
2519.48/2520.01	c # time = 2519.48
2519.48/2520.01	c # Dec = 2063928
2519.48/2520.01	c # Propagate Calls = 3367405591
2519.48/2520.01	c # assignAt Calls = 21833927
2519.48/2520.01	c # removeAt Calls = 649101664
2519.48/2520.01	c # Run = 3928
2519.48/2520.01	c # Conflicts = 1998531
2519.48/2520.01	c # Memory used = 1125.28 Mb
2519.48/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8698 MiB free)
  memory of node 1: 16384 MiB (12657 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299082-1532781876/watcher-4299082-1532781876 -o /tmp/evaluation-result-4299082-1532781876/solver-4299082-1532781876 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19388 --watchdog 2580 nacre_mini_release HOME/instance-4299082-1532781876.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=21363, runsolver pid=21360


[startup+0.100159 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21864576/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=30132 memory=6572 CPUtime=0.1 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1918 0 0 0 10 0 0 0 20 0 1 0 95750723 30855168 1643 33554432000 4194304 4933779 140737339217456 140737339214456 139746893601179 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 7533 1643 618 181 0 1150 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30132 KiB
Current children cumulated memory: 6572 KiB

[startup+0.209566 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21863092/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=31236 memory=7628 CPUtime=0.21 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 2193 0 0 0 21 0 0 0 20 0 1 0 95750723 31985664 1907 33554432000 4194304 4933779 140737339217456 140737339214456 4357454 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 7809 1907 618 181 0 1426 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31236 KiB
Current children cumulated memory: 7628 KiB

[startup+0.309108 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21861976/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=32040 memory=8420 CPUtime=0.31 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 2426 0 0 0 31 0 0 0 20 0 1 0 95750723 32808960 2105 33554432000 4194304 4933779 140737339217456 140737339214456 4332816 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 8010 2105 618 181 0 1627 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32040 KiB
Current children cumulated memory: 8420 KiB

[startup+0.700289 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21859860/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=36092 memory=12644 CPUtime=0.69 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 3434 0 0 0 69 0 0 0 20 0 1 0 95750723 36958208 3161 33554432000 4194304 4933779 140737339217456 140737339215208 139746893601195 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 9023 3161 618 181 0 2640 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36092 KiB
Current children cumulated memory: 12644 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21855056/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=43676 memory=20036 CPUtime=1.49 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 5295 0 0 0 148 1 0 0 20 0 1 0 95750723 44724224 5009 33554432000 4194304 4933779 140737339217456 140737339215208 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 10919 5009 618 181 0 4536 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 43676 KiB
Current children cumulated memory: 20036 KiB

[startup+3.10949 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21835092/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=59356 memory=35668 CPUtime=3.1 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 12951 0 0 0 308 2 0 0 20 0 1 0 95750723 60780544 8917 33554432000 4194304 4933779 140737339217456 140737339215208 4357283 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 14839 8917 618 181 0 8456 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 59356 KiB
Current children cumulated memory: 35668 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21807192/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=88060 memory=64088 CPUtime=6.29 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 26647 0 0 0 626 3 0 0 20 0 1 0 95750723 90173440 16022 33554432000 4194304 4933779 140737339217456 140737339215224 4357438 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 22015 16022 618 181 0 15632 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 88060 KiB
Current children cumulated memory: 64088 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21771588/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=122944 memory=99324 CPUtime=12.69 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 49115 0 0 0 1264 5 0 0 20 0 1 0 95750723 125894656 24831 33554432000 4194304 4933779 140737339217456 140737339215208 139746893601147 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 30736 24831 618 181 0 24353 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 122944 KiB
Current children cumulated memory: 99324 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 21364
/proc/meminfo: memFree=21722716/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=166148 memory=142076 CPUtime=25.49 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 101189 0 0 0 2540 9 0 0 20 0 1 0 95750723 170135552 35519 33554432000 4194304 4933779 140737339217456 140737339215224 139746893601147 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 41537 35519 618 181 0 35154 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 166148 KiB
Current children cumulated memory: 142076 KiB

[startup+51.1096 s]
/proc/loadavg: 2.08 2.01 2.05 3/187 21364
/proc/meminfo: memFree=21653556/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=227804 memory=204004 CPUtime=51.08 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 152607 0 0 0 5094 14 0 0 20 0 1 0 95750723 233271296 51001 33554432000 4194304 4933779 140737339217456 140737339215208 4475942 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 56951 51001 618 181 0 50568 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 227804 KiB
Current children cumulated memory: 204004 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.01 2.05 3/187 21365
/proc/meminfo: memFree=21554772/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=314712 memory=290808 CPUtime=102.23 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 208876 0 0 0 10202 21 0 0 20 0 1 0 95750723 322265088 72702 33554432000 4194304 4933779 140737339217456 140737339215160 4437570 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 78678 72702 618 181 0 72295 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 314712 KiB
Current children cumulated memory: 290808 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 21366
/proc/meminfo: memFree=21473828/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=384172 memory=359156 CPUtime=162.19 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 247690 0 0 0 16190 29 0 0 20 0 1 0 95750723 393392128 89789 33554432000 4194304 4933779 140737339217456 140737339215160 4437839 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 96043 89789 618 181 0 89660 0
Current children cumulated CPU time: 162.19 s
Current children cumulated vsize: 384172 KiB
Current children cumulated memory: 359156 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21367
/proc/meminfo: memFree=21399448/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=444724 memory=419944 CPUtime=222.15 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 281589 0 0 0 22180 35 0 0 20 0 1 0 95750723 455397376 104986 33554432000 4194304 4933779 140737339217456 140737339215144 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 111181 104986 618 181 0 104798 0
Current children cumulated CPU time: 222.15 s
Current children cumulated vsize: 444724 KiB
Current children cumulated memory: 419944 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21368
/proc/meminfo: memFree=21342684/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=490636 memory=466076 CPUtime=282.09 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 305117 0 0 0 28170 39 0 0 20 0 1 0 95750723 502411264 116519 33554432000 4194304 4933779 140737339217456 140737339215160 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 122659 116519 618 181 0 116276 0
Current children cumulated CPU time: 282.09 s
Current children cumulated vsize: 490636 KiB
Current children cumulated memory: 466076 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 21377
/proc/meminfo: memFree=21292840/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=528728 memory=504476 CPUtime=342.07 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 318477 0 0 0 34164 43 0 0 20 0 1 0 95750723 541417472 126119 33554432000 4194304 4933779 140737339217456 140737339215160 4362472 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 132182 126119 618 181 0 125799 0
Current children cumulated CPU time: 342.07 s
Current children cumulated vsize: 528728 KiB
Current children cumulated memory: 504476 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 21378
/proc/meminfo: memFree=21244032/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=566788 memory=542588 CPUtime=402.06 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 334553 0 0 0 40160 46 0 0 20 0 1 0 95750723 580390912 135647 33554432000 4194304 4933779 140737339217456 140737339215160 4437824 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 141697 135647 618 181 0 135314 0
Current children cumulated CPU time: 402.06 s
Current children cumulated vsize: 566788 KiB
Current children cumulated memory: 542588 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 21379
/proc/meminfo: memFree=21204124/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=598652 memory=574404 CPUtime=462.06 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 343833 0 0 0 46156 50 0 0 20 0 1 0 95750723 613019648 143601 33554432000 4194304 4933779 140737339217456 140737339215144 4437426 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 149663 143601 618 181 0 143280 0
Current children cumulated CPU time: 462.06 s
Current children cumulated vsize: 598652 KiB
Current children cumulated memory: 574404 KiB


################
# More data... #
################

/proc/21363/statm: 248988 242665 618 181 0 242605 0
Current children cumulated CPU time: 1721.88 s
Current children cumulated vsize: 995952 KiB
Current children cumulated memory: 970660 KiB

[startup+1782.3 s]
/proc/loadavg: 2.10 2.12 2.08 3/187 21463
/proc/meminfo: memFree=20652176/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1009832 memory=984484 CPUtime=1781.88 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 931035 0 0 0 178049 139 0 0 20 0 1 0 95750723 1034067968 246121 33554432000 4194304 4933779 140737339217456 140737339215224 139746893601147 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 252458 246121 618 181 0 246075 0
Current children cumulated CPU time: 1781.88 s
Current children cumulated vsize: 1009832 KiB
Current children cumulated memory: 984484 KiB

[startup+1842.3 s]
/proc/loadavg: 2.04 2.10 2.08 3/187 21586
/proc/meminfo: memFree=21250328/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1021432 memory=996148 CPUtime=1841.87 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 954474 0 0 0 184045 142 0 0 20 0 1 0 95750723 1045946368 249037 33554432000 4194304 4933779 140737339217456 140737339215208 139746893610429 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 255358 249037 618 181 0 248975 0
Current children cumulated CPU time: 1841.87 s
Current children cumulated vsize: 1021432 KiB
Current children cumulated memory: 996148 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.08 2.07 3/187 21647
/proc/meminfo: memFree=21199724/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1033736 memory=1008516 CPUtime=1901.87 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 979241 0 0 0 190041 146 0 0 20 0 1 0 95750723 1058545664 252129 33554432000 4194304 4933779 140737339217456 140737339215160 4437524 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 258434 252129 618 181 0 252051 0
Current children cumulated CPU time: 1901.87 s
Current children cumulated vsize: 1033736 KiB
Current children cumulated memory: 1008516 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.07 2.07 3/187 21648
/proc/meminfo: memFree=21156704/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1047488 memory=1022120 CPUtime=1961.86 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1013233 0 0 0 196035 151 0 0 20 0 1 0 95750723 1072627712 255530 33554432000 4194304 4933779 140737339217456 140737339215224 139746893601155 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 261872 255530 618 181 0 255489 0
Current children cumulated CPU time: 1961.86 s
Current children cumulated vsize: 1047488 KiB
Current children cumulated memory: 1022120 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/187 21649
/proc/meminfo: memFree=21127068/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1058516 memory=1033156 CPUtime=2021.87 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1040739 0 0 0 202031 156 0 0 20 0 1 0 95750723 1083920384 258289 33554432000 4194304 4933779 140737339217456 140737339215160 4437389 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 264629 258289 618 181 0 258246 0
Current children cumulated CPU time: 2021.87 s
Current children cumulated vsize: 1058516 KiB
Current children cumulated memory: 1033156 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/187 21650
/proc/meminfo: memFree=21098928/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1069344 memory=1043984 CPUtime=2081.86 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1069222 0 0 0 208027 159 0 0 20 0 1 0 95750723 1095008256 260996 33554432000 4194304 4933779 140737339217456 140737339215144 139746898937005 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 267336 260996 618 181 0 260953 0
Current children cumulated CPU time: 2081.86 s
Current children cumulated vsize: 1069344 KiB
Current children cumulated memory: 1043984 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 21659
/proc/meminfo: memFree=21075672/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1081192 memory=1055812 CPUtime=2141.86 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1104811 0 0 0 214023 163 0 0 20 0 1 0 95750723 1107140608 263953 33554432000 4194304 4933779 140737339217456 140737339215160 4437547 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 270298 263953 618 181 0 263915 0
Current children cumulated CPU time: 2141.86 s
Current children cumulated vsize: 1081192 KiB
Current children cumulated memory: 1055812 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 21661
/proc/meminfo: memFree=21054476/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1090952 memory=1065508 CPUtime=2201.85 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1127042 0 0 0 220019 166 0 0 20 0 1 0 95750723 1117134848 266377 33554432000 4194304 4933779 140737339217456 140737339215160 139746893601147 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 272738 266377 618 181 0 266355 0
Current children cumulated CPU time: 2201.85 s
Current children cumulated vsize: 1090952 KiB
Current children cumulated memory: 1065508 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 21662
/proc/meminfo: memFree=21031888/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1102288 memory=1077464 CPUtime=2261.83 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1157018 0 0 0 226011 172 0 0 20 0 1 0 95750723 1128742912 269366 33554432000 4194304 4933779 140737339217456 140737339215208 4357325 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 275572 269366 618 181 0 269189 0
Current children cumulated CPU time: 2261.83 s
Current children cumulated vsize: 1102288 KiB
Current children cumulated memory: 1077464 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 21663
/proc/meminfo: memFree=21006496/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1116496 memory=1091672 CPUtime=2321.8 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1178891 0 0 0 232004 176 0 0 20 0 1 0 95750723 1143291904 272918 33554432000 4194304 4933779 140737339217456 140737339215160 4422724 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 279124 272918 618 181 0 272741 0
Current children cumulated CPU time: 2321.8 s
Current children cumulated vsize: 1116496 KiB
Current children cumulated memory: 1091672 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 21664
/proc/meminfo: memFree=20982256/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1127580 memory=1102960 CPUtime=2381.78 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1184991 0 0 0 238001 177 0 0 20 0 1 0 95750723 1154641920 275740 33554432000 4194304 4933779 140737339217456 140737339215160 4475930 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 281895 275740 618 181 0 275512 0
Current children cumulated CPU time: 2381.78 s
Current children cumulated vsize: 1127580 KiB
Current children cumulated memory: 1102960 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21666
/proc/meminfo: memFree=20962904/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1137508 memory=1112672 CPUtime=2441.77 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1189834 0 0 0 243999 178 0 0 20 0 1 0 95750723 1164808192 278168 33554432000 4194304 4933779 140737339217456 140737339215160 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 284377 278168 618 181 0 277994 0
Current children cumulated CPU time: 2441.77 s
Current children cumulated vsize: 1137508 KiB
Current children cumulated memory: 1112672 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21667
/proc/meminfo: memFree=20946556/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1147136 memory=1122236 CPUtime=2501.77 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1195332 0 0 0 249998 179 0 0 20 0 1 0 95750723 1174667264 280559 33554432000 4194304 4933779 140737339217456 140737339215160 4475561 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 286784 280559 618 181 0 280401 0
Current children cumulated CPU time: 2501.77 s
Current children cumulated vsize: 1147136 KiB
Current children cumulated memory: 1122236 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 21668
/proc/meminfo: memFree=20941348/32770624 swapFree=67108796/67108860
[pid=21363] ppid=21360 vsize=1150068 memory=1125284 CPUtime=2519.48 cores=1,3,5,7
/proc/21363/stat : 21363 (nacre_mini_rele) R 21360 21363 24279 0 -1 4202496 1197026 0 0 0 251769 179 0 0 20 0 1 0 95750723 1177669632 281321 33554432000 4194304 4933779 140737339217456 140737339215160 4437538 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 17772544 140737339221144 140737339221244 140737339221244 140737339224002 0
/proc/21363/statm: 287517 281321 618 181 0 281134 0
Current children cumulated CPU time: 2519.48 s
Current children cumulated vsize: 1150068 KiB
Current children cumulated memory: 1125284 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 21363 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.69 s, system=1.80291 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.02
CPU time (s): 2519.5
CPU user time (s): 2517.69
CPU system time (s): 1.80291
CPU usage (%): 99.9794
Max. virtual memory (cumulated for all children) (KiB): 1150068
Max. memory (cumulated for all children) (KiB): 1125284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.69
system time used= 1.80291
maximum resident set size= 1125440
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1197073
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 529
involuntary context switches= 2821


# summary of solver processes directly reported to runsolver:
#   pid: 21363
#   total CPU time (s): 2519.5
#   total CPU user time (s): 2517.69
#   total CPU system time (s): 1.80291

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.53165 second user time and 19.0057 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-28 14:44:36
IDJOB=4299082
IDBENCH=141292
IDSOLVER=2764
FILE ID=node138/4299082-1532781876
RUNJOBID= node138-1532773607-19388
PBS_JOBID= 21022455
Free space on /tmp= 53800 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Quasigroups_mini/QuasiGroup-v4-10_mini_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299082-1532781876/watcher-4299082-1532781876 -o /tmp/evaluation-result-4299082-1532781876/solver-4299082-1532781876 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19388 --watchdog 2580  nacre_mini_release HOME/instance-4299082-1532781876.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e8ea5ce8f134a5c516ecbdbf10fc886b
RANDOM SEED=1817351283

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        21868680 kB
MemAvailable:   31525076 kB
Buffers:          210440 kB
Cached:          9650088 kB
SwapCached:           44 kB
Active:          2944412 kB
Inactive:        7374528 kB
Active(anon):     402784 kB
Inactive(anon):    83488 kB
Active(file):    2541628 kB
Inactive(file):  7291040 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:               784 kB
Writeback:             0 kB
AnonPages:        465376 kB
Mapped:            38964 kB
Shmem:             25164 kB
Slab:             280304 kB
SReclaimable:     252188 kB
SUnreclaim:        28116 kB
KernelStack:        3376 kB
PageTables:         6396 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     752388 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    372736 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53800 MiB
End job on node138 at 2018-07-28 15:26:36