Trace number 4300322

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.83 2520.01

General information on the benchmark

NameFrb/
frb-59-26-2-mgd_c18.xml
MD5SUMdbc5e7d30fbc7022ec2241ba28b1d399
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables59
Number of constraints549
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":59}]
Minimum variable degree13
Maximum variable degree29
Distribution of variable degrees[{"degree":13,"count":1},{"degree":14,"count":3},{"degree":15,"count":6},{"degree":16,"count":9},{"degree":17,"count":8},{"degree":18,"count":10},{"degree":19,"count":2},{"degree":20,"count":4},{"degree":21,"count":3},{"degree":22,"count":2},{"degree":23,"count":5},{"degree":24,"count":3},{"degree":25,"count":1},{"degree":27,"count":1},{"degree":29,"count":1}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":549}]
Number of extensional constraints549
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":549}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.08	c NACRE 1.0.4
2519.82/2520.01	c
2519.82/2520.01	c # time = 2519.82
2519.82/2520.01	c # Dec = 2739019
2519.82/2520.01	c # Propagate Calls = 1379375151
2519.82/2520.01	c # assignAt Calls = 4892499
2519.82/2520.01	c # removeAt Calls = 435694417
2519.82/2520.01	c # Run = 4606
2519.82/2520.01	c # Conflicts = 2681905
2519.82/2520.01	c # Memory used = 292.016 Mb
2519.82/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9593 MiB free)
  memory of node 1: 16384 MiB (10039 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4300322-1532797884/watcher-4300322-1532797884 -o /tmp/evaluation-result-4300322-1532797884/solver-4300322-1532797884 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580 nacre_mini_release HOME/instance-4300322-1532797884.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=30106, runsolver pid=30103

[startup+0.100197 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20095824/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=33732 memory=10328 CPUtime=0.1 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 2769 0 0 0 10 0 0 0 20 0 1 0 97351595 34541568 2582 33554432000 4194304 4933779 140727598844816 140727598841816 140510080674789 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 8433 2582 599 181 0 2050 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 33732 KiB
Current children cumulated memory: 10328 KiB

[startup+0.209647 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20094460/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=34788 memory=11384 CPUtime=0.21 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 3057 0 0 0 21 0 0 0 20 0 1 0 97351595 35622912 2846 33554432000 4194304 4933779 140727598844816 140727598842584 140510080674789 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 8697 2846 599 181 0 2314 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 34788 KiB
Current children cumulated memory: 11384 KiB

[startup+0.309045 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20093344/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=35872 memory=12392 CPUtime=0.31 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 3311 0 0 0 31 0 0 0 20 0 1 0 97351595 36732928 3098 33554432000 4194304 4933779 140727598844816 140727598842584 140510080674789 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 8968 3098 600 181 0 2585 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 35872 KiB
Current children cumulated memory: 12392 KiB

[startup+0.70035 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20091484/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=39452 memory=16132 CPUtime=0.69 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 4199 0 0 0 69 0 0 0 20 0 1 0 97351595 40398848 4033 33554432000 4194304 4933779 140727598844816 140727598842584 140510080674789 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 9863 4033 600 181 0 3480 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 39452 KiB
Current children cumulated memory: 16132 KiB

[startup+1.50037 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20087604/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=45436 memory=22112 CPUtime=1.49 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 5716 0 0 0 149 0 0 0 20 0 1 0 97351595 46526464 5528 33554432000 4194304 4933779 140727598844816 140727598842504 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 11359 5528 600 181 0 4976 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 45436 KiB
Current children cumulated memory: 22112 KiB

[startup+3.10943 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20076576/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=52904 memory=29356 CPUtime=3.1 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 12436 0 0 0 309 1 0 0 20 0 1 0 97351595 54173696 7339 33554432000 4194304 4933779 140727598844816 140727598842568 140510080674789 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 13226 7339 600 181 0 6843 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 52904 KiB
Current children cumulated memory: 29356 KiB

[startup+6.30037 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20069200/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=60148 memory=36824 CPUtime=6.29 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 20739 0 0 0 627 2 0 0 20 0 1 0 97351595 61591552 9206 33554432000 4194304 4933779 140727598844816 140727598842520 4423376 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 15037 9206 600 181 0 8654 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 60148 KiB
Current children cumulated memory: 36824 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20058768/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=70748 memory=46916 CPUtime=12.69 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 31642 0 0 0 1266 3 0 0 20 0 1 0 97351595 72445952 11729 33554432000 4194304 4933779 140727598844816 140727598842520 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 17687 11729 600 181 0 11304 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 70748 KiB
Current children cumulated memory: 46916 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20044244/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=83068 memory=59352 CPUtime=25.49 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 57789 0 0 0 2544 5 0 0 20 0 1 0 97351595 85061632 14838 33554432000 4194304 4933779 140727598844816 140727598842568 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 20767 14838 600 181 0 14384 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 83068 KiB
Current children cumulated memory: 59352 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30107
/proc/meminfo: memFree=20022124/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=100360 memory=76740 CPUtime=51.09 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 78121 0 0 0 5102 7 0 0 20 0 1 0 97351595 102768640 19185 33554432000 4194304 4933779 140727598844816 140727598842504 4437469 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 25090 19185 600 181 0 18707 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 100360 KiB
Current children cumulated memory: 76740 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30108
/proc/meminfo: memFree=19992772/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=123592 memory=99064 CPUtime=102.26 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 103689 0 0 0 10216 10 0 0 20 0 1 0 97351595 126558208 24766 33554432000 4194304 4933779 140727598844816 140727598842568 4437792 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 30898 24766 600 181 0 24515 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 123592 KiB
Current children cumulated memory: 99064 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 30109
/proc/meminfo: memFree=19968540/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=141028 memory=116812 CPUtime=162.24 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 115870 0 0 0 16212 12 0 0 20 0 1 0 97351595 144412672 29203 33554432000 4194304 4933779 140727598844816 140727598842520 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 35257 29203 600 181 0 28874 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 141028 KiB
Current children cumulated memory: 116812 KiB

[startup+222.3 s]
/proc/loadavg: 2.98 2.29 2.14 3/188 30111
/proc/meminfo: memFree=19948584/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=156044 memory=132088 CPUtime=222.24 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 122674 0 0 0 22210 14 0 0 20 0 1 0 97351595 159789056 33022 33554432000 4194304 4933779 140727598844816 140727598842568 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 39011 33022 600 181 0 32628 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 156044 KiB
Current children cumulated memory: 132088 KiB

[startup+282.3 s]
/proc/loadavg: 2.36 2.23 2.13 3/188 30112
/proc/meminfo: memFree=19931824/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=167624 memory=143608 CPUtime=282.24 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 132097 0 0 0 28208 16 0 0 20 0 1 0 97351595 171646976 35902 33554432000 4194304 4933779 140727598844816 140727598842504 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 41906 35902 600 181 0 35523 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 167624 KiB
Current children cumulated memory: 143608 KiB

[startup+342.3 s]
/proc/loadavg: 2.13 2.19 2.12 3/188 30113
/proc/meminfo: memFree=19916008/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=177576 memory=153744 CPUtime=342.24 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 143886 0 0 0 34206 18 0 0 20 0 1 0 97351595 181837824 38436 33554432000 4194304 4933779 140727598844816 140727598842568 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 44394 38436 600 181 0 38011 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 177576 KiB
Current children cumulated memory: 153744 KiB

[startup+402.3 s]
/proc/loadavg: 2.05 2.16 2.12 3/188 30114
/proc/meminfo: memFree=19902436/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=185600 memory=162024 CPUtime=402.22 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 151912 0 0 0 40203 19 0 0 20 0 1 0 97351595 190054400 40506 33554432000 4194304 4933779 140727598844816 140727598842520 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 46400 40506 600 181 0 40017 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 185600 KiB
Current children cumulated memory: 162024 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.13 2.11 3/188 30115
/proc/meminfo: memFree=19890284/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=193080 memory=169300 CPUtime=462.21 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 155691 0 0 0 46201 20 0 0 20 0 1 0 97351595 197713920 42325 33554432000 4194304 4933779 140727598844816 140727598842504 4363875 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 48270 42325 600 181 0 41887 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 193080 KiB
Current children cumulated memory: 169300 KiB


################
# More data... #
################

/proc/30106/statm: 70691 64422 600 181 0 64308 0
Current children cumulated CPU time: 1722.14 s
Current children cumulated vsize: 282764 KiB
Current children cumulated memory: 257688 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/188 30163
/proc/meminfo: memFree=19734752/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=285644 memory=260656 CPUtime=1782.13 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 260473 0 0 0 178176 37 0 0 20 0 1 0 97351595 292499456 65164 33554432000 4194304 4933779 140727598844816 140727598842504 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 71411 65164 600 181 0 65028 0
Current children cumulated CPU time: 1782.13 s
Current children cumulated vsize: 285644 KiB
Current children cumulated memory: 260656 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/188 30164
/proc/meminfo: memFree=19730140/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=287984 memory=262872 CPUtime=1842.13 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 264808 0 0 0 184175 38 0 0 20 0 1 0 97351595 294895616 65718 33554432000 4194304 4933779 140727598844816 140727598842520 4437505 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 71996 65718 600 181 0 65613 0
Current children cumulated CPU time: 1842.13 s
Current children cumulated vsize: 287984 KiB
Current children cumulated memory: 262872 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 30165
/proc/meminfo: memFree=19724412/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=290840 memory=265992 CPUtime=1902.13 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 269897 0 0 0 190174 39 0 0 20 0 1 0 97351595 297820160 66498 33554432000 4194304 4933779 140727598844816 140727598842520 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 72710 66498 600 181 0 66327 0
Current children cumulated CPU time: 1902.13 s
Current children cumulated vsize: 290840 KiB
Current children cumulated memory: 265992 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 30166
/proc/meminfo: memFree=19719204/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=293508 memory=268608 CPUtime=1962.12 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 270548 0 0 0 196173 39 0 0 20 0 1 0 97351595 300552192 67152 33554432000 4194304 4933779 140727598844816 140727598842568 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 73377 67152 600 181 0 66994 0
Current children cumulated CPU time: 1962.12 s
Current children cumulated vsize: 293508 KiB
Current children cumulated memory: 268608 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 30167
/proc/meminfo: memFree=19715872/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=295820 memory=270936 CPUtime=2022.13 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 273038 0 0 0 202173 40 0 0 20 0 1 0 97351595 302919680 67734 33554432000 4194304 4933779 140727598844816 140727598842504 4437558 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 73955 67734 600 181 0 67572 0
Current children cumulated CPU time: 2022.13 s
Current children cumulated vsize: 295820 KiB
Current children cumulated memory: 270936 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 30168
/proc/meminfo: memFree=19712328/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=297936 memory=273024 CPUtime=2082.13 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 275990 0 0 0 208173 40 0 0 20 0 1 0 97351595 305086464 68256 33554432000 4194304 4933779 140727598844816 140727598842328 4437558 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 74484 68256 600 181 0 68101 0
Current children cumulated CPU time: 2082.13 s
Current children cumulated vsize: 297936 KiB
Current children cumulated memory: 273024 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 30169
/proc/meminfo: memFree=19708104/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=301000 memory=275736 CPUtime=2142.13 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 279801 0 0 0 214172 41 0 0 20 0 1 0 97351595 308224000 68934 33554432000 4194304 4933779 140727598844816 140727598842376 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 75250 68934 600 181 0 68867 0
Current children cumulated CPU time: 2142.13 s
Current children cumulated vsize: 301000 KiB
Current children cumulated memory: 275736 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/187 30294
/proc/meminfo: memFree=19888764/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=303040 memory=277928 CPUtime=2202.12 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 283715 0 0 0 220171 41 0 0 20 0 1 0 97351595 310312960 69482 33554432000 4194304 4933779 140727598844816 140727598842568 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 75760 69482 600 181 0 69377 0
Current children cumulated CPU time: 2202.12 s
Current children cumulated vsize: 303040 KiB
Current children cumulated memory: 277928 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 30295
/proc/meminfo: memFree=19864936/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=305808 memory=281100 CPUtime=2262.12 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 288634 0 0 0 226170 42 0 0 20 0 1 0 97351595 313147392 70275 33554432000 4194304 4933779 140727598844816 140727598842520 4437462 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 76452 70275 600 181 0 70069 0
Current children cumulated CPU time: 2262.12 s
Current children cumulated vsize: 305808 KiB
Current children cumulated memory: 281100 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 30303
/proc/meminfo: memFree=19847340/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=308740 memory=283800 CPUtime=2322.11 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 291023 0 0 0 232169 42 0 0 20 0 1 0 97351595 316149760 70950 33554432000 4194304 4933779 140727598844816 140727598842504 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 77185 70950 600 181 0 70802 0
Current children cumulated CPU time: 2322.11 s
Current children cumulated vsize: 308740 KiB
Current children cumulated memory: 283800 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 30304
/proc/meminfo: memFree=19832336/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=311576 memory=286744 CPUtime=2382.12 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 293910 0 0 0 238169 43 0 0 20 0 1 0 97351595 319053824 71686 33554432000 4194304 4933779 140727598844816 140727598842520 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 77894 71686 600 181 0 71511 0
Current children cumulated CPU time: 2382.12 s
Current children cumulated vsize: 311576 KiB
Current children cumulated memory: 286744 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 30305
/proc/meminfo: memFree=19821296/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=313784 memory=288908 CPUtime=2442.12 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 297488 0 0 0 244168 44 0 0 20 0 1 0 97351595 321314816 72227 33554432000 4194304 4933779 140727598844816 140727598842520 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 78446 72227 600 181 0 72063 0
Current children cumulated CPU time: 2442.12 s
Current children cumulated vsize: 313784 KiB
Current children cumulated memory: 288908 KiB

[startup+2502.3 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 30306
/proc/meminfo: memFree=19809400/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=316440 memory=291576 CPUtime=2502.11 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 301635 0 0 0 250167 44 0 0 20 0 1 0 97351595 324034560 72894 33554432000 4194304 4933779 140727598844816 140727598842504 4437445 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 79110 72894 600 181 0 72727 0
Current children cumulated CPU time: 2502.11 s
Current children cumulated vsize: 316440 KiB
Current children cumulated memory: 291576 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.97 2.00 2.04 3/187 30307
/proc/meminfo: memFree=19806548/32770624 swapFree=67108860/67108860
[pid=30106] ppid=30103 vsize=316836 memory=292016 CPUtime=2519.82 cores=0,2,4,6
/proc/30106/stat : 30106 (nacre_mini_rele) R 30103 30106 26996 0 -1 4202496 301921 0 0 0 251938 44 0 0 20 0 1 0 97351595 324440064 73004 33554432000 4194304 4933779 140727598844816 140727598842520 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 12341248 140727598847128 140727598847228 140727598847228 140727598849986 0
/proc/30106/statm: 79209 73004 600 181 0 72826 0
Current children cumulated CPU time: 2519.82 s
Current children cumulated vsize: 316836 KiB
Current children cumulated memory: 292016 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 30106 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.38 s, system=0.45099 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.83
CPU user time (s): 2519.38
CPU system time (s): 0.45099
CPU usage (%): 99.9929
Max. virtual memory (cumulated for all children) (KiB): 316836
Max. memory (cumulated for all children) (KiB): 292016

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.38
system time used= 0.45099
maximum resident set size= 292124
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 301963
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 142
involuntary context switches= 3154


# summary of solver processes directly reported to runsolver:
#   pid: 30106
#   total CPU time (s): 2519.83
#   total CPU user time (s): 2519.38
#   total CPU system time (s): 0.45099

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.8263 second user time and 17.8688 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 19:11:24
IDJOB=4300322
IDBENCH=141585
IDSOLVER=2764
FILE ID=node103/4300322-1532797884
RUNJOBID= node103-1532775163-27027
PBS_JOBID= 21022463
Free space on /tmp= 56536 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Frb/frb-59-26-2-mgd_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4300322-1532797884/watcher-4300322-1532797884 -o /tmp/evaluation-result-4300322-1532797884/solver-4300322-1532797884 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580  nacre_mini_release HOME/instance-4300322-1532797884.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dbc5e7d30fbc7022ec2241ba28b1d399
RANDOM SEED=87574564

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20104100 kB
MemAvailable:   31808920 kB
Buffers:          303144 kB
Cached:         11585424 kB
SwapCached:            0 kB
Active:          4039748 kB
Inactive:        8024784 kB
Active(anon):     178652 kB
Inactive(anon):    25184 kB
Active(file):    3861096 kB
Inactive(file):  7999600 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              1824 kB
Writeback:             0 kB
AnonPages:        188340 kB
Mapped:            44424 kB
Shmem:             25228 kB
Slab:             300228 kB
SReclaimable:     272584 kB
SUnreclaim:        27644 kB
KernelStack:        3584 kB
PageTables:         5372 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     474348 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     12288 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56536 MiB
End job on node103 at 2018-07-28 19:53:24