Trace number 4391472

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5-Hybrid? (TO) 2400.01 2400.11

General information on the benchmark

NameBlackhole/Blackhole-xcsp2-s07/
Blackhole-4-07-8_X2.xml
MD5SUM5c0d10b65067a89bbe36375c556425e1
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark654.324
Satisfiable
(Un)Satisfiability was proved
Number of variables112
Number of constraints1262
Number of domains4
Minimum domain size1
Maximum domain size28
Distribution of domain sizes[{"size":1,"count":2},{"size":7,"count":28},{"size":14,"count":27},{"size":28,"count":54}]
Minimum variable degree0
Maximum variable degree56
Distribution of variable degrees[{"degree":0,"count":1},{"degree":2,"count":29},{"degree":3,"count":26},{"degree":28,"count":1},{"degree":29,"count":18},{"degree":30,"count":9},{"degree":56,"count":28}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":1262}]
Number of extensional constraints1262
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":1262}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.03	c NACRE 1.0.5
2400.00/2400.11	c
2400.00/2400.11	c # time = 2400
2400.00/2400.11	c # Dec = 2417931
2400.00/2400.11	c # Propagate Calls = 2864013907
2400.00/2400.11	c # assignAt Calls = 9278609
2400.00/2400.11	c # removeAt Calls = 206780939
2400.00/2400.11	c # Run = 4095
2400.00/2400.11	c # Conflicts = 2289435
2400.00/2400.11	c # Memory used = 323.136 Mb
2400.00/2400.11	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9795 MiB free)
  memory of node 1: 16384 MiB (11616 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391472-1568315034/watcher-4391472-1568315034 -o /tmp/evaluation-result-4391472-1568315034/solver-4391472-1568315034 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node140-1568307582-20541 --watchdog 2560 nacre_mini_release HOME/instance-4391472-1568315034.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22933, runsolver pid=22930
Current StackSize limit: 8192 KiB


[startup+0.1002 s]*
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21919304/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=33488 memory=10064 CPUtime=0.1 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 2701 0 0 0 10 0 0 0 20 0 1 0 407441878 34291712 2516 33554432000 4194304 4935366 140727222316064 140727222313064 140151611313125 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 8372 2516 607 181 0 1989 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 33488 KiB
Current children cumulated memory: 10064 KiB

[startup+0.209863 s]*
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21918692/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=34152 memory=10856 CPUtime=0.21 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 2887 0 0 0 21 0 0 0 20 0 1 0 407441878 34971648 2714 33554432000 4194304 4935366 140727222316064 140727222313064 4390325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 8538 2714 607 181 0 2155 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 34152 KiB
Current children cumulated memory: 10856 KiB

[startup+0.309331 s]*
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21917452/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=35032 memory=11648 CPUtime=0.31 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 3083 0 0 0 31 0 0 0 20 0 1 0 407441878 35872768 2912 33554432000 4194304 4935366 140727222316064 140727222313064 140151611313125 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 8758 2912 608 181 0 2375 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 35032 KiB
Current children cumulated memory: 11648 KiB

[startup+0.70035 s]
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21916336/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=37012 memory=13496 CPUtime=0.69 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 3581 0 0 0 69 0 0 0 20 0 1 0 407441878 37900288 3374 33554432000 4194304 4935366 140727222316064 140727222313064 140151611313125 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 9253 3374 608 181 0 2870 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 37012 KiB
Current children cumulated memory: 13496 KiB

[startup+1.50036 s]
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21912956/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=41020 memory=17460 CPUtime=1.49 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 4586 0 0 0 149 0 0 0 20 0 1 0 407441878 42004480 4365 33554432000 4194304 4935366 140727222316064 140727222313816 4390357 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 10255 4365 608 181 0 3872 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 41020 KiB
Current children cumulated memory: 17460 KiB

[startup+3.10958 s]
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21901548/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=46948 memory=23460 CPUtime=3.1 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 10300 0 0 0 310 0 0 0 20 0 1 0 407441878 48074752 5865 33554432000 4194304 4935366 140727222316064 140727222313816 4450339 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 11737 5865 608 181 0 5354 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 46948 KiB
Current children cumulated memory: 23460 KiB

[startup+6.30038 s]
/proc/loadavg: 2.03 2.09 2.08 3/200 22934
/proc/meminfo: memFree=21893668/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=54912 memory=30704 CPUtime=6.29 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 17855 0 0 0 628 1 0 0 20 0 1 0 407441878 56229888 7676 33554432000 4194304 4935366 140727222316064 140727222313752 4461472 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 13728 7676 608 181 0 7345 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 54912 KiB
Current children cumulated memory: 30704 KiB

[startup+12.7004 s]
/proc/loadavg: 2.03 2.09 2.08 3/200 22935
/proc/meminfo: memFree=21880508/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=64256 memory=40456 CPUtime=12.69 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 27768 0 0 0 1268 1 0 0 20 0 1 0 407441878 65798144 10114 33554432000 4194304 4935366 140727222316064 140727222313752 4417899 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 16064 10114 608 181 0 9681 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 64256 KiB
Current children cumulated memory: 40456 KiB

[startup+25.5004 s]
/proc/loadavg: 2.02 2.09 2.08 3/200 22935
/proc/meminfo: memFree=21864192/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=76680 memory=53132 CPUtime=25.49 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 52585 0 0 0 2546 3 0 0 20 0 1 0 407441878 78520320 13283 33554432000 4194304 4935366 140727222316064 140727222313752 4461227 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 19170 13283 608 181 0 12787 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 76680 KiB
Current children cumulated memory: 53132 KiB

[startup+51.1096 s]
/proc/loadavg: 2.07 2.10 2.08 3/200 22937
/proc/meminfo: memFree=21838340/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=94612 memory=71036 CPUtime=51.1 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 72143 0 0 0 5105 5 0 0 20 0 1 0 407441878 96882688 17759 33554432000 4194304 4935366 140727222316064 140727222313816 4461133 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 23653 17759 608 181 0 17270 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 94612 KiB
Current children cumulated memory: 71036 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.08 2.08 3/201 22942
/proc/meminfo: memFree=21796640/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=118884 memory=94292 CPUtime=102.26 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 91656 0 0 0 10219 7 0 0 20 0 1 0 407441878 121737216 23573 33554432000 4194304 4935366 140727222316064 140727222313752 140151611305746 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 29721 23573 608 181 0 23338 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 118884 KiB
Current children cumulated memory: 94292 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/201 22946
/proc/meminfo: memFree=21763124/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=135880 memory=111436 CPUtime=162.26 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 97265 0 0 0 16218 8 0 0 20 0 1 0 407441878 139141120 27859 33554432000 4194304 4935366 140727222316064 140727222313816 4450339 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 33970 27859 608 181 0 27587 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 135880 KiB
Current children cumulated memory: 111436 KiB

[startup+222.3 s]
/proc/loadavg: 1.92 2.04 2.06 3/200 22952
/proc/meminfo: memFree=21727040/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=153000 memory=128452 CPUtime=222.26 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 107612 0 0 0 22216 10 0 0 20 0 1 0 407441878 156672000 32113 33554432000 4194304 4935366 140727222316064 140727222313816 4461250 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 38250 32113 608 181 0 31867 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 153000 KiB
Current children cumulated memory: 128452 KiB

[startup+282.3 s]
/proc/loadavg: 1.97 2.03 2.05 3/200 22956
/proc/meminfo: memFree=21697488/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=171768 memory=147096 CPUtime=282.26 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 122005 0 0 0 28214 12 0 0 20 0 1 0 407441878 175890432 36774 33554432000 4194304 4935366 140727222316064 140727222313752 4461216 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 42942 36774 608 181 0 36559 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 171768 KiB
Current children cumulated memory: 147096 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 2.03 2.05 3/200 22960
/proc/meminfo: memFree=21675732/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=182252 memory=157744 CPUtime=342.26 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 138416 0 0 0 34212 14 0 0 20 0 1 0 407441878 186626048 39436 33554432000 4194304 4935366 140727222316064 140727222313816 4390325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 45563 39436 608 181 0 39180 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 182252 KiB
Current children cumulated memory: 157744 KiB

[startup+402.3 s]
/proc/loadavg: 2.52 2.17 2.09 3/199 22966
/proc/meminfo: memFree=21655264/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=191916 memory=167792 CPUtime=402.22 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 157722 0 0 0 40207 15 0 0 20 0 1 0 407441878 196521984 41948 33554432000 4194304 4935366 140727222316064 140727222313752 4450164 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 47979 41948 608 181 0 41596 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 191916 KiB
Current children cumulated memory: 167792 KiB

[startup+462.3 s]
/proc/loadavg: 2.19 2.14 2.09 3/199 22977
/proc/meminfo: memFree=21638472/32770624 swapFree=66999160/67108860
[pid=22933] ppid=22930 vsize=200896 memory=176872 CPUtime=462.22 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 161613 0 0 0 46206 16 0 0 20 0 1 0 407441878 205717504 44218 33554432000 4194304 4935366 140727222316064 140727222313576 4461250 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 50224 44218 608 181 0 43841 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 200896 KiB
Current children cumulated memory: 176872 KiB


################
# More data... #
################

/proc/22933/statm: 77073 71119 608 181 0 70690 0
Current children cumulated CPU time: 1662.19 s
Current children cumulated vsize: 308292 KiB
Current children cumulated memory: 284476 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23092
/proc/meminfo: memFree=21422584/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=312776 memory=288928 CPUtime=1722.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 291308 0 0 0 172186 33 0 0 20 0 1 0 407441878 320282624 72232 33554432000 4194304 4935366 140727222316064 140727222313752 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 78194 72232 608 181 0 71811 0
Current children cumulated CPU time: 1722.19 s
Current children cumulated vsize: 312776 KiB
Current children cumulated memory: 288928 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23096
/proc/meminfo: memFree=21418388/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=315372 memory=291528 CPUtime=1782.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 295488 0 0 0 178185 34 0 0 20 0 1 0 407441878 322940928 72882 33554432000 4194304 4935366 140727222316064 140727222313752 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 78843 72882 608 181 0 72460 0
Current children cumulated CPU time: 1782.19 s
Current children cumulated vsize: 315372 KiB
Current children cumulated memory: 291528 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23102
/proc/meminfo: memFree=21413620/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=317344 memory=293500 CPUtime=1842.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 300056 0 0 0 184185 34 0 0 20 0 1 0 407441878 324960256 73375 33554432000 4194304 4935366 140727222316064 140727222313816 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 79336 73375 608 181 0 72953 0
Current children cumulated CPU time: 1842.19 s
Current children cumulated vsize: 317344 KiB
Current children cumulated memory: 293500 KiB

[startup+1902.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/200 23106
/proc/meminfo: memFree=21406844/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=321832 memory=297764 CPUtime=1902.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 306213 0 0 0 190184 35 0 0 20 0 1 0 407441878 329555968 74441 33554432000 4194304 4935366 140727222316064 140727222313752 4390343 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 80458 74441 608 181 0 74075 0
Current children cumulated CPU time: 1902.19 s
Current children cumulated vsize: 321832 KiB
Current children cumulated memory: 297764 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 23110
/proc/meminfo: memFree=21398368/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=322632 memory=298816 CPUtime=1962.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 311673 0 0 0 196184 35 0 0 20 0 1 0 407441878 330375168 74704 33554432000 4194304 4935366 140727222316064 140727222313752 4212288 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 80658 74704 608 181 0 74275 0
Current children cumulated CPU time: 1962.19 s
Current children cumulated vsize: 322632 KiB
Current children cumulated memory: 298816 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23116
/proc/meminfo: memFree=21391920/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=329488 memory=305584 CPUtime=2022.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 320357 0 0 0 202183 36 0 0 20 0 1 0 407441878 337395712 76396 33554432000 4194304 4935366 140727222316064 140727222313752 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 82372 76396 608 181 0 75989 0
Current children cumulated CPU time: 2022.19 s
Current children cumulated vsize: 329488 KiB
Current children cumulated memory: 305584 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23120
/proc/meminfo: memFree=21387400/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=330516 memory=306796 CPUtime=2082.18 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 322294 0 0 0 208181 37 0 0 20 0 1 0 407441878 338448384 76699 33554432000 4194304 4935366 140727222316064 140727222313816 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 82629 76699 608 181 0 76246 0
Current children cumulated CPU time: 2082.18 s
Current children cumulated vsize: 330516 KiB
Current children cumulated memory: 306796 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23124
/proc/meminfo: memFree=21373508/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=332876 memory=309104 CPUtime=2142.18 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 324539 0 0 0 214181 37 0 0 20 0 1 0 407441878 340865024 77276 33554432000 4194304 4935366 140727222316064 140727222313768 4461238 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 83219 77276 608 181 0 76836 0
Current children cumulated CPU time: 2142.18 s
Current children cumulated vsize: 332876 KiB
Current children cumulated memory: 309104 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23130
/proc/meminfo: memFree=21358084/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=346284 memory=322452 CPUtime=2202.18 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 332814 0 0 0 220179 39 0 0 20 0 1 0 407441878 354594816 80613 33554432000 4194304 4935366 140727222316064 140727222313752 4461261 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 86571 80613 608 181 0 80188 0
Current children cumulated CPU time: 2202.18 s
Current children cumulated vsize: 346284 KiB
Current children cumulated memory: 322452 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23141
/proc/meminfo: memFree=21356728/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=346780 memory=322844 CPUtime=2262.18 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 337328 0 0 0 226179 39 0 0 20 0 1 0 407441878 355102720 80711 33554432000 4194304 4935366 140727222316064 140727222313752 4461519 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 86695 80711 608 181 0 80312 0
Current children cumulated CPU time: 2262.18 s
Current children cumulated vsize: 346780 KiB
Current children cumulated memory: 322844 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23145
/proc/meminfo: memFree=21356752/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=346976 memory=323044 CPUtime=2322.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 343133 0 0 0 232178 41 0 0 20 0 1 0 407441878 355303424 80761 33554432000 4194304 4935366 140727222316064 140727222313752 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 86744 80761 608 181 0 80361 0
Current children cumulated CPU time: 2322.19 s
Current children cumulated vsize: 346976 KiB
Current children cumulated memory: 323044 KiB

[startup+2382.3 s]
/proc/loadavg: 2.53 2.15 2.09 3/199 23211
/proc/meminfo: memFree=21621132/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=346976 memory=323136 CPUtime=2382.19 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 348746 0 0 0 238178 41 0 0 20 0 1 0 407441878 355303424 80784 33554432000 4194304 4935366 140727222316064 140727222313752 4461069 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 86744 80784 608 181 0 80361 0
Current children cumulated CPU time: 2382.19 s
Current children cumulated vsize: 346976 KiB
Current children cumulated memory: 323136 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.63 2.19 2.10 3/199 23212
/proc/meminfo: memFree=21592100/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=346976 memory=323136 CPUtime=2400 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 349132 0 0 0 239959 41 0 0 20 0 1 0 407441878 355303424 80784 33554432000 4194304 4935366 140727222316064 140727222313752 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 86744 80784 608 181 0 80361 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 346976 KiB
Current children cumulated memory: 323136 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 22933 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.59 s, system=0.420004 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.63 2.19 2.10 3/199 23212
/proc/meminfo: memFree=21592100/32770624 swapFree=66999164/67108860
[pid=22933] ppid=22930 vsize=346976 memory=323136 CPUtime=2400 cores=0,2,4,6
/proc/22933/stat : 22933 (nacre_mini_rele) R 22930 22933 20510 0 -1 4202496 349132 0 0 0 239959 41 0 0 20 0 1 0 407441878 355303424 80784 33554432000 4194304 4935366 140727222316064 140727222313752 4461073 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 33972224 140727222322177 140727222322277 140727222322277 140727222325186 0
/proc/22933/statm: 86744 80784 608 181 0 80361 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 346976 KiB
Current children cumulated memory: 323136 KiB

Child status: 0
Real time (s): 2400.11
CPU time (s): 2400.01
CPU user time (s): 2399.59
CPU system time (s): 0.420004
CPU usage (%): 99.9957
Max. virtual memory (cumulated for all children) (KiB): 346976
Max. memory (cumulated for all children) (KiB): 323136

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.59
system time used= 0.420004
maximum resident set size= 323212
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 349175
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 151
involuntary context switches= 1335


# summary of solver processes directly reported to runsolver:
#   pid: 22933
#   total CPU time (s): 2400.01
#   total CPU user time (s): 2399.59
#   total CPU system time (s): 0.420004

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.9226 second user time and 12.429 second system time

The end

Launcher Data 

Begin job on node140 at 2019-09-12 21:03:14
IDJOB=4391472
IDBENCH=134584
IDSOLVER=2834
FILE ID=node140/4391472-1568315034
RUNJOBID= node140-1568307582-20541
PBS_JOBID= 21701122
Free space on /tmp= 56868 MiB

SOLVER NAME= NACRE 1.0.5-Hybrid
BENCH NAME= XCSP17/Blackhole/Blackhole-xcsp2-s07/Blackhole-4-07-8_X2.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391472-1568315034/watcher-4391472-1568315034 -o /tmp/evaluation-result-4391472-1568315034/solver-4391472-1568315034 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node140-1568307582-20541 --watchdog 2560  nacre_mini_release HOME/instance-4391472-1568315034.xml -ca -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5c0d10b65067a89bbe36375c556425e1
RANDOM SEED=1897889764

node140.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        21926128 kB
MemAvailable:   31785940 kB
Buffers:          146348 kB
Cached:          9888632 kB
SwapCached:         2860 kB
Active:          1631224 kB
Inactive:        8486316 kB
Active(anon):      79260 kB
Inactive(anon):    43924 kB
Active(file):    1551964 kB
Inactive(file):  8442392 kB
Unevictable:      107728 kB
Mlocked:          107728 kB
SwapTotal:      67108860 kB
SwapFree:       66999160 kB
Dirty:               800 kB
Writeback:             0 kB
AnonPages:        187948 kB
Mapped:            43596 kB
Shmem:             32136 kB
Slab:             323488 kB
SReclaimable:     293916 kB
SUnreclaim:        29572 kB
KernelStack:        3568 kB
PageTables:         5748 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     603896 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 56864 MiB
End job on node140 at 2019-09-12 21:43:14