Trace number 4391436

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5-Hybrid? (TO) 2400.07 2400.11

General information on the benchmark

NameGracefulGraph/
GracefulGraph-K04-P04_c18.xml
MD5SUMbba9b3428f0c8228a4e28ff2342631fb
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.51133
Satisfiable
(Un)Satisfiability was proved
Number of variables92
Number of constraints38
Number of domains2
Minimum domain size36
Maximum domain size37
Distribution of domain sizes[{"size":36,"count":36},{"size":37,"count":16}]
Minimum variable degree0
Maximum variable degree6
Distribution of variable degrees[{"degree":0,"count":40},{"degree":2,"count":36},{"degree":5,"count":8},{"degree":6,"count":8}]
Minimum constraint arity3
Maximum constraint arity36
Distribution of constraint arities[{"arity":3,"count":36},{"arity":16,"count":1},{"arity":36,"count":1}]
Number of extensional constraints0
Number of intensional constraints36
Distribution of constraint types[{"type":"intension","count":36},{"type":"allDifferent","count":2}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c NACRE 1.0.5
2400.05/2400.10	c
2400.05/2400.10	c # time = 2400.05
2400.05/2400.10	c # Dec = 703486
2400.05/2400.10	c # Propagate Calls = 539677309
2400.05/2400.10	c # assignAt Calls = 916343
2400.05/2400.10	c # removeAt Calls = 133808028
2400.05/2400.11	c # Run = 1528
2400.05/2400.11	c # Conflicts = 692346
2400.05/2400.11	c # Memory used = 192.3 Mb
2400.05/2400.11	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10059 MiB free)
  memory of node 1: 16384 MiB (14209 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391436-1568321397/watcher-4391436-1568321397 -o /tmp/evaluation-result-4391436-1568321397/solver-4391436-1568321397 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568301555-23462 --watchdog 2560 nacre_mini_release HOME/instance-4391436-1568321397.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28362, runsolver pid=28359

[startup+0.100152 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 28363
/proc/meminfo: memFree=24850444/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=27712 memory=4388 CPUtime=0.1 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 1287 0 0 0 10 0 0 0 20 0 1 0 408407516 28377088 1097 33554432000 4194304 4935366 140725693412528 140725693409528 4382870 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 6928 1097 613 181 0 545 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27712 KiB
Current children cumulated memory: 4388 KiB

[startup+0.209486 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 28363
/proc/meminfo: memFree=24850072/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=27844 memory=4388 CPUtime=0.21 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 1319 0 0 0 21 0 0 0 20 0 1 0 408407516 28512256 1097 33554432000 4194304 4935366 140725693412528 140725693409528 140590280134418 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 6961 1097 613 181 0 578 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27844 KiB
Current children cumulated memory: 4388 KiB

[startup+0.308836 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 28363
/proc/meminfo: memFree=24849820/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=27844 memory=4652 CPUtime=0.31 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 1338 0 0 0 31 0 0 0 20 0 1 0 408407516 28512256 1163 33554432000 4194304 4935366 140725693412528 140725693409528 140590280151960 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 6961 1163 613 181 0 578 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27844 KiB
Current children cumulated memory: 4652 KiB

[startup+0.700267 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28363
/proc/meminfo: memFree=24849448/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=28240 memory=4916 CPUtime=0.69 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 1430 0 0 0 69 0 0 0 20 0 1 0 408407516 28917760 1229 33554432000 4194304 4935366 140725693412528 140725693409528 4212032 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 7060 1229 613 181 0 677 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 28240 KiB
Current children cumulated memory: 4916 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28363
/proc/meminfo: memFree=24848816/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=28764 memory=5372 CPUtime=1.49 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 1559 0 0 0 149 0 0 0 20 0 1 0 408407516 29454336 1343 33554432000 4194304 4935366 140725693412528 140725693410296 4211440 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 7191 1343 613 181 0 808 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 28764 KiB
Current children cumulated memory: 5372 KiB

[startup+3.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28363
/proc/meminfo: memFree=24847080/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=29684 memory=6408 CPUtime=3.1 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 2571 0 0 0 310 0 0 0 20 0 1 0 408407516 30396416 1602 33554432000 4194304 4935366 140725693412528 140725693410296 4386769 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 7421 1602 613 181 0 1038 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 29684 KiB
Current children cumulated memory: 6408 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28365
/proc/meminfo: memFree=24843364/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=31700 memory=8376 CPUtime=6.29 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 4127 0 0 0 629 0 0 0 20 0 1 0 408407516 32460800 2094 33554432000 4194304 4935366 140725693412528 140725693410296 140590280139359 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 7925 2094 613 181 0 1542 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 31700 KiB
Current children cumulated memory: 8376 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28365
/proc/meminfo: memFree=24829176/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=36364 memory=13040 CPUtime=12.69 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 6904 0 0 0 1269 0 0 0 20 0 1 0 408407516 37236736 3260 33554432000 4194304 4935366 140725693412528 140725693410296 140590280139570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 9091 3260 613 181 0 2708 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 36364 KiB
Current children cumulated memory: 13040 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28365
/proc/meminfo: memFree=24803200/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=45904 memory=22332 CPUtime=25.49 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 16474 0 0 0 2548 1 0 0 20 0 1 0 408407516 47005696 5583 33554432000 4194304 4935366 140725693412528 140725693410296 140590281067946 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 11476 5583 613 181 0 5093 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 45904 KiB
Current children cumulated memory: 22332 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28376
/proc/meminfo: memFree=24778924/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=57420 memory=33888 CPUtime=51.1 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 26339 0 0 0 5108 2 0 0 20 0 1 0 408407516 58798080 8472 33554432000 4194304 4935366 140725693412528 140725693410296 140590280139338 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 14355 8472 613 181 0 7972 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 57420 KiB
Current children cumulated memory: 33888 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28380
/proc/meminfo: memFree=24706076/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=74192 memory=50448 CPUtime=102.29 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 39662 0 0 0 10225 4 0 0 20 0 1 0 408407516 75972608 12612 33554432000 4194304 4935366 140725693412528 140725693410232 4383589 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 18548 12612 613 181 0 12165 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 74192 KiB
Current children cumulated memory: 50448 KiB

[startup+162.3 s]
/proc/loadavg: 1.86 1.98 2.03 3/200 28445
/proc/meminfo: memFree=28628576/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=85172 memory=61320 CPUtime=162.28 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 54754 0 0 0 16223 5 0 0 20 0 1 0 408407516 87216128 15330 33554432000 4194304 4935366 140725693412528 140725693410232 4461519 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 21293 15330 613 181 0 14910 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 85172 KiB
Current children cumulated memory: 61320 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.00 2.04 3/200 28449
/proc/meminfo: memFree=28575080/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=94960 memory=71240 CPUtime=222.27 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 64138 0 0 0 22221 6 0 0 20 0 1 0 408407516 97239040 17810 33554432000 4194304 4935366 140725693412528 140725693410280 140590280140895 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 23740 17810 613 181 0 17357 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 94960 KiB
Current children cumulated memory: 71240 KiB

[startup+282.3 s]
/proc/loadavg: 2.07 2.02 2.05 3/200 28455
/proc/meminfo: memFree=28542904/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=100760 memory=77320 CPUtime=282.27 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 67848 0 0 0 28221 6 0 0 20 0 1 0 408407516 103178240 19330 33554432000 4194304 4935366 140725693412528 140725693410216 4383589 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 25190 19330 613 181 0 18807 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 100760 KiB
Current children cumulated memory: 77320 KiB

[startup+342.3 s]
/proc/loadavg: 2.03 2.01 2.05 3/200 28460
/proc/meminfo: memFree=28523532/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=106284 memory=82920 CPUtime=342.27 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 72799 0 0 0 34220 7 0 0 20 0 1 0 408407516 108834816 20730 33554432000 4194304 4935366 140725693412528 140725693410216 140590280134451 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 26571 20730 613 181 0 20188 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 106284 KiB
Current children cumulated memory: 82920 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 28464
/proc/meminfo: memFree=28493892/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=113288 memory=89832 CPUtime=402.26 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 79577 0 0 0 40218 8 0 0 20 0 1 0 408407516 116006912 22458 33554432000 4194304 4935366 140725693412528 140725693410232 4513792 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 28322 22458 613 181 0 21939 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 113288 KiB
Current children cumulated memory: 89832 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28471
/proc/meminfo: memFree=28471792/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=117636 memory=94244 CPUtime=462.26 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 82388 0 0 0 46218 8 0 0 20 0 1 0 408407516 120459264 23561 33554432000 4194304 4935366 140725693412528 140725693410232 4483712 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 29409 23561 613 181 0 23026 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 117636 KiB
Current children cumulated memory: 94244 KiB


################
# More data... #
################

/proc/28362/statm: 46665 40702 613 181 0 40282 0
Current children cumulated CPU time: 1662.26 s
Current children cumulated vsize: 186660 KiB
Current children cumulated memory: 162808 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 28607
/proc/meminfo: memFree=28193800/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=188484 memory=164524 CPUtime=1722.26 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 158620 0 0 0 172210 16 0 0 20 0 1 0 408407516 193007616 41131 33554432000 4194304 4935366 140725693412528 140725693410232 4461252 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 47121 41131 613 181 0 40738 0
Current children cumulated CPU time: 1722.26 s
Current children cumulated vsize: 188484 KiB
Current children cumulated memory: 164524 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 28611
/proc/meminfo: memFree=28189068/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=189312 memory=165436 CPUtime=1782.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 160836 0 0 0 178209 16 0 0 20 0 1 0 408407516 193855488 41359 33554432000 4194304 4935366 140725693412528 140725693410280 140590286435657 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 47328 41359 613 181 0 40945 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 189312 KiB
Current children cumulated memory: 165436 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 28623
/proc/meminfo: memFree=28175740/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=193396 memory=169308 CPUtime=1842.26 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 164254 0 0 0 184209 17 0 0 20 0 1 0 408407516 198037504 42327 33554432000 4194304 4935366 140725693412528 140725693410040 4383783 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 48349 42327 613 181 0 41966 0
Current children cumulated CPU time: 1842.26 s
Current children cumulated vsize: 193396 KiB
Current children cumulated memory: 169308 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 28629
/proc/meminfo: memFree=28172548/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=195876 memory=171948 CPUtime=1902.26 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 168048 0 0 0 190208 18 0 0 20 0 1 0 408407516 200577024 42987 33554432000 4194304 4935366 140725693412528 140725693410280 4315006 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 48969 42987 613 181 0 42586 0
Current children cumulated CPU time: 1902.26 s
Current children cumulated vsize: 195876 KiB
Current children cumulated memory: 171948 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 28633
/proc/meminfo: memFree=28169728/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=199360 memory=175504 CPUtime=1962.26 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 172919 0 0 0 196207 19 0 0 20 0 1 0 408407516 204144640 43876 33554432000 4194304 4935366 140725693412528 140725693410232 140590281065319 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 49840 43876 613 181 0 43457 0
Current children cumulated CPU time: 1962.26 s
Current children cumulated vsize: 199360 KiB
Current children cumulated memory: 175504 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 28637
/proc/meminfo: memFree=28159868/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=202696 memory=178728 CPUtime=2022.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 178625 0 0 0 202206 19 0 0 20 0 1 0 408407516 207560704 44682 33554432000 4194304 4935366 140725693412528 140725693410280 140590280150915 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 50674 44682 613 181 0 44291 0
Current children cumulated CPU time: 2022.25 s
Current children cumulated vsize: 202696 KiB
Current children cumulated memory: 178728 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 28643
/proc/meminfo: memFree=28145736/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=205676 memory=181792 CPUtime=2082.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 181807 0 0 0 208205 20 0 0 20 0 1 0 408407516 210612224 45448 33554432000 4194304 4935366 140725693412528 140725693410280 4483885 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 51419 45448 613 181 0 45036 0
Current children cumulated CPU time: 2082.25 s
Current children cumulated vsize: 205676 KiB
Current children cumulated memory: 181792 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 28648
/proc/meminfo: memFree=28134480/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=205936 memory=182272 CPUtime=2142.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 183249 0 0 0 214205 20 0 0 20 0 1 0 408407516 210878464 45568 33554432000 4194304 4935366 140725693412528 140725693410216 4382288 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 51484 45568 613 181 0 45101 0
Current children cumulated CPU time: 2142.25 s
Current children cumulated vsize: 205936 KiB
Current children cumulated memory: 182272 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 28652
/proc/meminfo: memFree=28123116/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=208100 memory=184556 CPUtime=2202.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 185324 0 0 0 220205 20 0 0 20 0 1 0 408407516 213094400 46139 33554432000 4194304 4935366 140725693412528 140725693410232 140590281067923 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 52025 46139 613 181 0 45642 0
Current children cumulated CPU time: 2202.25 s
Current children cumulated vsize: 208100 KiB
Current children cumulated memory: 184556 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/199 28658
/proc/meminfo: memFree=28113168/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=211020 memory=187440 CPUtime=2262.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 188231 0 0 0 226204 21 0 0 20 0 1 0 408407516 216084480 46860 33554432000 4194304 4935366 140725693412528 140725693410280 4383054 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 52755 46860 613 181 0 46372 0
Current children cumulated CPU time: 2262.25 s
Current children cumulated vsize: 211020 KiB
Current children cumulated memory: 187440 KiB

[startup+2322.3 s]
/proc/loadavg: 2.04 2.01 2.05 3/199 28663
/proc/meminfo: memFree=28107152/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=212440 memory=188804 CPUtime=2322.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 191392 0 0 0 232204 21 0 0 20 0 1 0 408407516 217538560 47201 33554432000 4194304 4935366 140725693412528 140725693410280 4383800 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 53110 47201 613 181 0 46727 0
Current children cumulated CPU time: 2322.25 s
Current children cumulated vsize: 212440 KiB
Current children cumulated memory: 188804 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 28667
/proc/meminfo: memFree=28100708/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=214908 memory=191276 CPUtime=2382.25 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 195157 0 0 0 238204 21 0 0 20 0 1 0 408407516 220065792 47819 33554432000 4194304 4935366 140725693412528 140725693410280 4513831 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 53727 47819 613 181 0 47344 0
Current children cumulated CPU time: 2382.25 s
Current children cumulated vsize: 214908 KiB
Current children cumulated memory: 191276 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 28670
/proc/meminfo: memFree=28097464/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=216096 memory=192300 CPUtime=2400.05 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 199141 0 0 0 239984 21 0 0 20 0 1 0 408407516 221282304 48075 33554432000 4194304 4935366 140725693412528 140725693410232 140590286333094 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 54024 48075 613 181 0 47641 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 216096 KiB
Current children cumulated memory: 192300 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 28362 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.85 s, system=0.218999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 28670
/proc/meminfo: memFree=28097464/32770624 swapFree=67004752/67108860
[pid=28362] ppid=28359 vsize=216096 memory=192300 CPUtime=2400.05 cores=1,3,5,7
/proc/28362/stat : 28362 (nacre_mini_rele) R 28359 28362 11220 0 -1 4202496 199141 0 0 0 239984 21 0 0 20 0 1 0 408407516 221282304 48075 33554432000 4194304 4935366 140725693412528 140725693410232 140590286333094 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35414016 140725693416449 140725693416549 140725693416549 140725693419458 0
/proc/28362/statm: 54024 48075 613 181 0 47641 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 216096 KiB
Current children cumulated memory: 192300 KiB

Child status: 0
Real time (s): 2400.11
CPU time (s): 2400.07
CPU user time (s): 2399.85
CPU system time (s): 0.218999
CPU usage (%): 99.9982
Max. virtual memory (cumulated for all children) (KiB): 216096
Max. memory (cumulated for all children) (KiB): 192300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.85
system time used= 0.218999
maximum resident set size= 192504
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 199184
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 55
involuntary context switches= 1423


# summary of solver processes directly reported to runsolver:
#   pid: 28362
#   total CPU time (s): 2400.07
#   total CPU user time (s): 2399.85
#   total CPU system time (s): 0.218999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.35624 second user time and 16.1818 second system time

The end

Launcher Data 

Begin job on node126 at 2019-09-12 22:49:19
IDJOB=4391436
IDBENCH=141167
IDSOLVER=2834
FILE ID=node126/4391436-1568321397
RUNJOBID= node126-1568301555-23462
PBS_JOBID= 21701113
Free space on /tmp= 55384 MiB

SOLVER NAME= NACRE 1.0.5-Hybrid
BENCH NAME= XCSP18/GracefulGraph/GracefulGraph-K04-P04_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391436-1568321397/watcher-4391436-1568321397 -o /tmp/evaluation-result-4391436-1568321397/solver-4391436-1568321397 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568301555-23462 --watchdog 2560  nacre_mini_release HOME/instance-4391436-1568321397.xml -ca -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bba9b3428f0c8228a4e28ff2342631fb
RANDOM SEED=492964989

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24851632 kB
MemAvailable:   28017328 kB
Buffers:          116620 kB
Cached:          3299684 kB
SwapCached:         2860 kB
Active:          5672040 kB
Inactive:        1592140 kB
Active(anon):    3845892 kB
Inactive(anon):    43292 kB
Active(file):    1826148 kB
Inactive(file):  1548848 kB
Unevictable:      109112 kB
Mlocked:          109112 kB
SwapTotal:      67108860 kB
SwapFree:       67004752 kB
Dirty:               788 kB
Writeback:             0 kB
AnonPages:       3955676 kB
Mapped:            44352 kB
Shmem:             32816 kB
Slab:             242696 kB
SReclaimable:     213072 kB
SUnreclaim:        29624 kB
KernelStack:        3552 kB
PageTables:        13148 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    4369988 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    362496 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 55384 MiB
End job on node126 at 2019-09-12 23:29:20