Trace number 4267500

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco-mini 1.12? (TO) 2400.1001 2400.1101

General information on the benchmark

NameWwtpp/Wwtpp-ord-s1/
Wwtpp-ord-ex05480.xml
MD5SUMc9499957e3a18a7800afc05acf28f8ff
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables476
Number of constraints402
Number of domains22
Minimum domain size1
Maximum domain size10001
Distribution of domain sizes[{"size":1,"count":22},{"size":2,"count":92},{"size":1001,"count":46},{"size":1501,"count":46},{"size":2501,"count":46},{"size":3001,"count":46},{"size":5001,"count":88},{"size":10001,"count":90}]
Minimum variable degree1
Maximum variable degree3
Distribution of variable degrees[{"degree":1,"count":16},{"degree":2,"count":29},{"degree":3,"count":431}]
Minimum constraint arity2
Maximum constraint arity24
Distribution of constraint arities[{"arity":2,"count":189},{"arity":3,"count":96},{"arity":4,"count":90},{"arity":10,"count":4},{"arity":11,"count":7},{"arity":12,"count":7},{"arity":13,"count":5},{"arity":14,"count":2},{"arity":23,"count":1},{"arity":24,"count":1}]
Number of extensional constraints192
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":192},{"type":"sum","count":210}]
Optimization problemNO
Type of objective

Solver Data 

0.60/0.65	c root propagations     : 789934      
0.60/0.65	c restarts enabled, print stats at every restarts
0.60/0.65	c
0.60/0.65	c
0.60/0.65	c
0.60/0.65	c This is cosoco 1.12 --  
0.60/0.65	c
0.60/0.65	c command line: cosoco -lc -model -restarts HOME/instance-4267500-1502618563.xml 
0.60/0.65	c ========================================[ Problem Statistics ]===========================================
0.60/0.65	c |                                                                                                       
0.60/0.65	c |  Parse time        :         0.21 s 
0.60/0.65	c |
0.60/0.65	c |               Variables: 476
0.60/0.65	c |            Domain Sizes: 1..10001
0.60/0.65	c |
0.60/0.65	c |             Constraints: 402
0.60/0.65	c |                   Arity: 2..24  -- Binary: 189  -- Ternary: 96
0.60/0.65	c | 
0.60/0.65	c |                   Types: 
0.60/0.65	c |                          Extension: 192  (nb tuples: 1..20001) -- (shared: 166)
0.60/0.65	c |                          Sum: 210
0.60/0.65	c |                          
0.60/0.65	c =========================================================================================================
0.60/0.65	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
1.49/1.52	c 101            477            4788           3095636        254            0              168   369   340
2.09/2.15	c 211            932            9842           5009861        254            0              3   346   314  
3.99/4.04	c 332            1761           18604          11377855       254            0              3   416   376  
4.58/4.65	c 465            2261           23106          14364525       254            0              12   358   338 
7.28/7.33	c 611            3036           35393          23493689       254            0              11   371   348 
9.29/9.30	c 771            4141           55139          37749210       254            0              5   384   329  
11.48/11.55	c 947            4858           66901          44289143       254            0              17   366   334 
14.00/14.06	c 1140           5793           81696          53384893       254            0              15   388   335 
14.79/14.81	c 1352           6366           87283          57025371       254            0              16   340   316 
18.59/18.60	c 1585           7377           116971         71396613       254            0              19   383   339 
19.99/20.01	c 1841           8201           126638         77612187       254            0              21   373   321 
20.29/20.32	c 2122           8833           131877         80422224       254            0              11   332   309 
21.29/21.32	c 2431           9437           140287         87742487       254            0              22   58   35   
21.69/21.72	c 2770           9776           144015         95594896       254            0              1   1   0      
22.19/22.24	c 3142           10148          148107         103413592      254            0              1   1   0      
22.99/23.05	c 3551           10557          152724         111774006      256            0              1   1   0      
24.58/24.63	c 4000           11006          158750         122372185      256            0              1   1   0      
29.18/29.23	c 4493           11499          166483         133914475      256            0              1   1   0      
36.19/36.21	c 5035           12127          198848         146469528      256            0              1   36   6     
38.79/38.84	c 5631           12723          235413         179983461      258            0              1   1   0      
41.89/41.99	c 6286           13813          279971         212779871      258            0              1   69   21    
46.19/46.22	c 7006           14888          362051         240792647      258            0              12   258   87  
46.89/46.97	c 7798           15721          371769         249453037      258            0              14   41   34   
50.99/51.02	c 8669           16904          430237         318333652      258            0              5   72   43    
54.29/54.33	c 9627           18099          492616         352855324      258            0              4   72   71    
68.59/68.69	c 10680          20488          645065         395130752      258            0              4   409   225  
72.89/72.93	c 11838          21921          740113         419248774      258            0              4   80   77    
77.59/77.65	c 13111          23366          852654         465485835      258            0              7   74   72    
92.39/92.50	c 14511          25158          1041181        549771591      258            0              5   337   235  
107.99/108.02	c 16051          30171          1137809        599545219      258            0              5   83   71    
122.18/122.21	c 17745          36447          1237465        641660964      258            0              5   75   58    
136.19/136.27	c 19608          38704          1400118        693463470      258            0              5   339   261  
140.59/140.60	c 21657          41133          1514477        737551413      258            0              5   59   58    
154.39/154.48	c 23910          43997          1662970        775336582      258            0              5   358   275  
181.39/181.41	c 26388          57575          1827394        846531523      258            0              5   74   72    
197.10/197.11	c 29113          63633          2042862        949987845      258            0              5   57   51    
212.58/212.60	c 32110          69347          2327383        1070943887     258            0              6   52   49    
229.69/229.76	c 35406          73284          2519253        1179208821     258            0              5   293   253  
271.09/271.11	c 39031          85854          2906140        1460276395     258            0              6   57   55    
281.18/281.24	c 43018          91621          3069400        1589425280     258            0              7   63   28    
293.77/293.82	c 47403          100023         3410719        1747249246     258            0              7   62   59    
305.27/305.35	c 52226          105000         3586071        1845895284     258            0              6   101   97   
322.77/322.84	c 57531          110404         4120315        2017654586     258            0              7   48   47    
371.08/371.14	c 63366          132250         4673351        2330656193     258            0              7   137   122  
391.87/391.90	c 69784          138943         5288597        2518608685     258            0              7   51   49    
410.17/410.20	c 76843          146556         5555300        2825718030     258            0              7   147   141  
431.27/431.32	c 84607          154545         6173434        3029225272     258            0              7   50   48    
571.47/571.52	c 93147          181733         10689686       3424311873     258            0              7   155   139  
598.17/598.21	c 102541         191423         11477040       3674064495     258            0              8   49   46    
633.57/633.62	c 112874         204513         12150612       3951485490     258            0              8   98   90    
664.77/664.87	c 124240         216261         13081154       4241165386     258            0              8   47   45    
758.78/758.85	c 136742         258936         15276073       4818540189     258            0              8   117   102  
789.58/789.62	c 150494         273117         15806939       5115827882     258            0              19   67   48   
891.58/891.68	c 165621         316197         16945801       5951564064     258            0              14   126   113 
924.38/924.44	c 182260         333641         18492292       6305035881     258            0              24   78   72   
1063.68/1063.76	c 200562         379084         20455511       7353901428     258            0              5   118   61   
1167.88/1167.91	c 220694         434050         21999683       8253985419     258            0              14   77   55   
1249.48/1249.55	c 242839         458647         24112890       9056300284     258            0              11   78   71   
1425.99/1426.06	c 267198         512507         26106481       10143682731    258            0              11   128   109 
1525.18/1525.22	c 293992         540350         28876452       10999686389    258            0              17   54   48   
1663.18/1663.27	c 323465         590418         30470932       12003496681    258            0              11   115   74  
1747.38/1747.40	c 355885         623510         33020560       12853805596    258            0              16   57   51   
1856.88/1856.99	c 391547         663736         34455116       14525131898    258            0              10   123   110 
1959.28/1959.33	c 430775         703663         37553804       15551768223    258            0              16   55   50   
2148.28/2148.37	c 473925         774301         40294661       17113813044    258            0              8   126   114  
2265.78/2265.88	c 521390         832867         43725645       18197433750    258            0              16   91   60   
2400.09/2400.10	
2400.09/2400.10	c *** INTERRUPTED ***
2400.09/2400.10	c restarts              : 66          
2400.09/2400.10	c conflicts             : 534986       (223 /sec)
2400.09/2400.10	c decisions             : 881386       (367 /sec)
2400.09/2400.10	c propagations          : 18703485731 (7793258 /sec)
2400.09/2400.10	c root propagations     : 789934      
2400.09/2400.10	c filter calls          : 45430418       (18930 /sec)
2400.09/2400.10	c useless filter calls  : 18309901       (40 %)
2400.09/2400.10	c Memory used           : 213.46 MB
2400.09/2400.10	c CPU time              : 2399.96 s
2400.09/2400.10	
2400.09/2400.10	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15338 MiB free)
  memory of node 1: 16384 MiB (14437 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4267500-1502618563/watcher-4267500-1502618563 -o /tmp/evaluation-result-4267500-1502618563/solver-4267500-1502618563 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502602184-31004 --watchdog 2560 cosoco -lc -model -restarts HOME/instance-4267500-1502618563.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=1506, runsolver pid=1503
Current StackSize limit: 8192 KiB


[startup+0.100116 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30361996/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=155068 memory=131500 CPUtime=0.1 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 33101 0 0 0 6 4 0 0 20 0 1 0 94944587 158789632 32875 33554432000 4194304 5748600 140725213479600 140725213476248 139846143417317 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 38767 32875 734 380 0 32185 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 155068 KiB
Current children cumulated memory: 131500 KiB

[startup+0.209472 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30314752/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=202312 memory=178748 CPUtime=0.2 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 45116 0 0 0 15 5 0 0 20 0 1 0 94944587 207167488 44687 33554432000 4194304 5748600 140725213479600 140725213476248 139846143855616 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 50578 44687 734 380 0 43996 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 202312 KiB
Current children cumulated memory: 178748 KiB

[startup+0.309516 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30299128/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=217780 memory=194324 CPUtime=0.31 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 49046 0 0 0 25 6 0 0 20 0 1 0 94944587 223006720 48581 33554432000 4194304 5748600 140725213479600 140725213476248 4878081 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54445 48581 737 380 0 47863 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 217780 KiB
Current children cumulated memory: 194324 KiB

[startup+0.700311 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30298948/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=217780 memory=194324 CPUtime=0.69 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 49059 0 0 0 63 6 0 0 20 0 1 0 94944587 223006720 48581 33554432000 4194304 5748600 140725213479600 140725213476248 5000352 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54445 48581 737 380 0 47863 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 217780 KiB
Current children cumulated memory: 194324 KiB

[startup+1.50033 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30298584/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218308 memory=194852 CPUtime=1.49 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 49166 0 0 0 143 6 0 0 20 0 1 0 94944587 223547392 48713 33554432000 4194304 5748600 140725213479600 140725213476664 5127457 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54577 48713 777 380 0 47995 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 218308 KiB
Current children cumulated memory: 194852 KiB

[startup+3.10942 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30297960/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218308 memory=195040 CPUtime=3.1 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 65288 0 0 0 303 7 0 0 20 0 1 0 94944587 223547392 48760 33554432000 4194304 5748600 140725213479600 140725213477000 4878081 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54577 48760 779 380 0 47995 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 218308 KiB
Current children cumulated memory: 195040 KiB

[startup+6.3003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30298156/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218440 memory=195124 CPUtime=6.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 81595 0 0 0 621 7 0 0 20 0 1 0 94944587 223682560 48781 33554432000 4194304 5748600 140725213479600 140725213477000 4878064 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54610 48781 779 380 0 48028 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 218440 KiB
Current children cumulated memory: 195124 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30297976/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218440 memory=195152 CPUtime=12.68 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 97864 0 0 0 1260 8 0 0 20 0 1 0 94944587 223682560 48788 33554432000 4194304 5748600 140725213479600 140725213477000 4878152 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54610 48788 779 380 0 48028 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 218440 KiB
Current children cumulated memory: 195152 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30298248/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218440 memory=195160 CPUtime=25.48 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 118362 0 0 0 2539 9 0 0 20 0 1 0 94944587 223682560 48790 33554432000 4194304 5748600 140725213479600 140725213477000 4878147 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54610 48790 779 380 0 48028 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 218440 KiB
Current children cumulated memory: 195160 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1507
/proc/meminfo: memFree=30298456/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218440 memory=195164 CPUtime=51.09 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 138923 0 0 0 5099 10 0 0 20 0 1 0 94944587 223682560 48791 33554432000 4194304 5748600 140725213479600 140725213477000 4878081 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54610 48791 779 380 0 48028 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 218440 KiB
Current children cumulated memory: 195164 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1515
/proc/meminfo: memFree=30297188/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195200 CPUtime=102.29 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 157765 0 0 0 10218 11 0 0 20 0 1 0 94944587 223830016 48800 33554432000 4194304 5748600 140725213479600 140725213477000 4878152 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48800 779 380 0 48064 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195200 KiB

[startup+162.3 s]
/proc/loadavg: 2.49 2.16 2.09 3/187 1516
/proc/meminfo: memFree=30297636/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195208 CPUtime=162.29 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 174112 0 0 0 16217 12 0 0 20 0 1 0 94944587 223830016 48802 33554432000 4194304 5748600 140725213479600 140725213477000 4878152 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48802 779 380 0 48064 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195208 KiB

[startup+222.3 s]
/proc/loadavg: 2.47 2.23 2.13 3/187 1517
/proc/meminfo: memFree=30296072/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195216 CPUtime=222.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 190254 0 0 0 22216 12 0 0 20 0 1 0 94944587 223830016 48804 33554432000 4194304 5748600 140725213479600 140725213477000 4878081 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48804 779 380 0 48064 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195216 KiB

[startup+282.3 s]
/proc/loadavg: 2.17 2.19 2.12 3/187 1518
/proc/meminfo: memFree=30296372/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195216 CPUtime=282.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 205243 0 0 0 28215 13 0 0 20 0 1 0 94944587 223830016 48804 33554432000 4194304 5748600 140725213479600 140725213477000 4949752 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48804 779 380 0 48064 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195216 KiB

[startup+342.3 s]
/proc/loadavg: 2.06 2.16 2.11 3/187 1519
/proc/meminfo: memFree=30297356/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195244 CPUtime=342.27 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 206464 0 0 0 34214 13 0 0 20 0 1 0 94944587 223830016 48811 33554432000 4194304 5748600 140725213479600 140725213477000 5127563 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48811 779 380 0 48064 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195244 KiB

[startup+402.3 s]
/proc/loadavg: 2.02 2.13 2.11 3/187 1521
/proc/meminfo: memFree=30297712/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195244 CPUtime=402.27 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 207074 0 0 0 40214 13 0 0 20 0 1 0 94944587 223830016 48811 33554432000 4194304 5748600 140725213479600 140725213477000 4941450 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48811 779 380 0 48064 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195244 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.10 2.10 3/187 1522
/proc/meminfo: memFree=30297784/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195244 CPUtime=462.27 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 207688 0 0 0 46214 13 0 0 20 0 1 0 94944587 223830016 48811 33554432000 4194304 5748600 140725213479600 140725213477000 4878143 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48811 779 380 0 48064 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195244 KiB


################
# More data... #
################

/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 1662.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1581
/proc/meminfo: memFree=30297120/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=1722.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 218723 0 0 0 172214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 5000352 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 1722.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 1582
/proc/meminfo: memFree=30297412/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=1782.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 219334 0 0 0 178214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4878081 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 1782.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+1842.3 s]
/proc/loadavg: 1.78 1.97 2.03 2/180 1629
/proc/meminfo: memFree=31530640/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=1842.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 219438 0 0 0 184214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4995497 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 1842.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+1902.3 s]
/proc/loadavg: 1.29 1.79 1.96 2/181 1638
/proc/meminfo: memFree=31531088/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=1902.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 219973 0 0 0 190214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4942481 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 1902.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+1962.3 s]
/proc/loadavg: 1.11 1.65 1.91 2/181 1639
/proc/meminfo: memFree=31531340/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=1962.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 220569 0 0 0 196214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4941434 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 1962.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2022.3 s]
/proc/loadavg: 1.04 1.53 1.85 2/181 1640
/proc/meminfo: memFree=31531840/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2022.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 220705 0 0 0 202214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4949799 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2022.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2082.3 s]
/proc/loadavg: 1.01 1.43 1.80 2/181 1641
/proc/meminfo: memFree=31531956/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2082.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 220899 0 0 0 208214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4878081 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2082.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2142.3 s]
/proc/loadavg: 1.01 1.35 1.75 2/181 1642
/proc/meminfo: memFree=31532216/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2142.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 221176 0 0 0 214214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4878081 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2142.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.29 1.70 2/180 1644
/proc/meminfo: memFree=31532152/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2202.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 222076 0 0 0 220214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4877926 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2202.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.24 1.66 2/180 1645
/proc/meminfo: memFree=31532184/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2262.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 222495 0 0 0 226214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 5000352 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2262.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.19 1.61 2/181 1649
/proc/meminfo: memFree=31532360/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2322.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 223261 0 0 0 232214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4878143 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2322.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.16 1.58 2/181 1651
/proc/meminfo: memFree=31532104/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2382.28 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 223500 0 0 0 238214 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4878152 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2382.28 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 1.00 1.15 1.56 2/181 1651
/proc/meminfo: memFree=31532228/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2400.09 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 223694 0 0 0 239995 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4941424 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2400.09 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 1506 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.96 s, system=0.147 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 1.00 1.15 1.56 2/181 1651
/proc/meminfo: memFree=31532228/32770624 swapFree=67108860/67108860
[pid=1506] ppid=1503 vsize=218584 memory=195276 CPUtime=2400.09 cores=0,2,4,6
/proc/1506/stat : 1506 (cosoco) R 1503 1506 30973 0 -1 4202496 223694 0 0 0 239995 14 0 0 20 0 1 0 94944587 223830016 48819 33554432000 4194304 5748600 140725213479600 140725213477000 4941424 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 7849824 7854664 33722368 140725213488319 140725213488414 140725213488414 140725213491150 0
/proc/1506/statm: 54646 48819 779 380 0 48064 0
Current children cumulated CPU time: 2400.09 s
Current children cumulated vsize: 218584 KiB
Current children cumulated memory: 195276 KiB

Child status: 1
Real time (s): 2400.11
CPU time (s): 2400.1
CPU user time (s): 2399.96
CPU system time (s): 0.147
CPU usage (%): 99.9997
Max. virtual memory (cumulated for all children) (KiB): 218584
Max. memory (cumulated for all children) (KiB): 195276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.96
system time used= 0.147
maximum resident set size= 195348
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 223747
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21
involuntary context switches= 831


# summary of solver processes directly reported to runsolver:
#   pid: 1506
#   total CPU time (s): 2400.1
#   total CPU user time (s): 2399.96
#   total CPU system time (s): 0.147

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.6206 second user time and 17.2131 second system time

The end

Launcher Data 

Begin job on node103 at 2017-08-13 11:48:25
IDJOB=4267500
IDBENCH=140774
IDSOLVER=2657
FILE ID=node103/4267500-1502618563
RUNJOBID= node103-1502602184-31004
PBS_JOBID= 20628296
Free space on /tmp= 61792 MiB

SOLVER NAME= cosoco-mini 1.12
BENCH NAME= XCSP17/Wwtpp/Wwtpp-ord-s1/Wwtpp-ord-ex05480.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4267500-1502618563/watcher-4267500-1502618563 -o /tmp/evaluation-result-4267500-1502618563/solver-4267500-1502618563 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502602184-31004 --watchdog 2560  cosoco -lc -model -restarts HOME/instance-4267500-1502618563.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c9499957e3a18a7800afc05acf28f8ff
RANDOM SEED=1509336255

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30490696 kB
MemAvailable:   30765308 kB
Buffers:           89852 kB
Cached:           479724 kB
SwapCached:            0 kB
Active:          1718492 kB
Inactive:         133848 kB
Active(anon):    1232096 kB
Inactive(anon):    78704 kB
Active(file):     486396 kB
Inactive(file):    55144 kB
Unevictable:        6412 kB
Mlocked:            6412 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2728 kB
Writeback:             0 kB
AnonPages:       1288856 kB
Mapped:            45032 kB
Shmem:             25228 kB
Slab:             123492 kB
SReclaimable:      97816 kB
SUnreclaim:        25676 kB
KernelStack:        3264 kB
PageTables:         7476 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1578908 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    913408 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61792 MiB
End job on node103 at 2017-08-13 12:28:25