Trace number 4389617

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2519.86 2520.01

General information on the benchmark

NameMagicHexagon/MagicHexagon-m1-s1/
MagicHexagon-06-0021.xml
MD5SUM5b025fdb2af725278bd5449402283f43
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark50.8929
Satisfiable
(Un)Satisfiability was proved
Number of variables121
Number of constraints40
Number of domains1
Minimum domain size91
Maximum domain size91
Distribution of domain sizes[{"size":91,"count":91}]
Minimum variable degree0
Maximum variable degree9
Distribution of variable degrees[{"degree":0,"count":30},{"degree":4,"count":85},{"degree":5,"count":3},{"degree":6,"count":2},{"degree":9,"count":1}]
Minimum constraint arity2
Maximum constraint arity91
Distribution of constraint arities[{"arity":2,"count":6},{"arity":6,"count":6},{"arity":7,"count":6},{"arity":8,"count":6},{"arity":9,"count":6},{"arity":10,"count":6},{"arity":11,"count":3},{"arity":91,"count":1}]
Number of extensional constraints0
Number of intensional constraints6
Distribution of constraint types[{"type":"intension","count":6},{"type":"allDifferent","count":1},{"type":"sum","count":33}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c root propagations     : 9           
0.00/0.00	c restarts enabled, print stats at every restarts
0.00/0.00	c
0.00/0.00	c
0.00/0.00	c
0.00/0.00	c This is cosoco 2.00 --  
0.00/0.00	c
0.00/0.00	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389617-1568341391.xml 
0.00/0.00	c ========================================[ Problem Statistics ]===========================================
0.00/0.00	c |                                                                                                       
0.00/0.00	c |  Parse time        :         0.01 s 
0.00/0.00	c |
0.00/0.00	c |               Variables: 121
0.00/0.00	c |            Domain Sizes: 91..91
0.00/0.00	c |
0.00/0.00	c |             Constraints: 40
0.00/0.00	c |                   Arity: 2..91  -- Binary: 6
0.00/0.00	c | 
0.00/0.00	c |                   Types: 
0.00/0.00	c |                          (X - Y < k): 6
0.00/0.00	c |                          All Different: 1
0.00/0.00	c |                          Sum: 33
0.00/0.00	c |                          
0.00/0.00	c =========================================================================================================
0.00/0.00	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.00	c remove useless variable x[0][6]
0.00/0.00	c remove useless variable x[0][7]
0.00/0.00	c remove useless variable x[0][8]
0.00/0.00	c remove useless variable x[0][9]
0.00/0.00	c remove useless variable x[0][10]
0.00/0.00	c remove useless variable x[1][7]
0.00/0.00	c remove useless variable x[1][8]
0.00/0.00	c remove useless variable x[1][9]
0.00/0.00	c remove useless variable x[1][10]
0.00/0.00	c remove useless variable x[2][8]
0.00/0.00	c remove useless variable x[2][9]
0.00/0.00	c remove useless variable x[2][10]
0.00/0.00	c remove useless variable x[3][9]
0.00/0.00	c remove useless variable x[3][10]
0.00/0.00	c remove useless variable x[4][10]
0.00/0.00	c remove useless variable x[6][10]
0.00/0.00	c remove useless variable x[7][9]
0.00/0.00	c remove useless variable x[7][10]
0.00/0.00	c remove useless variable x[8][8]
0.00/0.00	c remove useless variable x[8][9]
0.00/0.00	c remove useless variable x[8][10]
0.00/0.00	c remove useless variable x[9][7]
0.00/0.00	c remove useless variable x[9][8]
0.00/0.00	c remove useless variable x[9][9]
0.00/0.00	c remove useless variable x[9][10]
0.00/0.00	c remove useless variable x[10][6]
0.00/0.00	c remove useless variable x[10][7]
0.00/0.00	c remove useless variable x[10][8]
0.00/0.00	c remove useless variable x[10][9]
0.00/0.00	c remove useless variable x[10][10]
0.00/0.02	c 101            141            2381           19408          6              0              2   14   10    
0.00/0.03	c 211            291            4466           51016          6              0              5   11   9     
0.00/0.04	c 332            471            7382           73829          6              0              2   28   19    
0.00/0.06	c 465            648            10358          101169         6              0              5   12   9     
0.00/0.10	c 611            857            15431          180579         6              0              4   11   7     
0.10/0.12	c 771            1086           19168          214832         6              0              4   16   14    
0.10/0.14	c 947            1312           22479          254759         6              0              4   11   9     
0.10/0.16	c 1140           1560           25717          289704         6              0              5   11   10    
0.10/0.18	c 1352           1832           29814          337206         6              0              4   11   9     
0.21/0.23	c 1585           2163           35007          418390         6              0              9   12   10    
0.21/0.26	c 1841           2491           39956          477099         6              0              4   11   9     
0.21/0.31	c 2122           2881           46033          579933         6              0              9   12   10    
0.31/0.35	c 2431           3275           51870          648267         6              0              4   11   9     
0.31/0.41	c 2770           3750           59535          774212         6              0              6   12   10    
0.41/0.45	c 3142           4231           67889          865267         6              0              3   11   9     
0.41/0.50	c 3551           4747           75518          956250         6              0              4   11   9     
0.51/0.55	c 4000           5311           82851          1037389        6              0              5   12   10    
0.51/0.60	c 4493           5943           92121          1134599        6              0              4   12   9     
0.60/0.65	c 5035           6597           99886          1230492        6              0              8   15   14    
0.69/0.72	c 5631           7343           110705         1355829        6              0              4   11   10    
0.69/0.78	c 6286           8136           120536         1481296        6              0              8   16   14    
0.79/0.87	c 7006           9199           138589         1619414        6              0              5   53   24    
0.89/0.98	c 7798           10223          152417         1813288        6              0              5   12   10    
1.00/1.06	c 8669           11309          166316         1970285        6              0              5   12   10    
1.10/1.18	c 9627           12687          185927         2216455        6              0              6   14   12    
1.29/1.36	c 10680          14013          228578         2526278        6              0              2   46   42    
1.49/1.51	c 11838          15456          250053         2776260        6              0              5   12   10    
1.59/1.64	c 13111          17071          272160         2982515        6              0              6   12   11    
1.79/1.86	c 14511          18960          306455         3486912        6              0              6   13   10    
2.00/2.10	c 16051          21023          338394         3942088        6              0              6   19   14    
2.29/2.31	c 17745          23444          373470         4322421        6              0              5   14   12    
2.39/2.45	c 19608          25685          399220         4653494        6              0              7   14   13    
2.59/2.62	c 21657          28027          423866         5252977        6              0              11   16   14   
2.79/2.80	c 23910          30896          459076         5605038        6              0              9   14   12    
2.89/2.98	c 26388          33812          491430         6029413        6              0              7   14   13    
3.19/3.24	c 29113          36973          526176         6956911        6              0              7   16   14    
3.49/3.59	c 32110          41125          578800         7654136        6              0              8   14   12    
3.79/3.83	c 35406          44985          618761         8259856        6              0              9   14   13    
4.19/4.28	c 39031          50142          691080         9076421        6              0              5   14   12    
4.59/4.67	c 43018          55531          767567         9732950        6              0              6   48   36    
5.00/5.02	c 47403          60660          822444         10543339       6              0              8   15   14    
5.69/5.74	c 52226          67719          944219         12048156       6              0              8   14   11    
6.39/6.46	c 57531          76534          1069413        13335266       6              0              4   50   32    
7.19/7.22	c 63366          85589          1207336        14995708       6              0              6   48   41    
7.89/7.96	c 69784          95822          1334614        16326234       6              0              6   29   26    
8.89/8.97	c 76843          105385         1495184        18333418       6              0              4   12   10    
9.89/9.96	c 84607          118020         1677881        19867767       6              0              4   50   33    
10.89/10.91	c 93147          132615         1857482        21116683       6              0              5   29   25    
11.59/11.64	c 102541         144062         1984975        22732670       6              0              7   15   14    
12.69/12.72	c 112874         158765         2176462        24798652       6              0              5   14   13    
13.79/13.87	c 124240         175323         2413187        26774155       6              0              9   57   45    
15.79/15.87	c 136742         192308         2895112        29772077       6              0              10   49   42   
17.49/17.55	c 150494         210268         3310770        32883780       6              0              9   57   46    
18.89/18.91	c 165621         228981         3517827        36243291       6              0              8   16   14    
20.89/20.91	c 182260         252976         3850615        40366134       6              0              6   14   12    
24.00/24.06	c 200562         278372         4540163        46356616       6              0              10   59   49   
27.19/27.21	c 220694         308523         5383513        50502260       6              0              6   64   55    
30.68/30.75	c 242839         342194         6179417        55283683       6              0              9   59   51    
35.68/35.77	c 267198         377386         7420976        62184008       6              0              9   64   57    
39.78/39.86	c 293992         416197         8489085        67858759       6              0              9   67   59    
44.28/44.39	c 323465         460273         9466135        74351177       6              0              9   64   57    
51.58/51.65	c 355885         508032         11027112       85225569       6              0              9   63   58    
54.48/54.52	c 391547         555330         11661443       89582678       6              0              7   51   47    
59.99/60.04	c 430775         607744         13071416       97655256       6              0              7   58   51    
65.57/65.63	c 473925         672751         14510854       107767800      6              0              7   57   54    
75.87/75.95	c 521390         742035         16679961       127071475      6              0              7   60   55    
87.87/87.99	c 573601         816688         19460780       144830517      6              0              8   58   53    
103.76/103.82	c 631033         913565         22847722       167505851      6              0              8   56   53    
117.97/118.01	c 694208         1015945        25896040       190164092      6              0              12   66   60   
129.36/129.40	c 763700         1121691        28245855       210098191      6              0              10   58   55   
156.15/156.27	c 840141         1234270        33457306       259133752      6              0              13   60   56   
181.74/181.88	c 924226         1361468        38701907       295062390      6              0              12   62   57   
195.84/195.99	c 1016719        1518832        41777483       312252674      6              0              11   58   51   
213.04/213.13	c 1118461        1670440        45388713       337470073      6              0              11   62   57   
241.23/241.38	c 1230377        1880971        51642999       373640903      6              0              11   63   57   
271.62/271.71	c 1353484        2093291        58406635       426628702      6              0              12   55   52   
305.81/306.00	c 1488901        2288601        65648203       477084375      6              0              13   62   58   
341.70/341.81	c 1637859        2504355        72584109       547856164      6              0              13   67   63   
374.49/374.67	c 1801712        2758942        79339122       598671957      6              0              13   73   64   
392.68/392.84	c 1981950        2992084        82802636       633502345      6              0              15   52   47   
405.78/405.98	c 2180211        3234575        85422088       666630785      6              0              11   52   50   
422.57/422.72	c 2398298        3502045        88630701       700080494      6              0              13   55   54   
455.76/455.96	c 2638193        3834927        95280913       763378104      6              0              11   67   62   
506.55/506.73	c 2902077        4223309        105074298      855697565      6              0              11   68   62   
565.84/566.06	c 3192349        4634525        117644448      955085438      6              0              23   64   59   
621.83/622.05	c 3511648        5082000        130241486      1050636640     6              0              24   63   59   
705.12/705.39	c 3862876        5685726        146303796      1172278463     6              0              13   52   49   
764.02/764.24	c 4249226        6269521        159380824      1279451669     6              0              8   61   58    
892.52/892.70	c 4674211        6838970        184594875      1524192359     6              0              8   61   57    
932.42/932.67	c 5141694        7422217        193028853      1589221322     6              0              9   54   52    
1030.72/1030.90	c 5655925        8259139        212970970      1734272001     6              0              9   68   61    
1217.02/1217.24	c 6221579        9043544        249685920      2090883248     6              0              14   64   59   
1292.52/1292.74	c 6843798        9949643        263111092      2223330330     6              0              11   44   38   
1396.03/1396.27	c 7528238        10978439       285895201      2419587002     6              0              8   62   58    
1523.03/1523.29	c 8281122        12105039       315347033      2608038566     6              0              11   64   57   
1624.23/1624.43	c 9109294        13196208       336624830      2778153132     6              0              11   64   59   
1738.84/1739.06	c 10020283       14498276       359727005      3025939521     6              0              4   58   49    
1997.73/1998.00	c 11022370       15759303       407324607      3643562931     6              0              8   57   50    
2201.73/2201.91	c 12124665       17324413       448451400      4010746829     6              0              10   66   58   
2519.85/2520.01	
2519.85/2520.01	c *** INTERRUPTED ***
2519.85/2520.01	c restarts              : 99          
2519.85/2520.01	c conflicts             : 12960322     (5143 /sec)
2519.85/2520.01	c decisions             : 18559548     (7365 /sec)
2519.85/2520.01	c propagations          : 4639238940  (1841075 /sec)
2519.85/2520.01	c root propagations     : 9           
2519.85/2520.01	c filter calls          : 506406089      (200966 /sec)
2519.85/2520.01	c useless filter calls  : 296761092      (58 %)
2519.85/2520.01	c Memory used           : 26.85 MB
2519.85/2520.01	c CPU time              : 2519.85 s
2519.85/2520.01	c real time             : 2520.01 s
2519.85/2520.01	
2519.85/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13579 MiB free)
  memory of node 1: 16384 MiB (13599 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389617-1568341391/watcher-4389617-1568341391 -o /tmp/evaluation-result-4389617-1568341391/solver-4389617-1568341391 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9509 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389617-1568341391.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=16786, runsolver pid=16783
Current StackSize limit: 8192 KiB


[startup+0.100154 s]*
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27831176/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=3924 CPUtime=0.1 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1191 0 0 0 10 0 0 0 20 0 1 0 410145406 28147712 981 33554432000 4194304 6210612 140723248842528 140723248839064 5192912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 981 845 493 0 177 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 3924 KiB

[startup+0.210484 s]*
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830896/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=3924 CPUtime=0.21 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1191 0 0 0 21 0 0 0 20 0 1 0 410145406 28147712 981 33554432000 4194304 6210612 140723248842528 140723248840488 5078384 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 981 845 493 0 177 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 3924 KiB

[startup+0.31008 s]*
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830896/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=3924 CPUtime=0.31 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1191 0 0 0 31 0 0 0 20 0 1 0 410145406 28147712 981 33554432000 4194304 6210612 140723248842528 140723248840488 5078496 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 981 845 493 0 177 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 3924 KiB

[startup+0.700288 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830896/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=3924 CPUtime=0.69 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1191 0 0 0 69 0 0 0 20 0 1 0 410145406 28147712 981 33554432000 4194304 6210612 140723248842528 140723248840488 5078695 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 981 845 493 0 177 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 3924 KiB

[startup+1.5003 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830580/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=3924 CPUtime=1.49 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1194 0 0 0 149 0 0 0 20 0 1 0 410145406 28147712 981 33554432000 4194304 6210612 140723248842528 140723248840488 5081842 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 981 845 493 0 177 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 3924 KiB

[startup+3.11023 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830272/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4128 CPUtime=3.1 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1275 0 0 0 310 0 0 0 20 0 1 0 410145406 28147712 1032 33554432000 4194304 6210612 140723248842528 140723248840488 5082021 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1032 887 493 0 177 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4128 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830136/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4128 CPUtime=6.29 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1357 0 0 0 629 0 0 0 20 0 1 0 410145406 28147712 1032 33554432000 4194304 6210612 140723248842528 140723248840488 5075219 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1032 887 493 0 177 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4128 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 16787
/proc/meminfo: memFree=27830476/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4128 CPUtime=12.69 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1439 0 0 0 1269 0 0 0 20 0 1 0 410145406 28147712 1032 33554432000 4194304 6210612 140723248842528 140723248840488 5192912 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1032 887 493 0 177 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4128 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.06 2.07 3/200 16789
/proc/meminfo: memFree=27830360/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=25.49 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1609 0 0 0 2549 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5149280 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+51.1102 s]
/proc/loadavg: 2.00 2.05 2.07 3/200 16789
/proc/meminfo: memFree=27830700/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=51.09 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1695 0 0 0 5109 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5185930 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/199 16793
/proc/meminfo: memFree=27831272/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=102.26 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1779 0 0 0 10226 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5148330 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 16800
/proc/meminfo: memFree=27830216/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=162.25 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1865 0 0 0 16225 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5080837 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 16804
/proc/meminfo: memFree=27830392/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=222.23 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 1950 0 0 0 22223 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5076066 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/200 16808
/proc/meminfo: memFree=27830372/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=282.21 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 2035 0 0 0 28221 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5080969 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 16814
/proc/meminfo: memFree=27830112/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=342.2 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 2119 0 0 0 34220 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5076066 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 342.2 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/200 16825
/proc/meminfo: memFree=27830020/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=402.18 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 2203 0 0 0 40218 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5078992 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 16829
/proc/meminfo: memFree=27829736/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=462.16 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 2286 0 0 0 46216 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5149332 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 462.16 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB


################
# More data... #
################

/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 1722.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+1782.3 s]
/proc/loadavg: 1.98 1.99 2.03 3/200 17121
/proc/meminfo: memFree=27822984/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=1782.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4008 0 0 0 178213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5079064 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 1782.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+1842.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/201 17126
/proc/meminfo: memFree=27823264/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=1842.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4085 0 0 0 184213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5074199 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 1842.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17130
/proc/meminfo: memFree=27823288/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=1902.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4156 0 0 0 190213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5082070 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 1902.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17136
/proc/meminfo: memFree=27823604/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=1962.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4227 0 0 0 196213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5082051 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 1962.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17140
/proc/meminfo: memFree=27823116/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2022.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4311 0 0 0 202213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5080981 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2022.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17144
/proc/meminfo: memFree=27822532/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2082.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4375 0 0 0 208213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5192880 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2082.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/199 17150
/proc/meminfo: memFree=27821608/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2142.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4438 0 0 0 214213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5078380 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2142.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 17162
/proc/meminfo: memFree=27821696/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2202.13 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4522 0 0 0 220213 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5080961 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2202.13 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2262.3 s]
/proc/loadavg: 2.03 2.01 2.04 3/200 17166
/proc/meminfo: memFree=27821752/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2262.14 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4591 0 0 0 226214 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5078408 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2262.14 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.01 2.04 3/200 17172
/proc/meminfo: memFree=27821608/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2322.14 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4660 0 0 0 232214 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5081394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2322.14 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 17176
/proc/meminfo: memFree=27821572/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2382.14 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4729 0 0 0 238214 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5149724 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2382.14 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 17180
/proc/meminfo: memFree=27821432/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2442.14 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4798 0 0 0 244214 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5074853 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2442.14 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 17187
/proc/meminfo: memFree=27821644/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2502.14 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4867 0 0 0 250214 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5078899 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2502.14 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.04 3/199 17187
/proc/meminfo: memFree=27821268/32770688 swapFree=66919992/67108860
[pid=16786] ppid=16783 vsize=27488 memory=4132 CPUtime=2519.85 cores=0-3
/proc/16786/stat : 16786 (cosoco) R 16783 16786 9478 0 -1 4202496 4934 0 0 0 251985 0 0 0 20 0 1 0 410145406 28147712 1033 33554432000 4194304 6210612 140723248842528 140723248840488 5081007 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 39989248 140723248849931 140723248850033 140723248850033 140723248852942 0
/proc/16786/statm: 6872 1033 887 493 0 177 0
Current children cumulated CPU time: 2519.85 s
Current children cumulated vsize: 27488 KiB
Current children cumulated memory: 4132 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 16786 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.85 s, system=0.003999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.86
CPU user time (s): 2519.85
CPU system time (s): 0.003999
CPU usage (%): 99.9939
Max. virtual memory (cumulated for all children) (KiB): 27488
Max. memory (cumulated for all children) (KiB): 4132

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.85
system time used= 0.003999
maximum resident set size= 4200
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4985
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 4300


# summary of solver processes directly reported to runsolver:
#   pid: 16786
#   total CPU time (s): 2519.86
#   total CPU user time (s): 2519.85
#   total CPU system time (s): 0.003999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.6588 second user time and 17.5257 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-14 10:43:33
IDJOB=4389617
IDBENCH=133559
IDSOLVER=2829
FILE ID=node120/4389617-1568341391
RUNJOBID= node120-1323826654-9509
PBS_JOBID= 21701129
Free space on /tmp= 59152 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/MagicHexagon/MagicHexagon-m1-s1/MagicHexagon-06-0021.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389617-1568341391/watcher-4389617-1568341391 -o /tmp/evaluation-result-4389617-1568341391/solver-4389617-1568341391 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9509 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389617-1568341391.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5b025fdb2af725278bd5449402283f43
RANDOM SEED=1977198539

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        27831524 kB
MemAvailable:   31816408 kB
Buffers:          154844 kB
Cached:          4123720 kB
SwapCached:        77548 kB
Active:          1219172 kB
Inactive:        3141932 kB
Active(anon):       3444 kB
Inactive(anon):   128784 kB
Active(file):    1215728 kB
Inactive(file):  3013148 kB
Unevictable:      108228 kB
Mlocked:          108228 kB
SwapTotal:      67108860 kB
SwapFree:       66919992 kB
Dirty:              2780 kB
Writeback:             0 kB
AnonPages:        126952 kB
Mapped:            49112 kB
Shmem:             41008 kB
Slab:             172560 kB
SReclaimable:     143688 kB
SUnreclaim:        28872 kB
KernelStack:        3776 kB
PageTables:         5664 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     545532 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     79872 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 59148 MiB
End job on node120 at 2011-12-14 11:25:34