NetApp Hybrid Aggregate

From Labrats.us
Jump to navigationJump to search

Node 1:

First, we need to get a list of disks on the new shelf we wish to assign to node 1.

netapp-vfiler1::> disk show -shelf 2                                                 
                     Usable           Container                       
Disk                   Size Shelf Bay Type        Position   Aggregate Owner
---------------- ---------- ----- --- ----------- ---------- --------- --------
netapp-vfiler1-01:3a.02.0   -     2   0 unassigned  present    -         -
netapp-vfiler1-01:3a.02.2   -     2   2 unassigned  present    -         -
netapp-vfiler1-01:3a.02.4   -     2   4 unassigned  present    -         -
netapp-vfiler1-01:3a.02.6   -     2   6 unassigned  present    -         -
netapp-vfiler1-01:3a.02.8   -     2   8 unassigned  present    -         -
netapp-vfiler1-01:3a.02.10  -     2  10 unassigned  present    -         -
netapp-vfiler1-01:3a.02.12  -     2  12 unassigned  present    -         -
netapp-vfiler1-01:3a.02.14  -     2  14 unassigned  present    -         -
netapp-vfiler1-01:3a.02.16  -     2  16 unassigned  present    -         -
netapp-vfiler1-01:3a.02.18  -     2  18 unassigned  present    -         -
netapp-vfiler1-01:3a.02.20  -     2  20 unassigned  present    -         -
netapp-vfiler1-01:3a.02.22  -     2  22 unassigned  present    -         -
netapp-vfiler1-01:4b.02.1   -     2   1 unassigned  present    -         -
netapp-vfiler1-01:4b.02.3   -     2   3 unassigned  present    -         -
netapp-vfiler1-01:4b.02.5   -     2   5 unassigned  present    -         -
netapp-vfiler1-01:4b.02.7   -     2   7 unassigned  present    -         -
netapp-vfiler1-01:4b.02.9   -     2   9 unassigned  present    -         -
netapp-vfiler1-01:4b.02.11  -     2  11 unassigned  present    -         -
netapp-vfiler1-01:4b.02.13  -     2  13 unassigned  present    -         -
netapp-vfiler1-01:4b.02.15  -     2  15 unassigned  present    -         -
netapp-vfiler1-01:4b.02.17  -     2  17 unassigned  present    -         -
netapp-vfiler1-01:4b.02.19  -     2  19 unassigned  present    -         -
netapp-vfiler1-01:4b.02.21  -     2  21 unassigned  present    -         -
netapp-vfiler1-01:4b.02.23  -     2  23 unassigned  present    -         -
24 entries were displayed.

Now we can assign the disks to node 1.

netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.0 
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.2
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.4
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.6
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.8
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.10
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.12
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.14
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.16
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.18
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.20
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:3a.02.22
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.1
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.3
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.5
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.7
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.9
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.11
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.13
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.15
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.17
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.19
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.21
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-01 -disk netapp-vfiler1-01:4b.02.23

Now we can see that the disks are assigned to node 1, and show up as "spare" and have their size listed.

netapp-vfiler1::> disk show -shelf 2                                                 
                     Usable           Container                       
Disk                   Size Shelf Bay Type        Position   Aggregate Owner
---------------- ---------- ----- --- ----------- ---------- --------- --------
netapp-vfiler1-01:3a.02.0   
                    186.1GB     2   0 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.2   
                    186.1GB     2   2 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.4   
                    186.1GB     2   4 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.6   
                    186.1GB     2   6 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.8   
                    546.9GB     2   8 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.10  
                    546.9GB     2  10 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.12  
                    546.9GB     2  12 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.14  
                    546.9GB     2  14 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.16  
                    546.9GB     2  16 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.18  
                    546.9GB     2  18 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.20  
                    546.9GB     2  20 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.22  
                    546.9GB     2  22 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.1   
                    186.1GB     2   1 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.3   
                    186.1GB     2   3 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.5   
                    186.1GB     2   5 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.7   
                    186.1GB     2   7 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.9   
                    546.9GB     2   9 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.11  
                    546.9GB     2  11 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.13  
                    546.9GB     2  13 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.15  
                    546.9GB     2  15 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.17  
                    546.9GB     2  17 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.19  
                    546.9GB     2  19 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.21  
                    546.9GB     2  21 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.23  
                    546.9GB     2  23 spare       present    -         netapp-vfiler1-01
24 entries were displayed.

Create the new aggregate. It needs to be 64-bit, but we all the dual_parity option as well. We only assign the spinning media at this time.

netapp-vfiler1::> aggr create -aggregate hybrid_aggr3 -disktype SAS -diskrpm 10000 -diskcount 14 -n netapp-vfiler1-01 -raidtype raid_dp -block-type 64-bit
[Job 10490] Job succeeded: DONE                                                                                  

Change the option on the new aggregate to allow it to become a hybrid aggregate.

netapp-vfiler1::> storage aggregate modify -aggregate hybrid_aggr3 -hybrid-enabled true

Show the volume, noting that it is a hybrid_enables aggregate, and has 14 disks assigned to it.

netapp-vfiler1::> storage aggregate show -aggregate hybrid_aggr3 

                                        Aggregate: hybrid_aggr3
                                             Size: 5.77TB
                                        Used Size: 364KB
                                  Used Percentage: 0%
                                   Available Size: 5.77TB
                                            State: online
                                            Nodes: netapp-vfiler1-01
                                  Number Of Disks: 14
                                   Checksum Style: block
                                            Disks: netapp-vfiler1-01:3a.02.8,
                                                   netapp-vfiler1-01:4b.02.9,
                                                   netapp-vfiler1-01:3a.02.10,
                                                   netapp-vfiler1-01:4b.02.11,
                                                   netapp-vfiler1-01:3a.02.12,
                                                   netapp-vfiler1-01:4b.02.13,
                                                   netapp-vfiler1-01:3a.02.14,
                                                   netapp-vfiler1-01:4b.02.15,
                                                   netapp-vfiler1-01:3a.02.16,
                                                   netapp-vfiler1-01:4b.02.17,
                                                   netapp-vfiler1-01:3a.02.18,
                                                   netapp-vfiler1-01:4b.02.19,
                                                   netapp-vfiler1-01:3a.02.20,
                                                   netapp-vfiler1-01:4b.02.21
                                Number Of Volumes: 0
                                           Plexes: /hybrid_aggr3/plex0(online)
                                      RAID Groups: /hybrid_aggr3/plex0/rg0 (block)
                                        RAID Type: raid_dp
                                    Max RAID Size: 16
                                      RAID Status: raid_dp, hybrid_enabled, normal
                                 Checksum Enabled: true
                                  Checksum Status: active
                                     Inconsistent: false
                                           Hybrid: false
                          Total Hybrid Cache Size: 0B
                      Automatic Snapshot Deletion: on
                                        HA Policy: sfo
                          Free Space Reallocation: off
               Space Reserved for Snapshot Copies: 0%
                                   Hybrid Enabled: true
                                     Volume Style: flex
                                 Has Mroot Volume: false
                    Has Partner Node Mroot Volume: false
                                          Is Root: false
                                       Block Type: 64-bit
     Space Used By metadata for Volume Efficiency: 0B

Add the 6 SSD drives to the hybrid_aggregate. We only add 6, reservice the other two as spares.

netapp-vfiler1::> aggr add-disks -aggregate hybrid_aggr3 -disktype SSD -diskcount 6

Show the aggregate again, noting that there are now 20 disks, however the size has not increased. This shows that this is a hybrig volume, and will use the flash pool for volumes configured on this aggregate.

netapp-vfiler1::> storage aggregate show -aggregate hybrid_aggr3                   

                                        Aggregate: hybrid_aggr3
                                             Size: 5.77TB
                                        Used Size: 388KB
                                  Used Percentage: 0%
                                   Available Size: 5.77TB
                                            State: online
                                            Nodes: netapp-vfiler1-01
                                  Number Of Disks: 20
                                   Checksum Style: block
                                            Disks: netapp-vfiler1-01:3a.02.8,
                                                   netapp-vfiler1-01:4b.02.9,
                                                   netapp-vfiler1-01:3a.02.10,
                                                   netapp-vfiler1-01:4b.02.11,
                                                   netapp-vfiler1-01:3a.02.12,
                                                   netapp-vfiler1-01:4b.02.13,
                                                   netapp-vfiler1-01:3a.02.14,
                                                   netapp-vfiler1-01:4b.02.15,
                                                   netapp-vfiler1-01:3a.02.16,
                                                   netapp-vfiler1-01:4b.02.17,
                                                   netapp-vfiler1-01:3a.02.18,
                                                   netapp-vfiler1-01:4b.02.19,
                                                   netapp-vfiler1-01:3a.02.20,
                                                   netapp-vfiler1-01:4b.02.21,
                                                   netapp-vfiler1-01:3a.02.0,
                                                   netapp-vfiler1-01:4b.02.1,
                                                   netapp-vfiler1-01:3a.02.2,
                                                   netapp-vfiler1-01:4b.02.3,
                                                   netapp-vfiler1-01:3a.02.4,
                                                   netapp-vfiler1-01:4b.02.5
                                Number Of Volumes: 0
                                           Plexes: /hybrid_aggr3/plex0(online)
                                      RAID Groups: /hybrid_aggr3/plex0/rg0 (block)
                                                   /hybrid_aggr3/plex0/rg1 (block)
                                        RAID Type: raid_dp
                                    Max RAID Size: 16
                                      RAID Status: raid_dp, hybrid, normal
                                 Checksum Enabled: true
                                  Checksum Status: active
                                     Inconsistent: false
                                           Hybrid: true
                          Total Hybrid Cache Size: 744.2GB
                      Automatic Snapshot Deletion: on
                                        HA Policy: sfo
                          Free Space Reallocation: off
               Space Reserved for Snapshot Copies: 0%
                                   Hybrid Enabled: true
                                     Volume Style: flex
                                 Has Mroot Volume: false
                    Has Partner Node Mroot Volume: false
                                          Is Root: false
                                       Block Type: 64-bit
     Space Used By metadata for Volume Efficiency: 0B                         

Finally show the disks again on the new sheld, and notice that they are assigned to the new aggregate, excepf for the spares.

netapp-vfiler1::> disk show -shelf 2
                     Usable           Container
Disk                   Size Shelf Bay Type        Position   Aggregate Owner
---------------- ---------- ----- --- ----------- ---------- --------- --------
netapp-vfiler1-01:3a.02.0 
                    186.1GB     2   0 aggregate   dparity    hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.2 
                    186.1GB     2   2 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.4 
                    186.1GB     2   4 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.6 
                    186.1GB     2   6 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:3a.02.8 
                    546.9GB     2   8 aggregate   dparity    hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.10 
                    546.9GB     2  10 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.12 
                    546.9GB     2  12 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.14 
                    546.9GB     2  14 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.16 
                    546.9GB     2  16 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.18 
                    546.9GB     2  18 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.20 
                    546.9GB     2  20 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:3a.02.22 
                    546.9GB     2  22 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.1 
                    186.1GB     2   1 aggregate   parity     hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.3 
                    186.1GB     2   3 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.5 
                    186.1GB     2   5 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.7 
                    186.1GB     2   7 spare       present    -         netapp-vfiler1-01
netapp-vfiler1-01:4b.02.9 
                    546.9GB     2   9 aggregate   parity     hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.11 
                    546.9GB     2  11 aggregate   data       hybrid_aggr3      
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.13 
                    546.9GB     2  13 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.15 
                    546.9GB     2  15 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.17 
                    546.9GB     2  17 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.19 
                    546.9GB     2  19 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.21 
                    546.9GB     2  21 aggregate   data       hybrid_aggr3 
                                                                       netapp-vfiler1-01
netapp-vfiler1-01:4b.02.23 
                    546.9GB     2  23 spare       present    -         netapp-vfiler1-01
24 entries were displayed.

Node 2:

Repeat the above steps on the second node.

netapp-vfiler1::> disk show -shelf 20
                     Usable           Container
Disk                   Size Shelf Bay Type        Position   Aggregate Owner
---------------- ---------- ----- --- ----------- ---------- --------- --------
netapp-vfiler1-01:3d.20.1   -    20   1 unassigned  present    -         -
netapp-vfiler1-01:3d.20.3   -    20   3 unassigned  present    -         -
netapp-vfiler1-01:3d.20.5   -    20   5 unassigned  present    -         -
netapp-vfiler1-01:3d.20.7   -    20   7 unassigned  present    -         -
netapp-vfiler1-01:3d.20.9   -    20   9 unassigned  present    -         -
netapp-vfiler1-01:3d.20.11  -    20  11 unassigned  present    -         -
netapp-vfiler1-01:3d.20.13  -    20  13 unassigned  present    -         -
netapp-vfiler1-01:3d.20.15  -    20  15 unassigned  present    -         -
netapp-vfiler1-01:3d.20.17  -    20  17 unassigned  present    -         -
netapp-vfiler1-01:3d.20.19  -    20  19 unassigned  present    -         -
netapp-vfiler1-01:3d.20.21  -    20  21 unassigned  present    -         -
netapp-vfiler1-01:3d.20.23  -    20  23 unassigned  present    -         -
netapp-vfiler1-01:4c.20.0   -    20   0 unassigned  present    -         -
netapp-vfiler1-01:4c.20.2   -    20   2 unassigned  present    -         -
netapp-vfiler1-01:4c.20.4   -    20   4 unassigned  present    -         -
netapp-vfiler1-01:4c.20.6   -    20   6 unassigned  present    -         -
netapp-vfiler1-01:4c.20.8   -    20   8 unassigned  present    -         -
netapp-vfiler1-01:4c.20.10  -    20  10 unassigned  present    -         -
netapp-vfiler1-01:4c.20.12  -    20  12 unassigned  present    -         -
netapp-vfiler1-01:4c.20.14  -    20  14 unassigned  present    -         -
netapp-vfiler1-01:4c.20.16  -    20  16 unassigned  present    -         -
netapp-vfiler1-01:4c.20.18  -    20  18 unassigned  present    -         -
netapp-vfiler1-01:4c.20.20  -    20  20 unassigned  present    -         -
netapp-vfiler1-01:4c.20.22  -    20  22 unassigned  present    -         -
24 entries were displayed.
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.0
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.2
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.4
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.6
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.8
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.10
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.12
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.14
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.16
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.18
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.20
netapp-vfiler1::> storage disk assign -o netapp-vfiler1-02 -disk netapp-vfiler1-01:4c.20.22
netapp-vfiler1::> disk show -shelf 20
                     Usable           Container                       
Disk                   Size Shelf Bay Type        Position   Aggregate Owner
---------------- ---------- ----- --- ----------- ---------- --------- --------
netapp-vfiler1-02:3d.20.1   
                    186.1GB    20   1 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.3
                    186.1GB    20   3 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.5
                    186.1GB    20   5 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.7   
                    186.1GB    20   7 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.9   
                    546.9GB    20   9 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.11  
                    546.9GB    20  11 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.13  
                    546.9GB    20  13 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.15  
                    546.9GB    20  15 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.17  
                    546.9GB    20  17 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.19  
                    546.9GB    20  19 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.21  
                    546.9GB    20  21 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.23  
                    546.9GB    20  23 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.0   
                    186.1GB    20   0 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.2   
                    186.1GB    20   2 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.4   
                    186.1GB    20   4 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.6   
                    186.1GB    20   6 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.8   
                    546.9GB    20   8 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.10  
                    546.9GB    20  10 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.12  
                    546.9GB    20  12 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.14  
                    546.9GB    20  14 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.16  
                    546.9GB    20  16 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.18  
                    546.9GB    20  18 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.20  
                    546.9GB    20  20 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.22  
                    546.9GB    20  22 spare       present    -         netapp-vfiler1-02
24 entries were displayed.
netapp-vfiler1::> aggr create -aggregate hybrid_aggr4 -disktype SAS -diskrpm 10000 -diskcount 14 -n netapp-vfiler1-02 -raidtype raid_dp -block-type 64-bit
[Job 10491] Job succeeded: DONE                                                                                  
netapp-vfiler1::> storage aggregate modify -aggregate hybrid_aggr4 -hybrid-enabled true
netapp-vfiler1::> storage aggregate show -aggregate hybrid_aggr4
                                        Aggregate: hybrid_aggr4
                                             Size: 5.77TB
                                        Used Size: 364KB
                                  Used Percentage: 0%
                                   Available Size: 5.77TB
                                            State: online
                                            Nodes: netapp-vfiler1-02
                                  Number Of Disks: 14
                                   Checksum Style: block
                                            Disks: netapp-vfiler1-02:3d.20.8,
                                                   netapp-vfiler1-02:4c.20.9,
                                                   netapp-vfiler1-02:3d.20.10,
                                                   netapp-vfiler1-02:4c.20.11,
                                                   netapp-vfiler1-02:3d.20.12,
                                                   netapp-vfiler1-02:4c.20.13,
                                                   netapp-vfiler1-02:3d.20.14,
                                                   netapp-vfiler1-02:4c.20.15,
                                                   netapp-vfiler1-02:3d.20.16,
                                                   netapp-vfiler1-02:4c.20.17,
                                                   netapp-vfiler1-02:3d.20.18,
                                                   netapp-vfiler1-02:4c.20.19,
                                                   netapp-vfiler1-02:3d.20.20,
                                                   netapp-vfiler1-02:4c.20.21
                                Number Of Volumes: 0
                                           Plexes: /hybrid_aggr4/plex0(online)
                                      RAID Groups: /hybrid_aggr4/plex0/rg0 (block)
                                        RAID Type: raid_dp
                                    Max RAID Size: 16
                                      RAID Status: raid_dp, hybrid_enabled, normal
                                 Checksum Enabled: true
                                  Checksum Status: active
                                     Inconsistent: false
                                           Hybrid: false
                          Total Hybrid Cache Size: 0B
                      Automatic Snapshot Deletion: on
                                        HA Policy: sfo
                          Free Space Reallocation: off
               Space Reserved for Snapshot Copies: 0%
                                   Hybrid Enabled: true
                                     Volume Style: flex
                                 Has Mroot Volume: false
                    Has Partner Node Mroot Volume: false
                                          Is Root: false
                                       Block Type: 64-bit
     Space Used By metadata for Volume Efficiency: 0B

netapp-vfiler1::> aggr add-disks -aggregate hybrid_aggr4 -disktype SSD -diskcount 6

netapp-vfiler1::> storage aggregate show -aggregate hybrid_aggr4                   
                                        Aggregate: hybrid_aggr4
                                             Size: 5.77TB
                                        Used Size: 436KB
                                  Used Percentage: 0%
                                   Available Size: 5.77TB
                                            State: online
                                            Nodes: netapp-vfiler1-02
                                  Number Of Disks: 20
                                   Checksum Style: block
                                            Disks: netapp-vfiler1-02:3d.20.8,
                                                   netapp-vfiler1-02:4c.20.9,
                                                   netapp-vfiler1-02:3d.20.10,
                                                   netapp-vfiler1-02:4c.20.11,
                                                   netapp-vfiler1-02:3d.20.12,
                                                   netapp-vfiler1-02:4c.20.13,
                                                   netapp-vfiler1-02:3d.20.14,
                                                   netapp-vfiler1-02:4c.20.15,
                                                   netapp-vfiler1-02:3d.20.16,
                                                   netapp-vfiler1-02:4c.20.17,
                                                   netapp-vfiler1-02:3d.20.18,
                                                   netapp-vfiler1-02:4c.20.19,
                                                   netapp-vfiler1-02:3d.20.20,
                                                   netapp-vfiler1-02:4c.20.21,
                                                   netapp-vfiler1-02:3d.20.0,
                                                   netapp-vfiler1-02:4c.20.1,
                                                   netapp-vfiler1-02:3d.20.2,
                                                   netapp-vfiler1-02:4c.20.3,
                                                   netapp-vfiler1-02:3d.20.4,
                                                   netapp-vfiler1-02:4c.20.5
                                Number Of Volumes: 0
                                           Plexes: /hybrid_aggr4/plex0(online)
                                      RAID Groups: /hybrid_aggr4/plex0/rg0 (block)
                                                   /hybrid_aggr4/plex0/rg1 (block)
                                        RAID Type: raid_dp
                                    Max RAID Size: 16
                                      RAID Status: raid_dp, hybrid, normal
                                 Checksum Enabled: true
                                  Checksum Status: active
                                     Inconsistent: false
                                           Hybrid: true
                          Total Hybrid Cache Size: 744.2GB
                      Automatic Snapshot Deletion: on
                                        HA Policy: sfo
                          Free Space Reallocation: off
               Space Reserved for Snapshot Copies: 0%
                                   Hybrid Enabled: true
                                     Volume Style: flex
                                 Has Mroot Volume: false
                    Has Partner Node Mroot Volume: false
                                          Is Root: false
                                       Block Type: 64-bit
     Space Used By metadata for Volume Efficiency: 0B
netapp-vfiler1::> disk show -shelf 20
                     Usable           Container
Disk                   Size Shelf Bay Type        Position   Aggregate Owner
---------------- ---------- ----- --- ----------- ---------- --------- --------
netapp-vfiler1-02:3d.20.0 
                    186.1GB    20   0 aggregate   dparity    hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.2 
                    186.1GB    20   2 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.4 
                    186.1GB    20   4 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.6 
                    186.1GB    20   6 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:3d.20.8 
                    546.9GB    20   8 aggregate   dparity    hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.10 
                    546.9GB    20  10 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.12 
                    546.9GB    20  12 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.14 
                    546.9GB    20  14 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.16 
                    546.9GB    20  16 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.18 
                    546.9GB    20  18 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.20 
                    546.9GB    20  20 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:3d.20.22 
                    546.9GB    20  22 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.1 
                    186.1GB    20   1 aggregate   parity     hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.3 
                    186.1GB    20   3 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.5 
                    186.1GB    20   5 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.7 
                    186.1GB    20   7 spare       present    -         netapp-vfiler1-02
netapp-vfiler1-02:4c.20.9 
                    546.9GB    20   9 aggregate   parity     hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.11 
                    546.9GB    20  11 aggregate   data       hybrid_aggr4      
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.13 
                    546.9GB    20  13 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.15 
                    546.9GB    20  15 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.17 
                    546.9GB    20  17 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.19 
                    546.9GB    20  19 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.21 
                    546.9GB    20  21 aggregate   data       hybrid_aggr4 
                                                                       netapp-vfiler1-02
netapp-vfiler1-02:4c.20.23 
                    546.9GB    20  23 spare       present    -         netapp-vfiler1-02
24 entries were displayed.