Showing posts with label clustered data ontap. Show all posts
Showing posts with label clustered data ontap. Show all posts

Monday, January 25, 2016

CDOT Tip: Vol Language

A few notes on vol languages:
1) With cDOT 8.2 you can change the SVM language afterwards, and volumes within the SVM can have different settings (from each other and from the SVM root), but you can’t change a volume language after creation time.
2) cDOT doesn’t have a “undefined” language setting so it may be necessary to change the volume language on the 7-Mode system before migrating it over to cDOT.
3) You can only replicate to a volume with the same language as the source volume.
4) Newly created volumes in CDOT will inherit the SVM default language.
5) NetApp often recommends customers use C.UTF-8 (particularly for the SVM root volume), because it will allow namespace traversal to child volumes of any language.

Even more details:
  en_US is a subset of C.UTF-8.  The first 128 characters of both character sets match and are stored in ASCII and are 1byte.  .UTF-8 differs in that it includes more character sets and stores them in more than 1 byte.  Ideally, everyone is trying to get to UTF-8 (any version) as all versions of UTF-8 are the same.  Volume language only impacts UNIX hosts not Windows.  All UNIX hosts should maintain a matching locale UTF-8 but this is not always possible as more current distros of *NIX are .UTF-8 by default and older volumes may be configured for something else.  The only time the customer is going to experience a potential issue is when and if there are high-order characters above 128 characters and where the UNIX host and volume language do not match.  
 
  When a host opens a file on a volume it interprets the data through the lens of the  locale of the host.  Given that most new installs of *NIX will be .UTF-8 and that en_US is a subset of .UTF-8, the recommendation from Engineering (last I heard) was UTF-8.  It’s difficult to align both host and volume since old volumes are often a different language.  The problem could arise if there are high order characters and the host cannot correctly interpret the data (maybe because it is a high-order character that utilizes multiple bytes)…in this case you could get a bag of bits OR if that character set does not align perfectly the data could potentially be interpreted as something else.  E.g. en_US = $ but .UTF-8 = % (just an example to make a point but there are character sets that don’t align).  The customers I would be more concerned about are those that share files internationally.  

  The volume language is completely irrelevant for the names with ASCII-only characters. The problem starts when volume names contain the non-ASCII characters. The reason UTF-8 was selected as a new default is that this problem goes away with UTF-8. 
 
  It does not really matter whether it’s en_us.UTF-8 or he.UTF-8 .  The difference between en_us.UTF-8 and he.UTF-8 is in the handling of date format, a currency sign, the comma in thousands, and other almost-irrelevant for ONTAP things. Currently, ONTAP does not pay attention to these “details”. It only cares about the character set, which is identical for any UTF-8 variations. And that’s the reason UTF-8 was selected as a new default (C.UTF-8 to be more accurate).

Wednesday, January 6, 2016

CDOT 8.3.2: What's New

The next release of our ONTAP operating system, CDOT 8.3.2, is expected to have several key features and is expected February-ish. 8.3.2RC2 is already out!  Here’s what’s new:

1) Inline Dedupe: supported on All-flash and FlashPool enabled systems.  This feature reduces the transactions to disk and reduces storage footprint by deduping in-memory.
    a. Enabled on all-flash arrays by default
    b. Uses 4k block size and stays deduped when replicated.
    c. Syntax: volume efficiency modify -vserver NorthAmerica -volume /vol/ production-001 -inline-deduplication true

2) QOS (adjustable performance limit) is now supported on clusters up to 24 nodes (up from 8 nodes)!

3) Support for 3.84TB TLC SSDs.  These huge flash drives have a lower cost per GB than smaller SSDs.  They also require lower power consumption (85% less) and lower rack footprint (82% less RU) than a same-performance HDD array.

4) Static Adaptive Compression: in 8.3.1 we introduced a high-efficiency compression algorithm for inline compression.  8.3.2 gives you the ability to run this algorithm on an existing volume or dataset.
    a. This is important for when you do a vol move from a system without inline compression enabled to one with it enabled, for example from a HDD FAS to an all-flash FAS.

5) Copy Free Transition: This feature allows you to shut down a 7-mode cluster and hook the disk shelves into a CDOT system.  The data is converted to CDOT, vfilers are converted to vservers, and in a 2-8 hour window the entire 7 to C migration is complete.

6) Migrate a volume between vservers: the equivalent of vfiler move, this allows you to re-host a volume between vservers.  This only works once, and only for volumes transitioned from 7-mode.

7) Inline Foreign LUN Import: Migrate FCP data by presenting the LUN at the NetApp controller, and NetApp then presents the LUN to the host.  In the background, NetApp will copy the data over and then you can retire the old system and LUN.  This is vendor-agnostic as of 8.3.1 and works for All-Flash FAS in 8.3.2.

8) SVM-DR MSID replication.  SVM-DR allows you to replicate an entire vserver and all its configuration for a push-button disaster recover.  MSID’s are the unique identifiers for volumes, and replicating them allows applications like VMware to accept the DR exports without re-mounting them, greatly shortening your RTO.

9) Audit Logging enhancements: records login failures and IP addresses of logins.

Read more at 8.3.2RC2 release notes: https://library.netapp.com/ecm/ecm_get_file/ECMLP2348067

Monday, June 1, 2015

CDOT Tip #6

Here are some recent CDOT questions we’ve fielded:

Q: ”I reviewed the volume move portion of the ‘CDOT replication Guide’ (attached). I don’t see anything in document about migrating an SVMs root volume to another node/aggregate along with volumes it host. Just wanted to confirm that there are no issues using ‘volume move’ to migrate an SVM root vol?” 
A: Root Volumes for data vservers are no problem, go ahead and move them.  Node volumes are not Vol movable, however. They belong to the physical node.

Q: “The standard vol language will be UTF8 in CDOT, but we have many 7mode volumes which are set to ‘en_US’ or ‘C’. The destination volumes will inherit the same language as the source. Is there any way to convert the volume languages ‘en_US’ or ‘C’ to UTF8 once they have been migrated to CDOT?” 
A:  No - You cannot change the volume language after it is set; thus, if you want it to be something specific, it needs to be changed on the 7-Mode volume prior to migrating with the 7-Mode Transition Tool.

Q:  “Can I have a backup (snapvault) configured on a volume which is currently the destination of a 7mode to cdot migration?” 
A:   No - During a TDP snapmirror (snapmirror from 7 to C), you cannot cascade the destination volume.

Q: “The Oracle Database Team wrote a script to take snapshots of their oracle volumes in cdot. They have a similar script for 7mode. In 7mode, they take a snapshot via the script and we set retentions on the filer so that aged snapshots can be deleted. But, I can’t figure out how to create a policy which does NOT create a snapshot, but will delete aged snapshots. Any ideas how we can achieve this?”
A: Your best bet would be to estimate the space per snapshot, turn on snap autodelete, then size the volume/snapreserve to hold that many snapshots.  You could also use an outside script or snapcreator.

Q: “Is there a command to see snapmirror lag in CDOT?”
A: Snapmirror show with the –fields option is what you’re looking for!  There are a lot of fields you can include, from lag time to last-transfer-end-timestamp. 

CDOT Tip #2

Here’s a nugget that is relevant to anyone who does CDOT implementations and surprised me when I found it out last year.  Essentially, cluster ha modify should only be run on 2 node clusters, because cluster ha (high availability) is different than storage failover.

Storage failover modify –mode non-ha: This is for Single Node Clusters.
Cluster ha modify –configured true: This is for Two Node Clusters only.  This disables Epsilon (the system of tie-breaking for 4+ node clusters). 
Storage failover modify –mode ha: This controls what we normally understand as takeover/giveback (cf enable).  It is applicable for any 2+ node cluster.  This  must be configured correctly for “cluster ha modify” to work. 





Lastly, if you have a 2-node cluster and you have set cluster ha modify to true, you will need to manually set it to false when you add nodes to grow the cluster.


Bonus link: Here is a description of which ONTAP files (q, e, I, m) are compatible with each platform.  In general, the ‘q’ file is what you will use, in the form “814P1_q_image.tgz.”  The .zip is the older format, for use with upgrades from 7.x systems, while the .tgz is used for upgrades from 8.x systems.  Lastly, netboot is for booting systems from an image on your laptop/server. 

CDOT Tip #1

CDOT Tip #1: When you’re looking up a CDOT system in ASUPs, remember that “hostname” correlates to node name, while “cluster name” is the name of the cluster admin vserver. 


When you look up a node (hostname), it displays the fitness dashboard.  Look below: the “Cluster Name” field is a hyperlink that takes accesses the cluster admin vserver.

When you click the hyperlink, it takes you to the cluster dashboard!  This lists all the vservers and nodes for that cluster.



Bonus: you can find 7-mode to CDOT command mapping here: https://library.netapp.com/ecm/ecm_download_file/ECMP1196780

Monday, September 22, 2014

SnapMirror vs SnapVault in CDOT

 In CDOT we’ve simplified the commands and protocol: to create a snapvault relationship, you run “SnapMirror create –type XDP.”  To create a SnapMirror relationship, you run “SnapMirror create –type DP.”  In fact, for CDOT we no longer call it snapvault, it is called XDP SnapMirror. 

e.g., vs2::> snapmirror create -destination-path vs2:dept_eng_dp_mirror2 -source-path vs1:dept_eng -type DP

The primary distinction between DP snapmirror and XDP SnapMirror is that snapvault allows you to keep more snapshots on the destination.  Essentially, XDP snapmirror is for long-term backups.  Other differences:
·         DP SnapMirror relationships can be reversed (swap destination and source)
·         DP SnapMirror can replicate every minutes, XDP SnapMirror once per hour.
·         DP SnapMirror destination volumes can be made read/write.

Do you have some datasets that would benefit from a quicker time to recovery or have stricter SLA’s?  If so, DP SnapMirror is the best choice.  

Thursday, April 24, 2014

CDOT 8.2.1 Summary

Take a moment to familiarize yourself with this CDOT 8.2.1 documentation.  There is a TON new and improved in 8.2.1 over 8.2, as well as some cautions.  I’ve highlighted a few here.

https://library.netapp.com/ecmdocs/ECMP1368924/html/GUID-45F85A02-114C-4192-8F1B-A4F50996D307.html

Features:
  • Support for FAS8000 series
  • V-Series feature now called “FlexArray,” a non disruptive on-the-fly licensable feature.
  • Support for qtree exports
  • Storage Encryption support
  • Support for direct attach E-Series configurations
  • Non-Disruptive shelf removal support
  • Log and core dumps available via http:///spi/
  • SQL over SMB3 non-disruptive operations support
  • VMware over IPv6 support
  • Offbox antivirus support
  • Health monitoring of Cluster Switches
  • Increased Max aggr sizes
  • 32-64-bit aggr conversion enhancements
  • Automatic Workload Analyzer, which assesses how the system would benefit from SSDs (Flash Pool)
  • Support for “Microsoft Previous Versions” tab on files (8.2 and later)

Cautions:
  • Some Hitachi or HP XP array LUNs might not be visible.  “In the case of Data ONTAP systems that support array LUNs, if the FC initiator ports are zoned with Hitachi or HP XP array target ports before the storage array parameters are set and the LUNs are mapped to the host groups, you might not be able to see any LUNs presented to the Data ONTAP interface“
  • NFSv2 not supported. Windows over NFSv3 not supported.
  • Verify management software versions are compatible.
  • First VLAN configuration may temporarily disconnect the port.
  • LUN revision numbers change during upgrades.  Windows 2008, 2012 interpret these as new LUNs.  
  • Dedupe space considerations and clearing stale metadata for upgrades.
  • Cautions for proper cluster and vserver peering methods
  • Cautions for proper vol move methods