Dispelling the Myths of Shredded Storage in SharePoint 2013
Read Part 1: The Impact of Shredded Storage on SharePoint 2013
It is important to separate fact from fiction when it comes to shredded storage in SharePoint 2013, a topic that created a tremendous amount of buzz in the SharePoint community.
It is true that shredded storage, for collaboration scenarios, will reduce network and storage I/O associated with saving edits to an existing document. However, it completely misses the mark when it comes to SharePoint performance related to file upload and download.
Thus, it is now time to dispel the myth that shredded storage serves as a replacement for Remote BLOB Storage (RBS) and show how you can optimize Metalogix StoragePoint to make the most of shredded storage in SharePoint 2013.
Remote BLOB Storage (RBS) provides plumbing to allow third-party providers to offload binary large objects (BLOBs) from SharePoint Content Databases to external storage locations. The primary benefit of RBS is to reduce the size of unstructured data (BLOBs) stored in SQL Server databases while providing support for commodity storage. Third party providers like Metalogix StoragePoint have extended this basic BLOB offloading capability to provide a long list of enterprise capabilities including support for a wide variety of storage devices, compliant storage, archiving, and enhanced backup/restore capabilities.
Recently I have heard statements from within the SharePoint community and from other companies that RBS is no longer needed due to the introduction of shredded storage. This couldn't be further from the truth.
In part 1 of this series we discussed the primary benefits of shredded storage. Microsoft's goal in implementing shredded storage was to reduce the I/O associated with saving document changes. Rather than store entire copies of files, SharePoint 2013 shreds files into smaller chunks allowing for incremental changes to documents to be saved to the SharePoint Content Database. As a result network and storage I/O is greatly reduced making the process of saving edits to a document very efficient. Additionally SQL transaction logs associated with document edits are smaller making log shipping more efficient (in fact addressing log shipping challenges for Office 365 was one of the drivers for introducing Shredded Storage). But what about the impact to uploading new documents and downloading existing documents for SharePoint?
In my experience, most SharePoint farms have a much higher ratio of downloads and uploads versus edits to existing documents. The fact remains that while shredded storage greatly improves the I/O characteristics when saving incremental changes to SharePoint, it has a net negative impact on uploads and downloads speeds.
With Shredded Storage in place, the core value of what RBS provides still exists. Does Shredded Storage reduce the size of SharePoint Content Databases (SQL Server) by removing BLOBs from SQL Server databases? Does shredded storage allow you to leverage commodity or complaint storage devices? Does shredded storage address backup challenges with growing SharePoint environments? The answer to all of these questions is a resounding "NO!"
Optimizing RBS with Shredded Storage
In SharePoint Server 2013, Shredded Storage and RBS coexist without issue. As previously discussed, the result of Shredded Storage is a single file broken down into smaller "chunks" and stored within the SharePoint Content Database. With RBS in place, the smaller "chunks" will be externalized rather than a single file. Regardless of shredding, the end result is the same: BLOBs are stored outside of SharePoint Content Databases.
There are, however, considerations when optimizing the performance of RBS with Shredded Storage. While Shredded Storage cannot be "turned off" in SharePoint Server 2013, it can be optimized or disabled altogether by changing the chunk size of the file shreds. The default chunk size is set to 64KB, but you could set the chunk size to 2GB (the maximum allowable file size in SharePoint), which effectively disables Shredded Storage. When performance testing Metalogix StoragePoint with Shredded Storage, we found that setting the chunk size to 20MB will yield the best upload and download performance. Changing the chunk size is quite simple and requires a bit of PowerShell script.
$service = [Microsoft.SharePoint.Administration.SPWebService]::ContentService
$service.FileWriteChunkSize = chunk size in bytes
You will need perform an IISRESET and restart the SP Timer Service on all machines in the farm.
As you have seen over this two-part series, there is a lot of misinformation currently floating around about Shredded Storage and RBS in SharePoint 2013. The reality is that neither replaces the other. In fact, Shredded Storage and RBS complement each other. Shredded Storage reduces network and storage I/O when saving document edits. And RBS reduces Content Database size, improves upload and download speed, and accelerates backup/restore operations. Following the guidelines above will help you get the most out of RBS and Shredded Storage.
Learn more about Metalogix StoragePoint.
Trevor is a recognized SharePoint innovator and the principal architect of StoragePoint, the ground-breaking storage optimization software for SharePoint. Trevor joined Metalogix in 2010 with the acquisition of BlueThread Technologies. He was instrumental in the launch and growth of StoragePoint while serving as Chief Operating Officer (COO) of BlueThread Technologies, a company focused on developing applications for Microsoft products and technologies. StoragePoint has become the #1 Remote BLOB Storage (RBS) solution in the market. Prior to BlueThread, Trevor led technology teams in Enterprise Content Management (ECM) and Enterprise Application Integration at NuSoft Solutions, acquired by RCM Technologies in 2008.