My second report for GigaOm is now online. This document paper is available for free to all GigaOm subscribers or purchase as a single report at $299.00.

My next report, which focuses on alternatives to Amazon AWS S3, is in the works and will be out soon…

Abstract

Most organizations face a growing number of data storage challenges. The number of applications and services IT departments support are increasing; with users accessing data from everywhere, at any time, and from different devices. The variety of workloads are increasing as well, with applications competing for resources from the same infrastructure. The cost of traditional infrastructure is incompatible with the exponential growth of unstructured data, big data workloads, or Internet of Things (IoT) applications.

The traditional classifications of primary and secondary data, that correlate primary with structured data/databases and secondary with unstructured files, are no longer valid. With data becoming one of the most important assets for organizations, structured and unstructured data are now equally important, and they should be protected and treated accordingly. A new primary/secondary classification has emerged and is based on the value of data, with data indexation and classification. Coupling this new classification with a two-tier storage infrastructure can help reduce costs and simplify the process, especially if the two tiers are integrated and data can move seamlessly between them.

Modern applications can now be divided into two families: latency-sensitive or capacity-driven. The first group needs data as close as possible to the processing engines (e.g. CPU, GPU, etc.) while the latter usually requires easily accessible data spanning multiple devices across the network. New infrastructure designs must take this division into account to cope quickly with new and ever-evolving business requirements.

In this report we analyze several aspects of the two-tier storage strategy including:

  • Why a two tier-storage strategy
  • Different types of tier integration
  • How to manage file-based storage in a two-tier storage strategy
  • Automated tiering and application-based profiling
  • Security considerations about two-tier storage strategy
  • Key players
  • First steps for adopting a two-tier storage strategy and improving overall infrastructure TCO

Key findings include:

  • A two-tier storage policy is easy to adopt and saves money while optimizing infrastructure resources.
  • This approach enables improved ROI on infrastructure, and makes future investments necessary only where and when they are required, as opposed to months or years in advance.
  • The infrastructure layout is highly simplified and optimized to take advantage of the cloud and seamlessly integrate it with the rest of the infrastructure. This also helps to simplify and redistribute budget resources from CAPEX to OPEX.