Cloud native app developers delight: Container storage just got a whole lot easier!

The new Red Hat OpenShift Container Platform offers a rich user experience with dynamic provisioning of storage volumes, automation, and much more

 

By Michael Adam, Engineering Lead, Container Native Storage, and Sayan Saha, Head of Product, Red Hat Gluster Storage

 

Today, Red Hat announced general availability of Red Hat OpenShift Container Platform 3.4, which includes key features such as enhanced multi-tenancy and streamlined deployment for hybrid clouds. In addition, a number of open source storage innovations have been included in this release, which enable easier storage management and provisioning across the lifecycle of containers.

The story so far

Containers were built to be ephemeral and stateless. However, stateful applications running in containers need enterprise-grade persistent storage. Over the past 18 months, Red Hat has delivered a continuum of innovation around persistent storage for containers, leading the charge on both fronts – the open source communities and enterprise products. Red Hat offers container-native storage – durable, distributed, software-defined storage integrated deeply into the Red Hat OpenShift Container Platform, managed by Kubernetes.

cns3-4-1

Rich developer and management experience

In the latest release, Red Hat OpenShift Container Platform 3.4 offers dynamic provisioning of persistent volumes, allowing for a much richer developer experience, addressing annoying delays due to lengthy storage provisioning cycles needed by traditional storage platforms.

Storage administrators can expect to find that easier volume management with dynamic provisioning frees them up for more value-added tasks. Developers building cloud-native apps deployed in containers can benefit from faster storage provisioning and a better user experience.

DevOps managers can relish the automation and integration through a new deployment tool included with the subscription that can deploy container-native storage with push-button simplicity.

Dynamic provisioning for persistent volume claims

Prior to this release, storage administrators and application developers were limited to a static provisioning model where persistent volumes (PVs) of fixed capacity had to be pre-provisioned manually to be consumed by applications running in Kubernetes pods.

Persistent volume claims (PVCs) are used to consume storage resources in Kubernetes like pods that consume compute resources. When new PVCs were received, an attempt was made to match the PVC request with the closest available PV in terms of capacity, and if one was found the claim would be bound to it. This scheme is inefficient.

Consider a situation where 10, 100 GB PVs have been pre-provisioned and made available. A request for 50 GB of storage would be matched to one of the available 100 GB PVs. This is wasteful as storage is over-committed. On the other hand, a request for 150 GB of storage would go unsatisfied as there is no close match, even though there is unused storage capacity.

The new dynamic provisioning feature fixes that issue by automating the provisioning of storage volumes. For instance, a 50 GB PVC request is addressed using a 50 GB PV that is dynamically provisioned for developers requiring zero admin intervention. In other words, users can expect to get exactly what they asked for as long as the underlying storage platform has available capacity.

Note that dynamic provisioning is supported even when Red Hat Gluster Storage serves out storage from a dedicated storage cluster in addition to container-native storage. This demo shows how container-native storage can be dynamically provisioned in OpenShift Container Platform.

cns3-4-2

Dynamic provisioning using storage classes

Dynamic provisioning is enabled by a new feature in OpenShift called storage classes. Storage classes enable storage admins to describe as well as classify their various storage implementations that are available to be used by the OpenShift cluster, and they enable developers to configure specific parameters when requesting storage on demand. Container-native storage can be configured as a storage class, which allows OpenShift developers to dynamically provision storage when submitting claims against the storage class, as seen below.

cns3-4-3

Faster and easier storage deployments using Kubernetes daemon sets

Container-native storage now ships with a deployment tool that will deploy the whole system in an already installed OpenShift cluster. The deployment tool is flexible in that it can easily be used in Ansible playbooks. The administrator only needs to prepare a topology file, a JSON-formatted file describing the nodes and storage devices to be used. Based on that, the deployment of the Gluster storage cluster and the management server as pods in the OpenShift cluster is achieved with the invocation of just a single command. Once deployment is completed, the Gluster storage is ready for both manual and dynamic provisioning with an appropriate storage class. In case of any errors encountered during deployment, the tool supports an abort operation that undoes the failed partial deployment, so that it can be started from scratch. This demo shows the deployment tool in action.

cns3-4-4

GID level security and endpoints

Several features have been added to Red Hat OpenShift Container Platform 3.4 to create a more secure storage environment. The first of these is the addition of system-controlled, preallocated GIDs for the Red Hat Gluster Storage container. This enables the container to run as a non-root user, permitting only allowed users to access the data.

Second, usability with endpoints has been resolved with the deployment of a service and endpoint for each dynamically provisioned volume. This allows PVs to be specific to the requestors namespace without the added steps of manually creating these resources.

The most comprehensive persistent storage for containers

Red Hat continues to be a major contributor to the Docker and Kubernetes communities. In fact, as of today, Red Hat has the second-most contributors in each, second only to Docker and Google, respectively. Much of the innovation happening upstream is focused on solving the persistent storage challenge for stateful applications. Red Hat has contributed a number of volume plugins for a variety of protocols. Learn more about the latest innovations from Red Hat during the virtual event on January 19 or in a webinar with container storage experts on January 24. Learn more at redhat.com/containerstorage.

A happy new year with Red Hat Ceph Storage!

By Daniel Gilfix, Red Hat Storage

Now that a somewhat tumultuous 2016 is in our rearview mirror, what better way to kick off the new year than with a couple of major endorsements for one of the key emerging businesses of the world’s leading provider of open source solutions? That’s right: Last week alone, over a scant 48 hours, Red Hat watched as Red Hat Ceph Storage 2 earned distinction by CRN as one of the 10 coolest open source products of 2016 and by TechTarget as one of its 12 finalists for 2016 product of the year in server-based storage. Two major endorsements.

Commitment upstream and down

The dual recognition is testament not only to the open source community but also to Red Hat and its valued customers spanning industries like telco, financial services, retail, and the public sector for the advancement of software-defined storage, which has become increasingly indispensable for workloads like cloud infrastructure, data lakes, backup and recovery, media repository, surveillance, and containers. Some of these customers have the necessary in-house skills, but many others rely on the expertise of Red Hat Storage Consulting and training for access to the best practices in architectural design, solution implementation, and knowledge transfer typically required when graduating from upstream to downstream deployment.

Always breaking new ground

Red Hat Ceph Storage 2 was announced at Red Hat Summit last May and began shipping in August. The first major release since the acquisition of Inktank by Red Hat in 2014, it marked the introduction of a user-friendly interface and an integrated lifecycle management system called Red Hat Console 2. Besides the ability to manage and monitor cluster activity in terms of health, performance, and capacity, Console empowered users to install Ceph in under an hour and to grow clusters graphically using Ansible. Red Hat Ceph Storage 2 also marked a departure from an exclusive “we’re for OpenStack” philosophy to a broader emphasis on offering object storage capabilities that are vital for managing vast quantities of unstructured data efficiently with emerging workloads.

Not just for OpenStack anymore

This is not to say that Red Hat Ceph Storage isn’t for OpenStack anymore—far from it. Ceph remains the overwhelmingly preferred storage backend for OpenStack workloads (OpenStack.org user survey, April 2016), and Red Hat Ceph Storage continues to tighten its integration with Red Hat OpenStack Platform. This is evident by Red Hat OpenStack Platform Director’s ability to automate upgrades from Red Hat Ceph Storage 1.3 to 2, manage object and block deployment, and leverage OpenStack’s shared filesystem service (Manila) with the CephFS driver. In effect, Red Hat customers can now fully customize their OpenStack deployment architectures with one unified storage platform. OpenStack Platform customers even receive a complimentary 64 TBs of Red Hat Ceph Storage for proof of concept.

Something more for everyone

But the focus of Red Hat Ceph Storage 2 that caught the attention of CRN and TechTarget was the retransformation of Red Hat’s storage product as an easier-to-use, more versatile product for everyone. The new management interface expanded user appeal for those without advanced Linux expertise or prior familiarity with Ceph. Features like support for Active Directory and LDAP authentication, integration with the S3 protocol of Amazon Web Services, and disaster-recovery options that include remote workloads all added to the product’s strength as an object storage platform. Red Hat Ceph Storage 2 now handles petabyte-scale deployments with the flexibility required by next-generation software-defined datacenters and the ease and enhanced cost efficiency required by today’s business.

Onward to new accomplishments

So, as we embark on new adventures and roller-coaster rides in 2017, let us all take note that software-defined storage on industry-standard hardware has now matured to be a platform of stability for the general populace needing to store enterprise data. Red Hat Ceph Storage has garnered well-deserved recognition for its advancement as a leader of the pack. Stay tuned for things to come this year.