Software Defined Storage
What’s next after CSI? An introduction to Object Storage for Kubernetes
Moving beyond file and block storage in Kubernetes
February 6, 2021
2:30 PM – 3:00 PM Add to calendar
2:30 PM – 3:00 PM Add to calendar
D.sds
Kubernetes graduated Container Storage Interface (CSI) to GA status in v1.13. Since CSI’s origin, it has evolved to support a large number of vendors and storage formats. It has brought the industry together in consensus about the best practices in storage. However, CSI’s major limitation is that it only supports Block and File storage. The rapid growth of Object storage means that a growing share of the ecosystem is currently using ad-hoc solutions to leverage this new technology.
Object storage is a fundamentally different paradigm where data is accessed over the network rather than locally. It allows applications to remain stateless while offloading state into a black box over the network. Object storage is the key enabler for cloud migration. This paradigm, however, does not have a standard mechanism for consumption in Kubernetes. COSI fundamentally exists to enable the natural consumption of object storage with Kubernetes.
In this talk, we discuss our efforts in bringing object storage into the forefront of Kubernetes and introduce the Container Object Storage Interface (COSI) and cover:
- Why COSI is needed for Kubernetes
- Best practices for using COSI
- Designing apps to leverage COSI
- The COSI architecture, and how to contribute to the project.
Additional information
| Type | devroom |
|---|
More sessions
| 2/6/21 |
There are a number of available tools and approaches for benchmarking S3 performance in Ceph. Benchmarking reliably and sensibly gets more challenging as you scale out storage clusters, gateways, and benchmarking drivers. In this talk I’ll go over some of the benchmarking tools we’ve used in recent months, talk about our focus around COSBench, and some of the approaches and steps we took to improve the state of COSBench for Ceph benchmarking, both in COSBench itself and with helper tools.
|
| 2/6/21 |
What's new in Ceph RGW Ceph is an open source, highly scalable, software defined storage that provides object, file and block interfaces under a unified system. Ceph Object Storage Gateway (RGW) provides a RESTful object storage interface to the Ceph Storage cluster. It provides an interface that is compatible with a large subset of AWS S3 APIs. In this talk we will discuss the upcoming features in ‘Pacific’ release and beyond. The list of features are: S3select Lua scripting Encryption - ...
|
| 2/6/21 |
Data Processing Units (DPUs) and SmartNICs--these things are getting a lot of attention, particularly in the network storage world. There's a bit of history behind them, particularly if you consider TCP Offload Engine (TOE) cards and iSCSI NICs, both of which have been around for quite a while. This latest wave, however, is more general-purpose by design and presents an opportunity for developers like us.
|
| 2/6/21 |
LINSTOR enables the automation of the deployment of block storage that is replicated over multiple storage nodes and can act as a software defined storage provider for various container and virtualization platforms, such as Kubernetes, OpenStack, OpenNebula and Proxmox. It also includes additional storage features, such as the automation of storage encryption, deduplication or the automatic creation of file systems on new block storage volumes.
|
| 2/6/21 |
A proposal to support AWS SQS API natively in Ceph RGW, for advanced Serverless computing use cases.
|
