Simplified distributed block storage with strong consistency, like in Ceph
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Go to file
Vitaliy Filippov 81fc8bb94c Release 0.8.4
New features:
- Implement QCOW2 image/snapshot export via qemu-img (bdrv_co_block_status in the driver)
- Remove OSDs from PG history during `vitastor-cli rm-osd` to prevent `left_on_dead` PG states after deletion
- Add a new recovery_pg_switch setting to mix all PGs during recovery, to almost
  fully reduce the probability of ENOSPC during rebalance
- Introduce partial ENOSPC ("OSD is full") handling - now ENOSPC doesn't turn
  into cascades of crashes
- Add migration support to Proxmox VE Vitastor driver
- Track last_clean_pgs on a per-pool basis thus reducing data movement in a cluster
  with pools remaining unclean/degraded for a long time

Bug fixes:
- Fix a bug where monitor could generate degraded PGs if one of the hosts had no OSDs
- Fix a bug where monitor could skip PG redistribution with a lot of OSDs in cluster
- Report PG history synchronously on the first write, which improves PG consistency
  and availability at the same time, because history now gets reported correctly
  and doesn't get reported without the need for it
- Fix possible write and recovery stalls which could happen in a cluster with both EC and replicated pools
- Make OSD and monitors sanitize & deduplicate PG history items in etcd
- Fix non-working OSD peer config safety check
- Fix a rare journal flush stall where flushing wasn't activated with full journal, but with empty flush queue
- Fix builds without ISA-L (jerasure-only) crashing with EC N+K, K>=2 due to the lack of 16-byte buffer alignment
- Fix a possible crash for EC N+K, K>=2 when calculating a parity chunk with previous parity chunk missing
- Fix a bug where vitastor-disk purge with suppressed warnings didn't work
5 months ago
cpp-btree@45e6d1f131 Fix build under GCC 8 1 year ago
csi Release 0.8.4 5 months ago
debian Release 0.8.4 5 months ago
docker Add Dockerfile 2 years ago
docs Replace apt-key with trusted.gpg.d 5 months ago
json11@52a3af664f Fix build under clang and some warnings 1 year ago
mon Skip empty hosts in lp-optimizer 5 months ago
patches Release 0.8.4 5 months ago
rpm Release 0.8.4 5 months ago
src Release 0.8.4 5 months ago
tests Implement bdrv_co_block_status for snapshot export support 5 months ago
.dockerignore Add the remaining build script for Debian 2 years ago
.gitignore Add .gitignore 2 years ago
.gitmodules Add cpp-btree and json11 submodules 3 years ago
CMakeLists.txt Release 0.8.4 5 months ago
GPL-2.0.txt Add license texts 3 years ago
LICENSE Add LICENSE 2 years ago Add documentation for the new "vitastor-disk" tool 9 months ago Add documentation for the new "vitastor-disk" tool 9 months ago
VNPL-1.1-RU.txt Add Russian translation of VNPL-1.1 11 months ago
VNPL-1.1.txt Fix typo in VNPL-1.1 11 months ago Use packages/ subdir instead of build/ for Docker package builds 2 years ago Use packages/ subdir instead of build/ for Docker package builds 2 years ago


Читать на русском

The Idea

Make Clustered Block Storage Fast Again.

Vitastor is a distributed block SDS, direct replacement of Ceph RBD and internal SDS's of public clouds. However, in contrast to them, Vitastor is fast and simple at the same time. The only thing is it's slightly young :-).

Vitastor is architecturally similar to Ceph which means strong consistency, primary-replication, symmetric clustering and automatic data distribution over any number of drives of any size with configurable redundancy (replication or erasure codes/XOR).

Vitastor targets SSD and SSD+HDD clusters with at least 10 Gbit/s network, supports TCP and RDMA and may achieve 4 KB read and write latency as low as ~0.1 ms with proper hardware which is ~10 times faster than other popular SDS's like Ceph or internal systems of public clouds.

Vitastor supports QEMU, NBD, NFS protocols, OpenStack, Proxmox, Kubernetes drivers. More drivers may be created easily.

Read more details below in the documentation.

Talks and presentations


Author and License

Copyright (c) Vitaliy Filippov (vitalif [at], 2019+

Join Vitastor Telegram Chat:

All server-side code (OSD, Monitor and so on) is licensed under the terms of Vitastor Network Public License 1.1 (VNPL 1.1), a copyleft license based on GNU GPLv3.0 with the additional "Network Interaction" clause which requires opensourcing all programs directly or indirectly interacting with Vitastor through a computer network and expressly designed to be used in conjunction with it ("Proxy Programs"). Proxy Programs may be made public not only under the terms of the same license, but also under the terms of any GPL-Compatible Free Software License, as listed by the Free Software Foundation. This is a stricter copyleft license than the Affero GPL.

Please note that VNPL doesn't require you to open the code of proprietary software running inside a VM if it's not specially designed to be used with Vitastor.

Basically, you can't use the software in a proprietary environment to provide its functionality to users without opensourcing all intermediary components standing between the user and Vitastor or purchasing a commercial license from the author 😀.

Client libraries (cluster_client and so on) are dual-licensed under the same VNPL 1.1 and also GNU GPL 2.0 or later to allow for compatibility with GPLed software like QEMU and fio.

You can find the full text of VNPL-1.1 in the file VNPL-1.1.txt. GPL 2.0 is also included in this repository as GPL-2.0.txt.