Simplified distributed block storage with strong consistency, like in Ceph
 
 
 
 
 
 
Go to file
Vitaliy Filippov 5a9e1ede52
Test / buildenv (push) Successful in 9s Details
Test / build (push) Successful in 2m31s Details
Test / test_cas (push) Successful in 12s Details
Test / make_test (push) Successful in 33s Details
Test / test_change_pg_size (push) Successful in 19s Details
Test / test_change_pg_count (push) Successful in 55s Details
Test / test_create_nomaxid (push) Successful in 21s Details
Test / test_change_pg_count_ec (push) Successful in 58s Details
Test / test_failure_domain (push) Successful in 13s Details
Test / test_etcd_fail (push) Successful in 1m4s Details
Test / test_interrupted_rebalance (push) Successful in 1m13s Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m7s Details
Test / test_add_osd (push) Successful in 2m59s Details
Test / test_move_reappear (push) Successful in 24s Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m22s Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m1s Details
Test / test_rebalance_verify (push) Successful in 2m12s Details
Test / test_minsize_1 (push) Successful in 15s Details
Test / test_rebalance_verify_imm (push) Successful in 2m4s Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m9s Details
Test / test_rm (push) Successful in 17s Details
Test / test_snapshot (push) Successful in 23s Details
Test / test_rebalance_verify_ec (push) Successful in 2m31s Details
Test / test_splitbrain (push) Successful in 23s Details
Test / test_snapshot_ec (push) Successful in 30s Details
Test / test_write_no_same (push) Successful in 16s Details
Test / test_write (push) Successful in 53s Details
Test / test_write_xor (push) Successful in 1m19s Details
Test / test_heal_pg_size_2 (push) Successful in 4m30s Details
Test / test_heal_ec (push) Successful in 4m32s Details
Release 0.8.9
- The tests are now stable and run in a CI system based on Gitea CI
- The release includes final bug fixes for EC:
  - Implement missing EC recovery of allocation bitmap when built with ISA-L
  - Fix broken snapshot export with EC (allocation bitmap reads were giving incorrect results previously)
- Also fixed bugs manifesting under heavy load:
  - Fix monitor possibly applying incorrect PG history on retries
  - Fix monitor incorrectly changing PG count when last_clean_pgs contains less PGs than the new number
  - Allow writes to wait for free space again, but now correctly (previously dropped in 0.8.2)
  - Fix a rare segfault in client (handle client stop during incoming stream handling in 1 more place)
  - Make monitor correctly handle etcd connection errors - it could die instead of connecting to another etcd
  - Fix OSD rarely being unable to report PG states after a PG was taken over by another OSD
- Fixed return code for incomplete EC objects (now EIO) and made cluster client retry this error
- Made other small changes for tests: timeouts, nice/ionice for etcd, waiting conditions, NBD device checks and so on
2023-05-14 01:25:09 +03:00
.gitea/workflows Add tests to CI 2023-05-14 00:06:09 +03:00
cpp-btree@45e6d1f131 Fix build under GCC 8 2022-05-10 12:26:47 +03:00
csi Release 0.8.9 2023-05-14 01:25:09 +03:00
debian Release 0.8.9 2023-05-14 01:25:09 +03:00
docker Add tests to CI 2023-05-14 00:06:09 +03:00
docs Notes about config and vitastor-disk cache status 2023-04-29 00:08:24 +03:00
json11@fd37016cf8 Fix json11: allow trailing comma 2023-02-23 01:16:01 +03:00
mon Handle etcd connection errors correctly in mon (unhandled error events) 2023-05-11 11:02:44 +03:00
patches Release 0.8.9 2023-05-14 01:25:09 +03:00
rpm Release 0.8.9 2023-05-14 01:25:09 +03:00
src Release 0.8.9 2023-05-14 01:25:09 +03:00
tests Allow rebalance to start in test_interrupted_rebalance, raise etcd start timeout 2023-05-13 15:16:28 +03:00
.dockerignore Add the remaining build script for Debian 2021-02-26 01:59:18 +03:00
.gitignore Add .gitignore 2021-03-08 17:04:10 +03:00
.gitmodules Add cpp-btree and json11 submodules 2020-09-17 23:07:06 +03:00
CMakeLists.txt Release 0.8.9 2023-05-14 01:25:09 +03:00
GPL-2.0.txt Add license texts 2020-09-17 23:07:06 +03:00
LICENSE Add LICENSE 2021-04-10 17:44:12 +03:00
README-ru.md Add documentation for the new "vitastor-disk" tool 2022-08-22 00:31:30 +03:00
README.md Add documentation for the new "vitastor-disk" tool 2022-08-22 00:31:30 +03:00
VNPL-1.1-RU.txt Fix typo 2023-01-27 01:52:02 +03:00
VNPL-1.1.txt Fix typo in VNPL-1.1 2022-06-24 01:34:25 +03:00
copy-fio-includes.sh Use packages/ subdir instead of build/ for Docker package builds 2021-02-25 23:59:04 +03:00
copy-qemu-includes.sh Use packages/ subdir instead of build/ for Docker package builds 2021-02-25 23:59:04 +03:00

README.md

Vitastor

Читать на русском

The Idea

Make Clustered Block Storage Fast Again.

Vitastor is a distributed block SDS, direct replacement of Ceph RBD and internal SDS's of public clouds. However, in contrast to them, Vitastor is fast and simple at the same time. The only thing is it's slightly young :-).

Vitastor is architecturally similar to Ceph which means strong consistency, primary-replication, symmetric clustering and automatic data distribution over any number of drives of any size with configurable redundancy (replication or erasure codes/XOR).

Vitastor targets SSD and SSD+HDD clusters with at least 10 Gbit/s network, supports TCP and RDMA and may achieve 4 KB read and write latency as low as ~0.1 ms with proper hardware which is ~10 times faster than other popular SDS's like Ceph or internal systems of public clouds.

Vitastor supports QEMU, NBD, NFS protocols, OpenStack, Proxmox, Kubernetes drivers. More drivers may be created easily.

Read more details below in the documentation.

Talks and presentations

Documentation

Author and License

Copyright (c) Vitaliy Filippov (vitalif [at] yourcmc.ru), 2019+

Join Vitastor Telegram Chat: https://t.me/vitastor

All server-side code (OSD, Monitor and so on) is licensed under the terms of Vitastor Network Public License 1.1 (VNPL 1.1), a copyleft license based on GNU GPLv3.0 with the additional "Network Interaction" clause which requires opensourcing all programs directly or indirectly interacting with Vitastor through a computer network and expressly designed to be used in conjunction with it ("Proxy Programs"). Proxy Programs may be made public not only under the terms of the same license, but also under the terms of any GPL-Compatible Free Software License, as listed by the Free Software Foundation. This is a stricter copyleft license than the Affero GPL.

Please note that VNPL doesn't require you to open the code of proprietary software running inside a VM if it's not specially designed to be used with Vitastor.

Basically, you can't use the software in a proprietary environment to provide its functionality to users without opensourcing all intermediary components standing between the user and Vitastor or purchasing a commercial license from the author 😀.

Client libraries (cluster_client and so on) are dual-licensed under the same VNPL 1.1 and also GNU GPL 2.0 or later to allow for compatibility with GPLed software like QEMU and fio.

You can find the full text of VNPL-1.1 in the file VNPL-1.1.txt. GPL 2.0 is also included in this repository as GPL-2.0.txt.