Simplified distributed block and file storage with strong consistency, like in Ceph
Go to file
Vitaliy Filippov 5524dbdab7
Test / buildenv (push) Successful in 9s Details
Test / build (push) Successful in 2m36s Details
Test / test_cas (push) Successful in 8s Details
Test / make_test (push) Successful in 32s Details
Test / test_change_pg_size (push) Successful in 7s Details
Test / test_change_pg_count (push) Successful in 38s Details
Test / test_create_nomaxid (push) Successful in 6s Details
Test / test_change_pg_count_ec (push) Successful in 39s Details
Test / test_etcd_fail (push) Successful in 1m5s Details
Test / test_add_osd (push) Successful in 2m32s Details
Test / test_interrupted_rebalance (push) Successful in 1m51s Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m21s Details
Test / test_failure_domain (push) Successful in 37s Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m33s Details
Test / test_minsize_1 (push) Successful in 15s Details
Test / test_snapshot (push) Successful in 24s Details
Test / test_snapshot_ec (push) Successful in 25s Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m18s Details
Test / test_rm (push) Successful in 15s Details
Test / test_snapshot_down (push) Successful in 22s Details
Test / test_snapshot_down_ec (push) Successful in 23s Details
Test / test_splitbrain (push) Successful in 18s Details
Test / test_snapshot_chain (push) Successful in 2m13s Details
Test / test_snapshot_chain_ec (push) Successful in 2m57s Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s Details
Test / test_write (push) Successful in 38s Details
Test / test_rebalance_verify (push) Successful in 3m39s Details
Test / test_write_no_same (push) Successful in 12s Details
Test / test_rebalance_verify_ec (push) Successful in 3m56s Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m6s Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m35s Details
Test / test_heal_csum_32k_dj (push) Successful in 5m44s Details
Test / test_heal_csum_32k (push) Successful in 5m50s Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m44s Details
Test / test_scrub_zero_osd_2 (push) Successful in 57s Details
Test / test_scrub (push) Successful in 1m0s Details
Test / test_scrub_xor (push) Successful in 1m5s Details
Test / test_heal_csum_4k_dj (push) Successful in 5m9s Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 54s Details
Test / test_scrub_ec (push) Successful in 52s Details
Test / test_heal_csum_4k (push) Successful in 5m8s Details
Test / test_heal_ec (push) Successful in 3m17s Details
Test / test_write_xor (push) Successful in 35s Details
Test / test_move_reappear (push) Failing after 48s Details
Release 1.2.0
New features:

- Implement CSI volume expansion
- Implement CSI volume snapshots
- CSI driver now requires Kubernetes >= 1.20

Bug fixes:

- Important bug fix for EC: fix EC n+k, k>=2 read recovery in ISA-L version returning
  incorrect data when reading at least the second chunk out of multiple missing chunks
  without reading the first one. All users of EC n+k, k>=2 should upgrade as soon as
  possible, and upgrade should be conducted with downtime: first stop all clients
  (VMs/containers), then all OSDs, then upgrade and restart everything.
- Fix unstable statistics aggregation in monitor (affecting vitastor-cli status and df)
- Make udev not wait for OSDs to start during boot
- Do not report negative numbers of offline PGs in vitastor-cli status when changing PG count
- Report both old and new PG counts in vitastor-cli df when changing it
- Fix OSDs sometimes not starting with "The code only supports journal versions 1 and 2,
  but it is 2 on disk" error after upgrading from pre-1.0 versions and letting OSDs run
  for some time
- Fix monitors sometimes returning old PG count back after OSD configuration changes
- Make monitor PG changes more stable and timeout errors less probable
2023-11-05 01:48:57 +03:00
.gitea/workflows Verify checksums in test_heal in different combinations 2023-07-29 12:17:18 +03:00
cpp-btree@45e6d1f131 Fix build under GCC 8 2022-05-10 12:26:47 +03:00
csi Release 1.2.0 2023-11-05 01:48:57 +03:00
debian Release 1.2.0 2023-11-05 01:48:57 +03:00
docker Add tests to CI 2023-05-14 00:06:09 +03:00
docs Document vitastor-csi features 2023-11-05 01:05:26 +03:00
json11@52a3af664f Add cmake and pkg-config to debian build depends 2023-11-01 12:45:27 +03:00
mon Release 1.2.0 2023-11-05 01:48:57 +03:00
patches Release 1.2.0 2023-11-05 01:48:57 +03:00
rpm Release 1.2.0 2023-11-05 01:48:57 +03:00
src Release 1.2.0 2023-11-05 01:48:57 +03:00
tests Support listening on non- in tests 2023-11-01 12:45:27 +03:00
.dockerignore Add the remaining build script for Debian 2021-02-26 01:59:18 +03:00
.gitignore Add .gitignore 2021-03-08 17:04:10 +03:00
.gitmodules Add cpp-btree and json11 submodules 2020-09-17 23:07:06 +03:00
CMakeLists.txt Release 1.2.0 2023-11-05 01:48:57 +03:00
GPL-2.0.txt Add license texts 2020-09-17 23:07:06 +03:00
LICENSE Add LICENSE 2021-04-10 17:44:12 +03:00 Forgot to add new parameter page to README 2023-10-28 13:39:53 +03:00 Forgot to add new parameter page to README 2023-10-28 13:39:53 +03:00
VNPL-1.1-RU.txt Fix typo 2023-01-27 01:52:02 +03:00
VNPL-1.1.txt Fix typo in VNPL-1.1 2022-06-24 01:34:25 +03:00 Use packages/ subdir instead of build/ for Docker package builds 2021-02-25 23:59:04 +03:00 Use packages/ subdir instead of build/ for Docker package builds 2021-02-25 23:59:04 +03:00


Читать на русском

The Idea

Make Clustered Block Storage Fast Again.

Vitastor is a distributed block SDS, direct replacement of Ceph RBD and internal SDS's of public clouds. However, in contrast to them, Vitastor is fast and simple at the same time. The only thing is it's slightly young :-).

Vitastor is architecturally similar to Ceph which means strong consistency, primary-replication, symmetric clustering and automatic data distribution over any number of drives of any size with configurable redundancy (replication or erasure codes/XOR).

Vitastor targets primarily SSD and SSD+HDD clusters with at least 10 Gbit/s network, supports TCP and RDMA and may achieve 4 KB read and write latency as low as ~0.1 ms with proper hardware which is ~10 times faster than other popular SDS's like Ceph or internal systems of public clouds.

Vitastor supports QEMU, NBD, NFS protocols, OpenStack, Proxmox, Kubernetes drivers. More drivers may be created easily.

Read more details below in the documentation.

Talks and presentations


Author and License

Copyright (c) Vitaliy Filippov (vitalif [at], 2019+

Join Vitastor Telegram Chat:

All server-side code (OSD, Monitor and so on) is licensed under the terms of Vitastor Network Public License 1.1 (VNPL 1.1), a copyleft license based on GNU GPLv3.0 with the additional "Network Interaction" clause which requires opensourcing all programs directly or indirectly interacting with Vitastor through a computer network and expressly designed to be used in conjunction with it ("Proxy Programs"). Proxy Programs may be made public not only under the terms of the same license, but also under the terms of any GPL-Compatible Free Software License, as listed by the Free Software Foundation. This is a stricter copyleft license than the Affero GPL.

Please note that VNPL doesn't require you to open the code of proprietary software running inside a VM if it's not specially designed to be used with Vitastor.

Basically, you can't use the software in a proprietary environment to provide its functionality to users without opensourcing all intermediary components standing between the user and Vitastor or purchasing a commercial license from the author 😀.

Client libraries (cluster_client and so on) are dual-licensed under the same VNPL 1.1 and also GNU GPL 2.0 or later to allow for compatibility with GPLed software like QEMU and fio.

You can find the full text of VNPL-1.1 in the file VNPL-1.1.txt. GPL 2.0 is also included in this repository as GPL-2.0.txt.