Vitaliy Filippov
5d9d6f32a0
Fix common realloc memory leak mistakes found by cppcheck
2024-01-13 01:30:28 +03:00
Vitaliy Filippov
5280d1d561
Release 1.4.0
...
Test / test_snapshot (push) Successful in 26s
Details
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Successful in 24s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_snapshot_chain (push) Successful in 2m41s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m48s
Details
Test / test_rebalance_verify (push) Successful in 3m28s
Details
Test / test_write (push) Successful in 47s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m5s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m41s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m45s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m52s
Details
Test / test_heal_ec (push) Successful in 5m11s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m42s
Details
Test / test_heal_csum_32k (push) Successful in 5m56s
Details
Test / test_scrub (push) Successful in 1m25s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m18s
Details
Test / test_scrub_xor (push) Successful in 42s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m49s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m32s
Details
Test / test_heal_csum_4k (push) Successful in 5m31s
Details
Test / test_scrub_ec (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m5s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m21s
Details
Test / test_write_xor (push) Successful in 36s
Details
New features:
- Intelligent recovery/rebalance speed auto-tuning to reduce its impact on clients (see README -> Features)
- Auto-restoration of dead VDUSE daemons in CSI plugin
- Add vitastor-disk update-sb command
- Update QEMU for Debian Bookworm to 8.1 and use it for CSI plugin
Bug fixes:
- Fix pools SOMETIMES staying inactive after stopping a node due to OSDs not reacting
to PG state changes caused by incorrect full reload of state from etcd on reconnection
- Make monitors retry pool configuration changes quickier which fixes them being unable
to apply changes when an ongoing rebalance is quickly making a lot of PGs clean
- Fix CSI plugin not accepting array of strings as etcd address in /etc/vitastor/vitastor.conf
- Allow multiple interfaces with the same IP address, for "simple routed" full mesh network
- Do not ignore loopback addresses for OSD network (to make ECMP setups with frr possible)
- Fix a rare client crash during OSD reconnections
- Only treat data partitions as existing OSDs in vitastor-disk prepare
- Remove etcd parameter from default command examples
- Fix reported free space sometimes changing non-immediately after deletion of data from OSDs
- Fix a possible OSD crash on print_slow when bs_op is NULL
- Use the same etcd_ws_keepalive_interval in mon as in OSD
- Fix mon not using values from config when /config/global is not present
- Remove pve-storage-portal-dns-list format for vitastor_etcd_address
- Parse log_level in cluster_client
- Fix vitastor-nbd image existence check not working because of non-zeroed inode_watch fields
- Do not warn on EPIPE in client unless log_level is raised explicitly
- Fix incorrect error in CSI when searching for the device in /sys
- Remove 2 last prints to stdout in etcd_state_client
- Fix a possible OSD crash when checking corrupted journal entries
2024-01-12 01:28:33 +03:00
Vitaliy Filippov
317b0feb0a
Add a note about VDUSE daemon auto-restart
2024-01-12 01:27:36 +03:00
Vitaliy Filippov
247f0552db
Fix debug log "killing..." in CSI
2024-01-10 01:19:34 +03:00
Vitaliy Filippov
2f228fa96a
Only treat data partitions as existing OSDs in vitastor-disk prepare
Test / test_interrupted_rebalance_ec (push) Successful in 2m40s
Details
Test / test_rm (push) Successful in 31s
Details
Test / test_move_reappear (push) Successful in 39s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_interrupted_rebalance (push) Successful in 4m42s
Details
Test / test_snapshot_down_ec (push) Successful in 26s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Failing after 3m17s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m13s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s
Details
Test / test_write (push) Successful in 37s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m37s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m20s
Details
Test / test_write_xor (push) Failing after 3m8s
Details
Test / test_rebalance_verify (push) Successful in 8m20s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m17s
Details
Test / test_heal_ec (push) Successful in 4m59s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m15s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m35s
Details
Test / test_heal_csum_32k (push) Successful in 6m47s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m49s
Details
Test / test_scrub (push) Successful in 1m2s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 45s
Details
Test / test_scrub_xor (push) Successful in 40s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m16s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m9s
Details
Test / test_scrub_ec (push) Successful in 45s
Details
Test / test_heal_csum_4k (push) Successful in 5m26s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
2023-12-31 11:46:47 +03:00
Vitaliy Filippov
2f6b9c0306
Remove etcd parameter from default command examples
2023-12-31 02:50:41 +03:00
Vitaliy Filippov
48b5f871e0
Add Contributor License Aggrement in Russian and English
2023-12-31 01:23:52 +03:00
Vitaliy Filippov
c17f76a3e4
Add documentation for recovery auto-tuning
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_snapshot_down_ec (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 1m50s
Details
Test / test_splitbrain (push) Successful in 52s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m31s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m28s
Details
Test / test_rebalance_verify (push) Successful in 3m25s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m31s
Details
Test / test_write (push) Successful in 1m17s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m36s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m12s
Details
Test / test_heal_ec (push) Successful in 5m20s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m36s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m11s
Details
Test / test_heal_csum_32k (push) Successful in 6m13s
Details
Test / test_scrub (push) Successful in 56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m6s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m31s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m58s
Details
Test / test_scrub_xor (push) Successful in 43s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m10s
Details
Test / test_scrub_ec (push) Successful in 49s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m40s
Details
Test / test_heal_csum_4k (push) Successful in 5m59s
Details
Test / test_write_xor (push) Successful in 34s
Details
Test / test_interrupted_rebalance (push) Successful in 1m19s
Details
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
a6ab54b1ba
Do not allow negative util_low/high
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
99ee8596ea
Rename min/max_util to util_low/high
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
c4928e6ecd
Protect from try_send completing the operation immediately
...
Fixes a possible use-after-free in case of continue_ops() calling try_send(),
then connect_peer() -> set_timer() -> trigger_nearest() -> handle_op_part() -> continue_ops() again
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
ec7dcd1be5
Do not apply very large recovery pauses during tests
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
e600bbc151
Fix flapping move_reappear test by adding an fsync before stopping PG
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
8b8c1179a7
Use a separate used_blocks counter for free space stats to hide possibly delayed on-flush deallocation
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
d5a6fa6dd7
Fix possible crash on print_slow when bs_op is NULL
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
f757a35a8d
Retry PG changes without re-running lpsolve when pool configuration and OSD tree don't change
...
OSDs often change their /pg/history keys during rebalance, so monitor receives additional
transaction failures from etcd if it re-runs lpsolve which sometimes may even lead to monitor
being unable to apply PG changes at all until rebalance completes
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
1edf86ed26
Aggregate recovery delay using simple mean over last 10 observations (EWMA is shit)
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
5ca7cde612
Experiment/WIP: Try to track "secondary" recovery ops separately
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
751935ddd8
WIP Auto-tune recovery speed
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
d84dee7098
Track recovery op latencies + refactor into a structure
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
dcc76eee15
Add a parity chunk count change test script
2023-12-26 23:48:41 +03:00
Vitaliy Filippov
2f38adeb3d
Restart dead VDUSE daemons at regular intervals
2023-12-24 12:58:50 +03:00
Vitaliy Filippov
f72f14e6a7
Clear old PG states, history, and OSD states on etcd state reload
...
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m24s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m24s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m21s
Details
Test / test_write (push) Successful in 36s
Details
Test / test_rebalance_verify (push) Successful in 4m12s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m29s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m25s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m10s
Details
Test / test_heal_ec (push) Successful in 4m46s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m31s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m41s
Details
Test / test_heal_csum_32k (push) Successful in 6m41s
Details
Test / test_scrub (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m53s
Details
Test / test_scrub_xor (push) Successful in 54s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 58s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m27s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m15s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m27s
Details
Test / test_heal_csum_4k (push) Successful in 6m20s
Details
Test / test_scrub_ec (push) Successful in 29s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Also add protection from etcd watcher messages being split into multiple websocket
messages - I'm not sure if etcd actually does that, but it's better to have extra
protection anyway.
Also check that all etcd watchers are started in the keepalive routine, otherwise
it sometimes tries to revive etcd watchers starting with revision=1 which obviously
always fails because this revision is nearly always compacted.
All these changes should fix an old rarely reproduced bug where SOMETIMES OSDs
didn't react to PG config changes which was leading to offline pools on node reboot.
It happened on the full reload of state from etcd.
2023-12-24 02:02:13 +03:00
Vitaliy Filippov
1299373988
Use the same etcd_ws_keepalive_interval in OSD and mon
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m58s
Details
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m36s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m8s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m58s
Details
Test / test_rebalance_verify (push) Successful in 3m55s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m18s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m8s
Details
Test / test_write_xor (push) Failing after 3m11s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m47s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m58s
Details
Test / test_heal_ec (push) Successful in 6m21s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m11s
Details
Test / test_heal_csum_32k (push) Successful in 6m22s
Details
Test / test_scrub (push) Successful in 1m17s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m17s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m35s
Details
Test / test_scrub_xor (push) Successful in 57s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m27s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m3s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m33s
Details
Test / test_scrub_ec (push) Successful in 44s
Details
Test / test_heal_csum_4k (push) Successful in 6m9s
Details
2023-12-23 20:07:29 +03:00
Vitaliy Filippov
178bb0e701
Prevent re-entry into timerfd set_nearest
Test / test_interrupted_rebalance_ec (push) Successful in 2m0s
Details
Test / test_rm (push) Successful in 19s
Details
Test / test_move_reappear (push) Successful in 23s
Details
Test / test_snapshot_ec (push) Successful in 40s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 2m32s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m10s
Details
Test / test_rebalance_verify (push) Successful in 4m2s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m25s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m19s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m8s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m26s
Details
Test / test_heal_csum_32k (push) Successful in 6m12s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m41s
Details
Test / test_scrub (push) Successful in 1m17s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 57s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m36s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m36s
Details
Test / test_scrub_ec (push) Successful in 31s
Details
Test / test_heal_csum_4k (push) Successful in 5m23s
Details
Test / test_write_xor (push) Successful in 1m4s
Details
Test / test_heal_ec (push) Successful in 3m29s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m20s
Details
2023-12-22 02:32:40 +03:00
Vitaliy Filippov
4ece4dfdd0
Fix mon not using values from config when /config/global is not present
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m24s
Details
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m57s
Details
Test / test_rebalance_verify (push) Successful in 3m47s
Details
Test / test_write (push) Successful in 44s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 56s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m29s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m42s
Details
Test / test_heal_ec (push) Successful in 5m1s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m10s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m57s
Details
Test / test_heal_csum_32k (push) Successful in 6m21s
Details
Test / test_scrub (push) Successful in 1m16s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_xor (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 8m15s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m1s
Details
Test / test_heal_csum_4k (push) Successful in 5m47s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m14s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m24s
Details
Test / test_scrub_ec (push) Successful in 27s
Details
2023-12-22 02:25:09 +03:00
Vitaliy Filippov
95631773b6
Remove pve-storage-portal-dns-list format for vitastor_etcd_address
2023-12-20 02:22:06 +03:00
Vitaliy Filippov
7239cfb91a
Parse log_level in cluster_client
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m52s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 20s
Details
Test / test_snapshot_down (push) Successful in 27s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_snapshot_chain (push) Successful in 2m18s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_rebalance_verify (push) Successful in 3m43s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m17s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m9s
Details
Test / test_write_xor (push) Failing after 3m16s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m49s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m6s
Details
Test / test_heal_ec (push) Successful in 6m46s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m25s
Details
Test / test_heal_csum_32k (push) Successful in 6m41s
Details
Test / test_scrub (push) Successful in 1m15s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m25s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m33s
Details
Test / test_scrub_xor (push) Successful in 1m7s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m16s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m56s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m7s
Details
Test / test_heal_csum_4k (push) Successful in 6m14s
Details
2023-12-20 02:21:23 +03:00
Vitaliy Filippov
7cea642f4a
Fix vitastor-nbd image existence check not working because of non-zeroed inode_watch fields
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m14s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m53s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m49s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 3m34s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 53s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m48s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m16s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m3s
Details
Test / test_heal_ec (push) Successful in 4m37s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m49s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m0s
Details
Test / test_heal_csum_32k (push) Successful in 6m59s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m6s
Details
Test / test_scrub (push) Successful in 1m13s
Details
Test / test_scrub_xor (push) Successful in 51s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m44s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m44s
Details
Test / test_scrub_ec (push) Successful in 45s
Details
Test / test_heal_csum_4k (push) Successful in 6m56s
Details
2023-12-19 01:11:37 +03:00
Vitaliy Filippov
dc615403d9
Do not warn on EPIPE in client unless log_level is raised explicitly
Test / test_snapshot_ec (push) Successful in 36s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m58s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 49s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m26s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 4m6s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 41s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m10s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m0s
Details
Test / test_heal_ec (push) Successful in 4m32s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m50s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m50s
Details
Test / test_heal_csum_32k (push) Successful in 7m6s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m2s
Details
Test / test_scrub (push) Successful in 1m6s
Details
Test / test_scrub_xor (push) Successful in 58s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m57s
Details
Test / test_heal_csum_4k (push) Successful in 6m42s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m42s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 53s
Details
Test / test_scrub_ec (push) Successful in 22s
Details
2023-12-17 13:42:26 +03:00
Vitaliy Filippov
1a704e06ab
Allow multiple interfaces with the same IP address, for "simple routed" full mesh network
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m59s
Details
Test / test_rm (push) Successful in 20s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 51s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m29s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m7s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_rebalance_verify (push) Successful in 3m59s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 41s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m20s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m17s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m52s
Details
Test / test_heal_ec (push) Successful in 5m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m38s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m7s
Details
Test / test_heal_csum_32k (push) Successful in 6m56s
Details
Test / test_scrub (push) Successful in 1m10s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_xor (push) Successful in 49s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m32s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m19s
Details
Test / test_heal_csum_4k (push) Successful in 6m3s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m45s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
2023-12-17 13:25:56 +03:00
Vitaliy Filippov
575475de71
Do not ignore loopback addresses for OSD network (to make ECMP setups with frr possible)
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m21s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m55s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m42s
Details
Test / test_write (push) Successful in 43s
Details
Test / test_rebalance_verify (push) Successful in 3m42s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 39s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m9s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m54s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m20s
Details
Test / test_heal_ec (push) Successful in 4m53s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m14s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m9s
Details
Test / test_heal_csum_32k (push) Successful in 6m49s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m56s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m10s
Details
Test / test_scrub_xor (push) Successful in 55s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m31s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m19s
Details
Test / test_heal_csum_4k (push) Successful in 6m16s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m44s
Details
Test / test_scrub_ec (push) Successful in 21s
Details
2023-12-17 11:55:13 +03:00
Vitaliy Filippov
aca2bef15f
Add vitastor-disk update-sb command
Test / test_snapshot_ec (push) Successful in 31s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 2m8s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m52s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m56s
Details
Test / test_write (push) Successful in 36s
Details
Test / test_rebalance_verify (push) Successful in 3m38s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m0s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m14s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m22s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m9s
Details
Test / test_heal_ec (push) Successful in 6m49s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m14s
Details
Test / test_heal_csum_32k (push) Successful in 6m12s
Details
Test / test_scrub (push) Successful in 1m21s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m21s
Details
Test / test_scrub_xor (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m9s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m3s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m48s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_heal_csum_4k (push) Successful in 6m2s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_write_xor (push) Failing after 3m5s
Details
2023-12-14 01:11:42 +03:00
Vitaliy Filippov
4dd6e89263
Change qemu to qemu-system-x86 in docs
2023-12-14 01:01:00 +03:00
Vitaliy Filippov
9bac99ffb6
Fix incorrect error in CSI when searching for the device in /sys
2023-12-14 01:00:32 +03:00
Vitaliy Filippov
62ed130960
Support building qemu 8.1 from bookworm-backports
2023-12-10 00:34:13 +03:00
Vitaliy Filippov
9c7755b6e8
Use qemu-storage-daemon from QEMU 8.1.2 for CSI
2023-12-08 00:10:12 +03:00
Vitaliy Filippov
691ebd991a
Move 2 last log printfs to stderr from stdout in etcd_state_client
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m46s
Details
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m12s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m57s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 22s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m45s
Details
Test / test_write (push) Successful in 31s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m32s
Details
Test / test_write_xor (push) Successful in 1m15s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 6m34s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m43s
Details
Test / test_heal_ec (push) Successful in 5m33s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m45s
Details
Test / test_heal_csum_32k (push) Successful in 6m37s
Details
Test / test_scrub (push) Successful in 1m3s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m39s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m37s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 54s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m29s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 48s
Details
Test / test_scrub_ec (push) Successful in 46s
Details
Test / test_heal_csum_4k (push) Successful in 5m31s
Details
2023-12-08 00:01:52 +03:00
Vitaliy Filippov
6d5df908a3
Fix possible out of bounds when checking invalid journal entries
2023-12-08 00:01:07 +03:00
Vitaliy Filippov
fa87769ed8
Correct config options in vduse docs
2023-12-06 02:09:04 +03:00
Vitaliy Filippov
2ce8292803
Also log when killing process
2023-12-06 01:06:53 +03:00
Vitaliy Filippov
7f8f7ded52
Check for empty output of vitastor-nbd map (just in case)
2023-12-06 01:01:14 +03:00
Vitaliy Filippov
68553eabbb
Log executed CLI commands
2023-12-06 00:48:12 +03:00
Vitaliy Filippov
3147c5c8d5
Remove internal error wrapping
2023-12-06 00:39:42 +03:00
Vitaliy Filippov
576e2ae608
Fix etcd_address check in CSI
2023-12-06 00:28:21 +03:00
Vitaliy Filippov
a1c7cc3d8d
Release 1.3.1
...
Test / test_interrupted_rebalance_ec (push) Successful in 1m46s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m22s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m59s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m3s
Details
Test / test_rebalance_verify (push) Successful in 3m47s
Details
Test / test_write (push) Successful in 44s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m36s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m20s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m45s
Details
Test / test_heal_ec (push) Successful in 6m22s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Details
Test / test_heal_csum_32k (push) Successful in 6m2s
Details
Test / test_scrub (push) Successful in 1m14s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m19s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m54s
Details
Test / test_scrub_xor (push) Successful in 1m1s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m59s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m54s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m2s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
Test / test_heal_csum_4k (push) Successful in 6m0s
Details
Test / test_write_xor (push) Successful in 32s
Details
Hotfix to 1.3.0 - new "journal space reservation" had a bug which
caused OSDs to crash with EC and without immediate_commit.
2023-12-04 18:35:09 +03:00
Vitaliy Filippov
a5e3dfbc5a
Oops, 1.3.0 needs a hotfix
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m53s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 27s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m56s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s
Details
Test / test_rebalance_verify (push) Successful in 3m38s
Details
Test / test_write (push) Successful in 45s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m5s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m22s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m51s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m39s
Details
Test / test_heal_ec (push) Successful in 6m39s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m55s
Details
Test / test_heal_csum_32k (push) Successful in 6m5s
Details
Test / test_scrub (push) Successful in 1m18s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m19s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m25s
Details
Test / test_scrub_xor (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m46s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m17s
Details
Test / test_heal_csum_4k (push) Successful in 5m51s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m0s
Details
Test / test_scrub_ec (push) Successful in 21s
Details
Test / test_write_xor (push) Successful in 33s
Details
2023-12-04 13:45:54 +03:00
Vitaliy Filippov
7972502eaf
Release 1.3.0
...
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m1s
Details
Test / test_snapshot_down (push) Successful in 19s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_snapshot_down_ec (push) Failing after 3m10s
Details
Test / test_rebalance_verify (push) Successful in 2m45s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m17s
Details
Test / test_write (push) Successful in 1m11s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m41s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_write_xor (push) Failing after 3m6s
Details
Test / test_rebalance_verify_ec (push) Failing after 5m27s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m36s
Details
Test / test_heal_csum_32k_dj (push) Failing after 4m53s
Details
Test / test_heal_csum_32k (push) Failing after 5m27s
Details
Test / test_heal_ec (push) Failing after 10m15s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m14s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m15s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 56s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m4s
Details
Test / test_heal_csum_4k (push) Failing after 5m31s
Details
Test / test_scrub_xor (push) Failing after 3m17s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 3m6s
Details
Test / test_change_pg_count_ec (push) Failing after 3m5s
Details
Test / test_snapshot_ec (push) Failing after 3m5s
Details
Test / test_scrub_ec (push) Failing after 3m5s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m5s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m5s
Details
New features:
- RDMA without ODP - much faster and all cards are now supported, not just Mellanox
- VDUSE in CSI - faster, more stable and can even recover after CSI pod restart!
- Reserve journal space for stabilize requests dynamically to prevent stalls under load with EC
- Raise default NBD timeout from 30 to 300 seconds and allow to take it from /etc/vitastor/vitastor.conf
- Remove explicit etcdUrl/etcdPrefix K8S storage class parameter support to prevent
etcd migration issues for volumes created with these parameters
- Support QEMU 8.1 and pve-qemu 8.1
Bug fixes:
- Fix RDMA connection (and thus memory) leak
- Fix rare crashes under load due to incorrect io_uring queue size tracking
- Fix monitor statistics aggregation in case of empty /osd/stats keys
- Fix crash on unknown long argument to vitastor-disk
- Allow trailing comma in JSONs again
- Fix crash on attempts to dump a long listing of objects "to stabilize" or "to rollback" in a slow op
2023-12-04 02:36:43 +03:00
Vitaliy Filippov
e57b7203b8
Use cmake3 on RHEL 7
2023-12-04 02:36:29 +03:00
Vitaliy Filippov
c8a179dcda
Note that Proxmox 8.1 is supported
2023-12-04 02:20:33 +03:00