Vitaliy Filippov
21e7686037
Fix possible "assertion failed: pg.inflight >= 0" error during PG stop
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
ab21a1908b
Check for the dirty PG flag when trying to continue to stop it after sync
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
30d1ccd43e
Fix an infinite loop when discarding list operations during stop_pg()
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
8bdd6d8d78
Reset PG state when stopping them
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
09b3e4e789
Fix OSDs being unable to stop PGs that are 'peering', not 'active'
...
This was sometimes leading to incorrect misplaced and degraded object count statistics
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
07912fd670
Use history/last_clean_pgs to avoid extra data move when observing a series of changes in the cluster
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
bc742ccf8c
Fix a small memory leak in etcd_state_client
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
314b20437b
Do not break subsequent small writes badly when a big write is canceled
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
29bac892ad
Add .gitignore
2021-03-08 17:04:10 +03:00
Vitaliy Filippov
cf7547faf3
Fix *.sh build scripts
2021-03-02 02:17:11 +03:00
Vitaliy Filippov
ab90ed747f
Release 0.5.6
...
- Fix operation statistics
- Fix a rebalance hang introduced in 0.5.5
- Test PG count changes with actual data moving
- Fix a possible 'unexpected pg state: 0' error during PG count change
2021-03-01 16:26:04 +03:00
Vitaliy Filippov
29d8ac8b1b
Do not report statistics for the empty operation
2021-03-01 16:20:57 +03:00
Vitaliy Filippov
97795ea1b1
Use pg_minsize=2 in the pg_count change test
...
Also don't check for has_degraded because it's not a bug that objects
are _temporarily_ listed as degraded during PG peering as it's not
required for the new primary to connect to _all_ older peers to start
peering. The test may be improved in the future by temporarily disabling
degraded recovery during it and returning the has_degraded check back.
2021-03-01 16:18:08 +03:00
Vitaliy Filippov
24e7075f08
Fix monitor's statistics aggregation
2021-02-28 19:51:16 +03:00
Vitaliy Filippov
6155b23a7e
Replace pgs[id] with pgs.at(id) to prevent accidental auto-vivification
2021-02-28 19:36:59 +03:00
Vitaliy Filippov
7d49706c07
Improve the pg_count change test: add more OSDs and actually move data between them
2021-02-28 19:36:59 +03:00
Vitaliy Filippov
46e79f3306
Wait for PGs to become clean before stopping them
2021-02-28 19:36:59 +03:00
Vitaliy Filippov
41fd14e024
Fix deletes not increasing write_iodepth
2021-02-28 19:36:59 +03:00
Vitaliy Filippov
bb2d9a3afe
Release 0.5.5
...
- Transition to CMake build system
- Fix Monitor being unable to change PG sizes
- Fix PG optimizer not using some OSDs in some cases
- Fix inability to change PG count online
- Improve journal flusher performance
- Add a little better systemd unit generator
- Use w=8 with jerasure (breaking change for EC pools)
2021-02-26 01:59:18 +03:00
Vitaliy Filippov
e899ed2c25
Make OSDs with 256 flushers (as they are now dynamic)
2021-02-26 01:59:18 +03:00
Vitaliy Filippov
e21b14b72c
Fix rpm specs for building with CMake
2021-02-26 01:59:18 +03:00
Vitaliy Filippov
5af8eddaa9
Add the remaining build script for Debian
2021-02-26 01:59:18 +03:00
Vitaliy Filippov
4f5a94c07a
Modify instructions for the CMake build
2021-02-26 00:28:57 +03:00
Vitaliy Filippov
e16b87ecc8
Rename random_combinations() parameter from "unordered" to "ordered" as it's more correct
2021-02-25 23:59:34 +03:00
Vitaliy Filippov
fcb4aa0a11
Fix Monitor being unable to change PG sizes
2021-02-25 23:59:34 +03:00
Vitaliy Filippov
12adfa470c
Add a test for changing PG size
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
7f15e0c084
Add a simple test for the PG optimizer
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
08d4bef419
Fix PG optimizer removing PGs without adding new ones
...
This happened when the distribution was already valid for the current OSD tree,
but didn't use all OSDs. For example, OSDs 1 2 3 and all PGs equal to [ 1, 2 ]
remained unchanged.
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
2d73b19a6c
Fix online PG count change bugs
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
69c87009e9
Add a test for changing PG count
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
c974cb539c
Make flusher_count adaptive and limit write iodepth
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
00e98f64f3
A little better systemd unit generator
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
91a70dfb1b
Add a test for the no_same_sector_overwrites mode
2021-02-25 23:59:33 +03:00
Vitaliy Filippov
178388ac8c
Use packages/ subdir instead of build/ for Docker package builds
2021-02-25 23:59:04 +03:00
Vitaliy Filippov
bf9a175efc
Move C/C++ sources to src subdirectory
2021-02-25 23:59:03 +03:00
Vitaliy Filippov
08aed962de
Use CMake
2021-02-25 23:58:08 +03:00
Vitaliy Filippov
8c65e890b9
Slightly clean up the build script
2021-02-25 23:56:54 +03:00
Vitaliy Filippov
8cda70b889
Allow to enable AddressSanitizer with "ASAN=1 make"
2021-02-25 23:55:33 +03:00
Vitaliy Filippov
61ab22403a
Use w=8 with jerasure
2021-02-25 23:55:33 +03:00
Vitaliy Filippov
16da663a66
Add another test for failure domains
2021-02-25 23:55:33 +03:00
Vitaliy Filippov
4a2dcf7b6b
Update the license to VNPL 1.1
...
VNPL 1.1 is slightly reworded to make it clear that proprietary software
interacting with Vitastor and providing some kind of service to end users isn't
a "Proxy Program" if it's not specially designed to be used with Vitastor.
For example, Windows OS running in a virtual machine stored in a Vitastor
cluster clearly isn't.
2021-02-25 23:55:33 +03:00
Vitaliy Filippov
8d48cc56b0
Generate randomly permutated OSD combinations when optimizing for compressed chunks
2021-02-25 23:55:33 +03:00
Vitaliy Filippov
9f58f01425
Mirror afr.js from /vitalif/ceph-afr-calc
2021-02-25 23:55:33 +03:00
Vitaliy Filippov
b9e7d31aa1
Release v0.5.4
...
- Fix a rare hang, more or less reproducible with very slow drives
- Fix a hang with the no_same_sector_overwrites mode
2021-02-24 01:40:30 +03:00
Vitaliy Filippov
2d9f09dcb6
Attempt forced trim when stopping an overrun flusher
...
Fixes a rare hang happening in the event of journal space running out without
new work to do for flushers except the current sector.
The hang could be reproduced more or less consistently with very slow drives.
2021-02-24 01:33:01 +03:00
Vitaliy Filippov
7cc59260c5
Fix no_same_sector_overwrites related bug
2021-02-23 18:50:51 +03:00
Vitaliy Filippov
ca0a11ec85
Release 0.5.3
2021-02-03 00:38:57 +03:00
Vitaliy Filippov
51c0b5afee
Whitelist more leaks
2021-02-02 02:05:41 +03:00
Vitaliy Filippov
e1e01d042e
Rename sector_info.usage_count to flush_count
2021-02-02 01:32:23 +03:00
Vitaliy Filippov
534a4a657e
Rename space_check.sectors_required to sectors_to_write
2021-02-02 01:30:23 +03:00