Vitaliy Filippov
5fe3a40416
More fixes for QEMU 2.x :)
2021-12-02 02:25:50 +03:00
Vitaliy Filippov
15957b7d13
Update QEMU 4.2 patch and CentOS 7 QEMU 4.2 spec patch
2021-12-02 01:03:19 +03:00
Vitaliy Filippov
5859f913fc
Fix client failover in case of etcd shutdown or crash
2021-12-01 00:33:02 +03:00
Vitaliy Filippov
92362027a8
Build vitastor driver as part of the QEMU package by default
...
Old behaviour can be restored with cmake var WITH_QEMU=true
2021-11-29 02:05:26 +03:00
Vitaliy Filippov
c4aeeda143
Fix index removal in vitastor-cli rm
2021-11-29 02:00:05 +03:00
Vitaliy Filippov
24f0f8278a
Fix modify --readwrite
2021-11-29 01:52:21 +03:00
Vitaliy Filippov
95496d0845
Implement renaming images in CLI (vitastor-cli modify --rename)
2021-11-28 22:38:57 +03:00
Vitaliy Filippov
94b1f09ef2
Create snapshots in the same pool by default
2021-11-28 21:50:42 +03:00
Vitaliy Filippov
7a0b5212fe
Exit if unable to restart watches
...
FIXME: It's probably not OK for the client to exit in this case
2021-11-28 01:43:31 +03:00
Vitaliy Filippov
ce5b6253ab
Make OSDs stick to the last successful etcd address
...
Previously OSDs were selecting a new random etcd from the cluster
on every request so they were failing randomly when part of etcds was down
2021-11-27 23:48:56 +03:00
Vitaliy Filippov
8398ad0117
Fix #36 - Fix old version data sometimes overriding new version data
...
Reproduction case:
- v3 = (offset 4kb, length 16kb)
- v2 = (offset 24kb, length 16kb)
- v1 = (offset 16kb, length 16kb)
- At the third step it was inserting 16..24kb instead of 20..24kb
2021-11-27 01:17:45 +03:00
Vitaliy Filippov
fea451b4db
Prefer local etcd in OSD
2021-11-27 00:36:53 +03:00
Vitaliy Filippov
7b7f20fb89
Merge pull request #34 from mirrorll/master
...
report pg state failed
2021-11-25 10:26:42 +03:00
Vitaliy Filippov
300d507026
Fix capture of out in alloc_osd
2021-11-25 10:20:01 +03:00
harley
6886171289
report pg state failed
...
after report pg state failed parse response error
2021-11-25 09:34:34 +08:00
Vitaliy Filippov
43f8ea47a0
Ok, something is not allowed somewhere in C99
2021-11-24 11:28:10 +03:00
Vitaliy Filippov
6e0e172e15
Implement OSD address selection from a specified subnet
2021-11-23 21:59:26 +03:00
Vitaliy Filippov
879fe9b2b4
Add a patch for qemu 6.1 and replace _ with - in qemu options
2021-11-21 16:24:30 +03:00
Vitaliy Filippov
660c3f7b0d
Change default RDMA settings to 128x 129K buffers
...
129K to leave extra space for the header
The problem with 8x 1M buffers is that the following happens with,
for example, 2 OSDs and 4M T1Q1 write:
- Server posts 8 receives
- Client posts 8 sends
- WRs are processed by the RDMA stack, but the OSD doesn't have the time
to handle them and doesn't refill buffers
- Client posts 1 more send
- RNR retransmission happens and performance drops to zero
Overall it seems that RDMA support should be reworked to use real 'RDMA'
operations i.e. operations writing into remote memory. This has an
additional advantage of avoiding a copy at the receive side of the OSD.
2021-11-21 12:05:52 +03:00
Vitaliy Filippov
f0ebfae3b8
Fix vitastor-cli alloc-osd, use vitastor-cli in make-osd.sh
2021-11-21 00:01:03 +03:00
Vitaliy Filippov
eb7ad2c114
Fix empty size syntax, use C version of simple-offsets in tests
2021-11-20 23:51:26 +03:00
Vitaliy Filippov
cd21ff0b6a
Rewrite simple-offsets.js in C/C++
2021-11-19 02:39:56 +03:00
Vitaliy Filippov
d3903f039c
Implement alloc-osd (allocate a new OSD number) command
2021-11-19 02:39:37 +03:00
Vitaliy Filippov
c5029961ea
Oops. Fix vitastor-cli ls
2021-11-16 12:39:41 +03:00
Vitaliy Filippov
920345f7b6
Release 0.6.8
...
- Build separate packages for OSD, monitor, client, C header, fio and QEMU drivers
instead of one package which included everything
2021-11-15 00:49:21 +03:00
Vitaliy Filippov
75b47a6298
Generate pkg-config file
2021-11-15 00:49:21 +03:00
Vitaliy Filippov
7eabc364bf
Release 0.6.7
...
- Implement CLI commands for listing, viewing I/O statistics, creating,
snapshotting, cloning, resizing and modifying images. All these operations
are covered by 3 commands: ls, create, modify
- Implement an important fix to prior OSD set tracking for PGs. The previous
version had an issue which could lead to data loss due to an OSD with older
copy of the data thinking it has the newest copy
- Fix I/O statistics aggregation in the monitor
- Several minor fixes for Cinder driver
- Fix QEMU driver to be compatible with QEMU 2.x > 2.0
- Fix stalls sometimes possible in configurations without immediate_commit due
to insufficient amount of automatic internal fsync operations
- Add `vita` alias for `vitastor-cli`
2021-11-13 23:23:55 +03:00
Vitaliy Filippov
a346f84c69
Allow to show only specific images in listing
2021-11-13 23:23:55 +03:00
Vitaliy Filippov
71a0c1a7b9
Fix list sorting
2021-11-13 23:23:55 +03:00
Vitaliy Filippov
110b39900b
Rename the new "set" command to "modify"
2021-11-13 22:39:17 +03:00
Vitaliy Filippov
42479b4590
Fix vitastor-nbd list, add ls alias
2021-11-13 22:39:17 +03:00
Vitaliy Filippov
6e82044e84
Add `vita` symlink
2021-11-13 22:39:17 +03:00
Vitaliy Filippov
2cb3e84882
Implement CLI set (resize, change readonly status) command
2021-11-13 22:39:17 +03:00
Vitaliy Filippov
aa436027c8
Report pg/history from OSD on every degraded activation
...
Required to prevent data loss due to activation of an OSD with older data
when PG OSD set change doesn't occur. I.e. fixes the simplest case:
- Run 2 OSDs with 1 PG
- Start writing into the PG
- Stop OSD 2
- Stop OSD 1
- Start OSD 2
After this change the PG will refuse to start after the last step.
2021-11-13 22:39:17 +03:00
Vitaliy Filippov
577a563b91
Allow to disable colored output
2021-11-11 01:41:58 +03:00
Vitaliy Filippov
e4efa2c08a
Improve vitastor-cli ls - show I/O statistics, allow to sort & limit output
2021-11-11 01:41:58 +03:00
Vitaliy Filippov
d528cd77f1
Fix install_symlink
2021-11-09 16:42:29 +03:00
Vitaliy Filippov
4d43774cbb
Use 5s etcd_report_interval by default
2021-11-09 01:27:12 +03:00
Vitaliy Filippov
a1488f7217
Fix qemu_driver to build with QEMU 2.x (previously it was only correct for QEMU 2.0)
2021-11-08 23:07:31 +03:00
Vitaliy Filippov
404e07d365
Implement image/snapshot/clone creation and listing by pool
2021-11-07 01:01:07 +03:00
Vitaliy Filippov
b3dcee0d43
Also print "bare" inodes with missing config if they occupy space
2021-11-06 14:56:41 +03:00
Vitaliy Filippov
609bd4eb59
Remove naggy RDMA messages when log level is zero
2021-11-06 14:36:23 +03:00
Vitaliy Filippov
8e445ddc9a
Begin to implement CLI: implement listing, add help, add create stub
2021-11-06 14:32:19 +03:00
Tân Lê
e889ac4209
Fix building QEMU 3.1
2021-11-05 13:45:51 +07:00
Vitaliy Filippov
cfe8de9b84
Autosync based on number of unstable ops to prevent journal stalls
2021-10-30 14:26:48 +03:00
Vitaliy Filippov
fb2f7a0d3c
Release 0.6.6
...
- New command-line tool: vitastor-cli
- Implement layer (snapshot/clone) merge and delete
- Remove 'bool' from the C header
- Fix a very rare flusher stall
- More diagnostics now printed for slow ops in the log
2021-10-19 02:26:37 +03:00
Vitaliy Filippov
38d85da19a
Fix build for older gcc
2021-10-19 02:26:37 +03:00
Vitaliy Filippov
89dcda1fed
Remove "bool" from the C header
2021-10-18 01:49:07 +03:00
Vitaliy Filippov
1526e2055e
Do not crash with RDMA when receiving garbage, free RDMA buffers when connection is closed
2021-10-15 23:56:22 +03:00
Vitaliy Filippov
74cb3911db
Rebase children of the "inverse" child when it is removed, change /index/image/%s keys during metadata ops
2021-09-26 13:41:48 +03:00