Vitaliy Filippov
3d7f838c59
Verify checksums in test_heal in different combinations
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
7fe82c692e
Add a test for checksums
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
213a9ccb4d
Verify checksums during journal reads
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
7d532880c3
Implement large csum_block_size support (more than 4k) + refactor blockstore_flush
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
0b0405d115
Implement bitmap-granular (4k) metadata & data checksums
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
b7e4d0c9bf
Fix journal dirty_start position tracking and some debug prints
...
Fixes two bugs found during HDD testing :-)
1) OSD crashed with "BUG: Attempt to overwrite used offset of the journal" during
`fio -bs=900k -iodepth=128` test with 16 MB journal
2) OSD stalled during `fio -bs=512k -iodepth=128` test with 64 MB journal
2023-07-09 01:17:55 +03:00
Vitaliy Filippov
c8d61568b5
Fix primary_read bitmap buffers being freed too early (use-after-free)
Test / test_etcd_fail (push) Successful in 1m43s
Details
Test / test_interrupted_rebalance (push) Successful in 1m23s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m33s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m39s
Details
Test / test_failure_domain (push) Successful in 10s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 17s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m7s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m1s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 20s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 2m51s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m49s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m6s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m3s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_xor (push) Successful in 34s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m11s
Details
Test / test_heal_ec (push) Successful in 3m54s
Details
Test / test_scrub (push) Successful in 44s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 30s
Details
Test / test_scrub_xor (push) Successful in 31s
Details
Test / test_scrub_pg_size_3 (push) Successful in 37s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Details
Test / test_scrub_ec (push) Successful in 1m31s
Details
2023-06-30 12:47:45 +03:00
Vitaliy Filippov
b14220b4d0
Add a test for snapshot chain
2023-06-29 00:47:21 +03:00
Vitaliy Filippov
181d6ba407
Move npm install to CI build and remove it from tests
2023-06-28 23:41:46 +03:00
Vitaliy Filippov
a4186e20aa
First derive, then sum per-OSD statistics instead of first summing and then deriving
...
Test / test_change_pg_count (push) Successful in 43s
Details
Test / test_change_pg_count_ec (push) Successful in 37s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_failure_domain (push) Successful in 16s
Details
Test / test_interrupted_rebalance (push) Successful in 1m49s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m38s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m23s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 3m2s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m53s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m27s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot (push) Successful in 34s
Details
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_write (push) Successful in 37s
Details
Test / test_write_xor (push) Successful in 44s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m31s
Details
Test / test_heal_ec (push) Successful in 4m20s
Details
Test / test_scrub (push) Successful in 38s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 30s
Details
Test / test_scrub_xor (push) Successful in 32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 42s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 37s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
This makes statistics reported by vitastor-cli status much smoother
2023-06-18 01:32:24 +03:00
Vitaliy Filippov
9c405009f3
Use randrw in test_heal
Test / test_change_pg_count (push) Successful in 33s
Details
Test / test_change_pg_count_ec (push) Successful in 32s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 9s
Details
Test / test_etcd_fail (push) Successful in 51s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_interrupted_rebalance (push) Successful in 1m4s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m20s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 55s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_rebalance_verify (push) Successful in 1m47s
Details
Test / test_rebalance_verify_imm (push) Successful in 1m45s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m3s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 1m52s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot (push) Successful in 15s
Details
Test / test_snapshot_ec (push) Successful in 16s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_write (push) Successful in 31s
Details
Test / test_write_xor (push) Successful in 47s
Details
Test / test_write_no_same (push) Successful in 11s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m12s
Details
Test / test_scrub (push) Successful in 24s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 26s
Details
Test / test_scrub_xor (push) Successful in 26s
Details
Test / test_scrub_pg_size_3 (push) Successful in 25s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 42s
Details
Test / test_scrub_ec (push) Successful in 33s
Details
2023-06-03 00:49:53 +03:00
Vitaliy Filippov
150968070f
Slightly improve some debug prints
Test / test_change_pg_count (push) Successful in 30s
Details
Test / test_change_pg_count_ec (push) Successful in 31s
Details
Test / test_change_pg_size (push) Successful in 7s
Details
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Successful in 45s
Details
Test / test_failure_domain (push) Successful in 8s
Details
Test / test_interrupted_rebalance (push) Successful in 1m3s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 55s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m30s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 57s
Details
Test / test_minsize_1 (push) Successful in 20s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 1m49s
Details
Test / test_rebalance_verify_imm (push) Successful in 1m40s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 1m51s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot (push) Successful in 16s
Details
Test / test_snapshot_ec (push) Successful in 17s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_xor (push) Successful in 49s
Details
Test / test_write_no_same (push) Successful in 10s
Details
Test / test_heal_pg_size_2 (push) Successful in 2m58s
Details
Test / test_scrub (push) Successful in 23s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 19s
Details
Test / test_scrub_xor (push) Successful in 17s
Details
Test / test_scrub_pg_size_3 (push) Successful in 24s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 28s
Details
Test / test_scrub_ec (push) Successful in 25s
Details
2023-05-29 01:04:16 +03:00
Vitaliy Filippov
5997b76535
Remove -runtime=10 from fio params in test_scrub, it was breaking the test in CI :D
Test / test_change_pg_count (push) Successful in 49s
Details
Test / test_change_pg_count_ec (push) Successful in 2m53s
Details
Test / test_change_pg_size (push) Successful in 17s
Details
Test / test_create_nomaxid (push) Successful in 13s
Details
Test / test_etcd_fail (push) Successful in 1m0s
Details
Test / test_failure_domain (push) Successful in 13s
Details
Test / test_interrupted_rebalance (push) Successful in 1m18s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m3s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m40s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 52s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 23s
Details
Test / test_rebalance_verify (push) Successful in 2m32s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m29s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m55s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m30s
Details
Test / test_rm (push) Successful in 22s
Details
Test / test_snapshot (push) Successful in 26s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_write (push) Successful in 1m5s
Details
Test / test_write_xor (push) Successful in 2m13s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_heal_ec (push) Successful in 5m27s
Details
Test / test_scrub (push) Successful in 36s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 39s
Details
Test / test_scrub_xor (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_3 (push) Successful in 50s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 29s
Details
Test / test_scrub_ec (push) Successful in 1m25s
Details
2023-05-21 11:03:59 +03:00
Vitaliy Filippov
25fcedf6e7
Enable vitastor-cli fix in test
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
d55d7d5326
Add scrub test
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
1c7d53996d
Reweight only 2 OSDs to zero in test_rebalance_verify, otherwise the test does not pass with EC 3+2
Test / buildenv (push) Successful in 9s
Details
Test / build (push) Successful in 2m20s
Details
Test / test_cas (push) Successful in 11s
Details
Test / make_test (push) Successful in 35s
Details
Test / test_change_pg_size (push) Successful in 22s
Details
Test / test_change_pg_count (push) Successful in 52s
Details
Test / test_create_nomaxid (push) Successful in 19s
Details
Test / test_change_pg_count_ec (push) Successful in 1m3s
Details
Test / test_failure_domain (push) Successful in 13s
Details
Test / test_etcd_fail (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m3s
Details
Test / test_interrupted_rebalance (push) Successful in 1m14s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m1s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m38s
Details
Test / test_rebalance_verify (push) Successful in 2m20s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m1s
Details
Test / test_rm (push) Successful in 26s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m30s
Details
Test / test_snapshot (push) Successful in 22s
Details
Test / test_snapshot_ec (push) Successful in 28s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_write (push) Successful in 48s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m11s
Details
Test / test_write_xor (push) Successful in 1m28s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m48s
Details
Test / test_heal_ec (push) Successful in 5m12s
Details
Test / test_add_osd (push) Successful in 1m20s
Details
2023-05-18 00:42:40 +03:00
Vitaliy Filippov
2ca07b1ea7
Raise timeout in test_rebalance_verify
Test / buildenv (push) Successful in 10s
Details
Test / build (push) Successful in 2m27s
Details
Test / test_cas (push) Successful in 11s
Details
Test / make_test (push) Successful in 34s
Details
Test / test_change_pg_size (push) Successful in 22s
Details
Test / test_change_pg_count (push) Successful in 52s
Details
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_etcd_fail (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance (push) Successful in 1m15s
Details
Test / test_add_osd (push) Successful in 2m33s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m4s
Details
Test / test_change_pg_count_ec (push) Successful in 2m52s
Details
Test / test_minsize_1 (push) Successful in 19s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 53s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m36s
Details
Test / test_rebalance_verify (push) Successful in 2m22s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m22s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_rebalance_verify_ec (push) Failing after 3m6s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_write_no_same (push) Successful in 20s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 3m9s
Details
Test / test_write (push) Successful in 49s
Details
Test / test_write_xor (push) Successful in 1m17s
Details
Test / test_heal_ec (push) Successful in 4m53s
Details
Test / test_heal_pg_size_2 (push) Failing after 10m10s
Details
2023-05-17 01:58:01 +03:00
Vitaliy Filippov
e69d459d43
Allow rebalance to start in test_interrupted_rebalance, raise etcd start timeout
2023-05-13 15:16:28 +03:00
Vitaliy Filippov
da82754baa
Wait for conditions in test_move_reappear instead of waiting a fixed amount of time
2023-05-12 23:18:07 +03:00
Vitaliy Filippov
d356aca030
Add missing $NO_SAME OSD argument to test_splitbrain
2023-05-12 23:18:07 +03:00
Vitaliy Filippov
04a273d213
Raise NBD timeout in tests
2023-05-12 23:18:07 +03:00
Vitaliy Filippov
e431ecb715
Make tests more stable in CI
2023-05-11 01:53:41 +03:00
Vitaliy Filippov
ad2916068a
Fix test_add_osd rebalance timeout check
2023-05-08 20:39:20 +03:00
Vitaliy Filippov
cfcf4f4355
Support checking /dev/nbdX nodes in Docker
2023-05-08 20:39:20 +03:00
Vitaliy Filippov
e0fb17bfee
Make etcd more stable in tests (add ionice and raise timeout)
2023-05-08 20:36:00 +03:00
Vitaliy Filippov
5052174918
Fix test_write_no_same (too large image)
2023-04-24 00:44:41 +03:00
Vitaliy Filippov
eec9cf5575
Fix test_snapshot.sh - qemu-img requires explicit backing_fmt
2023-04-24 00:44:41 +03:00
Vitaliy Filippov
2f16c32eb4
Fix test_minsize_1 (left_on_dead)
2023-04-23 17:54:00 +03:00
Vitaliy Filippov
46462da45e
Preload own PG history updates to fix PG state loop possibly applying the old metadata version
2023-04-23 01:50:30 +03:00
Vitaliy Filippov
28d5e53c6c
Add test_heal to run_tests
2023-04-09 02:10:42 +03:00
Vitaliy Filippov
d9f55f11d8
More logs (log_level 10), append to log instead of overwriting on restart in tests
2023-04-09 02:06:10 +03:00
Vitaliy Filippov
137309cf29
Implement bdrv_co_block_status for snapshot export support
2023-01-07 17:06:58 +03:00
Vitaliy Filippov
b9b50ab4cc
Implement vitastor-disk purge command
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
bf6fdc4141
Check add/rm osd with 2048 PGs
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
c2244331e6
Add vitastor-cli rm-osd command
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
2d4cc688b2
Add a remove-osd test
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
a828a1233d
Remove old make-osd scripts
2022-09-03 02:04:21 +03:00
Vitaliy Filippov
dcc6d546be
Move simple-offsets into vitastor-disk, too
2022-07-15 02:19:35 +03:00
Vitaliy Filippov
85fa389557
Add a test for disk-tool resize
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
1eec4407ab
Fix inode creation when /index/maxid is out of sync
2022-06-06 16:35:51 +03:00
Vitaliy Filippov
be4087d9d2
Add a FIXME to test_interrupted_rebalance
2022-06-05 00:06:56 +03:00
Vitaliy Filippov
a0cae4c180
Rename "jerasure" to "ec" in pool configuration, function names, fix documentation and Debian build scripts
...
Old pool configurations with "jerasure" also remain supported as an alias for "ec"
2022-06-03 15:40:00 +03:00
Vitaliy Filippov
c4eb46600d
Merge run_3osds and run_7osds scripts
2022-06-03 01:56:36 +03:00
Vitaliy Filippov
82b9f4c52d
Add a test with OSD kills
2022-05-28 00:51:14 +03:00
Vitaliy Filippov
834554c523
LD_PRELOAD=libasan.so.5 fio in tests fails when vitastor is built with ASan
2022-05-05 02:11:34 +03:00
Vitaliy Filippov
5118980315
Add a script to run all tests
2022-04-09 01:14:00 +03:00
Vitaliy Filippov
0eb929f1ba
Fix change_pg_count test (statistic reporting may take some time)
2022-04-08 11:58:53 +03:00
Vitaliy Filippov
15dcaf7903
Add the same "rebalance" test with regular reads
2022-04-08 11:48:31 +03:00
Vitaliy Filippov
d334914948
Fix the test so it actually fails indicating a bug :-)
2022-04-07 15:56:26 +03:00
Vitaliy Filippov
a420c77107
Add rebalance-verify test
2022-04-03 10:42:06 +03:00