hsbench/README.md

70 lines
3.3 KiB
Markdown
Raw Normal View History

2017-06-09 19:36:33 +03:00
# Introduction
s3-benchmark is a performance testing tool provided by Wasabi for performing S3 operations (PUT, GET, and DELETE) for objects. Besides the bucket configuration, the object size and number of threads varied be given for different tests.
The testing tool is loosely based on the Nasuni (http://www6.nasuni.com/rs/nasuni/images/Nasuni-2015-State-of-Cloud-Storage-Report.pdf) performance benchmarking methodologies used to test the performance of different cloud storage providers
# Prerequisites
To leverage this tool, the following prerequisites apply
• Git development environment
• Ubuntu Linux shell programming skills
• Access to a Go 1.7 development system (only if the OS is not Ubuntu Linux 16.04)
• Access to the appropriate AWS EC2 (or equivalent) compute resource (optimal performance is realized using m4.10xlarge EC2 Ubuntu with 10 GB ENA)
2017-06-09 18:39:42 +03:00
# Building the Program
Obtain a local copy of the repository using the following git command with any directory that is convenient:
2017-06-09 19:36:33 +03:00
```
git clone https://github.com/wasabi-tech/s3-benchmark.git
```
You should see the following files in the s3-benchmark directory.
LICENSE README.md s3-benchmark.go s3-benchmark.ubuntu
2017-06-09 19:36:33 +03:00
If the test is being run on Ubuntu version 16.04 LTS (the current long term release), the binary
executable s3-benchmark.ubuntu will run the benchmark testing without having to build the executable.
2017-06-09 18:39:42 +03:00
Otherwise, to build the s3-benchmark executable, you must issue this following command:
/usr/bin/go build s3-bechmark.go
2017-06-09 18:39:42 +03:00
# Command Line Arguments
2017-06-09 19:36:33 +03:00
Below are the command line arguments to the program (which can be displayed using -help):
2017-06-09 18:39:42 +03:00
2017-06-09 19:36:33 +03:00
```
2017-06-09 18:39:42 +03:00
-a string
Access key
-b string
Bucket for testing (default "wasabi-benchmark-bucket")
-d int
Duration of each test in seconds (default 60)
-l int
Number of times to repeat test (default 1)
-s string
Secret key
-t int
Number of threads to run (default 1)
-u string
URL for host with method prefix (default "http://s3.wasabisys.com")
-z string
Size of objects in bytes with postfix K, M, and G (default "1M")
2017-06-09 19:36:33 +03:00
```
2017-06-09 18:39:42 +03:00
# Example Benchmark
2017-06-09 19:36:33 +03:00
Below is an example run of the benchmark for 10 threads with the default 1MB object size. The benchmark reports
for each operation PUT, GET and DELETE the results in terms of data speed and operations per second. The program
writes all results to the log file benchmark.log.
```
ubuntu:~/s3-benchmark$ ./s3-benchmark.ubuntu -a MY-ACCESS-KEY -b jeff-s3-benchmark -s MY-SECRET-KEY -t 10
Wasabi benchmark program v2.0
Parameters: url=http://s3.wasabisys.com, bucket=jeff-s3-benchmark, duration=60, threads=10, loops=1, size=1M
Loop 1: PUT time 60.1 secs, objects = 5484, speed = 91.3MB/sec, 91.3 operations/sec.
Loop 1: GET time 60.1 secs, objects = 5483, speed = 91.3MB/sec, 91.3 operations/sec.
Loop 1: DELETE time 1.9 secs, 2923.4 deletes/sec.
Benchmark completed.
```
2017-06-09 18:39:42 +03:00
2017-06-09 19:38:15 +03:00
# Note
Your performance testing benchmark results may vary most often because of limitations of your network connection to the cloud storage provider. Wasabi performance claims are tested under conditions that remove any latency (which can be shown using the ping command) and bandwidth bottlenecks that restrict how fast data can be moved. For more information,
contact Wasabi technical support (support@wasabi.com).