6.附上老外的性能测试
由测试结果可以看到使用api连接glusterfs性能比fuse提高近一倍,并且接近本地磁盘的速度.
The following numbers from FIO benchmark are to show the performance advantage of using QEMU’s GlusterFS block driver instead of the usual FUSE mount while accessing the VM image.
Test setup
Host | Dual core x86_64 system running Fedora 17 kernel (3.5.6-1.fc17.x86_64) |
Guest | Fedora 17 image, 4 way SMP, 2GB RAM, using virtio and cache=none QEMU options |
QEMU options
FUSE mount | qemu-system-x86_64 –enable-kvm –nographic -smp 4 -m 2048 -drive file=/mnt/F17,if=virtio,cache=none => /mnt is GlusterFS FUSE mount point |
GlusterFS block driver in QEMU (FUSE bypass) | qemu-system-x86_64 –enable-kvm –nographic -smp 4 -m 2048 -drive file=gluster://bharata/test/F17,if=virtio,cache=none |
Base (VM image accessed directly from brick) | qemu-system-x86_64 –enable-kvm –nographic -smp 4 -m 2048 -drive file=/test/F17,if=virtio,cache=none => /test is brick directory |
FIO load files
Sequential read direct IO | ; Read 4 files with aio at different depths [global] ioengine=libaio direct=1 rw=read bs=128k size=512m directory=/data1 [file1] iodepth=4 [file2] iodepth=32 [file3] iodepth=8 [file4] iodepth=16 |
Sequential write direct IO | ; Write 4 files with aio at different depths [global] ioengine=libaio direct=1 rw=write bs=128k size=512m directory=/data1 [file1] iodepth=4 [file2] iodepth=32 [file3] iodepth=8 [file4] iodepth=16 |
FIO READ numbers
aggrb (KB/s) | minb (KB/s) | maxb (KB/s) | |
FUSE mount | 15219 | 3804 | 5792 |
QEMU’s GlusterFS block driver (FUSE bypass) | 39357 | 9839 | 12946 |
Base | 43802 | 10950 | 12918 |
FIO WRITE numbers
aggrb (KB/s) | minb (KB/s) | maxb (KB/s) | |
FUSE mount | 24579 | 6144 | 8423 |
QEMU’s GlusterFS block driver (FUSE bypass) | 42707 | 10676 | 17262 |
Base | 42393 | 10598 | 15646 |
Updated numbers
Here are the recent FIO numbers averaged from 5 runs using latest QEMU (git commit: 03a36f17d77) and GlusterFS (git commit: cee1b62d01). The test environment remains same as above with the following two changes:
- The GlusterFS volume has write-behind translator turned off
- The host kernel is upgraded to 3.6.7-4.fc17.x86_64
FIO READ numbers
aggrb (KB/s) | % Reduction from Base | |
Base | 44464 | 0 |
FUSE mount | 21637 | -51 |
QEMU’s GlusterFS block driver (FUSE bypass) | 38847 | -12.6 |
FIO WRITE numbers
aggrb (KB/s) | % Reduction from Base | |
Base | 45824 | 0 |
FUSE mount | 40919 | -10.7 |
QEMU’s GlusterFS block driver (FUSE bypass) | 45627 | -0.43 |