| | Providing scalable clustered storage in a cost-effective way depends on the availability of an efficient network block device (nbd) layer. We study the performance of gmblock, an nbd server over Myrinet utilizing a direct disk-to-NIC data path which bypasses the CPU and main memory bus. To overcome the architectural limitation of a low number of outstanding requests, we focus on overlapping read and network I/O for a single request, in order to improve throughput. To this end, we introduce the concept of synchronized send operations and present an implementation on Myrinet/GM, based on custom modifications to the NIC firmware and associated userspace library. Compared to a network block sharing system over standard GM and the base version of gmblock, our enhanced implementation supporting synchronized sends delivers 81% and 44% higher throughput for streaming block I/O, respectively. |
<
< | Interconnects
Publications
- M. Athanasaki, E. Koukis, N. Koziris, "Efficient Scheduling of Tiled Iteration Spaces onto a Fixed Size Parallel Architecture," 9th Panhellenic Conference in Informatics, pp.178-192, Thessaloniki, Greece, November 21 23, 2003
- M. Athanasaki, E. Koukis, N. Koziris, "Scheduling of Tiled Nested Loops onto a Cluster with a Fixed Number of SMP Nodes," 12th Euromicro Conference on Parallel, Distributed and Network based Processing (PDP '04), pp.424-433, A Coruna, Spain, February 11-13, 2004
- Ε. Koukis and Ν. Koziris, "Memory Bandwidth Aware Scheduling for SMP Cluster Nodes," Proceedings of the 13th Euromicro Conference on Parallel, Distributed and Network-based Processing (PDP '05), pp. 187-196, Lugano, Switzerland, 6-11 Feb. 2005
- Ε. Koukis and Ν. Koziris, "Memory and Network Bandwidth Aware Scheduling of Multiprogrammed Workloads on Clusters of SMPs," Proceedings of the 12th International Conference on Parallel and Distributed Systems (ICPADS 2006), pp. 345-354, Minneapolis, MN, USA, 12-15 July, 2006
- Ε. Koukis and Ν. Koziris, "Efficient Block Device Sharing over Myrinet with Memory Bypass," Proceedings of the 21th International Parallel and Distributed Processing Symposium (IPDPS 2007), p. 29, Long Beach, CA, USA, 26-30 March, 2007
- Ε. Koukis, A. Nanos and Ν. Koziris, “Synchronized Send Operations for Efficient Streaming Block I/O over Myrinet,” Proceedings of the Workshop on Communication Architecture for Clusters (CAC 2008), held in conjunction with the 22nd International Parallel and Distributed Processing Symposium (IPDPS 2008), Miami, FL, USA, 14-18 April, 2008, to appear
|
