Remote Direct Memory Access (RDMA) over IP Problem Statement

Metadata

Publisher: IETF
Doc Type: Informational
Pages: 20
Abstract: Overhead due to the movement of user data in the end-system network I/O processing path at high speeds is significant, and has limited the use of Internet protocols in interconnection networks, and the Internet itself -- especially where high bandwidth, low latency, and/or low overhead are required by the hosted application. This document examines this overhead, and addresses an architectural, IP-based "copy avoidance" solution for its elimination, by enabling Remote Direct Memory Access (RDMA). This memo provides information for the Internet community.
Publication Date: 2005-12-01
Status Note: Informational
DOI: 10.17487/RFC4297
Link: https://doi.org/10.17487/RFC4297
Author(s): Dr. Allyn Romanow
Jeffrey Mogul
Tom Talpey
Stephen Bailey
Keyword(s): Copy Avoidance

Latest version of IETF RFC 4297

Document Versions — IETF RFC 4297

▶ IETF RFC 4297 (2005-12-01)

THIS DOC [ACTIVE] [LATEST VERSION]

Bibliographic Reference(s)

ANSI.X3.269.1996 — [8] EXTERNAL
ISBN.0971288704 — VI EXTERNAL
ISO.9314 — FDDI EXTERNAL
V. S. Pai, P. Druschel, W. Zwaenepoel, "IO-Lite: a unified I/O buffering and caching system", Proc. of the 3rd Symposium on Operating Systems Design and Implementation, New Orleans, LA, February 1999. EXTERNAL
J. R. Walsh, "DART: Fast application-level networking via data-copy avoidance", IEEE Network, July/August 1997, pp. 28-38. EXTERNAL
J. L. Hennessy, D. A. Patterson, Computer Organization and Design, 2nd Edition, San Francisco: Morgan Kaufmann Publishers, 1997. EXTERNAL
P. Druschel, M. B. Abbott, M. A. Pagels, L. L. Peterson, "Network subsystem design", IEEE Network, July 1993, pp. 8-17. EXTERNAL
Quadrics Ltd., Quadrics QSNet product information, available from http://www.quadrics.com/website/pages/02qsn.html . EXTERNAL
Jeffrey Chase, Personal communication. EXTERNAL
J. C. Brustoloni, "Interoperation of copy avoidance in network and file I/O", Proceedings of IEEE Infocom, 1999, pp. 534-542. EXTERNAL
C-H Chang, D. Flower, J. Forecast, H. Gray, B. Hawe, A. Nadkarni, K. K. Ramakrishnan, U. Shikarpur, K. Wilde, "High-performance TCP/IP and UDP/IP networking in DEC OSF/1 for Alpha AXP", Proceedings of the 3rd IEEE Symposium on High Performance Distributed Computing, August 1994, pp. 36-42. EXTERNAL
J. Kay, J. Pasquale, "Profiling and reducing processing overheads in TCP/IP", IEEE/ACM Transactions on Networking, Vol 4, No. 6, pp.817-828, December 1996. EXTERNAL
T. von Eicken, A. Basu, V. Buch, and W. Vogels, "U-Net: A user-level network interface for parallel and distributed computing", Proc. of the 15th ACM Symposium on Operating Systems Principles, Copper Mountain, Colorado, December 3-6, 1995. EXTERNAL
K. Kleinpaste, P. Steenkiste, B. Zill, "Software support for outboard buffering and checksumming", SIGCOMM'95. EXTERNAL
D. D. Clark, V. Jacobson, J. Romkey, H. Salwen, "An analysis of TCP processing overhead", IEEE Communications Magazine, volume: 27, Issue: 6, June 1989, pp 23-29. EXTERNAL
D. D. Clark, D. Tennenhouse, "Architectural considerations for a new generation of protocols", Proceedings of the ACM SIGCOMM Conference, 1990. EXTERNAL
J. D. McCalpin, "A Survey of memory bandwidth and machine balance in current high performance computers", IEEE TCCA Newsletter, December 1995. EXTERNAL
J. Pinkerton, "Winsock Direct: The Value of System Area Networks", May 2001, available from http://www.microsoft.com/windows2000/techinfo/ howitworks/communications/winsock.asp . EXTERNAL
C. Dalton, G. Watson, D. Banks, C. Calamvokis, A. Edwards, J. Lumley, "Afterburner: architectural support for high- performance protocols", Technical Report, HP Laboratories Bristol, HPL-93-46, July 1993. EXTERNAL
InfiniBand Trade Association, "InfiniBand Architecture Specification, Volumes 1 and 2", Release 1.1, November 2002, available from http://www.infinibandta.org/specs . EXTERNAL
The ATM Forum, "Asynchronous Transfer Mode Physical Layer Specification" af-phy-0015.000, etc. available from http://www.atmforum.com/standards/approved.html . EXTERNAL
D. Patterson, T. Anderson, N. Cardwell, R. Fromm, K. Keeton, C. Kozyrakis, R. Thomas, K. Yelick , "A case for intelligient RAM: IRAM", IEEE Micro, April 1997. EXTERNAL
H.K. Chu, "Zero-copy TCP in Solaris", Proc. of the USENIX 1996 Annual Technical Conference, San Diego, CA, January 1996. EXTERNAL
M. A. Blumrich, K. Li, R. Alpert, C. Dubnicki, E. W. Felten, "A virtual memory mapped network interface for the SHRIMP multicomputer", in Proceedings of the 21st Annual Symposium on Computer Architecture, April 1994, pp. 142- 153. EXTERNAL
G. Buzzard, D. Jacobson, M. Mackey, S. Marovich, J. Wilkes, "An implementation of the Hamlyn send-managed interface architecture", in Proceedings of the Second Symposium on Operating Systems Design and Implementation, USENIX Assoc., October 1996. EXTERNAL
R. Horst, "TNet: A reliable system area network", IEEE Micro, pp. 37-45, February 1995. EXTERNAL
P. Druschel, L. L. Peterson, "Fbufs: a high-bandwidth cross-domain transfer facility", Proceedings of the 14th ACM Symposium of Operating Systems Principles, December 1993. EXTERNAL
J. C. Brustoloni, P. Steenkiste, "Effects of buffering semantics on I/O performance", Proceedings OSDI'96, USENIX, Seattle, WA October 1996, pp. 277-291. EXTERNAL
N. J. Boden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic, and W. Su. "Myrinet - A gigabit-per-second local-area network", IEEE Micro, February 1995. EXTERNAL
M. N. Thadani, Y. A. Khalidi, "An efficient zero-copy I/O framework for UNIX", Technical Report, SMLI TR-95-39, May 1995. EXTERNAL
K. Magoutis, S. Addetia, A. Fedorova, M. I. Seltzer, J. S. Chase, D. Gallatin, R. Kisley, R. Wickremesinghe, E. Gabber, "Structure and Performance of the Direct Access File System (DAFS)", in Proceedings of the 2002 USENIX Annual Technical Conference, Monterey, CA, June 9-14, 2002. EXTERNAL
J. S. Chase, A. J. Gallatin, and K. G. Yocum, "End system optimizations for high-speed TCP", IEEE Communications Magazine, Volume: 39, Issue: 4 , April 2001, pp 68-74. http://www.cs.duke.edu/ari/publications/end- system .{ps,pdf}. EXTERNAL
InfiniBand Trade Association, "Sockets Direct Protocol v1.0", Annex A of InfiniBand Architecture Specification Volume 1, Release 1.1, November 2002, available from http://www.infinibandta.org/specs . EXTERNAL
K. Magoutis, "Design and Implementation of a Direct Access File System (DAFS) Kernel Server for FreeBSD", in Proceedings of USENIX BSDCon 2002 Conference, San Francisco, CA, February 11-14, 2002. EXTERNAL
J. D. McAlpin, The STREAM Benchmark Reference Information, http://www.cs.virginia.edu/stream/ . EXTERNAL
IETF RFC 793 [Superseded*]
IETF RFC 2246 [Superseded*]
IETF RFC 2401 [Superseded*]
IETF RFC 2616 [Superseded*]
IETF RFC 4296 [Active*]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/RFC4297.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

IETF RFC 4297, Remote Direct Memory Access (RDMA) over IP Problem Statement. Available at https://doi.org/10.17487/RFC4297

Snippet:

IETF RFC 4297, Remote Direct Memory Access (RDMA) over IP Problem Statement. Available at https://doi.org/10.17487/RFC4297

HTML (ISO 690 compliant)

Preview:

IETF RFC 4297, Remote Direct Memory Access (RDMA) over IP Problem Statement. Available at https://doi.org/10.17487/RFC4297

Snippet:

<span class="citation"><cite>IETF RFC 4297</cite>, Remote Direct Memory Access (RDMA) over IP Problem Statement. Available at <a href="https://doi.org/10.17487/RFC4297" target="_blank" rel="noopener">https://doi.org/10.17487/RFC4297</a></span>

SMPTE's HTML Pub

Preview:

IETF RFC 4297, Remote Direct Memory Access (RDMA) over IP Problem Statement
doi: 10.17487/RFC4297
url: https://doi.org/10.17487/RFC4297

Snippet:

<li>
<cite id="bib-rfc4297">IETF RFC 4297</cite>, Remote Direct Memory Access (RDMA) over IP Problem Statement
<span class="doi">10.17487/RFC4297</span>
</li>

Referenced By

IETF RFC 4296 [Active*]
IETF RFC 5044 [Active*]
IETF RFC 5532 [Active*]
IETF RFC 7143 [Active*]