Petabytes in Motion: Ultra High Speed Transport of Media Files: A Theoretical Study and its Engineering Practice of Aspera fasp

Metadata

Publisher: SMPTE — White Plains, NY
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2010, No. 10, pp. 2–13
Abstract: With the explosive growth of file-based entertainment content, fast movement of massive digital data over global distances is vital to business success. The Transmission Control Protocol (TCP) that provides reliable data movement has inherent bottlenecks in performance, especially for WANs with large bandwidth, high round-trip time and packet loss. Network file systems (NFS, CIFS) and wide area block based storage protocols (iSCSI) that utilize TCP have severe performance bottlenecks over such WANs. Block-based protocols such as fibre channel provide a high-speed data pathway in the LAN but are impractical over the WAN. This paper introduces fasp (fast and secure protocol), which overcomes the network bottleneck, only to expose other bottlenecks in the end systems, such as in the disk I/O and network file systems. This “last foot” of data movement is our focus. We cover multi-Gigabit per second transfer benchmarks with major storage vendors, across SAN, LAN, and WAN, and explain the key engineering practices learned to maximize the transmission speed and efficiency.
Publication Date: 2010-10-01
DOI: 10.5594/M001352
Link: https://doi.org/10.5594/M001352
Author(s): Xingzhe FanAspera, Inc.
Michelle MunsonAspera, Inc.
Keyword(s): Protocol, Storage
Copyright: © 2010 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

[i] Munson M.C. Simu S. , European Patent Number 1867110, “Bulk Data Transfer” , Issued February 10, 2010 and US Patent Application 11/317,663 (in progress). EXTERNAL
[ii] Brakmo L.S. O'Malley S.W. Peterson L. L. , “TCP Vegas: new techniques for congestion detection and avoidance,” SIGCOMM Computer Communications Review 24 , 4 (Oct. 1994 ), 24–35. DOI=doi.acm.org/10.1145/190809.190317. EXTERNAL
[iii] Floyd S. Ratnasamy S. Shenker S. , “Modifying TCP's Congestion Control for High Speeds,” Internet draft, May 2002 . EXTERNAL
[iv] Floyd S. Jacobson V. V , “Random early detection gateways for congestion avoidance,” IEEE/ACM Transactions on Networking 1 , 4 (Aug. 1993 ), 397 – 413 . DOI=dx.doi.org/10.1109/90.251892. EXTERNAL
[v] Kelly F. Maulloo A. Tan D. “Rate control in communication networks: shadow prices, proportional fairness and stability” , Journal of the Operational Research Society , vol. 49 , pp. 237 – 252 , 1998 . EXTERNAL
[vi] Brakmo L. S. Peterson L. L. , “TCP Vegas: end-to-end congestion avoidance on a global internet,” IEEE Journal Selected Areas in Communications , vol. 13 , no. 8 , pp. 1465 – 1480 , Oct. 1995 . EXTERNAL
[vii] http://sourceforge.net/projects/iperf/ . EXTERNAL
[viii] http://www.apposite-tech.com/products/10g.html . EXTERNAL
[ix] Batsakis A. Burns R. Talpey T. Kanevsky A. Lentini J. “Enhancing the Linux Memory Architecture to Support File Systems over Heterogeneous Devices. Position paper at Linux File Systems and IO Workshop (LSF)” , USENIX , 2007 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001352.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Xingzhe Fan and Michelle Munson; Petabytes in Motion: Ultra High Speed Transport of Media Files: A Theoretical Study and its Engineering Practice of Aspera fasp, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at https://doi.org/10.5594/M001352

Snippet:

Xingzhe Fan and Michelle Munson; Petabytes in Motion: Ultra High Speed Transport of Media Files: A Theoretical Study and its Engineering Practice of Aspera fasp, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at https://doi.org/10.5594/M001352

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Xingzhe Fan and Michelle Munson; <cite>Petabytes in Motion: Ultra High Speed Transport of Media Files: A Theoretical Study and its Engineering Practice of Aspera fasp</cite>, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at <a href="https://doi.org/10.5594/M001352" target="_blank" rel="noopener">https://doi.org/10.5594/M001352</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Xingzhe Fan and Michelle Munson; <cite id="bib-10-5594-m001352">Petabytes in Motion: Ultra High Speed Transport of Media Files: A Theoretical Study and its Engineering Practice of Aspera fasp</cite>, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010
<span class="doi">10.5594/M001352</span>
</li>