Google Play icon

NRL and Collaborators Conduct 100 Gigabit/Second Remote I/O Demonstration

Share
Posted November 24, 2014

The U.S. Naval Research Laboratory (NRL), in collaboration with the DOE’s Energy Sciences Network (ESnet), the International Center for Advanced Internet Research (iCAIR) at Northwestern University, the Center for Data Intensive Science (CDIS) at the University of Chicago, the Open Cloud Consortium (OCC) and significant industry support, have conducted a 100 gigabits per second (100G) remote I/O demonstration at the SC14 supercomputing conference in New Orleans, LA.

The display is cycling through various 4Gbps streams where each stream has remote processing applied. In this case, the normal color bar sequence has "Shagadelic" filtering applied by processing at the first location and "edge detection" applied a second location along the path. (Photo: U.S. Naval Research Laboratory)

The display is cycling through various 4Gbps streams where each stream has remote processing applied. In this case, the normal color bar sequence has “Shagadelic” filtering applied by processing at the first location and “edge detection” applied a second location along the path. (Photo: U.S. Naval Research Laboratory)

The remote I/O demonstration illustrates a pipelined distributed processing framework and software defined networking (SDN) between distant operating locations. The demonstration shows the capability to dynamically deploy a production quality 4K Ultra-High Definition Television (UHDTV) video workflow across a nationally distributed set of storage and computing resources that is relevant to emerging Department of Defense data processing challenges.

The remote I/O strategy allows data processing to start as soon as data begins to arrive at the compute location rather than waiting for bulk transfers to complete. This is achieved at near 100% efficiency over global distances and with low CPU loading using RDMA over Converged Ethernet (RoCE) and Open Fabrics Enterprise Distribution (OFED). The storage nodes generate multiple uncompressed, full quality 4K UHDTV video streams that fill a 100G link.

A single solid-state storage device at the Department of Energy’s NERSC supercomputing facility in Oakland, CA, offers remote access to that data over the ESnet’s 100G testbed via a connection to Chicago, IL, that brings in iCAIR’s StarLight International/National Communications Exchange Facility, then through New York City.

Video processing is accomplished in Oakland, Chicago, Washington, DC and New Orleans and shows the ability to process against remote data “on the fly” without first doing bulk data transfers. This demonstration showcases the remote process and management of ultra-capacity streams processing and networking over 100 Gbps WANs.

Future capabilities of the “Pipelines” processing framework application will automatically switch video sources and redistribute the processing. The Pipelines manager will dynamically redirect the data flow to line up with the processing options by using prearranged VLANs or by requesting the SDN controller to reconfigure the network such as the Software Defined Exchange capabilities at StarLight in Chicago.

Source: NRL

Featured news from related categories:

Technology Org App
Google Play icon
87,495 science & technology articles

Most Popular Articles

  1. An 18 carat gold nugget made of plastic (January 13, 2020)
  2. Anti Solar Cells: A Photovoltaic Cell That Works at Night (February 3, 2020)
  3. Toyota Raize is a new cool compact SUV that we will not see in this part of the world (November 24, 2019)
  4. Nuclear waste could be recycled for diamond battery power (January 21, 2020)
  5. Physicist Proposes a Testable Theory Stating that Information has Mass and could Account for Universe s Dark Matter (January 24, 2020)

Follow us

Facebook   Twitter   Pinterest   Tumblr   RSS   Newsletter via Email