A High Performance Implementation of the Data Space Transfer Protocol (DSTP)

@incollection{citeulike:1512145, abstract = {With the emergence of high performance networks, clusters of workstations can now be connected by commodity networks (meta-clusters) or high speed networks (super-clusters) such as the very high speed Backbone Network Service (vBNS) or Internet2's Abilene. Distributed clusters are enabling a new class of data mining applications in which large amounts of data can be transferred using high performance networks and statistically and numerically intensive computations can be done using clusters of workstations. In this paper, we briefly describe a protocol called the Data Space Transfer Protocol (DSTP) for distributed data mining. With high performance networks, it becomes possible to move large amounts of data for certain queries when necessary. This paper describes the design of a high performance DSTP data server called Osiris which is designed to efficiently satisfy data requests for distributed data mining queries. In particular, we describe 1) Osiris's ability to lay out data by row or by column, 2) a scheduler intended to handle requests using standard network links and requests using network links enjoying some type of premium service, and 3) a mechanism designed to hide latency.}, author = {Bailey, Stuart and Creel, Emory and Grossman, Robert and Gutti, Srinath and Sivakumar, Harinath }, citeulike-article-id = {1512145}, journal = {Large-Scale Parallel Data Mining}, pages = {802}, posted-at = {2007-07-30 04:02:45}, priority = {2}, title = {A High Performance Implementation of the Data Space Transfer Protocol (DSTP)}, url = {http://www.springerlink.com/content/7772477rpqqq63tu }, year = {2000} }

TY - CHAP ID - citeulike:1512145 L3 - citeulike-article-id:1512145 TI - A High Performance Implementation of the Data Space Transfer Protocol (DSTP) JF - Large-Scale Parallel Data Mining SP - 802 EP - 802 N2 - With the emergence of high performance networks, clusters of workstations can now be connected by commodity networks (meta-clusters) or high speed networks (super-clusters) such as the very high speed Backbone Network Service (vBNS) or Internet2's Abilene. Distributed clusters are enabling a new class of data mining applications in which large amounts of data can be transferred using high performance networks and statistically and numerically intensive computations can be done using clusters of workstations. In this paper, we briefly describe a protocol called the Data Space Transfer Protocol (DSTP) for distributed data mining. With high performance networks, it becomes possible to move large amounts of data for certain queries when necessary. This paper describes the design of a high performance DSTP data server called Osiris which is designed to efficiently satisfy data requests for distributed data mining queries. In particular, we describe 1) Osiris's ability to lay out data by row or by column, 2) a scheduler intended to handle requests using standard network links and requests using network links enjoying some type of premium service, and 3) a mechanism designed to hide latency. AU - Bailey, Stuart AU - Creel, Emory AU - Grossman, Robert AU - Gutti, Srinath AU - Sivakumar, Harinath PY - 2000/// UR - http://www.springerlink.com/content/7772477rpqqq63tu ER -