The Kangaroo Way to deal with Information Development on the Framework.


64 views
Uploaded on:
Description
The Kangaroo Approach to Data Movement on the Grid Douglas Thain, Jim Basney, Se-Chang Son, and Miron Livny http://www.cs.wisc.edu/condor/kangaroo “Half-Interactive” Jobs on the Grid The “Grid” is a dream of a global, profoundly accessible, vigorous, shared calculation administration.
Transcripts
Slide 1

The Kangaroo Approach to Data Movement on the Grid Douglas Thain, Jim Basney, Se-Chang Son, and Miron Livny http://www.cs.wisc.edu/condor/kangaroo

Slide 2

"Half-Interactive" Jobs on the Grid The "Matrix" is a dream of a universal, profoundly accessible, powerful, shared calculation administration. Lattice applications by and large… ..are half-intuitive. ..are fragile wrt blunders. ..have feeble consistency prerequisites. Can we perform on-line information access without subjecting applications to sudden mistakes? Application Unreliable Network

Slide 3

The Kangaroo Approach To Data Movement Make an outsider in charge of executing every application\'s I/O operations. Utilize every single accessible asset to shroud latencies. Stay away for the indefinite future a mistake to the application. (Perhaps tell the client or scheduler.) Benefits: Fault resistance, higher throughput. Taken a toll: Weaker consistency.

Slide 4

App File System File System File System File System The Vision: A Data Grid K Data Movement System K Disk

Slide 5

Kangaroo Prototype An application may contact any hub in the framework and perform halfway document peruses and composes. The hub may then execute or cushion operations as conditions warrant. K App Buffer Disk

Slide 6

User Interface An intervention specialist changes over POSIX operations into the Kangaroo convention. % vi/kangaroo/coral.cs.wisc.edu/and so on/hosts % gcc - c/gsiftp/ftp.cs.wisc.edu/test.c - o/kangaroo/coral/tmp/test.o K Agent App read, compose get, put Kangaroo POSIX

Slide 7

Macrobenchmark: Image Processing Post-preparing of satellite picture information: Need to figure different upgrades and deliver yield for each. Perused info picture For I=1 to N Compute change of picture Write yield picture Example: Image size around 5 MB Compute time around 6 sec IO-cpu proportion around 0.9 MB/s

Slide 8

I/O Models Compared CPU Released Task Done Offline I/O: INPUT CPU OUTPUT CPU Released Online I/O: INPUT CPU OUTPUT CPU OUTPUT CPU OUTPUT CPU OUTPUT CPU Released Task Done Task Done Kangaroo: INPUT CPU PUSH OUTPUT

Recommended
View more...