GRAPLEr: A Distributed Collaborative Environment for Lake Ecosystem Modeling that Integrates Overlay Networks, High-throughput Computing, and Web Services

dc.contributor.authorSubratie, Kensworth C.en
dc.contributor.authorAditya, Saumitraen
dc.contributor.authorFigueiredo, Renato J.en
dc.contributor.authorCarey, Cayelan C.en
dc.contributor.authorHanson, Paul C.en
dc.contributor.departmentBiological Sciencesen
dc.date.accessioned2016-10-19T20:03:37Zen
dc.date.available2016-10-19T20:03:37Zen
dc.date.issued2015-09-29en
dc.description.abstractThe GLEON Research And PRAGMA Lake Expedition -- GRAPLE -- is a collaborative effort between computer science and lake ecology researchers. It aims to improve our understanding and predictive capacity of the threats to the water quality of our freshwater resources, including climate change. This paper presents GRAPLEr, a distributed computing system used to address the modeling needs of GRAPLE researchers. GRAPLEr integrates and applies overlay virtual network, high-throughput computing, and Web service technologies in a novel way. First, its user-level IP-over-P2P (IPOP) overlay network allows compute and storage resources distributed across independently-administered institutions (including private and public clouds) to be aggregated into a common virtual network, despite the presence of firewalls and network address translators. Second, resources aggregated by the IPOP virtual network run unmodified high-throughput computing middleware (HTCondor) to enable large numbers of model simulations to be executed concurrently across the distributed computing resources. Third, a Web service interface allows end users to submit job requests to the system using client libraries that integrate with the R statistical computing environment. The paper presents the GRAPLEr architecture, describes its implementation and reports on its performance for batches of General Lake Model (GLM) simulations across three cloud infrastructures (University of Florida, CloudLab, and Microsoft Azure).en
dc.description.notes8 pages, 7 figures. PRAGMA29en
dc.identifier.urihttp://hdl.handle.net/10919/73296en
dc.language.isoenen
dc.relation.urihttp://arxiv.org/abs/1509.08955v1en
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectcs.DCen
dc.titleGRAPLEr: A Distributed Collaborative Environment for Lake Ecosystem Modeling that Integrates Overlay Networks, High-throughput Computing, and Web Servicesen
dc.typeArticle - Refereeden
pubs.organisational-group/Virginia Techen
pubs.organisational-group/Virginia Tech/All T&R Facultyen
pubs.organisational-group/Virginia Tech/Scienceen
pubs.organisational-group/Virginia Tech/Science/Biological Sciencesen
pubs.organisational-group/Virginia Tech/Science/COS T&R Facultyen
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
1509.08955v1.pdf
Size:
291.97 KB
Format:
Adobe Portable Document Format
Description:
Accepted Version
License bundle
Now showing 1 - 1 of 1
Name:
VTUL_Distribution_License_2016_05_09.pdf
Size:
18.09 KB
Format:
Adobe Portable Document Format
Description: