Note on Three Classes of Data Grid Operations

DOI: 10.4236/jcc.2014.26001   PDF   HTML   XML   3,216 Downloads   4,727 Views  

Abstract

Traditional grid computing focuses on the movement of data to compute resources and the management of large scale simulations. Data grid computing focuses on moving the operations to the storage location and on operations on data collections. We present three types of data grid operations that facilitate data driven research: the manipulation of time series data, the reproducible execution of workflows, and the mapping of data access to software-defined networks. These data grid operations have been implemented as operations on collections within the NSF DataNet Federation Consortium project. The operations can be applied at the remote resource where data are stored, improving the ability of researchers to interact with large collections.

Share and Cite:

Rajasekar, A. , Xu, H. and Moore, R. (2014) Note on Three Classes of Data Grid Operations. Journal of Computer and Communications, 2, 1-6. doi: 10.4236/jcc.2014.26001.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1] DataNet Federation Consortium. http://datafed.org
[2] Rajasekar, R., Wan, M., Moore, R., Schroeder, W., Chen, S.-Y., Gilbert, L., Hou, C.-Y., Lee, C., Marciano, R., Tooby, P., De Torcy, A. and Zhu, B. (2010) iRODS Primer: Integrated Rule-Oriented Data System. Morgan & Claypool.
[3] Ward, J., Wan, M., Schroeder, W., Rajasekar, A., de Torcy, A., Russell, T., Xu, H. and Moore, R. (2011) The Integrated Rule-Oriented Data System (iRODS 3.0) Micro-Service Workbook. DICE Foundation, Amazon.com.
[4] Ocean Observatories Initiative. http://oceanobservatories.org
[5] NetCDF Network Common Data Form. http://www.unidata.ucar.edu/software/NetCDF/
[6] OPeNDAP Protocol. http://www.opendap.org
[7] ERDDAP Environmental Research Division’s Data Access Program.
http://coastwatch.pfeg.noaa.gov/erddap/index.html
[8] PyDAP Python Data Access Protocol. http://www.pydap.org
[9] NEXRAD Next Generation Radar. http://www.ncdc.noaa.gov/oa/radar/radarresources.html
[10] LandSat Thematic Mapper Data. http://landsat.gsfc.nasa.gov
[11] NASA MODIS Moderate Resolution Imaging Spectroradiometer Data. http://modis.gsfc.nasa.gov
[12] NCEP/NCAR National Centers for Environmental Prediction/National Center for Atmospheric Research Reanalysis. http://www.esrl.noaa.gov/psd/data/reanalysis/reanalysis.shtml
[13] The iPlant Collaborative. https://www.iplantcollaborative.org
[14] OpenFlow Switch. https://www.opennetworking.org/sdn-resources/onf-specifications/openflow
[15] ExoGeni Global Environment for Network Innovation Testbed. http://www.exogeni.net

  
comments powered by Disqus

Copyright © 2020 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.