Cloud Computing and Big Data: A Review of Current Service Models and Hardware Perspectives

Richard Branch, Heather Tjeerdsma, Cody Wilson, Richard Hurley, Sabine McConnell

Department of Computing and Information Systems, Trent University, Peterborough, Canada.

DOI: 10.4236/jsea.2014.78063                

Abstract

Big Data applications are pervading more and more aspects of our life, encompassing commercial and scientific uses at increasing rates as we move towards exascale analytics. Examples of Big Data applications include storing and accessing user data in commercial clouds, mining of social data, and analysis of large-scale simulations and experiments such as the Large Hadron Collider. An increasing number of such data—intensive applications and services are relying on clouds in order to process and manage the enormous amounts of data required for continuous operation. It can be difficult to decide which of the many options for cloud processing is suitable for a given application; the aim of this paper is therefore to provide an interested user with an overview of the most important concepts of cloud computing as it relates to processing of Big Data.

Keywords

Big Data, Cloud Computing, Cloud Storage, Software as a Service, NoSQL, Architectures

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	NIST (2011) The NIST Definition of Cloud Computing. http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf
[2]	NIST (2011) NIST Cloud Computing Reference Architecture. http://www.nist.gov/customcf/get_pdf.cfm?pub_id=909505
[3]	Zhang, Q., Cheng, L. and Boutaba, R. (2010) Cloud Computing: State-Of-The-Art and Research Challenges. Journal of Internet Services and Applications, 1.1, 7-18.
[4]	Dillon, T., Wu, C. and Chang, E. (2010) Cloud Computing: Issues and Challenges. Proceedings of the 24th IEEE International Conference on Advanced Information Networking and Applications (AINA), Perth, 20-23 April 2010, 27-33. http://dx.doi.org/10.1109/AINA.2010.187
[5]	Google (2013) Google App Engine. https://developers.google.com/appengine/
[6]	Microsoft (2013) Microsoft Azure. http://www.azure.microsoft.com/en-us/
[7]	Amazon (2013) Amazon EC2. http://aws.amazon.com/ec2/
[8]	Ambrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski A., Lee, G., Patterson, D., Rabkin, A., Stoica, I. and Zaharia, M. (2010) A View of Cloud Computing. Communications of the ACM, 53.4, 50-58. http://dx.doi.org/10.1145/1721654.1721672
[9]	Feldman, M. (2013) The Big Data Challenge: Intelligent Tiered Storage at Scale. http://www.cray.com/Assets/PDF/Integrated_Tiered_Storage_Whitepaper.pdf
[10]	Rouse, M. (2008) Flash Storage. http://whatis.techtarget.com/definition/flash-storage
[11]	Lawson, S. (2014) IBM Updates All-Flash Storage Array to Complement X6 Servers. http://www.infoworld.com/t/solid-state-drives/ibm-updates-all-flash-storage-array-complement-x6-servers-234432
[12]	Amazon (2010) AWS Import/Export. http://docs.aws.amazon.com/AWSImportExport/latest/DG/whatisIE.html
[13]	Jansen, W. (2011) Guidelines on Security and Privacy in Public Cloud Computing. National Institute of Standards and Technology, U.S. Department of Commerce, Computer Security Division, Gaithersburg.
[14]	Williams, P. (2012) The NoSQL Movement—What Is It? http://www.dataversity.net/the-nosql-movement-what-is-it/
[15]	Greene, N. (2013) The Five Key Advantages (And Disadvantages) of NoSQL. http://greendatacenterconference.com/blog/the-five-key-advantages-and-disadvantages-of-nosql/
[16]	Williams, P. (2012) The NoSQL Movement: Key-Value Databases. http://www.dataversity.net/the-nosql-movement-key-value-databases/
[17]	Loshin, D. (2013) An Introduction to NoSQL Data Management for Big Data. http://data-informed.com/introduction-nosql-data-management-big-data/#sthash.NuRvqbd4.dpuf http://data-informed.com/introduction-nosql-data-management-big-data
[18]	Williams, P. (2012) The NoSQL Movement—Graph Databases. http://www.dataversity.net/the-nosql-movement-graph-databases/
[19]	Williams, P. (2012) The NoSQL Movement: Document Databases. http://www.dataversity.net/the-nosql-movement-document-databases/
[20]	Williams, P. (2012, November 13). The NoSQL Movement—Big Table Databases. http://www.dataversity.net/the-nosql-movement-big-table-databases/
[21]	Fay Chang, J.D. (2006) Bigtable: A Distributed Storage System for Structured Data. OSDI’06: Seventh Symposium on Operating System Design and Implementation.
[22]	Nickolls, J. and Dally, W.J. (2010) The GPU Computing Era. IEEE Micro, 30, 56-69. http://dx.doi.org/10.1109/MM.2010.41
[23]	Jacobs, A. (2009) The Pathologies of Big Data.acmqueue.
[24]	McGillicuddy, S. (2013) IBM Selects Juniper QFabric for Big Data Networking. http://searchnetworking.techtarget.com/news/2240207684/IBM-selects-Juniper-QFabric-for-big-data-networking
[25]	Sammer, E. (2012) Hadoop Operations. O’Reilly Media, Inc., Sebastopol.
[26]	Merchant, S. (2011) Is a Fabric Architecture in Your Future? http://www.datacenterknowledge.com/archives/2011/08/04/is-a-fabric-architecture-in-your-future/
[27]	Cisco (2014) Big Data in the Enterprise—Network Design Considerations White Paper. http://www.cisco.com/c/en/us/products/collateral/switches/nexus-5000-series-switches/white_paper_ c11-690561.html