IJERD (www.ijerd.com) International Journal of Engineering Research and Development IJERD : hard copy of journal, Call for Papers 2012, publishing of journal, journal of science and technology, research paper publishing, where to publish research paper,

International Journal of Engineering Research and Development
e-ISSN: 2278-067X, p-ISSN: 2278-800X, www.ijerd.com
Volume 3, Issue 1 (August 2012), PP. 45-50

Study and Applications of Cluster Grid and Cloud Computing
Umesh Chandra Jaiswal
Department of Computer Science & Engineering, Madan Mohan Malaviya Engineering College, Gorakhpur – 273 010
(UP)

Abstract––The technology is changing very rapidly in the modern age to fulfill the computing requirements. A cluster
is a collection of parallel or distributed computers which are interconnected among them using high-speed networks. Clusters
are used mainly for high availability, load-balancing and for high speed computation purpose. The grid gained momentum and
became a mean for effective way of coordinated resource sharing and problem solving in dynamic, multi-institutional virtual
organizations after many years of research and development. A Grid basically uses the processing capabilities of different
computing units for a single task. This task though is managed by a single primary computing machine. It divides the tasks into
numerous tasks and gets processed from different computing machine in the cluster. As soon as these tasks are completed by the
machines, they send the result back to the primary machine which takes care of controlling all the tasks. All the results are
clubbed together and a single output is generated. Grid computing has been used in environments where users make few but
large allocation requests. Cloud computing provides a pool of computing resources which the users can access through Internet.
This paper presents an end-to-end comparison among different computing environments such as Cluster, Grid and Cloud
computing. This paper discusses all these models in detail that will give a better way to understand these models and to know
how these models are different from each other. This also discusses the ongoing projects and applications that use these
computing models as a platform for execution. This paper also discusses about tools to be used to design and develop
applications using discussed computing models. This paper may provide a platform to have some innovative ideas for
implementation of these computing models.

Keywords––Cluster Computing, Grid Computing, Cloud Computing, Related projects, Applications of these models,
Simulation Techniques

I. INTRODUCTION
Computer environment is changing so rapidly and modern computers have changed the definition parameters of
performance factors completely. High-performance computing (HPC) was once restricted to institutions that could afford the
significantly expensive and dedicated supercomputers of the time. There was a huge requirement for HPC in small scale and at a
lower cost which lead to Cluster computing. Modern conventional computing changed the way computers are used. In the mid of
1990s Grid computing originated in academia with an aim to facilitate the uses of idle computing power placed in remote places
with in other computing centres when local machine is busy. Initially it was only referred as a computing grid and had a limited
number of users. Grid computing became an effective way for coordinated resources sharing and problem solving in dynamic multi-
institutional virtual organizations after long dedicated researches in the area. Cloud computing, is a kind of computing model that
came into existence around the end of 2007. It provides a pool of computing resources which the users can access through Internet.
The basic principle of cloud computing is to shift the computing performed from the local computer into the networks [4]. This
makes the enterprise to use the resource which includes network, server, storage, application, service and so on that is required without
huge investment on its purchase, implementation, maintenance rather use it for other significant purpose. Resources are requested on-
demand with out any prior reservation and hence eliminate over provisioning and improve resource utilization. Cloud computing
is an emerging computing technology that uses the internet and central remote server to maintain data and applications. This
technology allows for much more efficient computing by centralizing storage, memory processing and bandwidth. Cloud computing
provides a pool of computing resources which the users can access through Internet. This paper presents an end-to-end comparison
among different computing environments like Cluster Computing, Grid computing and Cloud computing.
The paper is explained in six sections. Section II briefly explaines cloud computing, grid computing, and cluster
computing models. Issues and challenges related to these computing models are listed in Section III that compares these three
models from different perspectives. Section IV discusses projects and applications. Tools and simulation environment are discussed in
Section V. Concluding remarks are presented in Section VI.

II. THREE COMPUTING MODELS
This section presents in brief the three computing models such as cluster, Grid and cloud computing:

Cluster Computing: the super-computer was the leader in the field of computing for many yers. But due to some of the problems
faced in the area of science, engineering and business, which could not be effectively dealt with using supercomputers, they were
replaced with clusters with the aim of overcoming these problems and also offered a very cheap way for gaining access to
potentially huge computing power.

45


Definition: A cluster is a collection of parallel or distributed computers which are interconnected among them using high-speed
networks, such as gigabit Ethernet, SCI, Myrinet and Infiniband. They work together in the execution of com-pate intensive and
data intensive tasks that would be not feasible to execute on a single computer. Clusters are used mainly for high availability, load-
balancing and for compute purpose. They are used for high availability purpose as they maintain redundant nodes which are used to
provide service when system components fail. The performance of the system is improved here because even if one node fails there
is another standby node which will carry the task and eliminates single points of failure without any hindrance. When multiple
computers are linked together in a cluster, they share computational workload as a single virtual computer. From the users view
point they are multiple machines, but they function as a single virtual machine. The user's request are received and distributed
among all the standalone computers to form a cluster. This results in balanced computational work among different machines,
improving the performance of the cluster systems.

Grid computing: This combines computers from multiple to divide and apportion pieces of a program among several computers.
Grid computing involves computation in a distributed fashion, which may also involve the aggregation of large-scale cluster
computing- based systems. The size of a grid may vary from small a network of computer workstations within a corporation to large
collaborations across many companies and networks. Some of the definitions on grid computing are given below:
Definition: Ian Foster defined grid as a system that coordinates resources which are not subject to centralized control, using standard,
open, general-purpose protocols and interfaces to deliver nontrivial qualities of service.

Cloud Computing: According to Buyya et. al. [10] a cloud is a type of parallel and distributed system consisting of a collection of
interconnected and virtualized computers that are dynamically provisioned and presented as one or more unified computing resources
based on service-level agreement. Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a
shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly
provisioned and released with minimal management effort or service provider interaction [11]. Cloud computing provides
basically three kinds of service: Software as a Service (SaaS), Platform as a Service (PaaS) and Infrastructure as a Service
(IaaS) as shown in figure1.

SaaS is a kind of service where many users can make use of the software hosted by the service provider and pay only
for time its being used. It will be better than buying the hardware and software as keeps off the burden of updating the software to
the latest version, licensing and is of course more economical. Some example service providers are Sales force, Customer
Relationships Management (CRM) system and Google Apps.
PaaS provides a high level integrated environment to demand sign, build, test, deploy and update online custom
applications. Some example service providers are Google's App different Engine, Microsoft Azure RightScale and SalesForce.
IaaS refers to the service provided to the user processing power, storage, network, and other computing resources to run
any software including Operating system and applications. Some of the IaaS providers are AWS, Eucalyptus, Open Stack, GoGrid
and Flexi scale. This structure is shown in Fig. I.

III. CHALLENGES IN CLUSTER, GRID AND CLOUD COMPUTING
A. Challenges in the Cluster Computing:
The research challenges of cluster computing are as follows:
i) Middleware: To produce software environments that provides an illusion of a single system image, rather than a
collection of independent computers.
ii) Program: The applications that run on the clusters must be explicitly written which incorporates the division of tasks
between nodes; also the communication between them should be taken care of.
iii) Elasticity: The variance in real-time response time when the number of service requests changes dramatically.
iv) Scalability: To meet the requirements of resources thus affecting the performance of the system.

B. Challenges in the Grid Computing:
The research challenges faced in grids include:
i) Dynamicity: Resources in grid are owned and managed by more than one organization which may enter and leave the
grid at any time causing burden on the grid.
ii) Administration: To form a unified resource pool, a heavy system administration burden is raised along with other
maintenance work to coordinate local administration policies with global ones.
iii) Development: Problems are concerned with ways of writing software to run on grid-computing platforms, which
includes decomposing and distributing to processing elements, and then assembling solutions.
iv) Accounting: Finding ways to support different accounting infrastructure, economic model and application models that
can cope well with tasks that communicate frequently and are interdependent.
v) Heterogeneity: Finding ways to create a wide area data intensive programming and scheduling framework in
heterogeneous set of resources.
vi) Programming: The low-coupling between nodes and the distributed nature of processing make the programming of
applications over grids more complex.

C. Challenges in the Cloud Computing:
i) Dynamic scalability: The compute nodes are scaled up and down dynamically by the application according to the
response time of the user's queries. The scheduling delays involved are real concern which leads to the need of effective and
dynamic load management system.
46


ii) Multi-tenancy: When the number of applications running on the same compute node increases, it will reduce the amount of
bandwidth allocated to each application which may lead to performance degradation.
iii) Querying and access: Scalable provenance querying and secure access of provenance information is open problems for
both grid and cloud environment.
iv) Standardization: As every organization has their own APIs and protocols used which makes the user data or vendor
lock-in. Thus integration and interoperability of all the services and application is a challenge.
v) Reliability and fault-tolerance: Tools for testing the application against fault tolerance and compute failures are required
which help in developing a reliable system.
vi) Debugging and profiling: Parallel and remote debugging has always been a problem for developing HPC programs and is an
issue in cloud computing also.
vii) Security and Privacy: The user has no idea where data is stored and who will use it as there are more hackers than
developers.
viii) Power: Though cloud computing offers many type of services finally to meet the needs of users, enormous amount
of power is consumed. An autonomic energy aware resource management is very much required.

The computing comparisons of cluster, grid and cloud have been given in the Table-I.

IV. PROJECTS AND APPLICATIONS IN CLUSTER, GRID AND CLOUD COMPUTING
A. Cluster computing projects and applications
Some of the projects in the field of cluster computing are:
i) Condor [4]: It is a multifaceted project engaged in five primary activities.
-Research in distributed computing.
- Participation in the scientific community.
- Engineering of complex software.
- Maintenance of production environments.
- Education of students
ii) ShaRCS (Shared Research Computing Services)[5]:This pilot project has been designed to define, demonstrate and
measure how shared computing and storage clusters residing in regional data centers can provide computing services
to investigators
iii) The Weather Research and Forecast (WRF): This is a collaborative project by several institutions to develop a next-
generation regional forecast model and data assimilation system for operational numerical weather prediction and
atmospheric research.
iv) Hadoop [4]: This is an open-source framework for running data-intensive applications in a processing cluster built from
commodity server hardware. Some customers use Hadoop clustering to analyze customer search patterns for targeted
advertising. Other applications include filtering and indexing of web listings, facial recognition algorithms to search for
images in a large database.

Clusters were also used for solving grand challenging applications such as weather modeling, automobile crash
simulations, life sciences, computational ﬂuid dynamics, nuclear simulations, image processing, electromagnetic, data mining,
aerodynamics and astrophysics. Clusters were used as a platform for data mining applications which involve both compute and data
intensive operations. They are also used for commercial applications like in banking sector to have achieved high availability and
for backup. Clusters are used to host many new Internet service sites like Hotmail, web applications, database, and other
commerce a application.

B. Grid Projects and Applications
Some of the projects in grid computing have been discussed in brief below.
i) Globus [5]: It is open source grid software that addresses most challenging problems in distributed resource sharing.
The first release of Globus Demo Grid [6], a tool that will build an instructional grid environment that can be
deployed using virtual machines on a cloud or on physical resources. The main goal of Demo Grid is to provide easy
access to an environment with various grid tools, without having to install the tools themselves or needing an account on an
existing grid.
ii) EGI-InSPIRE [7] project (Integrated Sustainable Pan-European Infrastructure for Researchers in Europe):
Started in 2010, co-funded by the European Commission for four years, as a collaborative effort involving more than 50
institutions in over 40 countries. Its mission is to establish a sustainable European Grid Infrastructure (EGI) to join
together the new Distributed Computing Infrastructures (DCIs) such as clouds, supercomputing networks and desktop
grids, for the benefit of user communities within the European Research Area. The ultimate goal of EGI-InSPIRE is
to provide European scientists and their international partners with a sustainable, reliable e-Infrastructure that can support
their needs for large-scale data analysis.
iii) Some other grid projects are the NSFs National Technology Grid, NASAs Information Power Grid, GriPhyN, NEESgrid,
Particle Physics Data Grid and the European Data Grid. The grid applications range from advanced manufacturing, numerical
wind tunnel, oil reservoir simulation, particle physics research, High Energy Nuclear Physics (HENP), weather modelling,
bio-informatics, terrain analysis of nature observation, scientific database, and popular science web services.
iv) MammoGrid [7]: It is a service-oriented architecture based medical grid application. The aim is to deliver a set of
evolutionary prototypes to demonstrate the memo gram analysts, specialist radiologists working in breast cancer
screening who can use the grid information infrastructure to resolve common image analysis problems.
47


v) DDGrid (Drug Discovery Grid) [7]: This project aims to build a collaboration platform for drug discovery using the state-of-
the-art P2P and grid computing technology.

This project intends to solve large-scale computation and data intensive scientific applications in the field of medicine
chemistry and molecular biology with the help of grid middleware. Over 106 compounds database with D structure and
physiochemical properties are also provided to identify potential drug candidates.

C. Cloud Projects and Applications
An overview of the initiative projects in the area of cloud computing is presented below:
i) CERN: The European organization for Nuclear Research is developing a mega computing cloud to distribute data to
scientists around the world as part of the LHC project.
ii) Unified Cloud Interface (UCI): This project is proposed by the Cloud Computing Interoperability Forum (CCIF) working
on the development of standard APIs which can be used by all cloud service providers to overcome the interoperability
issues.
iii) Cloud-Enabled Space Weather Platform (CESWP): The purpose is to bring the power and legibility of cloud
computing to space weather physicists. The goal is to lower the barriers for the physicists to conduct their science,
i.e., to make it easier to collaborate with other scientists, develop space weather models, run simulations, produce
visualizations and enable provenance.
iv) OpenNebula: This project is successful with the release of the most advanced and ﬂexible enterprise-ready cloud
management tool, and the growth of an active open- source community. They aim to develop the most- advanced,
highly-scalable and adaptable software toolkit for cloud computing management. They plan for operation network to simplify
the management of OpenNebula cloud instances, fault tolerance functionality to maximize uptime in the cloud, enhanced
management of images and templates, new security functionality, enhanced support for federation of data centers and
support for multitier architectures.
v) TClouds [5]: The goal of the project is to prototype an advanced cloud infrastructure that can deliver a new level of
secure, private and resilient computing and storage that is cost-efficient, simple and scalable. To achieve security,
resiliency and scalability needed when outsourcing critical IT-systems to a cloud, scientists will build an advanced Cloud of
Clouds framework for the project. This framework provides multiple back-ups of the T Clouds data and applications in
case of a hardware failure or intrusion. Some of the applications that can be deployed on cloud include web hosting,
media hosting, multi-tenant service, HPC, distributed storage, multi-enterprise integration, etc. With the expansion of cloud
computing and establishing a pubic cloud among many University libraries, it can conserve library resources and
improve its user satisfaction. Although there are OPAC (Online Public Access Catalog) and ILL (Inter-library loan)
services, access to the shared resources through an uniform access platform is difficult which can be made possible with the
adoption of cloud computing in such libraries.
vii) RoboEarth: This is a European project led by the Eindhoven University of Technology, Netherlands, to develop a
WWW for robots, a giant database where robots can share information about objects, environments, and tasks.
Researchers at ASORO (A-Star Social Robotics Laboratory, Singapore) have built a cloud-computing infrastructure that
allows robots to generate 3-D maps of their environments much faster than they could with their onboard computers.
viii) Cloudo: A free computer that lives on the Internet, right in the web browser. It allows accessing documents, photos, music,
movies and all other files from any computer or mobile phone.
ix) Panda Cloud: An Antivirus, the first free antivirus from the cloud. Regular updates is not a problem and it occupies
very little system resources, uses collective intelligence servers for fast detection, simple interface and protects PC
offline

V. TOOLS AND SIMULATION ENVIRONMENT
We highlight some of the tools and simulators that can be used to develop applications on the three computing models.

A. Tools for cluster computing
i) Nimrod: This is a tool for parametric computing on clusters and it provides a simple declarative parametric modeling
language for expressing a parametric experiment. By using this it can be easy to create a plan for a parametric
computing and use the Nimrod runtime system to submit, run, and collect the results from multiple cluster nodes.
ii) PARMON: This is a tool that allows the monitoring of system resource and their activities at three different levels:
system, node and component. It is used to monitor C-DAC PARAM 10000 supercomputer, a cluster of 48 Ultra-4
workstations powered by Solaris.
iii) Condor: This is a specialized job and resource management system for compute intensive jobs. It provides a job
management mechanism, scheduling policy, priority scheme, and resource monitoring and management. Users submit
their jobs, tool chooses when and where to run them based upon a policy, monitors their progress, and ultimately informs
the user upon completion.
iv) MPI and OpenMP: Message passing libraries provide a high-level means of passing data between process executing on
distributed memory systems. They help to achieve high performance out of collections of individual cluster nodes. MPI I is
the de facto standard for parallel programming on clusters which consists of a rich set of library functions to do both point-
to-point and collective communication among parallel tasks.

Other cluster simulators include Flexi-Cluster a simulator for a single compute cluster, VERITAS a cluster server simulator, etc.

48


B. Tools used in Grid Computing
The tools used in the field of grid computing for resource discovery, management and performance analysis are given as below:
i) Paradyn: This is a performance analysis tool supports performance experiment management through techniques for
quantitatively comparing several experiments and performance diagnosis based on dynamic instrumentation. Experiments
have to be set up manually, whereas performance analysis is done automatically.
ii) Nimrod-G: This uses the Globus middleware services for dynamic resource discovery and dispatching jobs over
computational grids. It allows scientists and engineers to model parametric experiments and transparently stage the data
and program at remote sites, run the program on each element of a data set on different machines and finally gathers
results from remote sites to the user site.
iii) Condor-G: This represents the work of Globus and Condor projects which enables the utilization of large collections of
resources that span across multiple domains as if they all belonged to the user's personal domain. From Globus comes
the use of protocols for secure inter domain communications and standardized access to remote batch systems. From
Condor comes the concern of job submission, job allocation, error recovery, and creation of a friendly execution
environment.
iv) Globus: An open source software toolkit that facilitates construction of computational grids and grid based applications,
across corporate, institutional and geographic boundaries.
v) Gridbus (GRID computing and BUSiness) toolkit project: This is associated with the design and development of
cluster and grid middleware technologies for service- oriented computing. It provides end-to-end services to aggregate or
lease services of distributed resources de- pending on their availability, capability, and performance, cost, and QoS
requirements.
vii) Legion: This is an object-based meta system that supports transparent core scheduling, data management, fault tolerance,
site autonomy, and a middleware with a wide range of security options.

Other simulators used in grid computing include Gridsim, ZENTURIO, Optorsim, Chicsim, etc.

C. Tools used in Cloud Computing
Various tools and products which provide assistance in development applications on cloud computing are given as below:
i) Zenoss: This is a single, integrated product that monitors the entire IT infrastructure, wherever it is deployed
(physical, virtual, or in cloud). It manages the networks, servers, virtual devices, storage, and cloud deployments.
ii) Spring Roo: This is a next generation rapid application development tool, combined with the power of Google Web
Toolkit (GWT) that enables developers to build rich browser apps in enterprise production environments.
iii) CloudSim and Cloud Analyst: They are important for developers to evaluate the requirements of large-scale cloud
applications in terms of geographic distribution of both computing servers and user workloads. The former was
developed with the purpose of studying the behaviour of applications under various deployment configurations
whereas the latter helps developers with insights in how to distribute applications among cloud infrastructures and
value added services.
iv) Cloudera: This is an open-source Hadoop software framework is increasingly used in cloud computing deployments
due to its ﬂexibility with cluster-based, data- intensive queries and other tasks. It allows exploring complex, non-
relational data in its native form.

VI. CONCLUSION
This paper presented detail comparison on the three computing models, cluster, grid and cloud computing. The issues
and challenges related to these computing models are highlighted. The projects and applications in various fields are brieﬂy
discussed. We have also discussed the tools and simulation environments useful for the development of applications. Such a
comparison in different perspectives will make easy to understand the computing models since the features of these computing
models seems to be similar conceptually. It also helps in identifying the similarities and differences from each other. Grid and
cloud computing appears to be a promising model especially focusing on standardizing APIs, security, interoperability, new
business models, and dynamic pricing systems for complex services. Hence there is a scope for further research in these areas.

REFERENCES
[1]. PARMON", http://www.cloudbus.org/course/parmon.php.
[2]. Cluster Computing", http://en.wikipedia.org/wiki/Cluster computing
[3]. Cloud Security alliance CSA)", http://www.cloudsecurityalliance.org/trustedcloud.html. Globus",
http://www.globus.org/ogsa
[4]. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic, "Cloud computing and emerging it platforms: Vision,
hype, and reality for delivering csag.ucsd.edu/projects/hpvm.html. http://csrc.nist.gov/groups/SNS/cloud-
computing
[5]. “Panda Cloud” www.cloudantivirus.com
[6]. Cloudera” hhtp://cloudera.com
[7]. 6th International Conference on computers science & Education ( ICCSE 2011) Cluster ,Grid and Cloud
computing a Detail
[8]. Cloud Computing: New challenges to entire computer industry 2010 1st International Conference on Parallel
,Distributed and Grid Computin.

49


Table I: Computing Comparison of Cluster, Grid and Cloud

PARAMETERS CLUSTER GRID CLOUD

SLA Limited Yes Yes
Allocation Centralized Decentralized Both
Resource Handling Centralized Distributed Both
Loose coupling No Both Yes

Protocols/API MPI ,Parallel Virtual MPI,GRAM,GIS TCP/IP,SOAP, AJAX

Reliability No Half Full
Security No Half No
User friendliness No Half Yes
Virtualization Half Half Yes
Interoperability Yes Yes Half
Business Model No No Yes
Task Size Single large Single large Small & Medium
SOA No Yes Yes
Multi-tenancy No Yes Yes
System Performance Improve Improve Improve
Self service No Yes Yes
Computation service Computing Max. computing On demand
Heterogeneity No Yes Yes
Inexpensive No No Yes

Fig. I The Structure

50

IJERD (www.ijerd.com) International Journal of Engineering Research and Development IJERD : hard copy of journal, Call for Papers 2012, publishing of journal, journal of science and technology, research paper publishing, where to publish research paper,

More Related Content

What's hot(17)

Similar to IJERD (www.ijerd.com) International Journal of Engineering Research and Development IJERD : hard copy of journal, Call for Papers 2012, publishing of journal, journal of science and technology, research paper publishing, where to publish research paper, (20)

More from IJERD Editor(20)

Recently uploaded(20)

IJERD (www.ijerd.com) International Journal of Engineering Research and Development IJERD : hard copy of journal, Call for Papers 2012, publishing of journal, journal of science and technology, research paper publishing, where to publish research paper,