Scribd
Upload
7 views

COE4590_8_Multiprocessor

The document discusses multiprocessor systems, highlighting their elements, types, and benefits, including increased reliability and improved performance through parallel processing. It distinguishes between shared memory systems and message passing systems, detailing their characteristics and interconnection networks. Additionally, it outlines different categories of shared memory systems, such as UMA, NUMA, and COMA, and provides commercial examples of both system types.

Uploaded by

21COB164 Aisha Tanvir
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
7 views

COE4590_8_Multiprocessor

The document discusses multiprocessor systems, highlighting their elements, types, and benefits, including increased reliability and improved performance through parallel processing. It distinguishes between shared memory systems and message passing systems, detailing their characteristics and interconnection networks. Additionally, it outlines different categories of shared memory systems, such as UMA, NUMA, and COMA, and provides commercial examples of both system types.

Uploaded by

21COB164 Aisha Tanvir
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 17

Distributed and Parallel System

(Lecture-8)

BY
ABDUS SAMAD
Overview

 Elements of Multiprocessor Systems


 Types of Multiprocessor Systems
Multiprocessor Systems
 Asynchronous parallelism through a set of interactive
processors.
 A number of shared resources like memory, I/O,
databases etc. are used.
 A multiprocessor system consists of several
processors of approximately comparable capabilities.
 The entire system is controlled by a single O.S
 Besides shared memories and I/O devices, each
processor has its own local memory and private
devices.
 Interconnection network is used to provide
communication between memories and processors.
Multiprocessor Systems
Benefits of Multiprocessing:
1.Multiprocessing increases the reliability of the
system so that a failure or error in one part has
limited effect on the rest of the system.
2.Improved System performance. System derives
high performance from the fact that computations
can proceed in parallel in one of the two ways:
a) Multiple independent jobs can be made to operate in
parallel.
b) A single job can be partitioned into multiple parallel
tasks.
Elements of Multiprocessor Systems
There are four elements of a Multiprocessor System.

A set of processors

A set of memories

A set of I/O devices

An interconnection network that links the above
three elements
Types of Multiprocessor Systems
 There exists a distinction between
multiprocessor and multicomputers that
though both support concurrent operations.
 Multiprocessor systems are classified by
the way their memory is organized. There
are two major categories:
1. Shared Memory Systems or (Tightly Coupled
Systems).
2. Message Passing Systems or (Loosely
Coupled Systems) also known as Distributed
Memory Systems.
Shared Memory Systems
 Shared memory is a Global memory that may be
simultaneously accessed by multiple processors.
 Access to shared memory is balanced, therefore,
they are also known as SMP (Symmetric
Multiprocessor System).
 Shared memory is an efficient means of passing
data between programs.
 Each processor has equal opportunity to read/write
to memory, including equal access speed.
 Tasks and/or processors communicate in a highly
synchronized fashion.
 Processors may also have some local memory.
Shared Memory Systems
Shared Memory Systems…
Depending upon the interconnection network, a
shared memory system has three different
categories:
1. Uniform Memory Access (UMA)
 In UMA, a shared memory is accessible by all
processors through an interconnection network
in the same way a single processor accesses its
memory.
 All processors take the same time to reach all
memory locations.
Shared Memory Systems…
2. Non-uniform Memory Access (NUMA)
 In NUMA system, each processor has part of the
shared memory attached. The memory has a
single address space. Therefore,
 Any processor could access any memory
location directly using its real space.
 Access time depends upon the location of
processor, this results a non-uniform memory
access time.
 Memory access is not uniform.
Shared Memory Systems…
3. Cache-only memory Architecture (COMA)
 Similar to NUMA each processor has a part of the
shared memory in COMA, however, in this case
shared memory consists of cache memory.

Without caching With caching With caching &


Private memory
Message Passing Systems
Message Passing Systems
 Each processor has its own local memory.
Therefore, it is necessary to move data from
one local memory to another by means of
message passing.
 Unlike Shared memory the communication in
message passing is achieved by
send/receive pair of commands written into
the application software by the programmer.
Design factors for Interconnection Network

1. Link Bandwidth:
The number of bits that can be
transmitted per unit time (bits/s).
2. Network Latency:
The time to complete a message
transfer.
Shared Memory Vs. Message Passing
Commercial Examples
Shared Memory System Message Passing System
 Sequent Computer’s  nCUBE

Balance and Symmetry  iPSC/2


 Sun Microsystems  Transputer-based
multiprocessor servers systems
 Silicon Graphics Inc.
multiprocessor servers
Thanks

You might also like