FEDERAL POLYTECHNIC NASARAWA
SCHOOL OF INFORMATION TECHNOLOGY
DEPARTMENT OF NETWORKING AND CLOUD COMPUTING
ASSIGNMENT ON
COMPUTER ARCHITECTURE
NCC315
QUESTION
a. WHAT ARRE THE FUNCTIONS OF CACHE MEMORY IN A SYSTEM
b. WHAT DOES IT DO
SUBMITTED BY
OKAH EMMANUEL MADAKI
NOVEMBER 2024
1
CACHE MEMORY
Cache memory is a small, high-speed storage medium located close to or
inside the CPU. It plays a critical role in bridging the speed gap between the
fast processor and the slower main memory (RAM). By temporarily storing
frequently accessed data and instructions, cache memory ensures quicker data
retrieval, thereby improving system performance.
Key Features of Cache Memory
a. High Speed: Much faster than RAM but smaller in size.
b. Proximity to CPU: Located close to or integrated into the CPU for minimal
data access latency.
c. Volatility: Like RAM, cache memory is volatile, meaning data is lost when
power is turned off.
d. Hierarchical Design: Structured in multiple levels (L1, L2, L3) for optimized
performance.
HIERARCHY OF CACHE MEMORY
L1 Cache (Level 1):
a. Closest to the CPU cores.
b. Extremely fast but very small (typically 32 KB to 128 KB).
c. Stores critical instructions and data for immediate access.
L2 Cache (Level 2):
a. Larger but slower than L1 (usually 256 KB to a few MB).
b. Acts as a secondary cache for less critical but still frequently accessed data.
L3 Cache (Level 3):
2
a. Shared among multiple CPU cores.
b. Larger and slower than L2 (ranging from a few MB to tens of MB).
c. Reduces bottlenecks for multi-core processing.
HOW CACHE MEMORY WORKS
Data Request Flow:
When the CPU requests data, it first checks the cache.
If the data is found (cache hit), it is retrieved quickly.
If not (cache miss), the data is fetched from RAM or storage and added to the
cache.
Replacement Policies:
When the cache is full, replacement algorithms like Least Recently Used (LRU)
or First In, First Out (FIFO) decide which data to evict.
FUNCTIONS OF CACHE MEMORY
Improving Speed: Speeds up data access by storing frequently used data close
to the CPU.
Reducing Latency: Minimizes the delay in fetching data from slower main
memory.
Enhancing CPU Efficiency: Keeps the CPU busy by reducing idle time caused by
memory bottlenecks.
Optimizing Multi-core Performance: L3 cache helps share data efficiently
among CPU cores.
BENEFITS OF CACHE MEMORY
3
Increased Performance: Reduces the time taken for the CPU to fetch
instructions and data.
Energy Efficiency: Requires less power compared to frequent RAM access.
Reduced System Bottleneck: Bridges the speed disparity between the CPU and
RAM.
CHALLENGES OF CACHE MEMORY
Cost: Cache memory is expensive to manufacture, which limits its size.
Complex Management: Requires sophisticated algorithms to manage data
efficiently.
Limited Size: Its small size means it can only store a fraction of the data
needed by the CPU.
CONCLUSION
Cache memory is a vital component in modern computer systems, designed to
enhance overall system performance. Its hierarchical structure and proximity
to the CPU allow it to deliver data at high speeds, making it indispensable for
efficient processing.
Reference
a. Wikipedia
