UNIT - 1
Upon completion of this session , you should
be able to :
✔ Define data, information and data center
✔ Describe types of data
❖ Structured
❖ Unstructured data
❖ Big Data
✔ Describe the evolution of storage
architecture
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
UNIT - 1
SLO-1: Introduction to Information
Storage Management
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Why Information Storage
• “Digital universe – The Information Explosion”
– 21st Century is information era
– Information is being created at ever increasing rate
– Information has become critical for success
• We live in an on-command, on-demand world
(we need information when and where it is required)
– Example: Social networking sites, e-mails, video and
photo sharing website, online shopping, search
engines etc…
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Need for Information storage and management…
• Equipped with a growing number of content-
generating devices, more information is being created
by individuals than by businesses.
• Information created by individuals gains value when
shared with others.
• When created, information resides locally on devices
such as cell phones, cameras, and laptops.
• To share this information, it needs to be uploaded via
networks to data centers.
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Need for Information storage and management
• Eventhough the majority of information is created by
individuals, it is stored and managed by a relatively
small number of organizations.
• The importance, dependency, and volume of
information for the business world also continue to
grow at astounding rates.
• Businesses depend on fast and reliable access to
information critical to their success.
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Business Applications
• Airline reservations, Telephone billing systems
• E-commerce
• ATMs
• Product designs
• Inventory management
• E-mail archives
• Web portals
• Patient records
• Credit cards
• Life sciences and
• Global capital markets.
Information management is a big challenge
– Organization seek to Store 🡪 Protect 🡪 Optimize 🡪 Leverage the information
optimally
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Data center
• Organizations - maintain one or more data centers to store
and manage information.
• Data center contains – information storage and other
physical information technology (IT) resources for computing,
networking, and storing information.
Core elements of a data center
– Application (computer program 🡪 logic for computing operations)
– DBMS (a structured way to store data )
– Host or Computer (runs applications and databases)
– Network (path / communication among - networked devices)
– Storage (device that stores data)
• In traditional data centers, the storage resources are typically
dedicated for each of the business units or applications.
• Virtualized data centers (VDCs) – Cloud Computing (scale-up
and scale-down, based on the business requirements)
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Information Storage
• Organizations process data to derive the information
required for their day-to-day operations.
• Storage is a repository that enables users to
persistently store and retrieve this digital data.
– Data
– Types of Data
– Big Data
– Information
– Storage
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
What is Data?
“Collection of raw facts from which conclusions may be drawn”
• Examples : Handwritten letters,
a printed book, a family
photograph, a bank’s ledgers, Video
and an airline ticket
• data creation and sharing 🡪 01010101010
paper and film Photo 10101011010
00010101011
• Data can be generated using a 01010101010
computer and stored as Book
10101010101
strings of binary numbers (0s 01010101010
and 1s) Letter Digital Data
• Data is converted into more
convenient form i.e. Digital
Data
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Data vs. Information
• Data are raw facts • Data: building blocks of
– Information is the result information
of processing raw data to – Information produced by
processing data
reveal meaning
– Information used to reveal
– Information requires meaning in data
context to reveal meaning – Accurate, relevant, timely
– Raw data must be information is the key to good
formatted for storage, decision making
processing, and – Good decision making is the
presentation key to organizational survival
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Factors that have contributed to the growth of digital data:
• Increase in data-processing capabilities: Modern computers provide a
significant increase in processing and storage capabilities. This enables the
conversion of various types of content and media from conventional forms
to digital formats.
• Lower cost of digital storage: Technological advances and the decrease in
the cost of storage devices have provided low-cost storage solutions. This
cost benefit has increased the rate at which digital data is generated and
stored.
• Affordable and faster communication technology: The rate of sharing digital
data is now much faster than traditional approaches. A handwritten letter
might take a week to reach its destination, whereas it typically takes only a
few seconds for an e-mail message to reach its recipient.
• Proliferation(creation) of applications and smart devices: Smartphones,
tablets, and newer digital devices, along with smart applications, have
significantly contributed to the generation of digital content.
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Categories of Data …
• Data can be categorized as either structured or unstructured data
– Structured (organized in rows and columns)
• Data Bases
• Spread Sheets PDFs
E-Mail Attachments
– Unstructured (cannot be
X-Rays
stored in rows and columns) Check Unstructured (80%)
• Forms Manuals Instant Messages
• Images Images
Documents
• Audio Forms
Web Pages
• Movies
Rich Media
Contracts
Invoices
• Over 80% of enterprise
Audio Video
Information is unstructured
Structured (20%)
Rows and Columns
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Categories of Data
• Unstructured - difficult to retrieve the data
• Majority of new data being created today is
unstructured
• Industry is challenged with,
✔ new architectures
✔ Technologies
✔ techniques
✔ skills to store, manage, analyze, and derive value
from unstructured data from numerous sources
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
BIG DATA
• Big data – Large volume of Datasets.
• Commonly software tools used to capture,
store, manage, and process – within
acceptable time limits
• Includes structured and unstructured data.
• Sources : Web pages, videos, images, e-mails,
social media etc.
• These datasets require real-time capture or
updates for analysis and decision making.
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Big Data…
The big data ecosystem consists,
1. Devices - collect data from multiple locations 🡪 generate
new data about this data (metadata).
2. Data collectors who gather data from devices and users.
3. Data aggregators - compile the collected data to extract
meaningful information.
4. Data users and buyers who benefit from data / the
information
Analyzing big data in real time requires,
✔ new techniques,
✔ architectures
✔ Tools
🡪 high performance, Massively Parallel Processing (MPP), data platforms
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Big Data
• Data science
– which enables organizations to derive business value from
big data.
• List of Industries benefit from the analytics of big data.
– medical and scientific research
– health care
– public administration
– fraud detection, social media
– banks
– insurance companies etc…
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Big data ecosystem
Define Information
• What do individuals/businesses do
with the data they collect?
– They turn it into “information”
– “Information is the intelligence
Centralized information
storage and
Network processing Network
and knowledge derived from data”
Wired Wireles Wireles Wired
s s
Uploading Accessing
informatio informatio
n n
• Businesses analyze raw data in
order to identify meaningful Creators of
Users of
trends
Informatio
informatio
n
n
– For example:
• Buying habits and patterns of
customers
• Health history of patients Demand for more
Informatio
n
Virtuous cycle of information
Value of Information to a Business
• Identifying patterns that lead to changes in existing business
– Reduced cost
• Just-in-time inventory, eliminating over-stocking of products,
optimizing shipment and delivery
– New services
• Security alerts for “stolen” credit card purchases
– Targeted marketing campaigns
• Communicate to bank customers with high account balances
about a special savings plan
• Identifying new business opportunities
– Buying/spending patterns
• Internet stores, retail stores, supermarkets
– Customer satisfaction/service
• Tracking shipments, and deliveries
• Creating a competitive advantage
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Storage
• Who creates data?
– Individuals
– Businesses
• Data created by individuals/businesses must be stored and
easily accessible for further processing
• Type of storage used is based on the type of data and the rate at
which it is created and used
• Devices designed for storing data are termed storage devices or
simply storage
• Examples:
– Individuals: Digital camera, Cell phone, DVD’s, Hard disk
– Businesses: Hard disk, external disk arrays, tape library
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
SLO-2 : Evolution of Storage Architecture
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
Evolution of Storage Architecture
• Historically,
✔ centralized computers (mainframes), information storage
devices (tape reels and disk packs) in their data center
✔ business units/departments - own servers and storage
• In earlier, storage was typically internal to the server
open systems
⮚ server-centric storage architecture – limited storage
devices, unavailability of information(ie. maintenance
of the server or increasing storage capacity)
⮚ Information-centric architecture - storage devices are
managed centrally and independent of servers
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
storage devices could not be shared with any other
servers
18CSE360T - INFORMATION STORAGE AND MANAGEMENT S - 1 / UNIT - 1
