OracelDB-Overview_Day1_compressed
OracelDB-Overview_Day1_compressed
Mostafa Emam
Principal Solutions Engineer
Agenda
Database Fundamentals
Backup and Recovery concepts
Containers and Micro-services
Multitenant Overview
Migration and Upgrade concepts
Exadata overview
PCA and ZDLRA
DB Management and Automation
The following is intended to outline our general product direction. It is intended for information
purposes only, and may not be incorporated into any contract. It is not a commitment to deliver
any material, code, or functionality, and should not be relied upon in making purchasing
decisions.
The development, release, timing, and pricing of any features or functionality described for
Oracle’s products may change and remains at the sole discretion of Oracle Corporation.
Instance
PGA
Server
process Memory Structures
(System Global Area)
Server
Process Structures
User
process
I1
I1 I2 I3
I2
D1
D2
Local Storage D
Shared Storage
Connecting to the Database Instance
• Connection: Communication between a user process and an instance
User Server
SQL> Select … process process
User
Session
Connection
Session
Oracle Database Memory Structures
Program Global Area (PGA) PGA
Stack User Stack User
Space Global Space Global
Area Area
Server Server
process 1 process 2
KEEP
Database buffer pool
Redo log
Shared pool buffer
buffer
cache RECYCLE
buffer pool
KEEP
Database buffer pool
Redo log
Shared pool buffer
buffer
cache RECYCLE
buffer pool
• User process
– Is the application or tool that connects to the Oracle database
• Database processes
– Server process: Connects to the Oracle instance and is started
when a user establishes a session
– Background processes: Are started when an Oracle instance is
started
• Daemon / Application processes
– Networking listeners
– Grid infrastructure daemons
Process Structures
# cat /etc/inittab
..
h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
Database Storage Architecture
Logical Physical
Database
Segment
Storage System
• SAN • NFS
Extent
• NAS • ASM
• Exadata • RAW
Oracle data
block • File System
SYSTEM and SYSAUX Tablespaces
Operating system
ASM Storage Components
ASM
Oracle
ASM
Database ASM file
disk group
datafile
ASM
extent
File system
or ASM allocation
Raw device ASM disk
unit
Break for 10 Mins…
Simplified Initialization Parameters
Basic Advanced
CONTROL_FILES DB_CACHE_SIZE
DB_BLOCK_SIZE DB_FILE_MULTIBLOCK
PROCESSES _READ_COUNT
UNDO_TABLESPACE SHARED_POOL_SIZE
… …
Initialization Parameters: Examples
PGA PGA
KEEP
Database buffer pool
Redo log
Shared pool buffer
buffer
cache RECYCLE
buffer pool
• Static parameters:
– Can be changed only in the parameter file
– Require restarting the instance before taking effect
– Account for about 110 parameters
• Dynamic parameters:
– Can be changed while database is online
– Can be altered at:
— Session level
— System level
– Are valid for duration of session or based on SCOPE setting
– Are changed by using ALTER SESSION and ALTER SYSTEM
commands
– Account for about 234 parameters
Starting Up an Oracle Database Instance
2
1
5
4
Starting Up an Oracle Database Instance:
NOMOUNT
OPEN
STARTUP
MOUNT
NOMOUNT
Instance
started
SHUTDOWN
Starting Up an Oracle Database Instance:
MOUNT
OPEN
STARTUP
MOUNT
Control file
opened for this
NOMOUNT instance
Instance
started
SHUTDOWN
Starting Up an Oracle Database Instance:
OPEN
OPEN
STARTUP All files opened as
described by the control
MOUNT file for this instance
Control file
opened for this
NOMOUNT instance
Instance
started
SHUTDOWN
Startup Options: Examples
• Using the sqlplus utility:
SQL> startup 1
4
Shutdown Modes
Shutdown Modes A I T N
Shutdown modes:
• A = ABORT
• I = IMMEDIATE
• T = TRANSACTIONAL
• N = NORMAL
Shutdown Options
Consistent database
Shutdown Options
• Using SQL*Plus:
SQL> shutdown 1
4 DESCRIBE dba_indexes
Interaction Between Database Instances
and ASM
ASM Instance
System Global Area
Database Instance Create File
4
Initialize Allocation
ASM Storage
Oracle Database Backup and Recovery
Overview
Backup Solutions: Overview
Target
Data files database Image copies
Backup pieces
Archive
log files
Redundant Backup data
archive log
files Fast recovery area
Terminology
To open a database:
• All control files must be present and synchronized
• All online data files must be present and synchronized
• At least one member of each redo log group must be present
OPEN
STARTUP
MOUNT
NOMOUNT
SHUTDOWN
Keeping a Database Open
After the database is open, it fails in the case of the loss of:
• Any control file
• A data file belonging to the system or undo tablespaces
• An entire redo log group
(As long as at least one member of the group is available, the instance remains
open.)
Database Containers and Microservices
Overview
The Enterprise Application World Is Changing - “Cloud Native”
DevOps
Deployments That Run Tool Chains Cycle
Busines
Languages
s
Domain
Micro
service
2
45
What is “Containers”?
• Platform independence:
Build it once, run it anywhere
• Resource efficiency and
density
• Speed: Start, create, replicate
or destroy containers in
seconds
• Immense and smooth
scaling
• Improved developer
productivity and
development pipeline
46
Pluggable Databases Simplify Microservice Architectures
Oracle makes it simple for each Microservice to store its data in a logically
separate Data Container called a Pluggable Database
Pluggable Databases can easily be physically combined to simplify
deployment, or separated to improve isolation and scalability
Microservice
App Containers
on Kubernetes
Pluggable
Databases
AP
Self-contained PDB for each application
GL OE • Applications run unchanged
• Rapid provisioning (via clones)
• Portability (via pluggability)
Multitenant
databases, hosting Exadata Compute Node
Exadata Storage Cell
multiple pluggable
databases
CDB #1
PMEM/Flash
Standalone
(single tenant) CDB #2
Multiple databases,
databases, when sharing Exadata
needed storage
Hard Disks
Database
Minimize OpEx
• Manage many databases as one (Less administration)
• One upgrade, one HA solution, one backup, possibly one DR solution (more on this later)
Enable higher consolidation densities
• Share resources: CPU, memory, background processes
Mission Critical Applications/databases may require more isolation
• Non-CDBs is supported up to 19c
• CDBs with single PDB or less PDBs and more headroom for critical databases
And you may need multiple CDBs!
• For multiple Oracle versions, e.g. 18c vs 19c
• For varying Oracle options, e.g. partitioning, RAC, Data Guard
• For different performance, HA & DR, security and consolidation density requirements
• For different planned maintenance window or DR testing requirements
52 Copyright © 2021, Oracle and/or its affiliates
Resource Management
Consolidation Goals
Noisy neighbors
• One database’s high loads should not disturb the others
• Data warehouses must co-exist with OLTP databases
Fair access to resources
• Databases need configurable, guaranteed access to CPU, memory, I/O, etc.
Options to capitalize on excess or idle resources
• Allow databases to “burst” into unused resources
• Or limit usage for “pay for performance” clouds or to ensure predictable performance
Dynamic resize of database resource allocations
• Change resource allocations without restarts
Innovation
Innovation
2020
2026
2024
2025
2022
2023
2027
2010
2014
2016
2018
2019
2015
2017
2013
2021
2012
2011
MARKET
Oracle 11.2 Waived EXTENDED EXTENDED DRIVEN
Oracle 18
(12.2.0.2)
Oracle 19 EXTENDED
(12.2.0.3)
Oracle 21
Premier Support Waived Extended Support Paid Extended Support Market Driven Support Limited Error Correction
Lifetime Support Policy
Watch on YouTube
Basic Facts | Upgrade vs Migration vs Patching
11.2.0.4 19c
12.1.0.2 19c
12.2.0.1 19c
18c 19c
Exadata Overview X8M
Fastest analytics
Unique Smart Scan automatically offloads data intensive SQL operations to storage
Unique Smart Flash Cache and Storage Index automatically accelerate database I/O
Unique automatic conversion of data to fast In-Memory Columnar format in flash
Fastest OLTP
Fastest OLTP I/O with scale-out storage, RDMA, and NVMe flash
Fastest scale-out with unique RDMA algorithms for inter-node cluster coordination
Fully redundant and fastest recovery from failed or sick components
Best consolidation
Uniquely prioritizes latency sensitive or important workloads through full stack
Uniquely isolates workloads from multiple tenants through full stack
Exadata
DB Servers Smart Scan automatically offloads data-intensive SQL operations to
storage servers
In-database analytics
Machine-learning algorithms
NW fabric
offload
Query
Decryption
Decompression
Backup
Parallel execution of OLTP updates
Exadata Oracle Database only licensed on database server CPUs
Smart Storage
Exadata
DB Servers Architecturally, storage arrays can share flash capacity but not
flash performance due to network bottlenecks
Even with next gen scale-out, PCIe networks, NVMe over fabric
Exadata
Smart Storage
In-Memory
Exadata flash throughput approaches DRAM throughput Columnar Scans
Analytics SQL bottleneck moves from I/O to CPU
Compute Server
Exadata Storage Servers transparently add persistent memory in front
RoCE
of flash memory
RDMA
World’s first and only shared persistent memory optimized for database
Storage Server
Database uses RDMA instead of I/O to read remote PMEM
Bypasses network and I/O software, interrupts, context switches
Frees CPUs to work on Smarc Scan queries
Hot PMEM
10x better latency and 2.5x higher I/Os per second
Compute Server
Shared PMEM performance
RoCE RDMA Aggregate performance of all PMEM available to all database servers
Exadata
DB Servers Scale-out design based on proven Oracle Database technology
Database server resources scale by over 140X
Storage server resources scale by over 160X
NW fabric Runs faster by moving the compute to the data
Much faster than all-flash arrays; not limited by SAN bandwidth
Requires owning the full stack; can’t be solved in storage alone
An Exadata X8M rack delivers 560 GB/sec to any server
Exadata High availability based on proven technologies and MAA best practices
Smart Storage
Eighth
Quarter
Elastic
Multi-Rack
• Start with 2 Database Servers and 3 Storage Servers
- Add Database or storage servers as needed
- Use Oracle Exadata Configuration Assistant (OECA) to Create Desired Configuration
• X8M-2 Extreme Flash (EF) • X8M-2 High Capacity (HC) • X8M-2 Extended (XT) Storage
Storage Server Storage Server Server
• Industry Leading I/O Performance • More Flash, Higher Performance • Long Term / Archive Storage Solution
• All Flash, Scale-out, Highly Available, • Tiered, Scale-out, Highly Available, RDMA • Tiered, Scale-out, Highly Available,
RDMA Connected Smart Storage Connected Smart Storage RDMA Connected Smart Storage
• 12 x 128 GB Persistent Memory Modules • 12 x 128 GB Persistent Memory Modules • 12 front mounted 14 TB High Capacity
Disks
• 8 x 6.4 TB F640 PCIe rear-mounted • 12 front mounted 14 TB High Capacity Disks
• 3192 TB per Rack
flash cards per storage server—”Hot
Plug” Replaceable • 4 x 6.4 TB F640 PCIe rear-mounted flash
cards per storage server—”Hot Plug”
• State-of-the-art NVMe interface
Replaceable
optimized for low-overheard
• State-of-the-art NVMe interface optimized
• No flash cache misses, so predictably
for low-overheard
low flash response times
• Smart Flash Cache intelligently manages
flash
KVM enables:
2X more guest VM Memory – 1.5 TB/server
Lower client network latency
50% more guest VMs per server
Forward compatible
Flexibly supports any mix of workloads
Supports your choice of Oracle or 3rd party
storage
Automation speeds install
OVM virtual appliances and migration tool for
rapid Oracle app deployment
Works with Exadata
VMware to Oracle
Virtualization and Management VM migration tool
Applications
Middleware Webcenter
Database
Operating System
3rd Party SAP Microsoft SQL Server Microsoft Exchange Server Proprietary Apps
X
Database-
as-a-Service
X P
Database- Applications-
as-a-Service as-a-Service
VM
VM VM VM
Network
Server
Storage
Shared
Compliance
Provision Monitor
Application
Containers
VM 1 VM 2
100 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Summary
Oracle Private Cloud Appliance engineered for today’s most demanding applications
Host enterprise workloads, cloud native, applications, and middleware
Oracle Exadata Machine for Oracle DB, Oracle Private Cloud Appliance for everything else
Support for Oracle’s Linux Cloud Native Environment, containers, and micro-services, decoupling the
workloads from the infrastructure for application portability to Oracle Cloud Infrastructure
Preferred platform for Oracle Apps Unlimited ( Oracle E-Business Suite, Siebel, PeopleSoft, Hyperion, JDE)
Host non-Oracle applications
Customers use Oracle Private Cloud Appliance to host Oracle Global Business Unit applications
Upgrade path for Oracle Exalogic and Exalytics
Everything you need to get started is included - less than 6 hours from installation to production
Oracle Private Cloud Appliance and Oracle Cloud Infrastructure working together for your business
101 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
ZDLRA Overview
Zero Data Loss Recovery appliance
Oracle’s Recovery Appliance
103 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Complete, single-vendor solution with Oracle Exadata and
Recovery Appliance
Exadata Exadata
Proven seventh-generation high-availability, scalable
system architecture
Unique cross-system optimizations increase
performance and efficiency
Maximum Availability Architecture integrates active data
guard, enterprise manager and OSB
Coordinated full-stack patching and management for
increased security
ZDLRA ZDLRA
Primary Site Remote Site
Active Active
104 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Enables point-in time recovery of the Oracle Database
Pointer-based representation of physical full backup at incremental backup time
Request: January 6, 2018 Day ‘N’ Virtual Full Backup
Restore Database
To Day ‘N’ at 14:53.12
Recovery Appliance Delta Push (What it Does) Recovery Appliance Delta Store (The Data it Keeps)
105 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
General Purpose Backup vs. Recovery Appliance
Continuous protection and built-in integrity checking
?
Database
106 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Real-time recoverability knowledge
Integrated monitoring, alerting, and reporting on recoverability
Real-time recovery status for all databases at your fingertips:
! Alerts and warnings issued if a database is not meeting user-defined recovery goals or thresholds
Data Protection-as-a-Service: Policy-based management to meet recovery SLAs throughout the enterprise
107 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Oracle’s Zero Data Loss Recovery Appliance
108 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Database Automation with EMCC
Enterprise Manager Cloud Control
Manage
Improve database Simplify
performance and estate with consolidation
availability less effort and and migration
risk
110 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Oracle Enterprise Manager
• Comprehensive Lifecycle
Automation and Control
111 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Database Management Use Cases
FIND VALIDATE
Proactively prevent database Validate database performance to ensure
performance issues quality of service and to maintain SLAs
01 02 03
FIX
Reduce mean time for detecting and
repairing problems with deep root- 50%
cause analysis and application tuning 30%
20%
113 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Database Options for Automation: Database Lifecycle Management Pack
114 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Oracle Multitenant
Consolidating Databases and Simplifying Operations
115 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Delivering Database as a Service
Database Options for DBaaS: EM Cloud Management Pack; Multitenant
Efficiency
Consolidated, shared platform
maintained with automation Database
Accessibility
Automated request channel Dedicated Database Pluggable Database Database Schema
via self-service
Elasticity
Agile scale up, scale down,
relocation of services
Accountability
OR OR Data
Meter usage, quota,
compliance and governance Empty Full Clone Snap clones
Integration
API integrations to 3rd party tools, Physical, Virtual, or Infrastructure
change requests, dev workflows Engineered Systems
On-Premises or in Oracle Cloud
116 Copyright © 2020, Oracle and/or its affiliates. All rights reserved.
Thank you
Mostafa Emam
Principal Solutions Engineer