Redshift & dynamo db
Created by Sumera Hangi
Sumera Hangi 06
INTRODUCTION TO DYNAMO DB
BENEFITS & FEATURES OF AMAZON DYNAMO DB
DYNAMO DB APPLICATIONS
DYNAMO DB – READ/WRITE CAPACITY MODE AND CAPACITY UNITS
DEMO: CREATING, INSERTING AND QUERYING A TABLE IN DYNAMO DB
INTRODUCTION TO REDSHIFT
BENEFITS & FEATURES OF AMAZON REDSHIFT
AMAZON REDSHIFT NODE TYPES & PRICING
HOW TO SET UP AMAZON REDSHIFT
Sumera Hangi 06
INTRODUCTION TO DYNAMODB
 Amazon Dynamo DB is a fully managed NoSQL database
service that allows to create database tables that can store and
retrieve any amount of data.
 It automatically manages the data traffic of tables over multiple
servers and maintains performance
 It also relieves the customers from the burden of operating and
scaling a distributed database.
 Hence, hardware provisioning, setup, configuration, replication,
software patching, cluster scaling, etc. is managed by Amazon.
Sumera Hangi 06
BENEFITS & FEATURES OF AMAZON DYNAMODB
Sumera Hangi 06
Sumera Hangi 06
 On-demand - Dynamo DB on-demand offers
pay-per-request pricing for read and write
requests so that you pay only for what you
use.
 Provisioned - You specify the number of
reads and writes per second that you
require for your application.
Sumera Hangi 06
Step 1: Navigate to the Dynamo DB
section in AWS . Select “Create
Table“.
Step 2: Fill in with the necessary
details and click on “Create“.
Step 3: You can view your table
being created. Click on “Overview”
to understand your table, click on
“Items” to edit, insert and query on
the table. There are many more
options you can use to understand
your table better.
Sumera Hangi 06
Sumera Hangi 06
Now that you have created a
table, let’s go ahead and
insert a few items and
understand how NoSQL
works.
Step 1: Navigate to “Items”
and click on “Create item“.
Step 2: It will open a JSON
file where you can add
different items. Click on the
“+” symbol and select
“Append” and select what
type of data you want to
enter.
Sumera Hangi 06
Step 3: Since it is a NoSQL
architecture, you can play
around with the columns you
add to the table. E.g.
Step 5: This is how your table
will look like once you have
inserted the data. “Position“.
Sumera Hangi 06
Now that we have a table
ready, let’s go ahead and look
at some basic queries.
Step 1: Here you can frame
your query and click on
“Start Search” to get the
desired result.
Step 2: Here, I am searching
for the record which
has EmpId as “ED4“.
Sumera Hangi 06
 Amazon Redshift is a fully managed data
warehouse service in the cloud.
 Its datasets range from 100s of gigabytes to a
petabyte.
 The initial process to create a data warehouse is
to launch a set of compute resources
called nodes, which are organized into groups
called cluster.
 Amazon Redshift costs less to operate than any
other data warehouse.
Sumera Hangi 06
 .
Sumera Hangi 06
Sumera Hangi 06
HOW TO SET
UP AMAZON
REDSHIFT?Following are the steps to set up Amazon
Redshift.
Step 1 − Sign in and launch a Redshift
Cluster using the following steps.
• Sign in to AWS Management console
and use the following link to open
Amazon Redshift console
• Select the region where the cluster is
to be created using the Region menu
on the top right side corner of the
screen.
• Click the Launch Cluster button.
• The Cluster Details page opens.
Provide the required details and click
the Continue button till the review
page.
• A confirmation page opens.
• Select the cluster in the list and
review the Cluster Status information.
The page will show Cluster status.Sumera Hangi 06
Step 2 − Configure security group to authorize
client connections to the cluster. The authorizing
access to Redshift depends on whether the client
authorizes an EC2 instance or not.
• Follow these steps to security group on EC2-
VPC platform.
• Open Amazon Redshift Console and click
Clusters on the navigation pane.
• Select the desired Cluster. Its Configuration tab
opens.
• Click the Security group.
• Once the Security group page opens, click the
Inbound tab.
• Click the Edit button. Set the fields as shown
below and click the Save button.
Type − Custom TCP Rule.
Protocol − TCP.
Port Range − Type the same port
number used while launching the cluster. By-
default port for Amazon Redshift is 5439.
Source − Select Custom IP, then type
0.0.0.0/0.
Sumera Hangi 06
Step 3 − Connect to Redshift Cluster.
There are two ways to connect to
Redshift Cluster − Directly or via SSL.
Following are the steps to connect
directly.
Connect the cluster by using a SQL client
tool. It supports SQL client tools that are
compatible with PostgreSQL JDBC or
ODBC drivers.
Use the following steps to get the
Connection String.
• Open Amazon Redshift Console and
select Cluster in the Navigation pane.
• Select the cluster of choice and click
the Configuration tab.
• A page opens as shown in the
following screenshot with JDBC
URL under Cluster Database
Properties. Copy the URL.
Sumera Hangi 06
Use the following steps to connect the
Cluster with SQL Workbench/J.
• Open SQL Workbench/J.
• Select the File and click the
Connect window.
• Select Create a new connection
profile and fill the required details
like name, etc.
• Click Manage Drivers and Manage
Drivers dialog box opens.
• Click the Create a new entry
button and fill the required details.
• Click the folder icon and navigate
to the driver location. Finally, click
the Open button.
Sumera Hangi 06
• Leave the Classname box and Sample
URL box blank. Click OK.
• Choose the Driver from the list.
• In the URL field, paste the JDBC URL
copied.
• Enter the username and password to their
respective fields.
• Select the Auto commit box and click Save
profile list.
Sumera Hangi 06
Sumera Hangi 06

Amazon dynamodb & amazon redshift

  • 1.
    Redshift & dynamodb Created by Sumera Hangi Sumera Hangi 06
  • 2.
    INTRODUCTION TO DYNAMODB BENEFITS & FEATURES OF AMAZON DYNAMO DB DYNAMO DB APPLICATIONS DYNAMO DB – READ/WRITE CAPACITY MODE AND CAPACITY UNITS DEMO: CREATING, INSERTING AND QUERYING A TABLE IN DYNAMO DB INTRODUCTION TO REDSHIFT BENEFITS & FEATURES OF AMAZON REDSHIFT AMAZON REDSHIFT NODE TYPES & PRICING HOW TO SET UP AMAZON REDSHIFT Sumera Hangi 06
  • 3.
    INTRODUCTION TO DYNAMODB Amazon Dynamo DB is a fully managed NoSQL database service that allows to create database tables that can store and retrieve any amount of data.  It automatically manages the data traffic of tables over multiple servers and maintains performance  It also relieves the customers from the burden of operating and scaling a distributed database.  Hence, hardware provisioning, setup, configuration, replication, software patching, cluster scaling, etc. is managed by Amazon. Sumera Hangi 06
  • 4.
    BENEFITS & FEATURESOF AMAZON DYNAMODB Sumera Hangi 06
  • 5.
  • 6.
     On-demand -Dynamo DB on-demand offers pay-per-request pricing for read and write requests so that you pay only for what you use.  Provisioned - You specify the number of reads and writes per second that you require for your application. Sumera Hangi 06
  • 7.
    Step 1: Navigateto the Dynamo DB section in AWS . Select “Create Table“. Step 2: Fill in with the necessary details and click on “Create“. Step 3: You can view your table being created. Click on “Overview” to understand your table, click on “Items” to edit, insert and query on the table. There are many more options you can use to understand your table better. Sumera Hangi 06
  • 8.
  • 9.
    Now that youhave created a table, let’s go ahead and insert a few items and understand how NoSQL works. Step 1: Navigate to “Items” and click on “Create item“. Step 2: It will open a JSON file where you can add different items. Click on the “+” symbol and select “Append” and select what type of data you want to enter. Sumera Hangi 06
  • 10.
    Step 3: Sinceit is a NoSQL architecture, you can play around with the columns you add to the table. E.g. Step 5: This is how your table will look like once you have inserted the data. “Position“. Sumera Hangi 06
  • 11.
    Now that wehave a table ready, let’s go ahead and look at some basic queries. Step 1: Here you can frame your query and click on “Start Search” to get the desired result. Step 2: Here, I am searching for the record which has EmpId as “ED4“. Sumera Hangi 06
  • 12.
     Amazon Redshiftis a fully managed data warehouse service in the cloud.  Its datasets range from 100s of gigabytes to a petabyte.  The initial process to create a data warehouse is to launch a set of compute resources called nodes, which are organized into groups called cluster.  Amazon Redshift costs less to operate than any other data warehouse. Sumera Hangi 06
  • 13.
  • 14.
  • 15.
    HOW TO SET UPAMAZON REDSHIFT?Following are the steps to set up Amazon Redshift. Step 1 − Sign in and launch a Redshift Cluster using the following steps. • Sign in to AWS Management console and use the following link to open Amazon Redshift console • Select the region where the cluster is to be created using the Region menu on the top right side corner of the screen. • Click the Launch Cluster button. • The Cluster Details page opens. Provide the required details and click the Continue button till the review page. • A confirmation page opens. • Select the cluster in the list and review the Cluster Status information. The page will show Cluster status.Sumera Hangi 06
  • 16.
    Step 2 −Configure security group to authorize client connections to the cluster. The authorizing access to Redshift depends on whether the client authorizes an EC2 instance or not. • Follow these steps to security group on EC2- VPC platform. • Open Amazon Redshift Console and click Clusters on the navigation pane. • Select the desired Cluster. Its Configuration tab opens. • Click the Security group. • Once the Security group page opens, click the Inbound tab. • Click the Edit button. Set the fields as shown below and click the Save button. Type − Custom TCP Rule. Protocol − TCP. Port Range − Type the same port number used while launching the cluster. By- default port for Amazon Redshift is 5439. Source − Select Custom IP, then type 0.0.0.0/0. Sumera Hangi 06
  • 17.
    Step 3 −Connect to Redshift Cluster. There are two ways to connect to Redshift Cluster − Directly or via SSL. Following are the steps to connect directly. Connect the cluster by using a SQL client tool. It supports SQL client tools that are compatible with PostgreSQL JDBC or ODBC drivers. Use the following steps to get the Connection String. • Open Amazon Redshift Console and select Cluster in the Navigation pane. • Select the cluster of choice and click the Configuration tab. • A page opens as shown in the following screenshot with JDBC URL under Cluster Database Properties. Copy the URL. Sumera Hangi 06
  • 18.
    Use the followingsteps to connect the Cluster with SQL Workbench/J. • Open SQL Workbench/J. • Select the File and click the Connect window. • Select Create a new connection profile and fill the required details like name, etc. • Click Manage Drivers and Manage Drivers dialog box opens. • Click the Create a new entry button and fill the required details. • Click the folder icon and navigate to the driver location. Finally, click the Open button. Sumera Hangi 06
  • 19.
    • Leave theClassname box and Sample URL box blank. Click OK. • Choose the Driver from the list. • In the URL field, paste the JDBC URL copied. • Enter the username and password to their respective fields. • Select the Auto commit box and click Save profile list. Sumera Hangi 06
  • 20.