MySQL Sandbox 3

MySQL Sandbox 3.0
Installing and testing MySQL servers
effortlessly

http://launchpad.net/mysql-sandbox

Giuseppe Maxia
MySQL Community

This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License.

Sunday, 23 August 2009

Overview
 Not an official Sun/MySQL product
 GPL
 installs from a tarball in a few seconds
 to install side servers, not the main instance
 creates a separated environment
 data directory
 port
 socket
groups of related or unrelated servers


http://launchpad.net/mysql-sandbox/


System requirements
 Unix like operating system
Linux
Mac OS X
Solaris
Free BSD
 MySQL binary tarball
 MySQL Sandbox (current version 3.0.04)
 Perl
 Bash shell


explaining the sandbox is like boxing

explaining takes longer than delivering


Overview

data directory data directory

port port

socket socket


Overview

same data
directory?

/usr/local/mysql/data /usr/local/mysql/data

data corruption


Overview
same data
port or
socket?

3306 3306

/tmp/mysql.sock /tmp/mysql.sock

does not start


the hard way
1.unpack the tarball
2.ensure that it goes to a separate directory
3.create the database tables
4.create a .cnf file with separate
• port
• data directory
error prone
• socket
5.launch mysqld_safe manually
6.launch mysql with options


Why tar.gz?
Why not .rpm/.deb/.pgk?
• it would work
• but only in their specific environments

The sandbox aims at being standard
across operating systems.

It works the same way on Linux, Mac
OSX, OpenSolaris, FreeBSD, and
probably many more

MySQL Sandbox VERSION

$SANDBOX_HOME/msb_VERSION/data

VERSION

/tmp/mysql_VERSION.sock


MySQL Sandbox 5.1.37

$SANDBOX_HOME/msb_5_1_37/data

5137

/tmp/mysql_5137.sock


MySQL Sandbox 5.4.1

$SANDBOX_HOME/msb_5_4_1/data

5401

/tmp/mysql_5401.sock


MySQL Sandbox
single sandbox
commands

start
use
stop
restart
clear
send_kill


MySQL Sandbox multiple sandbox
commands

One sandbox to
rule them all
start_all m n1
stop_all s1 n2
clear_all s2 n3
send_kill_all
use_all

The easy way - installation

# as root
$ cpan
cpan> install MySQL::Sandbox


Installing the sandbox as
unprivileged user
# download the sandbox
# http://launchpad.net/mysql-sandbox/
$ tar -xzf MySQL-Sandbox-x.x.x.tar.gz
$ cd MySQL-Sandbox-x.x.x/
$ perl Makefile.PL
PREFIX=$HOME/usr/local
$ make
$ make test
$ make install

# change $PERL5LIB and $PATH

The easy way - single sandbox

$ make_sandbox
/path/mysql-OS-5.1.37.tar.gz

# that's it!


The easy way - replication
$ make_replication_sandbox

# that's it!


The easy way - circular replication
$ make_replication_sandbox
--circular=5

# that's it!


The easy way - multiple servers
$ make_multiple_sandbox

# that's it!


The even easier way -
$SANDBOX_BINARY
# default SANDBOX_BINARY=$HOME/opt/mysql
$ export SANDBOX_BINARY=$HOME/mybin
$ ls $SANDBOX_BINARY
5.0.64 5.0.66 5.0.67 5.1.20
5.1.23 5.1.24 5.1.25 5.1.26
5.1.28 5.1.29 5.1.37 5.1.38

$ make_sandbox 5.1.37

# that's it!


multiple servers - different
versions
$ make_multiple_custom_sandbox
5.0.67 5.1.37 5.4.1

# that's it!


fine tuning
$ make_sandbox
[option] [option] [option]


pick your size
$ make_sandbox
--my_file={small|medium|large|huge}


fine tuning easily
$ make_sandbox
--interactive


fine tuning easily

Enter the values for each option
* To leave the interactive choice and accept default
values for the remaining options, enter 'default'
* To go to the previous item, enter 'back'
* To quit the installation without any action, enter
'quit'
------------------------------------------
home_directory
The home directory. (default: $HOME/sandboxes
(/Users/gmax/sandboxes))
Your choice: (current value [/Users/gmax/sandboxes]) _


hands on


Using the sandbox

./start [mysqld options]
starts the server
creates a .pid file in the data directory
creates a socket file in /tmp
if a .pid file exists, it exits immediately


Using the sandbox

./restart [mysqld options]
starts the server
creates a .pid file in the data directory
creates a socket file in /tmp
if a .pid file exists, it exits immediately


Using the sandbox

./stop
stops the server
if no .pid file exists, it exits immediately


Using the sandbox

./send_kill
stops the server, using
kill -TERM pid#
if the server is unresponsive, uses
kill -KILL pid#


Using the sandbox

./clear
stops the server (by calling the stop script)
removes all files in the data directory
empties the test database


Using the sandbox

./use
starts the mysql client
uses the credentials in the my_sandbox.cnf
default username and password:
 msandbox/msandbox
root password:
 msandbox


Using the sandbox

./my {sqldump|sqlbinlog|sqladmin}
starts a mysql command line tool
uses the credentials in the my_sandbox.cnf

 it's a shortcut to call the tool from the right version
with the proper options


using mysql clients
$ ./my sqlbinlog
./data/mysql-bin.000001 |less

$ ./my sqldump dbname > dumpname

$ ./my sqladmin extended-status
# no username or password needed!


Using the replication sandbox
./start_all
 starts the master and all the slaves
./stop_all
 stops all the slaves and then the master
./send_kill_all
 kills all the slaves and then the master
./clear_all
 clears all the slaves and then the master
./use_all "command"
 executes "command" for all nodes

Using the replication sandbox

./m
 uses the master
./s1
 uses the first slave

./s2 [s3, s4 ... ]
 uses the Nth slave


Using the multi-nodes sandbox
./start_all
 starts all the nodes
./stop_all
 stops all the nodes
./send_kill_all
 kills all the nodes
./clear_all
 clears all the nodes
./use_all "command"
 executes "command" for all nodes

Using the multi-node sandbox

./n1
 uses the first node

./n2 [n3, n4 ... ]
 uses the Nth node


Using the $SANDBOX_HOME directory
the master sandbox that rules them all
./start_all
 starts all the sandboxes
./stop_all
 stops all the sandboxes

./clear_all
 clear all the sandboxes
./use_all "SQL statement"
 passes a SQL statement to all servers
in all sandboxes

a crowded host
sandbox
5.0.67

replication
replication
replication
7 servers
5.1.26
5.1.26
5.0.67

independent
independent
independent
5.1.26
5.1.26
5.0.67


a differently crowded host
sandbox
5.0.67

7 servers
replication
replication
replication
5.1.26
5.1.26
5.0.67
independent
5.0.67
independent independent
5.4.1 5.1.26


a more crowded host
sandbox sandbox
5.1.37 5.4.1

replication replication
replication
replication
replication
5.1.26
5.1.26 14 replication
5.1.26
5.1.26
5.1.37 5.4.1
servers
independent
independent
5.1.26 5.1.26
5.1.26
5.1.26
5.1.37 5.4.1


an even more crowded host
sandbox sandbox sandbox
5.0.67 5.1.37 5.4.1

replication replication replication
replication
replication
replication replication replication
5.1.26 replication
5.1.37 5.1.26
5.1.26
5.1.26
5.0.67 5.1.37 5.4.1
5.1.37

independent independent independent
independent
independent
independent independent independent
5.1.26
5.1.26 independent
5.1.26 5.1.26
5.1.26
5.0.67 5.1.26 5.4.1
5.1.37

21

DEMO TIME


Installing a single one
Executing ./low_level_make_sandbox --basedir=/Users/gmax/opt/mysql/5.1.37
--sandbox_directory=msb_5_1_37
--install_version=5.1
--sandbox_port=5129
--no_ver_after_name
--my_clause=log-error=msandbox.err
The MySQL Sandbox, version 2.0.12 16-Oct-2008
(C) 2006,2007,2008 Giuseppe Maxia, Sun Microsystems, Database Group
installing with the following parameters:
upper_directory = /Users/gmax/sandboxes
sandbox_directory = msb_5_1_37
sandbox_port = 5129
datadir_from = script
install_version = 5.1
basedir = /Users/gmax/opt/mysql/5.1.37
operating_system_user = gmax
db_user = msandbox
db_password = msandbox
my_clause = log-error=msandbox.err
prompt_prefix = mysql
prompt_body = [h] {u} (d) > '
do you agree? ([Y],n)
loading grants
.. sandbox server started
----------------------------------------
Your sandbox server was installed in /Users/gmax/sandboxes/msb_5_1_37


Using a single one
$ cd $HOME/sandboxes/msb_5_1_37
$ ./use

Welcome to the MySQL monitor. Commands end with ; or g.
Your MySQL connection id is 3
Server version: 5.1.37-rc MySQL Community Server (GPL)

Type 'help;' or 'h' for help. Type 'c' to clear the buffer.

mysql [localhost] {msandbox} ((none)) >


Installing a replication sandbox
$ make_replication_sandbox 5.1.37
installing and starting master
installing slave 1
installing slave 2
starting slave 1
starting slave 2
initializing slave 1
initializing slave 2
replication directory installed on
/Users/gmax/sandboxes/rsandbox_5_1_37


using a replication sandbox
$ cd $HOME/sandboxes/rsandbox_5_1_37
# m = master

$ ./m test
Welcome to the MySQL monitor. Commands end with ; or g.
Your MySQL connection id is 4
Server version: 5.1.37-rc-log MySQL Community Server (GPL)

Type 'help;' or 'h' for help. Type 'c' to clear the buffer.

master [localhost] {msandbox} (test) > create table t1 (i int);
Query OK, 0 rows affected (0.08 sec)


# s1 is slave1

$ ./s1 test
slave1 [localhost] {msandbox} (test) > show tables;
+----------------+
| Tables_in_test |
+----------------+
| t1 |
+----------------+


# checking the slaves

$ ./check_slaves
slave # 1
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
slave # 2


# sending commands to all nodes

$ ./use all "SELECT @@server_id"
# master
@@server_id
1
# server: 1:
@@server_id
101
# server: 2:
@@server_id
102


Example: breaking replication
# leveraging command line scripts
$ ./m -e 'create table test.t2 (i int primary key)'
$ ./s1 -e 'insert into test.t2 values (1)'
$ ./m -e 'insert into test.t2 values (1)'
$ ./check_slaves
slave # 1
Slave_SQL_Running: No
slave # 2

$ ./s1 -e 'show slave statusG' |grep Last_Error
Last_Error: Error 'Duplicate entry '1' for key 'PRIMARY''
on query. Default database: ''. Query: '


Installing circular replication
$ make_replication_sandbox --circular=4 5.1.34
installing node 1
installing node 2
installing node 3
installing node 4
# server: 1:
# server: 2:
# server: 3:
# server: 4:
Circular replication activated
group directory installed on
/Users/gmax/sandboxes/rcsandbox_5_1_34


using circular replication
$ cd $HOME/sandboxes/rcsandbox_5_1_34
$ ./n1 -e 'create table test.t1 (i int)'
$ ./n3 -e 'insert into test.t1 values (3)'
$ ./use_all 'select * from test.t1'
# server: 1:
i
3
# server: 2:
i
3
# server: 3:
i
3
# server: 4:
i
3


Testing same version in different
conditions
$ make_multiple_sandbox 5.1.34
--group_directory=unpartitioned
--base_port=5500 --check_base_port

$ make_multiple_sandbox 5.1.34
--group_directory=partitioned
--how_many_nodes=4
--base_port=6500 --check_base_port


conditions
$SANDBOX_HOME/unpartitioned
|
+-- node1 MyISAM
|
+-- node2 InnoDB
|
+-- node3 Archive


conditions
$SANDBOX_HOME/partitioned
|
+-- node1 MyISAM by month
|
+-- node2 InnoDB by month
|
+-- node3 InnoDB file per table by month
|
+-- node4 Archive by month


Running tests
cd $SANDBOX_HOME/unpartitioned

./stop_all
RESULTS=unpartitioned_results.txt
date > $RESULTS
for SB in 1 2 3
do
./node$SB/start
time ./n$SB < test.sql >> $RESULTS
./node$DB/stop
done
# more on tests later on. Stay tuned


MySQL Sandbox 3

More Related Content

What's hot (20)

Similar to MySQL Sandbox 3 (20)

More from Giuseppe Maxia (20)

Recently uploaded (20)

MySQL Sandbox 3