Transcript Oracle on EC2

Running Oracle in EC2
Ahbaid Gaffoor
Amazon.com/A9.com
Overview
•
•
•
•
2
Section 1: Pricing and Licensing
Section 2: Getting Started with AWS
Section 3: Installing Oracle
Section 4: Secure Backup
Oracle on EC2, NoCOUG Aug 20th 2009
Section 1
Pricing and Licensing
3
Oracle on EC2, NoCOUG Aug 20th 2009
Section 1: Pricing and Licensing
1.
2.
3.
4.
4
Amazon Web Services (AWS) Overview
Pricing of relevant AWS Services
Oracle Licensing and Support
Oracle Secure Backup Cloud Module
Oracle on EC2, NoCOUG Aug 20th 2009
1.1 AWS Overview:
•
•
•
•
•
•
5
Amazon Elastic Compute Cloud (EC2)
Amazon Simple Storage Service (S3)
Amazon Cloud Front
Amazon SimpleDB
Amazon Simple Queue Service (SQS)
Amazon Elastic MapReduce
Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing EC2:
• Elastic Compute Cloud (EC2)
– Prices http://aws.amazon.com/ec2/#pricing
– Amazon Machine Image (AMI):
• On Demand, Reserved 1 Year, 3 Years
– Standard CPU AMI:
• Small
• Large
• XLarge
$0.10/hr, $325/yr ($0.03/hr),$500/3yr
$0.40/hr, $1300/yr($0.12/hr),$2000/3yr
$0.80/hr, $2600/yr($0.24/hr),$4000/3yr
– High CPU AMI:
• Medium
• XLarge
6
$0.20/hr, $650/yr($0.06/hr),$1000/3yr
$0.80/hr, $2600/yr($0.24/hr),$4000/3yr
Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing EC2 (Cont’d):
• Elastic Compute Cloud (EC2)
– Elastic IP
• Public, Static IP
• IP Map/Re-map > 100/month $0.10 each
• $0.01 non-attached per hour
– Elastic Block Store (EBS)
• $0.10 GB/month provisioned
• $0.10 per 1MM/month I/O requests
– EBS Snapshots to S3
• $0.15 GB/month
• $0.01 per 1,000 PUT requests (when saving a snapshot)
• $0.01 per 10,000 GET requests (when loading a snapshot)
7
Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing S3:
• Simple Storage Service (S3)
– Prices http://aws.amazon.com/s3/#pricing
– Operations: PUT, GET, DELETE
– Storage
•
•
•
•
$0.15GB/Month < 50TB
$0.14GB/Month > 50TB, < 400TB
$0.13GB/Month > 400TB, < 500TB
$0.12GB/Month > 500TB
– Data Transfer
• $0.10GB all data transfer in
8
Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing S3 (Cont’d):
– Requests
• $0.01 per 1,000 PUT, COPY, POST or LIST request
• DELETES are free
• $0.01 per 10,000 GET and all other requests
– AWS Import/Export
• Device Handling $80.00 each
• Data loading $2.49 per hr (hourly increment)
9
Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing Import/Export:
– Not Database exp/imp
– AWS Import/Export
•
•
•
•
10
Device Handling $80.00 each
Data loading $2.49 per hr (hourly increment)
http://aws.amazon.com/importexport/
Calculator:
http://awsimportexport.s3.amazonaws.com/aws-importexport-calculator.html
Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Data Transfer Pricing:
• Data Transfer:
– Regions: US, EU
– Sub-region (zone)
– Free within zones on private IP
– Elastic IP or Public IP outside AWS, regional charges
11
Oracle on EC2, NoCOUG Aug 20th 2009
1.3 Oracle Licensing:
• Existing or New License
• http://www.oracle.com/corporate/pricing/cloudlicensing.pdf
• Cost of AMI
• Pre-built Oracle AMI (11g)
• Roll your own AMI
12
Oracle on EC2, NoCOUG Aug 20th 2009
1.3 Oracle Support:
•
•
•
•
Virtualization Support – AWS
Database Support
Oracle Secure Backup Cloud Module
http://www.oracle.com/technology/tech/cloud/f
aq.html#support
• No RAC
13
Oracle on EC2, NoCOUG Aug 20th 2009
1.4 Oracle Secure Backup Cloud Module:
•
•
•
•
•
•
14
Backups to S3 via. RMAN
9i R2 and higher
Pre-installed on Oracle AMIs
EC2 and non-EC2 databases
Requires S3 and OTN accounts
Integrated with Enterprise Manager
Oracle on EC2, NoCOUG Aug 20th 2009
Section 2
Getting Started with AWS
15
Oracle on EC2, NoCOUG Aug 20th 2009
Section 2: Getting Started with AWS
1.
2.
3.
4.
5.
6.
7.
8.
9.
16
AWS account
AWS EC2 Console
EC2 Security Groups
EC2 Key Pairs
EC2 Amazon Machine Images (AMIs)
EC2 Elastic IP
EC2 EBS Volumes
EC2 Snapshots
Using EC2 Command Line tools
Oracle on EC2, NoCOUG Aug 20th 2009
2.1 AWS account
• Amazon.com account
• Sign up for services at http://aws.amazon.com
• EC2 Console: http://console.aws.amazon.com
17
Oracle on EC2, NoCOUG Aug 20th 2009
2.2 AWS EC2 Console
18
Oracle on EC2, NoCOUG Aug 20th 2009
2.2 AWS EC2 Console
•
•
•
•
•
•
•
19
Security Groups
Key Pairs
AMIs
Instances
Elastic IPs
EBS Volumes
EBS Snapshots
Oracle on EC2, NoCOUG Aug 20th 2009
2.3 EC2 Security Groups
20
Oracle on EC2, NoCOUG Aug 20th 2009
2.3 EC2 Security Groups - Create
21
Oracle on EC2, NoCOUG Aug 20th 2009
2.3 EC2 Security Groups – Configuration
22
Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs
23
Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs – Create
24
Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs – Save PEM file
25
Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs – Save PEM file
•
•
•
•
•
26
Only one opportunity
Make a copy
Make another offline copy
Cannot be retrieved or restored
PEM?
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs
27
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – List Options
• Show/Hide (Owner, Platform, Architecture)
• Oracle owner id = 725966715235
• Linux only
28
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Launch Instance
29
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Instance Options
30
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Availability Zones
•
•
•
•
31
us-east-1a
us-east-1b
us-east-1c
us-east-1d
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Instance Launch
32
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 Instances - Pending
33
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 Instances – Launched
34
Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 Instances – Command Line Tools
• Scriptable command line tools:
–
–
–
–
–
–
–
–
–
–
–
35
ec2-bundle-instance
ec2-confirm-product-instance
ec2-describe-instances
ec2-describe-reserved-instances
ec2-describe-reserved-instances-offerings
ec2-monitor-instances
ec2-purchase-reserved-instances-offering
ec2-reboot-instances
ec2-run-instances
ec2-terminate-instances
ec2-unmonitor-instances
Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP
•
•
•
•
•
Static IP tied to account
Assign to any account instance
Unassigned is more expensive
Redirect failed services
Scriptable command line tools:
– ec2-allocate-address
– ec2-associate-address
– ec2-disassociate-address
– ec2-release-address
36
Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IPs
37
Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Allocate
38
Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Allocated
39
Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Associate
40
Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Associated
41
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 Elastic Block Store (EBS) Volumes
•
•
•
•
Persistent Storage
Pick zone and region
Assign to an instance within a zone
Scriptable command line tools:
– ec2-create-volume
– ec2-delete-volume
– ec2-attach-volume
– ec2-detach-volume
– ec2-describe-volume
42
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes
43
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Create
44
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Creating
45
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Created
46
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Attach
47
Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Attached
48
Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots
•
•
•
•
Copy of EBS Volume into S3
S3 replicates snapshots across zones
Snapshots restorable in any zone
Snapshots used to copy EBS volumes within
zones
• Scriptable command line tools:
– ec2-create-snapshot
– ec2-delete-snapshot
– ec2-describe-snapshot
49
Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots
50
Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots - Create
51
Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots - Created
52
Oracle on EC2, NoCOUG Aug 20th 2009
2.9 Using EC2 Command Line Tools
•
•
•
•
Requires at least Java 5 runtime
SSH Acces for Linux (Putty for Windows SSH)
RDC for windows (not covered)
AWS -> Resources – Developer tools – EC2-API
tools (ec2-api-tools.zip)
• Setup ENV variables:
– JAVA_HOME
– EC2_HOME is path to unzipped files
– EC2_PRIVATE_KEY (PEM file path)
– EC2_CERT (your X.509 cert file path)
53
Oracle on EC2, NoCOUG Aug 20th 2009
Section 3
Installing Oracle
54
Oracle on EC2, NoCOUG Aug 20th 2009
Section 3: Installing Oracle
1. Connecting to a new instance
2. Mount EBS Volumes
3. Create database
55
Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting to a New Instance
• PEM file is private key
• First connection SSH as root
• Linux SSH command line connect using PEM file
– “ssh -i <PEM_file> root@<ip_address>”
• Windows Putty SSH Client
– PuttyGen to load and convert PEM file
– Save Windows equivalent Private Key file
– Create Session in Putty using new Private Key file for
authentication
56
Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting – License Acceptance
57
Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting – Oracle Password
58
Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting – No DB auto creation
59
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Mount EBS Volumes
• Create Partitions on devices
– “fdisk /dev/sdf”
• Create Filesystems
– “mkfs.ext3 /dev/sdf1”
• Create mount points, mount, set permissions
– “mkdir /m1”
– “mount /dev/sdf1 /m1; chown –R oracle:dba /m1”
• Edit /etc/fstab to automount
– “/dev/sdf1 /m1
ext3 defaults
1 1”
• Repeat for EBS Volumes
60
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Mount EBS Volume – Create FS
61
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Mount EBS Volume – /etc/fstab
62
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Choices
• 11g Oracle Home:
– /u01/app/oracle/product/11.1.0/db_1
• Oracle provided script:
– /home/oracle/scripts/run_dbca.sh (as root)
– Customize database post creation
• DBA crafted scripts (better)
• Free script:
– http://ocpdba.net/dbcreate/index.html (10g)
63
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Recommendations
• Create separate EBS Volume for /admin
• /admin used for:
– DB Creation scripts
– Admin scripts
– DB files (init.ora, spfile, broker files, etc.)
• Symlinks from /admin/<dbname>/<file> to
Oracle software home
• EBS volume snapshot used for new DB hosts
64
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Recommendations
• Allow only SSH port to be open in Security Group
• Tunnel SQL*Net across SSH outside the cloud
• If opened, restrict listener port to fixed IPs
65
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Cloning
• /admin EBS Snapshot cloneable to new Instances
• EBS volume snapshots (cold db) used for new db
cloning of database files
66
Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Performance
• CPU & Memory fixed
• Within the cloud fastest for I/O
• I/O can be scaled
– Multiple EBS Volumes
– Oracle ASM
– Stripe across EBS Volumes
67
Oracle on EC2, NoCOUG Aug 20th 2009
Section 4
Oracle Secure Backup (OSB)
Cloud Module
68
Oracle on EC2, NoCOUG Aug 20th 2009
Section 4: OSB Cloud Module
1.
2.
3.
4.
5.
69
OSB Pre-requisites
OSB Setup
OSB RMAN Integration
OSB Performance
RMAN / OSB / S3 Use cases
Oracle on EC2, NoCOUG Aug 20th 2009
4.1 OSB Pre-requisites
• Download Cloud Backup Installer
• Included in Oracle AMIs
– “/home/oracle/scripts/osbws/osbws_install.jar”
• S3
• Oracle 9i R2 and higher
• OTN account
70
Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Installer Options
• List options for OSB Installer
– “su – oracle”
– “java -jar ~oracle/scripts/osbws/osbws_install.jar”
– “more ~oracle/scripts/osbws/osbws_readme.txt”
71
Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Installer Options
•
Required
–
–
–
–
–
•
•
AWSID
AWSKey
otnUser & otnPass
walletDir
libDir
AWS account access key ID
AWS account secret access key
OTN Credentials for download
Stores credentials for use
Location for platform specific
download (RMAN SBT library)
Optional platform and proxy parameters
Optional Recommended
– configFile
Initialization parameter file used
by future RMAN jobs
– Default: $ORA_HOME/dbs/osbsws<ORACLE_SID>.ora
72
Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Sample Installer Script
# install_osb.sh
# Set before running: AWSID, AWSKEY, OTNUSER, OTNPASS
# libDir stores software specific to the platform for RMAN SBT library parms use
java -jar ~oracle/scripts/osbws/osbws_install.jar \
-AWSID $AWSID \
-AWSKEY $AWSKEY \
-otnUser $OTNUSER \
-otnPass $OTNPASS \
-walletDir /admin/osbws/wallet \
-configFile /admin/osbws/osb_config.dat \
-libDir /admin/osbws/software
73
Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Install Platform Library
74
Oracle on EC2, NoCOUG Aug 20th 2009
4.3 OSB RMAN Integration
• RMAN SBT Parms configuration
• Installed to libDir parameter in installation
• RMAN Command:
RMAN> configure channel
device type sbt parms
“SBT_LIBRARY=/admin/osbws/sofware/libosbws11.so
ENV=(OSB_WS_PFILE=/admin/osbws/osb_config.dat)
“;
• Ready for backups
75
Oracle on EC2, NoCOUG Aug 20th 2009
4.4 OSB RMAN Performance
• 11g Multiple RMAN Channels
• 11g datafiles can be backed up across multiple
channels
• 11g Fast Backup Compression
• RMAN block change tracking
76
Oracle on EC2, NoCOUG Aug 20th 2009
4.5 RMAN / OSB / S3 Use Cases
•
•
•
•
77
Cloning
Scalable backups
Moving databases
Regional Backup/Recovery Availability
Oracle on EC2, NoCOUG Aug 20th 2009
Thank You
ahbaid@{amazon.com|a9.com|att.net}
http://redoblog.wordpress.com
http://ocpdba.net