Transcript LESSONS LEARNED – BUILDING PAYPAL CLOUD Chinmay Naik Lead Software Engineer, Cloud Engineering Anand Palanisamy Manager, Software Development, Cloud Engineering (OpenStack Summit – Hong Kong –

LESSONS LEARNED – BUILDING
PAYPAL CLOUD
Chinmay Naik
Lead Software Engineer, Cloud Engineering
Anand Palanisamy
Manager, Software Development, Cloud Engineering
(OpenStack Summit – Hong Kong – 2013)
ABOUT PAYPAL
137,000,000 Users.
$300,000 Payments processed by PayPal each minute.
193 markets / 26 currencies.
PayPal is the World’s Most Widely Used Digital Wallet.
2
Confidential and Proprietary
STRUCTURE OF THE PRESENTATION
Challenges we are trying to address
Why OpenStack has emerged as a problem solver ?
Getting Openstack ready for production primetime
Success stories
3
Confidential and Proprietary
WHAT ARE WE TRYING TO
SOLVE ?
4
Confidential and Proprietary
SOME OF OUR CHALLENGES
Seamless On-Demand Infrastructure Capacity
Do we really want those hundred tickets to deploy a service ?
Drive developer agility
Provide self-service tool for application life cycle mgmt
Provide a platform to enable faster innovation.
5
Confidential and Proprietary
WHO WILL GET US THERE ?
6
Confidential and Proprietary
OPENSTACK IS THE WINNER
Solves Infrastructure-as-a-Service
Its open source
No specific vendor lock-ins
Fast growing developer community
Open standards and api driven
Industry best practices, prevent reinventing the wheel
7
Confidential and Proprietary
OPEN SOURCE CANNOT
ALWAYS BE USED OFF THE
SHELF
8
Confidential and Proprietary
OUR TECHNOLOGY STACK
Operations Portal
User
Interface
PD Deployment Portal
Asgard, Horizon, Ceilometer
Traffic Mgmt
Monitoring
Metering
Stages
Workflow
Monitoring
Orchestration Engine
Orchestration
Cloud Formation (Heat)
Foundational
Services
Software
Infrastructure
Hardware
Infrastructure
Nova, Cinder, Swift, Keystone, Neutron, Horizon
Cobbler
ISC DHCP
x86 Compute
Salt
Bind
Local Storage
RHEL 6.x
Network
LBaaS, DNSaaS
FWaaS
Hypervisor
Zabbix
Load Balancer
PP Specific
9
Confidential and Proprietary
TUNING NOVA FOR HIGH AVAILABILITY
Scheduling enhancements for failure and availability domains
Custom PayPal filter scheduler
Tenant based Compute Zone filters with Folsom
Host Aggregate filtering in Grizzly
25% distribution among different fault zone for HA
10
Confidential and Proprietary
NOVA CHANGES
Instance host naming uniqueness
Auto assigning floating IPs to VMs
Rack aware networking
Leveraging config-drive
Nova conductor - security vs. load on rabbit
11
Confidential and Proprietary
KEYSTONE CHANGES
Integrating keystone with LDAP
Auto tenancy feature
Tenant based hostnames & dns zones
Client side token caching
Team admin feature
12
Confidential and Proprietary
DNS-AS-A-SERVICE INTEGRATION
Automatic
Project based zones
Floating IPs
13
Confidential and Proprietary
LOAD BALANCER-AS-A-SERVICE
Registration and auto discovery
Rich tenant and operator facing apis
Propagating changes to multiple LBs
Change Management Integration
14
Confidential and Proprietary
OTHER SUCCESS STORIES
15
Confidential and Proprietary
USER EXPERIENCE
Ease of use
Adoption
Multi Version
Multi Region
16
Confidential and Proprietary
USER INTERFACE SCREEN SHOTS
17
Confidential and Proprietary
USER INTERFACE SCREENSHOTS
18
Confidential and Proprietary
DEPLOYMENT PAIN POINTS
Devstack != Production
Keeping up with trunk
Single keystone service
Performance & Scalability
Error Handling
19
Confidential and Proprietary
[email protected]
20
Confidential and Proprietary
COURTESIES FOR IMAGES USED
http://www.123rf.com/
http://www.trashionista.com/
http://www.coreytowe.com/
http://www.birst.com/
21
Confidential and Proprietary
THANK YOU
22
Confidential and Proprietary