Transcript Caringo Theatre Presentation
Thriving at Petabyte scale & beyond
+ Software-Defined Object Storage for the POST RAID era
Legacy file storage technology is limiting the ability for entities to thrive @ “scale”
Constrained Expansion & Extensibility Rigid & Brittle Durability
• • • • • Max out at PB level Data Silos Tedious management Service downtime for upgrades Specialized staff • • • RAID rebuild times too long Backup costs too high Not all data should be treated the same, anyway
Restricted Accessibility
• • • Web servers and load balancers needed SMB and NFS are not web protocols Limited query and analysis
The Need...
Multi-protocol ingest support (http, file, S3, Swift, block) Internet accessible, web-scale Ability to run on standard commodity hardware Simple to deploy, manage, scale & evolve Ability to continuously protect any amount of data,
natively
Secure and Compliant Future-proof (durable & extensible)
The Solution – Caringo SWARM Caringo’s Swarm object storage software: •
Aggregates
the disk capacity across heterogeneous clusters of commodity servers to… • Create
massively & dynamically scalable multi tenant
storage systems that are… •
Self-managing, self-healing, high-performance, and durable
through time, where • Files and their descriptive metadata (i.e. objects) are
accessible whenever and wherever
they are needed by users, administrators and by data services
How We Do It – Efficient Software Swarm Runs from RAM on any x86 hardware with Linux RAM CPU NIC Tune to any workload Boots from bare metal in minutes works on raw disk level
98%
available No file system, no software install leaves 98% drive capacity for data HTTP SNMP
How We Do It – Resource Virtualization Swarm RAM CPU NIC Node 1
How We Do It – Resource Virtualization Swarm RAM CPU NIC RAM RAM CPU CPU NIC Node 1
How We Do It – Resource Virtualization Swarm RAM CPU NIC RAM RAM CPU CPU NIC Node 1 Node 2
How We Do It – Resource Virtualization Swarm Node 1 Node 2 Node 3 Node …
How We Do It – Emergent Behavior No single points of failure SWARM follows simple rules to manage a complex system Nodes cooperate to perform processes Improves with size!
How We Do It – Encapsulated Data
Metadata stored with data
data + metadata
No metadata databases to manage
How We Do It – Encapsulated Data
Object is encapsulated
Includes all system, policy and custom metadata
How We Do It – Encapsulated Data
Object is portable & dynamic
Decoupled from hardware, location and apps Freeing data to be accessed in multiple ways
Swarm Adapts
Swarm lets you grow at the pace you choose and adapts to your requirements or workload
• Plug in new servers for more capacity & performance - address needs in real time • New resources available in minutes • Right resources to the right locations • Local and geo-distribution • Easily retire old hardware site 1
Swarm
site 3 site 2
Swarm Protects
Swarm automatically manages the data protection you choose
• Protection per cluster, bucket or at the object level • Seamlessly move between
replication and erasure coding
• Store objects with different protection levels on the same server • Auto-managed through Lifepoints • Protect data based on value
Erasure encoding
Swarm Repairs
Swarm watches for issues and repairs them automatically so you don
’
t have to
• Health Processor proactively checks integrity, availability and cardinality • Fast Volume Recovery, content aware, repairs only damaged objects • Assurance of data quality for the entire enterprise • Provides business continuity
+ + + + +
Portfolio Overview Scalable storage software for unified object, file and block
Cloud Big Data/Hadoop Archive Enterprise Apps Select the interface and hardware for your workload and use case.
CloudScaler HTTP 1.1, Amazon S3 Caringo
Swarm
FileScaler SMB, NFS BlockScaler iSCSI (Beta) Adaptable performance for unified storage under a single namespace.
It’s Simple…Really!
Ethernet Switches 1Gb or 10Gb Caringo SWARM Object Storage Cluster Caringo Cluster Services Node (Physical or Virtual) • • • Mix and Match HW w/ any drive size Grow from one form factor to another, at runtime, incrementally Never forklift upgrade again
Small
R420
Medium, Large
R720xd or +JBOD
Add Caringo Software Capacity Licenses, per TB, and annual support/maintenance Small, Medium, Large
R420 or VM
Add Caringo CSN Software License and annual support/maintenance
Simple…But Powerful!
Remote Sites Ingest from many sources* Add Storage Services Automate Retention, Protection & Durability down to the object level
Object storage - its all about use cases DOD Medical Health Systems (16 PBS) PACS Archiving Video Surveillance (2.5 PBS) File Retention M2M and analytics (4 PBS) Consumer/enterprise backup-to cloud service (2+ PBS) S3-like cloud storage services via Swarm & CloudScaler Web content delivery plus hundreds more…
Next Steps – Where/How to get Started?
• • • Identify your Target use case(s): See Use Case Slide. If in doubt: “
Drain your Filer Swamps
” – File System Optimization Tier!
• Contact your Dell Account Representative for pre-sales support –
All Caringo Software & Services are available through Dell
• OR, Contact [email protected]
Thank You
Software-Defined Object Storage for the POST RAID era