Transcript Document

the tangible benefits of block-level
flash acceleration and automated
tiering in rusty SAN
Simon Birbeck
30th April 2015
Presentation agenda
• Who, where and what were the results?
– Simpsons Malt (malting/brewery)
– Elddis (caravans & motorhomes)
– Fleet Factors (motor factor supply & distribution)
– OGN Group (offshore oil, gas & renewables)
– PWS Distributors (kitchens & worktops)
• How and why?
Simpsons Malt
• Progress db ERP system ‘Compac Gold’
by Cultura Technologies
• Used heavily to enter orders & track
commodity ‘fixings’ or movements (grain, barley, hops)
between stores for traceability
• Gold also includes Generation, Open Accounts invoicing &
billing, CRM, weighbridge…
• BEFORE: Entering 80 fixings takes 360-480 seconds
depending on load factors (~6 seconds per fixing)
• AFTER: Takes 80 seconds (~1 second per fixing)
Simpsons Malt iSCSI architecture
Primary
Server Room
Secondary
Server Room
Autoloader
192GB
192GB
MALTVC01 (vCSA)
MALTVEEAM
MALTESX01
MALTESX02
GbE fibre
GbE fibre
MirrorA GbE fibre P2P
MirrorB GbE fibre P2P
MD1220
MALTSSY01
MD1220
MALTSSY02
Simpsons Malt read/write I/O
Simpsons Malt vDisk latency
Elddis (Explorer Group)
• Legacy Unidata ERP system ‘Avante’ by Epicor
• Avante is used to plan, schedule, execute and monitor the
entire business in production planning, scheduling,
inventory control, quality management, supply chain
management and distribution..
• INVPLAN maintenance (rebuilds all stock internally to
correct errors with on premise/on order that have
occurred during daily transactions)
• BEFORE: Running out of hours (low utilisation) takes 3½
to 4 hours
• AFTER: Takes 17 minutes
Elddis iSCSI architecture
Veeam Cloud Connect backups
IT Office
EXP-ESX-01
Explorer House
EXP-SVR-BACKUP
EXP-ESX-02
EXP-ESX-01 iSCSI1 EXP-ESX-01 iSCSI2
EXP-ESX-02 iSCSI1
EXP-ESX-03
EXP-SVR-BACKUP
EXP-SVR-BACKUP
iSCSI1
iSCSI2
EXP-ESX-02 iSCSI2
EXP-ESX-03 iSCSI1
CISCO Stackwise
(HSRP)
CISCO Stackwise
(HSRP)
4GbE Fibre Etherchannel
FE
FE
FE
FE
EXP-SAN-01 iSCSI1
EXP-SAN-01 iSCSI2
EXP-SAN-02 iSCSI1
EXP-SAN-02 iSCSI2
MR
MR
EXP-SAN-01 MirrorA
EXP-SAN-02 MirrorA
MR
MR
EXP-SAN-01 MirrorB
EXP-SAN-02 MirrorB
EXP-SAN-01
EXP-SAN-02
EXP-ESX-03 iSCSI2
Fleet Factors
• ERP/e-commerce ‘Synergex’ using Synergy/DE heavily
bespoked by an in-house development team
• 25 Northern England/Scotland depots, and hundreds of
RDS users based permanently in client satellite locations
• BEFORE: Purging previous months’ data to archive (on the
last weekend of every month) takes over 3hrs to complete,
RDS users frustrated by sluggish daily performance
• AFTER: Purge & archive takes 1 hour, RDS performance
reinstated supporting continued business growth through
on-boarding new depots and clients
Fleet Factors high-level design
Leeds Site (DR)
Middlesbrough HQ (Production)
Fallback
Virtual
Infrastructure
VM
Virtual Host
Server
Virtual Host
Server
Highly Available Virtual Infrastructure
VM
VM
VM
VM
VM
VM
Virtual Host
Server
VM
VM
Virtual Host
Server
Storage Area Network (SAN)
Offsite
Replica Data
Wide Area
Replication
link
Live
Data Store
Mirror Data Links
Mirrored
Data Store
Offshore Group Newcastle
• Entirely virtual (8Gbps fibre channel metro-cluster), with
a wide variety of LOB and infrastructure VMs
• CHANGES: rapid business growth with prestigious
contract wins, 24-hour operations
• SAP ERP (SQL), Exchange, SharePoint, SQL, FP, AD…
• BEFORE: deteriorating host to storage latency and user
experience..
• AFTER: dramatic improvements across the board
OGN FC architecture
Core Room
WALSESX01
WALSESX01_HBA0
WALSESX02
WALSESX01_HBA1
WALSESX02_HBA0
WALSESX03
WALSESX02_HBA1
WALNFC011_Core
(domain I D1)
DR
WALSESX03_HBA0
WALNFC012_Core
(domain I D2)
WALSVC01
WALSESX04
WALSESX03_HBA1
WALSESX04_HBA0
8Gbps LWL ISL (~1km)
WALSESX04_HBA1
WALSVC01_HBA0
WALNFC013_A14
(domain I D3)
WALSVC01_HBA1
WALNFC014_A14
(domain I D4)
8Gbps SWL ISL
8Gbps LWL ISL (~1km)
FE
MR
FE
MR
FE
MR
FE
MR
WALSSAN01_red_FE0
WALSSAN01_MirrorA
WALSSAN01_blue_FE1
WALSSAN01_MirrorB
WALSSAN02_red_FE0
WALSSAN02_MirrorA
WALSSAN02_blue_FE1
WALSSAN02_MirrorB
WALSSAN01
WALSSAN02
OGN host datastore latency (sorted by worst av.)
OGN SAN IOPS
PWS Distributors
• SQL-based ERP - in-house development team
• E-commerce (20% of sales), call centre & business
processes all reliant on IT performance
• BEFORE: reporting across previous days’ invoices takes 30
minutes, and aggregating customer statistics takes 24
hours (on a weekend)
• AFTER: invoice report takes 10 seconds, stats aggregation
takes 1 hour
• E-commerce system re-launched with thousands more
products and a parameterised product navigation system
PWS Distributors iSCSI Architecture
256GB
7TB
256GB
21.6TB
PWSNAS01
PWSVEEAM
PWSVC01
PWSESX01
PWSESX02
4Gbps Etherchannel
MirrorA (P2P GbE)
MirrorB (P2P GbE)
PWSSSY01
PWSSSY02
PWS Distributors
E-commerce
average
response
time/delay
Before & after
PWS Distributors
Customer
Services (ERP
user) wait
time % of day
Before & after
How: Simpsons Malt storage config
How: Elddis storage config
How: Fleet Factors storage config
How: OGN storage config
How: OGN storage config 2
How: OGN storage config 3
How: PWS Distributors storage config
Common denominator:
PCI-e flash + DataCore SANsymphony-V
Caching & Automated Storage Tiering
PCI-e flash
• Micron P420m is a read-optimised PCI-e x8 NVMe similar
to Fusion-io, HGST s1122 etc but priced “very
competitively” by hardware vendors
• Uses 25nm MLC NAND & custom ASIC for ‘RAIN’
• The 1400GB card used can deliver :
– 3GB/sec & 750,000 4Kbps random read
– 630MB/s & 95,000 4Kbps random writes
• Rated at 10PB endurance (rewrite entire card every day
for 20 years)
SANsymphony-V design
• Uses RAM as a volatile ‘Tier 0’ to cache and adaptively
prefetch reads, and coalesce buffered writes
– 128GB RAM suits up to 250TB storage and >100 vDisks
• Can pool commodity physical or logical drives of (up to
15) different performance characteristics in a storage pool
• Tracks the I/O statistics for all storage allocation units to
maintain a tier and pool disk ‘migration plan’ (updated
every 5 minutes)
• Can automatically rebalance and relocate or promote
relatively ‘hot’ data at the block (SAU) level
SANsymphony-V summary
• Software defined storage/storage virtualisation/
storage hypervisor/virtual SAN/hyper-convergence
• Serves up pooled commodity storage over block SAN or
HA NAS via iSCSI/Fibre Channel/FCoE/hybrid to
– Windows, Linux, NetWare, Unix, HP-UX, IBM AIX,
Solaris..
• Scale up or scale out
– Current maximum of 64 nodes per SAN group
SANsymphony-V features
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Continuous availability (synchronous mirroring)
Caching
Auto-tiering and preservations
Thin provisioning & reclamation
Snapshots
Continuous Data Protection
Asynchronous remote replication
QoS (max IOPS or regulated throughput to objects or groups)
Random write acceleration (sequential storage)
Self-healing storage
Maintenance mode with multi-ported arrays
Automation/orchestration
Cloud gateway
Centralised administration and reporting
Post-process dedupe...
Questions? Or keep in touch…
[email protected]
www.waterstons.com/people/simon.birbeck
0845 094 094 5
@WaterstonsLtd
/ Waterstons