Transcript 云计算技术与架构前瞻
云计算技术与架构前瞻 Presented by: Fubo Zhang Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 内容提要 • 云计算的市场前景 • 云计算的现状 • 云计算的技术、架构发展趋势 2 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 1979: CFD Contributions to the 767 Much CFD penetration. Opportunities exist for higher accuracy and expanded complexity Some CFD penetration. Opportunities exist for large increases in design process speed and application CFD penetration opportunity High-Speed Wing Design Cab Design Inlet Design Nacelle Design Wing-Body Fairing Design Engine/Airframe Integration Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved. 3 3 2005: CFD Contributions to the 787 Wind Tunnel Corrections Cabin Noise Interior Connexion Air Quality Antenna Air Data System Location High-Speed Wing Design High-Lift Wing Design ECS Inlet Design Cab Design Icing Design for FOD Prevention Inlet Design Inlet Certification Nacelle Design Engine Bay Thermal Analysis CFD penetration opportunity Some CFD penetration. Opportunities exist for large increases in design process speed and application Much CFD penetration. Opportunities exist for higher accuracy and expanded complexity Wing Tip Design Control Failure Analysis Buffet Boundary Wing Controls Wing-Body Fairing Design Exhaust System Design Reynolds Number Corrections Thrust Reverser Design for Loads and S&C Vertical Tail and Aft Body Design Design For Stability & Control APU Inlet And Ducting Design For Loads Avionics Cooling Engine/Airframe Vortex Generator Integration Placement Flutter Wake Vortex Alleviation Planform Aeroelastics Design APU and Propulsion Community Noise Fire Suppression Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved. 4 4 Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved. 5 Gartner View of Private Cloud Market 可升级的 共享 自动化 弹性计算 6 Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 6 451 Group View of the Cloud Market 管理 自动化 安全 存储 7 Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 7 Forrester View on Cloud Computing Platforms 8 Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 8 云计算实现的3 条路径 Scope of sharing 网格 • • 静态资源、动态调度 基于策略的调度 Public & Private Cloud Enterprise VM Cluster Client/Server Silos • • • 同构服务器的整合 有限的应用 基于VM的管理功能 Workgroup / LOB Time 2009 2003 9 Proprietary and Confidential: Platform Computing Corporation 2015 Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 9 公共云 -- What do we believe? User • 上网机 • Internet 接入上网 ESX Virtual Machine Virtual Machine Virtual Machine Virtual Machine Virtual Machine Virtual Machine User • 手机 • 移动上网 – 3G PC cloud 虚拟机 User • Workstation • VIP 接入 物理机 10 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 10 公共云 -- What do I believe? • • • 11 Proprietary PC cloud 1. 上网笔记本等终端设备 2. 台式电脑、笔记本将会被淘汰 3. 虚拟PC服务运营商将会替代MS和google Data Bank 1. 解决数据、信息安全的最终解决方案 2. 衍生许多种数据服务， 比如医疗健康，个人企业信用征 询，个人数据银行 Many SPs 1. PC SP 2. Storage SP 3. Game SP 4. Many SAAS SPs 5. Many other SPs and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 11 私有云 Analytics LSF, Symphony, … Java Test & Dev JBoss, Tomcat, … Platform ISF 12 Proprietary and Confidential: Platform Computing Corporation HPC Apps LSF, Symphony, … Private cloud management software Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 今天IDC 数据中心的挑战 1. 数据中心体系很复杂， 系统 的维护和管理难度大 2. IT成本高，资源占用多，配 置峰值资源需求 = 浪费资源 3. 4. 地理上分布的用户 根据应用静态分配IT资源 Web eCommerce Dev/QA ERP Intranet BI Email CRM 系统稳定性、可靠性低。人 工服务为主，高成本、低满 意度 IT传统模式不能适应业务部 署速度的需求 （至少2个月 ） Supply and Demand Not Aligned 13 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 云计算（虚拟化）带来的好处 14 Proprietary 1. 资源虚拟化，从而实现全局共享 2. SOA 框架使得IT能对业务需求提供快速部署， 时 间从原来的几个月缩短到半天 提高了业务支 撑能力 3. 一体化管理打破了原来IT烟囱式业务系统管理， 使得系统维护人员的效率大大提高 运维效 率提高 4. 消除单点故障造成的稳定、可靠性问题 高系统稳定性和可靠性 5. 帮助IT投资风险和决策 6. 节能减排 and Confidential: Platform Computing Corporation 节省投资 提 Smart IT 绿色IT Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 实现云计算（虚拟化）的困难 15 Proprietary 1. 没有成熟的产品和方案让运营商有直观的理解。 2. 各个厂商都在推、强调自己的云计算概念和产品 ，像盲人摸象，无法让用户有个全局的认识。 3. 现有IT系统的改动成本和风险 4. 传统业务系统虚拟化改造 5. 少有成功案例可以借鉴 6. 组织管理和人们的认识需要提高 and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Platform在实现云计算方面的优势 16 Proprietary 1. Platform已经有了自己的云计算产品ISF -- IAAS 2. Platform的云计算产品是建立在许多用户的需求上 的， 如 JP Morgen, CityBank, Amazon, Alatum 3. 我们帮助用户实现小步快跑的策略， 降低IT系统 的改动成本和风险 4. 我们本地有近200名研发团队来协助用户的业务系 统虚拟化改造 5. Platform已有几个云计算成功案例 6. Platform可提供业务培训和成功用户案例考察 and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Java Cloud: Fortune 500 FS Companies App 1 App Server App 2 App Server App N App Server 环境 100s Java 应用软件运行在1000s UNIX SMP 服务器 挑战 烟囱式的业务系统导致了系统部署时间长，资 源利用率低下，IT管理维护成本高 解决方案 App 1 App 2 App N 资源池方案： Linux, Xen/KVM 和 storage; 自服务管理, 调度自动化，管理一体化 Self-Service Portal App Server Benefits Platform ISF 系统部署的时间从几天缩短到几分钟 没有双机备份 低成本 Virtual Servers 17 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. SaaS Cloud: Fetch Technologies 环境 200 virtual servers in production and test/dev using VMware CUST A CUST B CUST C … CUST X Platform ISF 挑战 由于手动部署业务系统，无法满足日益增长的业务 需求 简单的用户系统配置的改变，需要几个小时乃至几 天 解决方案 利用私有云的技术Platform ISF自动管理和部署系统 Benefits 满足了客户业务扩张的需求 减少了认为的中间环节，提高了工作效率 实现了Service on Demand 18 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. IaaS Cloud: SingTel 环境 Xen, VMware, Hyper-V, and physical blades on 2,400 cores providing public cloud services 挑战 在人工操作的方式下， 管理和维护出租 的计算机、计算用户使用情况和计费非 常的不方便 解决方案 利用私有云的技术Platform ISF自动管 理和部署系统 Benefits 多快好省的为用户提供各种服务 通过自动化管理， 降低了维护费用 提升了市场竞争力 19 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. HPC Cloud: CERN User A Workload Manager User B Workload Manager 环境 RHEL, KVM, Xen, Hyper-V for widely diverse set of scientific applications on x86 commodity boxes 挑战 系统无法为用户提供灵活的资源配置， 需要等待很长的时间 解决方案 User A User B 利用私有云的技术Platform ISF自动管 理和部署系统 Benefits Platform LSF Platform ISF 20 Proprietary and Confidential: Platform Computing Corporation 在固有的资源上， 开发了更多的服务 项目; 对一些应用系统的运行效率提高 了一倍多 降低成本， 提高资源利用率 通过自动化管理， 降低了维护费用 Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 3 个层次的云计算服务 SaaS (Software as a Service，软件即服务) PaaS (Platform as a Service，平台即服务) IaaS (Infrastructure as a Service，基础架构 即服务) 应用软件对最终用户按需分配 e.g., Salesforce.com APIs for developing new Cloud apps e.g., Google App Web 服务器， 网络，存储按需分配 e.g., Amazon EC2, S3 Each level provides a higher level of service abstraction & may use lower level(s) 21 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 2015/4/9 21 云计算体系架构 云计算门户 SAAS IDC 服务 IAAS 服务平台 服务应用系统 服务系统 服务调度和管理引擎 服务管理 云计算平台VM中间构建 IAAS 调度分配引擎 PAAS IAAS 资源池 22 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Placement Engine Policy 5) C-language plug-in placement policy: • vem_policy_init() • vem_policy_fin() • vem_policy_distribute() • vem_policy_place() • vem_policy_housekeep() • vem_policy_status() • vem_policy_info() 1) Application Topology Tier 1 DB App Server App Server Web Server App Server Web Server Tier 2 DC Rack Group Rack Placement Engine Offeri ng 3 400 Rack Rack Rack Group Rack Rack Rack 3) Network Access Cost Matrix (Available Bandwidth / Dynamic Utilization) Contract # 889 DC 1 Offeri ng 2 200 #999 Contract #888 Contract # 888 Offeri ng 1 Contract #677 Contract #677 Rack Group Contract # 768689 Contract # 78934 300 DC Tier 3 4) Previous reservations committed & Account Quotas Contract #55 / 2) Resource Hierarchy Contract #123 J a n 23 Proprietary Contract #444 D e c DC 2 Rac k1 DC 3 DC 1 R2 DC 2 R2 DC 3 R3 Rac k2 Rac k3 Output: - Initial Placement - Run-Time Management - Defragmentations& Migration and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 4/9/2015 23 基于资源可用状态的分配策略 Packing（填满） • 应用程序在尽量少的物理服务器上运行 • 每个被使用的服务器利用率最大化，减少资源碎片，减 少能源消耗。 Striping（分散） • 应用程序分散在尽可能多的物理服务器上运行 • 减少机器故障带来的影响，提高应用程序的运行效率 Load-Aware（基于 负载） • 新的应用程序总是运行在负载最轻的物理服务器上 • 获得更高的应用程序运行效率 HA-Aware（基于高 可靠性配置） • 将支持高可靠性（HA）的服务器资源分配给关键业务 • 提供更高的资源可用性 Energy-Aware（节 能） • 根据节能指数和数据中心热点运行应用程序 • 减少能源消耗 Affinity-Aware（基于 • 将任务分配到与关键资源关联度最高的服务器上，例如 将任务分配到与存储系统直连的服务器上 关联程度） • 保证应用程序运行效率 Server Model-Aware （基于服务器类型） • 根据服务器类型分配资源 • 尽可能利用性能好的、昂贵的资源，是投资回报最大化 Topology-Aware（基 • 尽量使用连接到同一个交换机、背板、刀片中心的服务 器运行用户任务 于网络拓扑） • 提高应用程序运行效率 24 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Application-Aware 调度 需求: 动态的调整业务应用对资源的需求改变，而无须修改应用的中间件 输入： 1.系统负载参数(cpu, mem) 2.集成的应用软件效率管理系统 3.需求的调度策略 2 Application Performance Manager Call ISF or send Alert 3 Get historical usage Application Orchestrator PTM Framework Monitor Grow/Shrink 1 Deploy & Monitor VMs P T M ICM ISF Master PVMO KVM Hypervisor Resource Group 25 Proprietary Vmware Hypervisor Resource Group Physical Linux Resource Group and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 资产管理与监控 • • • CMDB Asset DB Resource Updater API ISF • Add custom attributes about hosts from 3rd party tools via API Attributes can be used in scheduling & placement policies Useful to organize hosts by location, energy efficiency, model types, lease dates Supports both static and dynamic attribute updates Monitoring DB 26 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 资源使用数据用来做计费和能力规划 HPC Application Other Data Reporting App Platform ISF External Billing System Rate Definition 27 Proprietary and Confidential: Platform Computing Corporation JBOSS App Usage Data • Reserved Amount & Time • On-Demand Amount & Time • CPU Usage • Mem Usage • By Account • By Application Def • By User • By Resource Group Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 存储的集成 适配器来发现存储的内容和生成存储的资 源池 用户使用存储资源就如同使用一个服务的定 义 系统可以预约存储资源 系统启动适配器来生成存储的分配空间 工作流和后置配置步骤用来连接存储服务器 ISF Master Storage Adaptor Storage Containers Storage Manager APIs (EMC, NetApp) 28 Proprietary High Performance 2G 10G 5TB Mid-range storage 5G 10G 100G Low-end storage 25G 50G 10TB 20TB and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 网络集成 IP Pool Management ISF IP Pool 1 IP Pool N Network Adapter External Pool Network Device Adapter LB Adapter Physical Device 29 Proprietary and Confidential: Platform Computing Corporation FW Adapter Physical Device SW Adapter Physical Device Physical Device Router Adapter Physical Device Copyright © 2010 Platform Computing Corporation. All Rights Reserved. 企业私有云 ISF Market Place Broker Application App Manager ISF Master Node ICM Portal End-User ISF Master Node CES ICM Portal CES P-VMO P-VMO VMwar e Nagios xCAT VMwar e Nagios xCAT West Coast Data Center RedHat Remote Proxy Citrix Remote Proxy VMwar e Enterprise Messaging Infrastructure / JMS Blad eLogic xCAT Enterprise DB Infrastructure Opswar e Amazo n VMwar e Blad eLogic Tivoli xCAT Cloud Admin Europe Data Center East Coast Data Center Leverage EGO capabilities to distribute ISF services across multiple nodes and provide centralized monitoring, troubleshooting, and HA 30 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Platform Computing, Inc. Platform Clusters, Grids, Clouds, Whatever Computing The leader in cluster, grid and cloud management software: o 17 years of profitable growth o 2,000 of the world’s most demanding client organizations o 5,000,000 CPUs under management o 500 professionals working across 13 global centers o Many Strategic relationships including Dell, Intel, Microsoft, Red Hat and SAS 31 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Platform Product Portfolio Platform Cluster Platform LSF Platform MPI Platform Symphony Clusters Grids Platform ISF Clouds Workload Management Resource Management Platform Computing 32 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved. Thank you www.platform.com [email protected] 33 Proprietary and Confidential: Platform Computing Corporation Copyright © 2010 Platform Computing Corporation. All Rights Reserved.