WINER Workflow Integrated Network Resource Orchestration
Download as PPT, PDF0 likes383 views
WINNER (Workflow INtegrated NEtwork Resource orchestration) orchestrates network resources to enhance business workflows. It defines workflow activities for network resources and interacts with DRAC services to allocate resources for workflows. WINNER supports various workflow engines like Globus and BPEL and can dynamically adjust resources through late-binding to optimize multiple competing workflows. Use cases demonstrate benefits for medical imaging and disaster response workflows.
WINER Workflow Integrated Network Resource Orchestration
- 1. Workflow Integrated Network Resource Orchestration Phil Wang, Inder Monga, Satish Raghunath, Franco Travostino, Tal Lavian {pywang, imonga, satishra, travos, tlavian}@nortelnetworks.com Nortel Networks Labs Presented by Franco Travostino Boston, 02/09/2005
- 2. Agenda > WS Workflows and Challenges > WINNER > Featured Solutions > Related Work > Summary GlobusWorld 2005 Nortel Networks Labs WINNER - 2
- 3. Propel Network Resources into the Grid Universe > 1st Generation: Network Resources Mgmt for Grids • Demo-ed at GW04 Branded as “DRAC” www.nortel.com/DRAC > 2nd Generation: Secure Multi-Domain Brokering • Demo-ed at Supercomputing 2004 > 3rd Generation: Intercept the WS Workflow Curve (Today) GlobusWorld 2005 Nortel Networks Labs WINNER - 3
- 4. WS Workflows > Web Services (WS) boost opportunities for business development > Workflow defines the automation of a business process • With new SOA solutions, for WS: BPEL4WS, for Grid: GSFL • Streamlines application jobs in terms of WS and Grids activities > Workflow has a host of applications • eCommerce: B2B, financial brokerage, travel planning • Enterprise: concurrent design, data center, human resources • eScience: computing, data, visualization, sensor Grids GlobusWorld 2005 Nortel Networks Labs WINNER - 4
- 5. Challenges > WS Workflows bring new challenges • Business workflows streamline to network-wide collaboration • Grids/WS services and resources become workflow-aware > Challenges on Network resources our target • Pervasive resources sharing • Supply of services and resources may vary on conditions • Each workflow may demand a different level of resources • Resource requirements change as the workflow goes Workflow Engine App Grid/WS Workflow Start Data Distribution Computing Data Collection Visualization End Service Service Service Service Resource Storage+Network Cluster+Network Storage+Network Display+Network Process Activity WS/GS GlobusWorld 2005 Nortel Networks Labs WINNER - 5
- 6. WINNER > Orchestrates network resources in harmonization Workflow INtegrated NEtwork Resource orchestration with workflows • Enhances business processes with resource extensions • Employs network services to perform resource operations Applications Globus BPEL Custom User environments Grid WINNER Custom DRAC GMPLS UNI TL1 SNMP Networks End users Network services w/ Service gateways Network protocols Resources GlobusWorld 2005 Nortel Networks Labs WINNER - 6
- 7. DRAC: Dynamic Resource Allocation Controller > Resource discovery WINNER is the Workflow Arm of DRAC • Available physical resources in network domains • Available network services in network domains • Resource properties, status and updates > Resource Utilization • Resource collection and abstraction • Resource reservation and scheduling • Job status and feedback > Resource management • Resource allocation and release • Network configuration and control • Security and AAA > Application-aware smarts on resources Grid Storage • Multiple service gateways: Grid, workflow, storage • Resource policy, SLA • Resource optimization • Resource monitor and performance WINNER Workflow Health DRAC GlobusWorld 2005 Nortel Networks Labs WINNER - 7
- 8. WINNER and Workflow Engine > WINNER Process • Defines the workflow activities specific on network resources • Acts in either standalone or extension to a legacy process • Invocated from apps, and related business services > WINNER Process services (PS) • Web services that provide the activities of the business process • Realize the resource operations of the WINNER process • Support the workflow processing of network resources > WINNER Resource services (RS) • Web services that support PS by provisioning necessary resources to conduct the process and its activities Application • Perform the allocation of network resources • Update the status of network resources • Work closely with DRAC WINNER Process WINNER PS Workflow Engine Resources WINNER RS GlobusWorld 2005 Nortel Networks Labs WINNER - 8
- 9. WINNER Process: activity samples Interface to the Workflow Applications > Application registration • Unique identification of each application • Classification of resource workflows > Resource Job • Resource specification • Resource allocation • Resource re-allocation • Resource release > Query • Network resources • Resource workflows • Resource negotiation, when applicable > Misc • Account billing • Authorization, and security enhancement • Exceptions, status check, and error handling GlobusWorld 2005 Nortel Networks Labs WINNER - 9
- 10. WINNER and Grids Workflows > WINNER supports Grid infrastructures with a Grid workflow engine • WINNER enhances the Grid workflow processes with resource activities • WINNER Services interact with DRAC to perform network resource allocations in the Grid domains Grid app WINNER-enhanced Processes Globus engine WINNER Services WSRF WSRF WSRF WSRF DRAC DRAC DRAC DRAC Net 2 Net 1 Net … Net N GlobusWorld 2005 Nortel Networks Labs WINNER - 10
- 11. WINNER, Grids and WS Workflows > WS Workflow applications take advantages of Grids • WS engine provides the WINNER enhanced business processes to WS apps • Grids engine provides Grids services to WS apps through WINNER services API Globus engine WINNER Services WINNER-enhanced Processes WS engine WINNER Services WSRF WSRF WSRF WSRF DRAC DRAC DRAC DRAC Net 2 Net 1 Net … Net N WS app GlobusWorld 2005 Nortel Networks Labs WINNER - 11
- 12. WINNER and Multiple Workflows > Web Services are re-utilized across multiple types of workflows • Grid workflow • WS workflow: BPEL4WS • Others Compute RS Grid App Globus engine WINNER WINNER Network RS Storage RS > WINNER supports respective workflow engines • WINNER services widely shared Business PS WINNER App WS PS Utility PS WS App Process BPEL engine WINNER Process Workflow engine Services Process DRAC PS = Process Service RS = Resource Service GlobusWorld 2005 Nortel Networks Labs WINNER - 12
- 13. WINNER and Late-Binding > Late binding resources with workflows happen when • Workflow services and/or resources supply change • Workflows compete or optimize for resources • Workflows have special or uncertain requirements for resources > WINNER performs workflow-aware late-binding, through DRAC • Network resource selections or alternations according to applications • Resource optimization among workflows • Service site selections or alternations, together with service providers GlobusWorld 2005 Nortel Networks Labs WINNER - 13
- 14. Use Case: Workflow Engaged Networks for Radiology in Metro Regions > Workflows of radiology data transporting and medical processing • Application-aware network resource allocations • Dynamic adjustments of network resources and workflow priorities • Maximal utilization of network resources • Workflow classifications App Entry GlobusWorld 2005 Nortel Networks Labs WINNER - 14
- 15. Use Case: Disaster Recovery > Workflows of data evacuation and restoration in a disaster area • Critical Live Data pointing to survivors and their whereabouts • Sensor data showing distress in architectural structures and environment > Orchestrates network resources for orderly, max-yield workflows • Sensor-triggered workflow automation without any operator involvement • End-to-end, secure, across the agile network infrastructure • Policy-driving resource allocation and its preemptive usage GlobusWorld 2005 Nortel Networks Labs WINNER - 15
- 16. Related Work > WSBPEL or BPEL4WS: the OASIS effort • http://www.oasis-open.org > GridFlow/SDRC Matrix: a peer-to- peer infrastructure for Grid Workflow Management Systems • http://www.npaci.edu/dice/srb/matrix/ > GSFL and GridAnt: Globus workflow effort • http://www-unix.globus.org/cog/projects/workflow/ > Pegasus: mapping of complex scientific workflows onto the grid • http://pegasus.isi.edu/pegasus/main.htm > GWFE: execute their workflow applications on Grids • http://www.gridbus.org/workflow/: Globus 2.4 > Taverna: a language and software tools for eScience • http://taverna.sourceforge.net/ GlobusWorld 2005 Nortel Networks Labs WINNER - 16
- 17. Summary > WINNER integrates network resources with WS workflows • WINNER processes, process services and resource services • Workflow-aware network resource orchestration > DRAC network services are leveraged for allocation and information in network resource orchestration > Late-binding gives the adaptability to orchestrate network resources in favor of workflows’ needs > WINNER fits with Grids, Web Services, and other workflow applications • Enhances business processes with resource extensions • WS workflows can take advantages of Grids > Two use-cases show the workflow benefits in medical and disaster applications GlobusWorld 2005 Nortel Networks Labs WINNER - 17
- 18. Workflow Integrated Network Resource Orchestration Questions and Comments ? GlobusWorld 2005 Nortel Networks Labs WINNER - 18
Editor's Notes
- #11: The diagram does simplify the whole picture with Grid workflows. + The WINNER process is one of the Grid workflow processes that the Globus engine provides. + The WINNER process can be called by a Grid app, or though other processes and services. Only those apps directly using WINNER needs the WINNER API, and thus they are WINNER-specialized. + Similarly, the WINNER services are some of the Grid services that Globus engine runs.