Gc vit sttp cc december 2013
2 likes602 views
The document discusses grid computing and the speaker's background in the topic. It provides key takeaways about understanding the evolution of technologies like grid computing and envisioning upcoming trends. It then discusses what a grid is, including early definitions, and elements of grid computing like resource sharing, coordinated problem solving, and dynamic virtual organizations. The document also outlines attributes of grid computing related to virtualization, dynamic provisioning, resource pooling, and self-adaptive software. It provides examples of how grids are used and lists common grid components.
![11-12-2013
G
T
4
G
T
3
G
T
2
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
Pre-WS
Authentication
Authorization
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
Web
Services
Components
Non-WS
Components
Replica
Location
Service
XIO
Credential
Management
23
Security
Data
Management
Execution
Management
Information
Services
Common
Runtime
G
T
3
G
T
2
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
Pre-WS
Authentication
Authorization
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
12/11/2013
Globus Open Source Grid Software
G
T
4
12/11/2013
Globus Open Source Grid Software
Web
Services
Components
Non-WS
Components
Replica
Location
Service
XIO
Credential
Management
24
Security
Data
Management
Execution
Management
Information
Services
Common
Runtime
12](https://image.slidesharecdn.com/gcvitsttpccdecember2013-131211091326-phpapp02/85/Gc-vit-sttp-cc-december-2013-12-320.jpg)
Gc vit sttp cc december 2013
- 1. 11-12-2013 GRID COMPUTING Reference : Internet 12/11/2013 SPEAKER’S BACKGROUND IN GRID AND CLOUD COMPUTING An opening caveat This talk is based on my: My doctoral research in Grid Computing and Shared memory Review and session chair experience for various conferences Expert talks at various Institutes for faculty and students in STTPs, Conferences etc. Experience as a Project mentor 2 1
- 2. 11-12-2013 12/11/2013 KEY TAKEAWAYS Widen personal technical spectrum Understand the evolution of recent technologies Envision the upcoming technological trends Be useful in Teaching STTP related and allied subjects Guiding projects –UG/PG 3 12/11/2013 ELECTRICAL GRID 4 2
- 3. 11-12-2013 12/11/2013 WHY GRIDS ? LARGE SCALE EXPLORATION NEEDS THEM—KILLER APPLICATIONS. Solving grand challenge applications using computer modeling, simulation and analysis Life Sciences Aerospace Internet & Ecommerce CAD/CAM 5 Digital Biology Military Applications 12/11/2013 WHAT IS A GRID? Early defs: Foster and Kesselman, 1998 “A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive, and inexpensive access to high-end computational facilities” Kleinrock 1969: “We will probably see the spread of ‘computer utilities’, which, like present electric and telephone utilities, will service individual homes and offices across the country.” 6 3
- 4. 11-12-2013 12/11/2013 GRID COMPUTING 7 12/11/2013 ELEMENTS OF GRID COMPUTING Resource sharing Computers, data, storage, sensors, networks, … Sharing always conditional: issues of trust, policy, negotiation, payment, … Coordinated problem solving Beyond client-server: distributed data analysis, computation, collaboration, … Dynamic, multi-institutional virtual organizations Community overlays on classic org structures Large or small, static or dynamic 8 4
- 5. 11-12-2013 A Typical Grid Computing Environment Grid Information Service Grid Resource Broker R2 2 R5 R3 Application database R4 RN Grid Resource Broker R6 R1 Resource Broker Grid Information Service 12/ 11/ 201 3 9 12/11/2013 GRID COMPUTING: ATTRIBUTES (1) Virtualization: Abstracting grid entity into service It enables grid components to integrate tightly without creating rigidity and brittleness in the system. Components quickly react to change, and adapt failures without compromising performance and reliability. Dynamic Provisioning: It simply means distributing supplies where they are needed. Supplies mean request, data, computation A grid service broker links grid elements together automatically and dynamically, based on the knowledge about their requirements and attributes. and adjust the association according to the change and failures 10 5
- 6. 11-12-2013 12/11/2013 GRID COMPUTING: ATTRIBUTES (2) Resource Pooling: contributes to lower cost Consolidation and pooling is used for better utilization. Provide flexibility to optimize the association Self-Adaptive Software: Everyday task of administrator are automated and simplified. The bulk of maintenance and tuning is automated to reduce IT staff cost. Unified Management: Self-adaptive software does not eliminate human interaction. Unified management is provided to simplify the management process. Single tool can be used to provision, monitor, administer 11 12/11/2013 HOW ARE GRIDS USED? Utility computing High-performance computing Collaborative design Financial modeling BELLE Collaborative data-sharing High-energy physics E-Business Drug discovery Life sciences Data center automation E-Science Natural language processing 12 Business Intelligence (Data Mining) 6
- 7. 11-12-2013 ONLINE ACCESS TO SCIENTIFIC INSTRUMENTS Advanced Photon Source wide-area dissemination real-time collection archival storage desktop & VR clients with shared controls tomographic reconstruction DOE X-ray grand challenge: USC NIST, U.Chicago 13 12/11/2013 12/11/2013 GRID COMPUTING: COMPONENTS • Computation: – • Networked Storage: – • Integrated view of data storage (Datagrid). Local disk, secondary storage, mountable, Unified name space Network interconnects: – • Computing cycles provided by processors of grid machines. Simple, parallel, iterative uses of computing elements Fast interconnection technologies. Redundant and external Internet connections makes parallel processing faster, and management better. Software and licenses – Expensive software, Sharing Expensive licenses, Limited use of multiple installation 14 7
- 8. 11-12-2013 12/11/2013 GRID ARCHITECTURE (SERVICE-ORIENTED) Applications Grid Architected Services Web Services (Extended Web Services) Security Filesystems Servers Database Storage Directory Messaging Network 15 Grid developers Tool developers Application developers End Users System Administrators GRID TYPES 12/11/2013 GRID USERS Compute grid Data grid Grids on the Internet 16 8
- 9. 11-12-2013 12/11/2013 OPEN GRID SERVICES ARCHITECTURE Developed by the Global Grid Forum to define a common, standard, and open architectures for Grid-based applications. Provides a standard approach to all services on the Grid. VO Management Service. Resource discovery and management service: Job management service. Security services. Data management services. Built on top of and extends the Web Services architecture, protocols, and interfaces. 12/11/2013 CDAC: GARUDA COMPONENT ARCHITECTURE 17 18 9
- 10. 11-12-2013 12/11/2013 MANY GRID PROJECTS & INITIATIVES Australia Nimrod-G GridSim Virtual Lab Gridbus DISCWorld ..new coming up USA Globus Legion OGSA Javelin AppLeS NASA IPG Condor-G Jxta NetSolve AccessGrid and many more... Europe UNICORE MOL UK eScience Poland MC Broker EU Data Grid EuroGrid MetaMPI Dutch DAS XW, JaWS Japan Cycle Stealing & .com Initiatives Distributed.net SETI@Home, …. Entropia, UD, Parabon,…. Public Forums Global Grid Forum P2P Working Group IEEE TFCC Grid & CCGrid conferences Ninf DataFarm Korea... N*Grid 19 http://www.gridcomputing.com 12/11/2013 GRID APPLICATIONS-DRIVERS Distributed HPC (Supercomputing): Computational science. High-throughput computing: Large scale simulation/chip design & parameter studies. Content Sharing Sharing digital contents among peers (e.g., Napster) Remote software access/renting services: Application service provides (ASPs). Data-intensive computing: Data mining, particle physics (CERN), Drug Design. On-demand computing: Medical instrumentation & network-enabled solvers. Collaborative: Collaborative design, data exploration, education. 20 10
- 11. 11-12-2013 12/11/2013 GLOBUS Five parts: Common Runtime GT Core for building new services Security To provide secure access. Based upon Grid Security Infrastructure (GSI) Execution management Initiation, monitoring, management, scheduling and coordination of executable programs (jobs) Data management Discover, transfer, and access large data Information services Discover & monitor dynamic services 12/11/2013 GLOBUS TOOLKIT 21 22 11
- 12. 11-12-2013 G T 4 G T 3 G T 2 Python WS Core [contribution] C WS Core Community Authorization Service OGSA-DAI [Tech Preview] WS Authentication Authorization Reliable File Transfer Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 3 G T 4 Community Scheduler Framework [contribution] Delegation Service Web Services Components Non-WS Components Replica Location Service XIO Credential Management 23 Security Data Management Execution Management Information Services Common Runtime G T 3 G T 2 Python WS Core [contribution] C WS Core Community Authorization Service OGSA-DAI [Tech Preview] WS Authentication Authorization Reliable File Transfer Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 3 G T 4 Community Scheduler Framework [contribution] Delegation Service 12/11/2013 Globus Open Source Grid Software G T 4 12/11/2013 Globus Open Source Grid Software Web Services Components Non-WS Components Replica Location Service XIO Credential Management 24 Security Data Management Execution Management Information Services Common Runtime 12
- 13. 11-12-2013 12/11/2013 GRID SIMULATOR: OPTORSIM Models the interactions of the individual components of a running Data Grid. Simulates optimization and replication 25 12/11/2013 CONVERGENCE OF COMPETING PARADIGMS/COMMUNITIES NEEDED } ? Web Data Centres Utility Computing Service Computing Grid Computing P2P Computing Cloud Computing Market-Oriented Computing … Paradigms + •Ubiquitous access •Reliability •Scalability •Autonomic •Dynamic discovery •Composability •QoS •SLA •… Attributes/Capabilities -Trillion $ business - Who will own it? 26 Manjrasoft 13
- 14. 11-12-2013 VOLUNTEERS ARE SELDOM PAID; NOT BECAUSE THEY ARE WORTHLESS, BUT BECAUSE THEY ARE PRICELESS! --AUTHOR UNKNOWN Contact: [email protected]; [email protected] +919833818846 14