Scale Your Data Tier With Windows Server App Fabric
Download as PPTX, PDF6 likes1,190 views
The document discusses scaling data tiers using Windows Server AppFabric, focusing on the importance of caching in improving application performance. It details features of AppFabric caching, such as distributed in-memory application cache, data distribution, and the ability to manage cache services with PowerShell. The content also emphasizes security, session state management, and various data handling strategies to ensure high availability and efficient access across machines.
![Access APIs – Tagging ItemsTag hotItem = new Tag("hotItem");catalog.Put("toy-101", new Toy("Puzzle"),new Tag[]{hotItem}, “toyRegion”);catalog.Put("toy-102", new Toy("Bridge"), “toyRegion”);// From the same or a different clientList<KeyValuePair<string, object>> toys = catalog.GetAnyMatchingTag("toyRegion", hotItem);](https://image.slidesharecdn.com/scaleyourdatatierwithwindowsserverappfabric-12730696589578-phpapp02/85/Scale-Your-Data-Tier-With-Windows-Server-App-Fabric-29-320.jpg)
Scale Your Data Tier With Windows Server App Fabric
- 1. Scale Your Data Tier with Windows Server AppFabricChris Dufour, ASP MVPSoftware Architect, [email protected]
- 2. Agenda
- 3. SimpleDo the simplest thing that will possibly work
- 4. ScalabilityAble to support the required quality of service as the system load increases-Wiktionary
- 6. Web ExplosionWeb Site’s too slow!!Where did my shopping cart go?IIS/ASP.NETIIS/ASP.NETIIS/ASP.NET Application Application ApplicationServers are crashingDatabaseDatabase is hot!!Services are slow
- 7. Agenda
- 8. Data Near ProcessingCacheCacheBrowserSmart ClientCacheWeb ServiceCacheASP.NETCacheDatabase
- 9. Good but…Cache is scoped to machine / processMachines dieProcesses recycleCache memory is limited
- 10. What if?You could have as much cache as you wanted?You could share a giant cache across servers, services and even clients?What if this was something you could simply add to the platform for 1free?1Some features may require certain editions of Windows Server
- 11. Windows Server AppFabricAppFabricCACHINGWORKFLOW HOSTINGSERVICE HOSTINGMONITORINGSCALE OUTHIGH AVAILABILITY MANAGEMENT
- 12. Unified Cache ViewWhat is AppFabric Caching?An explicit, distributed, in-memory application cache for all kinds of data Caching clients can be across machines or processesClients Access the Cache as if it was a large single cacheCache Layer distributes data across the various cache nodes
- 13. AppFabric Cache
- 14. Data Distribution - Partitioned Cache…Web TierASP.Net AppASP.Net AppASP.Net AppCaching ClientCaching ClientCaching ClientGHIDEFABCCache ServiceCache ServiceCache TierCache ServiceEGBDHAICFScale on Data SizeMore machines => More memory to cacheScale on Cache ThroughputMore machines => keys distributed across more machines => better throughput
- 15. Scale Test OutputLoad1 Cache ServerAs load increases, throughput fails to scale latency increasesCaching TierThroughputLatency
- 16. Add a Second Cache ServerLoadLoad MaxThroughput increasesLatency decreasesCaching TierThroughputLatency
- 17. Add a Second Cache ServerLoadCaching TierThroughputLatency
- 18. Associated PressCaches metadata and newsServes 16 million hits per dayIncreased the amount of cached data 6 times.
- 19. System.Web.Cache
- 21. Copy Client DLLsUpdate Web.config….NET 3.5 SP1 OR .NET 4<hosts> <host name="BL1CDB8083714“cachePort="22233" cacheHostName="DistributedCacheService"/> ….. </hosts> <localCacheisEnabled=“true" ../><security … /> Application Application ApplicationCaching Access LayerCaching Access LayerCaching Access Layer.NET 4Install AppFabricConfigure AppFabricCaching ServiceCaching ServiceCaching ServiceConfiguration Store Deployment
- 22. Usage Pattern – Cache Aside (Explicit Caching)// Read from CacheToy toyObj = (Toy)catalog.Get("toy-101"); ApplicationCaching Access Layer// If Not present in the cacheif (toyObj == null){ // Read from backend.. toyObj = ReadFromDatabase(); // Populate Cachecatalog.Put("toy-101", toyObj); return toyObj;}Caching ServiceDatabase
- 23. AdministrationPowerShell cmdlets are used to administer the cache cluster Rich set of cmdlets for Cache cluster managementCache creation and monitoring
- 25. Using PowerShellRemember – PowerShell can also be called from .NET Code!
- 26. SecurityDomain Based Security OptionDomain Account / Local Account based AuthenticationOnly authorized servers can join the clusterOnly authorized clients can connect to the clusterTransport Level SecurityTurn on/off Signing or EncryptionCan turn off Cache SecurityUse Firewalls, IPSec, VLANs to protect cachegrant-cacheallowedclientaccount RedDomain\Machine1$ grant-cacheallowedclientaccount RedDomain\John
- 27. Logical HierarchyAppFabric Caching ServiceAppFabric Caching ServiceAppFabric Caching ServiceAppFabric Caching ServiceNamed Cache : Product CatalogNamed Cache : Electronics InventoryRegions Key Payload Tags Region A121 xxxx “Toy” “Child”123 yyyy “Toy” “Chair”.. MachineHostPhysical processes hosting AppFabric Caching instance.Named CachesCan span across machinesDefined in the configuration fileRegionsPhysically co-located Container of Cache ItemsMay be implicit or explicitly createdCache ItemKey, Payload (Object ), Tags, TTL, Timestamps, Version
- 28. AppFabric Caching API// Create instance of cachefactory (reads appconfig)DataCacheFactory fac = new DataCacheFactory();// Get a named cache from the factoryDataCache catalog = fac.GetCache("catalogcache");// Simple Get/Putcatalog.Put("toy-101", new Toy("Puzzle", .,.));// From the same or a different clientToy toyObj = (Toy)catalog.Get("toy-101");// Region based Get/Putcatalog.CreateRegion("toyRegion");// Both toy and toyparts are put in the same region catalog.Put("toy-101", new Toy( .,.), “toyRegion”);Catalog.Put("toypart-100", new ToyParts(…), “toyRegion”);Toy toyObj = (Toy)catalog.Get("toy-101“,"toyRegion");
- 29. Access APIs – Tagging ItemsTag hotItem = new Tag("hotItem");catalog.Put("toy-101", new Toy("Puzzle"),new Tag[]{hotItem}, “toyRegion”);catalog.Put("toy-102", new Toy("Bridge"), “toyRegion”);// From the same or a different clientList<KeyValuePair<string, object>> toys = catalog.GetAnyMatchingTag("toyRegion", hotItem);
- 30. Types of DataGrocery Shop Web TierShopping CartGrocery InventoryDistributed Cache Grocery Catalog
- 31. Reference Data – PerformanceCatalog data doesn’t change oftenUnnecessary network cost to access from different machinesSolution – Local CacheApplicationApplicationGet(K2)Get(K2)Put(K2, v3)AppFabric Caching ClientAppFabric Caching ClientLocal CacheRoutingTableRouting TableCache2Cache3Cache1K2, V2K2, V2Primary for K1,V1Primary for K3,V3Primary for K2,V2K1, V1K2, V3K3, V3
- 32. Reference Data – Bulk GetBulk Fetch from region200-300k ops per secondFewer network callsCatalog.BulkGet( new List<string>(){“toy-101”, “toy-102”} , “toyRegion”);
- 33. Activity Data – Session IntegrationLoad Balance RequestsNo more sticky routing<sessionState mode="Custom“ customProvider="SessionStoreProvider"><providers> <add name="SessionStoreProvider" type=“Microsoft.Data.Caching.DataCacheSessionStoreProvider, ClientLibrary“ cacheName="<YourNamedCache>"/></providers></sessionState>Drop in AppFabric Caching SessionStoreProvider…Caching Access LayerCaching Access LayerSession State stored in AppFabric CachingAllows session state to be shared amongst multiple applicationsScale your Session StoreDynamicallyCache ServiceCaching ServiceCaching ServiceHighly Available Application Application ApplicationCaching Access Layer
- 34. ApplicationApplicationActivity Data - AvailabilityPUTGet(K2)AppFabric Caching ClientAppFabric Caching ClientRouting TableRouting TableCache1Cache2Cache3Primary forPrimary forPrimary for Replication AgentK3, V3K1, V1K2, V2(K2, V2)K2, V2Secondary forSecondary for Secondary forK2, V2K2, V2K3, V3K1, V1
- 35. Resource Data - Optimistic LockingGetCacheItem returns a version objectEvery update to an object internally increments it's versionSupply the version obtained along with the Put/RemovePut/Remove will succeed only if the passed in version matches the version in the cache Two clients access the same item Both update the itemSecond Client gets in first; put succeeds because item version matches; atomically increments the versionFirst client tries put;Fails because the versions don’t match
- 36. Resource Data - Pessimistic LockingClient1: GetAndLock ("k1")Client3: Get ("k1")Client2: GetAndLock ("k1")GetAndLock gets lock handleRegular Get succeeds Other GetAndLock on same item failsTake locks on non-existent keysAllows you to co-ordinate calls for dataK1
- 38. Lock Non-Existent KeyGET/LOCKGET/LOCKGET/LOCKCache ServiceCache ServiceCaching Service
- 39. Composite RaceCALLWAITWAITCache ServiceCache ServiceCaching Service
- 40. Composite RacePUTUNLOCKGETGETCache ServiceCache ServiceCaching Service
- 41. Resource/Activity Data – Tracking ChangesCache Event notificationsRegister on any client to notify changesBatched NotificationsDataCache.RegisterCacheLevelCallback(int filter, DataCacheChangeCallback delegate); DataCache.RegisterRegionLevelCallback( String region, int filter, DataCacheChangeCallback delegate); DataCache.RegisterKeyLevelCallback( String region, String key, int filter, DataCacheChangeCallback delegate);
- 42. Register Notification for Key “K3"Call DelegateStore Last LSN ApplicationMap Keys to PartitionAppFabric Caching ClientPartition: P2Last LSN: 19Routing TablePoll Required NodesNodes Return List of Changes LSN OrderCache2Cache3Cache1K2, V2Primary forPrimary forPrimary forChange Log (Partition P2)Del K32Del K43Change LogPartition P1Add K2Del K32Change Log33 Add K134 Del K22K1, V1K3, V3Scalable Notifications
- 43. Agenda
- 46. Pre-FetchHospitalRemote ClinicData CenterCache ServiceWAN
- 47. Agenda
- 52. endpoint.tv
- 54. Thanks to our contributors
Editor's Notes
- #12: In the future we will be bringing these capabilities to the cloud and bringing some of the cloud capabilities such as service bus and access control to the on-premise server solution as well.