Workload Replay in the Cloud: Secret Weapon for Cloud Migrations
0 likes•503 views
The document outlines the Database Experimentation Assistant (DEA) designed to facilitate cloud migrations by ensuring successful workloads with minimal errors and performance complaints, potentially saving significant costs. It provides a detailed agenda including benchmarking, workload capture and replay techniques, migration to Azure SQL Database, and practical steps for implementation using various tools. Additionally, it offers resources for users seeking more information and feedback to improve the session.
![Create Database Credential to access
Blob Storage
CREATE MASTER KEY ENCRYPTION BY PASSWORD = ‘<Your Password>';
/* Remember to remove leading ? From SAS token in the Azure Portal */
CREATE DATABASE SCOPED CREDENTIAL [https://migrateazure.blob.core.windows.net/dataarchvc]
WITH IDENTITY='SHARED ACCESS SIGNATURE',
SECRET = 'sv=2019-12-12&ss=b&srt=sco&sp=rwdlacx&se=2020-08-29T08:23:26Z&st=2020-08-
26T00:23:26Z&spr=https&sig=i5RLPsd2oiBhJQsNZvvYloGoAUZno2%2BNT1DI%2Fz9rQPU%3F'
GO](https://image.slidesharecdn.com/introtodea-dataarchvc-2020aug-repaired-200911134554/85/Workload-Replay-in-the-Cloud-Secret-Weapon-for-Cloud-Migrations-41-320.jpg)
Workload Replay in the Cloud: Secret Weapon for Cloud Migrations
- 1. Introduction to Database Experimentation Assistant : Secret Weapon to Cloud Migrations @JohnSterrett Founder of Procure SQL LLC
- 2. Goals for A Successful Migration NO UNEXPECTED ERRORS
- 3. Goals for A Successful Migration No Unexpected Errors Users Not Complaining about Performance
- 4. Goals for A Successful Migration No Unexpected Errors Users Not Complaining about Performance Expenses going down!
- 7. Save ~ 40k per year for the right compute for your workload
- 10. History of Workload Replay
- 12. Today’s Agenda • Benchmarking the Common Way • Workload Replay Process • Database Experiment Assistant (DEA) • Distributed Replay vs RML Utilities • Capture Workload • Replay Workload • Testing Azure SQL VM to Azure SQL DB Migration
- 13. Help Me, Help You! • I need your feedback to make this session better. $50 Amazon gift card • https://survey.zohopublic.com/ zs/hKzJaz • Image Credit
- 15. Workload Tuning Never-ending cycle Workload is Running Capture Workload Analysis on Captured Workload Make Changes
- 16. Workload Replay Steps Backup (P) Capture Replay for Replay (P) Stop Capture Replay (P) Preprocess Replay Capture Restore Backup Capture Replay for Analysis Introduce a Change Replay Workload Stop Replay Capture Perform Analysis Only in Production!
- 17. DEA Tools Capture SQL Server Side Trace Extended Event Preprocess Distributed Replay RML Utilities (readtrace.exe) Replay Distributed Replay RML Utilities (ostress.exe) Analysis Database Experiment Assistant
- 18. DEA Tool Suite Distributed Replay (DReplay) RML Utilities (InBuilt)
- 19. How Distributed Replay Works
- 20. Distributed Replay Executables DReplay.exe DReplayClient.exe DReplayController.exe
- 21. Umm.. Where is DREPLAY.EXE? • SQL tools Forum Link • Vote for Fix • Workaround - Download SSMS 2017
- 23. Capture Workload for Replay
- 24. DEA – Capture Results
- 25. Capture Trace Events and Output
- 27. DEA – Replay Selection
- 28. Replay Process with Distributed Replay (DRU) Create Trace Replay Capture Preprocess Trace to DRU Replay Preprocessed DRU Stop Replay Trace Remove Trace
- 29. PreProcess Input and Output
- 30. DEA – Replay Results
- 31. Preprocess with Distributed Replay
- 32. Replay with Distributed Replay
- 33. Extended Event and Trace grow quickly!
- 34. Scripts Used by DEA
- 36. Replay Process for Azure SQL DB Validate Schema Move Schema and Data Setup Blob Storage Create SAS Key Create Database Credential Replay Workload Migrate Data Setup Extended Event Capture to Blob Storage DEA Replay
- 37. Successful Validation of Schema in DMA
- 38. Import Schema and Data to Azure SQL DB with Dbatools.io and PowerShell Import-Module dbatools -Force <# Variables #> $BackupPath = "C:DemoAzureSQLBacpac" #folder location for backups $SourceInstance = "sql2019sql2016" $DBName = "TestUpgrade" $AzureDestInstance = "procuresqlsc.database.windows.net" $DBNameDest = $DBName $SQLAdminUser = "<Your account name>" <# backpac options for import and export #> $option = New-DbaDacOption -Type Bacpac -Action Export $option.CommandTimeout = 0 $option2 = New-DbaDacOption -Type Bacpac -Action Publish $option2.CommandTimeout = 0 $bacpac = Export-DbaDacPackage -Type Bacpac -DacOption $option -Path $BackupPath -SqlInstance $SourceInstance -Database $DBName Publish-DbaDacPackage -Type Bacpac -SqlInstance $AzureDestInstance -Database $DBNameDest -Path $bacpac.path -DacOption $option2 - SqlCredential $SQLAdminUser
- 39. Create Shared Access Signature
- 40. Use SAS Token for Database Credential Note: Blob Container name is not included
- 41. Create Database Credential to access Blob Storage CREATE MASTER KEY ENCRYPTION BY PASSWORD = ‘<Your Password>'; /* Remember to remove leading ? From SAS token in the Azure Portal */ CREATE DATABASE SCOPED CREDENTIAL [https://migrateazure.blob.core.windows.net/dataarchvc] WITH IDENTITY='SHARED ACCESS SIGNATURE', SECRET = 'sv=2019-12-12&ss=b&srt=sco&sp=rwdlacx&se=2020-08-29T08:23:26Z&st=2020-08- 26T00:23:26Z&spr=https&sig=i5RLPsd2oiBhJQsNZvvYloGoAUZno2%2BNT1DI%2Fz9rQPU%3F' GO
- 42. Start Replay to Azure SQL Database
- 43. Ostress.exe for Azure SQL DB Replay
- 45. Analysis Azure VM vs Azure SQLDB
- 46. Analysis Automated Process Download from Blob Storage Read Trace on Load1 into DB1 Read Trace on Load2 into DB2 Compare Analysis into DB3 Load Analysis Viewer
- 51. Where Are DEA Logs?
- 53. Get Help for DEACMD Operations CD "C:Program Files (x86)Microsoft CorporationDatabase Experimentation Assistant" .deacmd.exe --help
- 54. Get Help for Starting Capture CD "C:Program Files (x86)Microsoft CorporationDatabase Experimentation Assistant" .deacmd.exe -o StartCapture --help
- 55. Start Capture with DEACMD.EXE $TracePath = "D:DRUReplayE" .Deacmd.exe -o StartCapture -n sql2008capture -x 0 -h localhost -f TestUpgrade -e --trust -m 0 -l $TracePath -d 10
- 56. Replay a Preprocessed Workload CD "C:Program Files (x86)Microsoft SQL Server140ToolsBinn" .dreplay.exe replay -s "ProcureLoad" -w "ProcureLoad" -f 30 -o -d "D:DRUPreProcess"
- 57. Stop Capture Replay <# Stop Replay #> CD "C:Program Files (x86)Microsoft CorporationDatabase Experimentation Assistant" .Deacmd.exe -o StopCapture -n sql2008capture -x 0 -h localhost -e --trust -m 0
- 58. Free Reference Material Videos, Reference Links, Tips, and slide deck can be found at http://azuresqldbresources.procuresql.com/