![Forklift
On Premise
• Database Attach
• Content Databases
Test-SPContentDatabase
`–Name <databaseName> -WebApplication <url>
Mount-SPContentDatabase
`–Name <databaseName> -WebApplication <url>
`[-SkipSiteUpgrade]
Upgrade Content Databases to SharePoint 2016
• https://docs.microsoft.com/en-
us/SharePoint/upgrade-and-update/upgrade-
content-databases](https://image.slidesharecdn.com/wispug-funwithsharepointmigrations-180418145535/85/WISPUG-Fun-with-SharePoint-Migrations-22-320.jpg)
![Migration Cycle
Prepare
Farm Insight (Continued)
• Tools
• WinDiff / BeyondCompare
• PowerShell
• Xcopy
• PowerShell
• Get-SPServer
• Get-SPWebApplication / Get-SPSite / Get-SPWeb
• Get-SPFeature
• Get-SPWebTemplates
• Test-SPContentDatabase
• Get-SPContentDatabase | %{$_.Repair([bool])}
• $true = fix issues
• $false = list issues
• MANY, MANY MORE…](https://image.slidesharecdn.com/wispug-funwithsharepointmigrations-180418145535/85/WISPUG-Fun-with-SharePoint-Migrations-61-320.jpg)
WISPUG - Fun with SharePoint Migrations
- 1. Fun with SharePoint Migrations Brian Caauwe @bcaauwe April 18th, 2018
- 2. Who am I • Manager, Consultant, Speaker and new dad of 2 • Email: [email protected] • Twitter: @bcaauwe • Technical Editor • Professional SharePoint 2013 Administration • Certifications • MCM: SharePoint Server 2010 • MCSM: SharePoint Brian Caauwe
- 3. Poll https://bit.ly/2JWjtOc SharePoint Environment
- 5. Overview
- 6. Where are we coming from? Where are we going?
- 7. 2001 2003 2006 2009 2012 201620112010 Core Collaboration Content Management Cloud and Enterprise Social Cloud Connected SharePoint History
- 8. Poll What are your “largest”, “time consuming”, “hardest to overcome” issues with SharePoint migrations?
- 9. Resources Customizations Available Disk Space Customizations I’m looking at you Branding Testing Or lack thereof Knowledge Customizations That configuration from 3 years ago Customizations Workflow manager, SharePoint Apps Customizations That guy who wrote that code Typical Issues
- 10. • 2010 – Need to go through 2007 • 2013 – Need to go through 2010 • 2016 – Need to go through 2013 Scenarios On-Prem
- 11. • Can bypass version requirement • Comes with other restrictions Scenarios On-Prem
- 12. • Manual • SharePoint Online Migration API • SharePoint Migration Tool • 3rd Party tools Scenarios Online
- 13. Planning
- 14. Migration Team Stakeholders Server Admins Database Admins SharePoint Admins Site Admins Security Admins Designers Developers Site Users Communications
- 15. • Gather Information • Determine Impact • Collect Customization • Manual • Scripted • SharePoint Migration Assessment Tool • https://docs.microsoft.com/en- us/SharePoint/migrate-to-sharepoint- online/overview-of-the-sharepoint- migration-assessment-tool • Sample Worksheet • https://www.microsoft.com/en- us/download/details.aspx?id=30370 Surveys
- 16. Upgrade Issues • Wide lists • Authentication Mismatch • Modified Databases • Customizations Recommendations • Complete Customer & Farm Survey’s BEFORE testing • Set Testing Goals • Test customizations • Use REAL data • Evaluate branding requirements TEST YOUR Upgrade Process • http://www.microsoft.com/en- us/download/details.aspx?id=30366 Customization Testing
- 17. • Remove Stale Content / Unneeded Versions • Review Quotas / Locks • Cleanup Templates, Solutions, Features, Web Parts • User Driven, OM / PowerShell can help • Repair Data issues • User Driven, OM / PowerShell can help • Verify “Healthy” Environment (e.g. Health Analyzer, Event Logs, SP Logs) • Balance / Organize Content Databases • Root sites • “Issue Sites” in their own DBs Environment Cleanup
- 18. Online • Office 365 Tenant • User Identity Management On-Premise • SharePoint Version(s) • SQL Version(s) • Office Online Server (Business Intelligence) • Workflow Manager • Microsoft Identity Manager (FIM Replacement) Application • Service Accounts • Service Application Reqs Environment Build Out
- 19. Patterns
- 20. On Premise • Database Attach • Service Application Databases • Secure Store • New-SPSecureStoreApplication (Upgrades SSS) • Update-SPSecureStoreApplicationServerKey (Requires Passphrase from 2013) • Business Connectivity Services • New-SPBusinessDataCatalogServiceApplication (Upgrades BCS) • Managed Metadata • New-SPMetadataServiceApplication (Upgrades MMS) • Search • Restore-SPEnterpriseSearchServiceApplication (Upgrades Search Admin DB) • Does NOT retain index • Auto-generates other search database names … GUIDS Forklift
- 21. On Premise • Database Attach • Service Application Databases • User Profile • New-SPProfileServiceApplication (Upgrades Profile and/or Social DBs) • IGNORE Sync database • PerformancePoint • New-SPPerformancePointServiceApplication (Upgrades PerformancePoint) • App Management • New-SPAppManagementServiceApplication (Upgrades AppMgmt) • Project • Migrate-SPProjectDatabase (Upgrades Project Server DB) • Set-SPProjectDatabaseQuota (Disable database quota limit) • Migrate-SPProjectResourcePlans (Migrates Resource Plans)Forklift
- 22. Forklift On Premise • Database Attach • Content Databases Test-SPContentDatabase `–Name <databaseName> -WebApplication <url> Mount-SPContentDatabase `–Name <databaseName> -WebApplication <url> `[-SkipSiteUpgrade] Upgrade Content Databases to SharePoint 2016 • https://docs.microsoft.com/en- us/SharePoint/upgrade-and-update/upgrade- content-databases
- 23. Forklift On Premise • Site Collection Upgrades • No more “preview” sites • No more compatibility view • Methods • Upon database attach (DEFAULT) • Upon first browse • Admin upgraded with Upgrade-SPSite
- 24. Forklift Online • Same “structure” moved online • No native tools from MSFT like database attach
- 25. Tools
- 26. Migration Patterns SharePoint Online Migration API • Forklift content • File shares • SharePoint • Requires • SharePoint Online Management Shell • Does NOT • Create lists / libraries • Create metadata fields • Create views
- 27. Migration Patterns SharePoint Migration Tool • Forklift content • File shares • SharePoint • Does NOT … yet • Create lists / libraries • Create metadata fields • Create views
- 28. Migration Patterns Re-architect • BEST time to tackle during migration • Realign with the business • Put EVERYTHING on the table • On Premise, Online, Hybrid • Web Applications • Service Applications • Customizations • Managed Paths • Site Collections • Sites • Lists / Libraries • Permissions • Metadata
- 29. Migration Patterns Moving content comes with some pain • Workflows • Running • Embedded Urls • Alerts • Favorites • Old Users Moving Content
- 30. Migration Patterns Moving Content Native Methods (On Premise) • Move-SPSite (Moves site between content databases) • Set-SPSite (change URL for host based site collections) • Backup-SPSite / Restore-SPSite • Export-SPWeb / Import-SPWeb • Get granular to lists and libraries with -Path
- 31. Migration Patterns Moving Content Native Methods (Online) TOOLS / CODE
- 32. Cycle
- 33. Migration Cycle Architecture Revisit YOUR architecture
- 34. Migration Cycle Managing a complex process • Communication • Farm Customization Surveys • Migration Customization Testing • Environment Cleanup • Environment Build Out • Customizations Deployment • Operations Scheduling • Rollback Plan • Post-Migration Activities • Ongoing Support Calls Before you get your servers… or licensing
- 35. Migration Cycle Learn •Migration methods •New capabilities •Downtime mitigation Prepare •Document environment •Manage customizations •Plan upgrade strategy •Make items upgradable Test •Build test farms •Use real data •Evaluate techniques •Find issues early Implement •Build production farms •Deploy customizations •Minimize downtime •Monitor progress Validate •Troubleshooting •Upgrade event failures •UI/UX issues •Data issues
- 36. Aftermath
- 37. Aftermath Fixing Issues • You WILL miss something • Solutions / Features • Templates / Definitions • Fab 40 … don’t go there • Large Lists / Wide Lists • User Experience • Use Site Collection Health Checks to help • Unghosted pages • Non-reghostable pages • Incompatible HTML
- 38. Aftermath New Features Plan for new feature rollouts • Data Loss Prevention • eDiscovery • Retention Policies • Hybrid • Search • User Profiles • App Launcher Plan for what’s next • Take a hint from what’s coming in Office 365
- 39. Aftermath Support • Support calls WILL happen • “something changed” • “what is this new button” • Who will receive support calls? • Can they solve the problems • Do they have permissions to do so • What is the escalation process • Proactive vs. Reactive Support
- 40. Aftermath Patching • Is your architecture ready for Zero Downtime Patching? • Redundant Services • Load Balancer • Microsoft Shipping Public Updates (PU) MONTHLY • Features Packs • Get new features from SPO before new major version • Requires Software Assurance
- 41. Aftermath Patching • Turn OFF Windows Update!!! • For Public Updates, Service Packs and Feature Packs, same cycle applies • Learn • Prepare • Test • Implement • Validate • Deploy Software Updates for SharePoint Server 2016 • https://docs.microsoft.com/en-us/SharePoint/upgrade-and- update/deploy-updates-for-sharepoint-server-2016
- 42. Aftermath Ongoing Training What Method(s) work for your organization • Classroom • Train the Trainer • Self Service • User Group • Feature Focuses • Lunch and Learns • General vs. Solution based
- 43. Questions
- 44. Resources • Create a Customization Plan (SharePoint 2013) • https://docs.microsoft.com/en-us/SharePoint/upgrade-and-update/create-a-plan-for-current- customizations-during-upgrade-to-sharepoint-2013 • Upgrade Worksheet (SharePoint 2013) • https://www.microsoft.com/en-us/download/details.aspx?id=30370 • Upgrade to SharePoint Server 2016 • https://docs.microsoft.com/en-us/SharePoint/upgrade-and-update/upgrade-to-sharepoint- server-2016 • Upgrade Service Applications to SharePoint 2016 • https://docs.microsoft.com/en-us/SharePoint/upgrade-and-update/upgrade-service-applications- to-sharepoint-server-2016 • Upgrade Content Databases to SharePoint 2016 • https://docs.microsoft.com/en-us/SharePoint/upgrade-and-update/upgrade-content-databases • Upgrade to Project Server 2016 • https://docs.microsoft.com/en-us/project/upgrade-to-project-server-2016
- 45. Resources • Overview of the SharePoint Migration Assessment Tool • https://docs.microsoft.com/en-us/SharePoint/migrate-to-sharepoint-online/overview-of-the-sharepoint-migration- assessment-tool • Upload on-premises content to SharePoint Online using PowerShell cmdlets • https://docs.microsoft.com/en-us/SharePoint/migrate-to-sharepoint-online/upload-on-premises-content-to-sharepoint- online-using-powershell-cmdlets • Introducing the SharePoint Migration Tool • https://docs.microsoft.com/en-us/SharePoint/migrate-to-sharepoint-online/introducing-the-sharepoint-migration-tool • SharePoint Online Solution Inspector • https://rencore.com/blog/introducing-sharepoint-sandboxed-solutions-inspector/ • New and improved features in SharePoint Server 2016 • https://docs.microsoft.com/en-us/SharePoint/what-s-new/new-and-improved-features-in-sharepoint-server-2016 • What’s deprecated or removed from SharePoint Server 2016 • https://docs.microsoft.com/en-us/SharePoint/what-s-new/what-s-deprecated-or-removed-from-sharepoint-server-2016 • Deploy Software Updates for SharePoint Server 2016 • https://docs.microsoft.com/en-us/SharePoint/upgrade-and-update/deploy-updates-for-sharepoint-server-2016
- 46. Contact Info • Email: [email protected] • Twitter: @bcaauwe • SlideShare: https://www.slideshare.net/BrianCaauwe • Microsoft Tech Community: https://techcommunity.microsoft.com/t5/user/viewp rofilepage/user-id/2831 • MNSPUG: http://www.sharepointmn.com Brian Caauwe
- 47. Migration Planning Communications • Migration Team • Roles & Responsibilities • Timelines • Issue Tracking Process • Site Owners • Surveys (NON Technical) • Training • Site Users • Reason • Plan • Status Updates • More, more, more…
- 48. Migration Planning Environment Build Out SharePoint 2016 Migration Requirements • SharePoint 2013 with SP1 and March 2013 PU • Database version 15.0.4481.1005 or higher • SharePoint sites need to be in 2013 mode • CompatibilityLevel 15
- 49. Migration Planning Customizations Deployment • Solutions • Features • Site Definitions • web.config modifications • Custom Files / Images • Use the Upgrade Worksheet
- 50. Migration Planning Operations Schedule Sample Schedule • Planned 36 hours outage (read-only) • Up to 54 hours emergency outage if rollback is required • Downtime mitigation process can reduce outage time Schedule Operation Friday 2200hrs Start backups Saturday 0000hrs Start upgrade of content farm/databases Sunday 1200hrs Upgrade must be effectively complete, or rollback of environment must begin Monday 0600hrs Environment must be completely working, either as original version or new version
- 51. Migration Planning Rollback Plan • DNS, Load Balancer, Service Applications, SQL Locks • Draw a line in the sand • How long does it take to implement? • How long does it take to rollback? • Test, Test and Re-Test processes AND procedures • Prepare communication
- 52. Migration Planning After Upgrade • Post Migration Activities • Ongoing Support Calls
- 53. Migration Cycle Learn About YOUR environment • Customizations (Solutions / Features / Cowboy) • Your code • Branding • 3rd party • Authentication Provider • Classic vs. Claims • FBA • Custom STS • Hardware Requirements (YOU NEED MORE) • Disk Requirements (include backup and restore sizing) • Resource Requirements • TechNet Reference: https://docs.microsoft.com/en- us/SharePoint/install/hardware-and-software- requirements
- 54. Migration Cycle Learn Upgrade Methods • Services Application (FIRST) • Hybrid • Point in time migration • Swing migration • Content Database • Read-only outage acceptable to reduce “downtime”
- 55. Migration Cycle Learn Web Browser Requirements • IE 10+ / Edge • Google Chrome (latest version) • Mozilla Firefox (latest version) • Apple Safari (latest version) • What about mobile? Office Requirements • 2016, 2013, 2010? • SharePoint Designer / InfoPath
- 56. Migration Cycle Learn “Deprecated” Features • Sandbox Solutions • code == bad • XML == OK • SharePoint Online Solution Inspector: https://rencore.com/blog/introducing-sharepoint-sandboxed- solutions-inspector/ • SharePoint Foundation • Forefront Identity Manager (FIM) • Excel Services • Tags & Notes • What’s deprecated or removed from SharePoint 2016: https://docs.microsoft.com/en-us/SharePoint/what-s- new/what-s-deprecated-or-removed-from-sharepoint-server- 2016
- 57. Migration Cycle Prepare Reconnect with users • Ask your users how they are using your solutions • Determine dead sites • Remove data clutter • Prioritize items that are fixed in 2016 • Re-visit information architecture • Build internal buzz • Start communication early!!
- 58. Migration Cycle Prepare Upgrade Strategy • Different Roles, Different Upgrade Schedules • SQL • Office Web Applications • Workflow Manager • SharePoint Upgrade Operations • Roles on call, required, optional • Downtime / Disruption limits • URL adjustments (AVOID IF POSSIBLE)
- 59. Migration Cycle Prepare SharePoint 2013 Environment • Validate / Complete Visual Upgrade • Cleanup sites, webs, versions • Isolate customized site collections into separate databases • Isolate ROOT (/) site collections into separate databases • Prepare site and list “templates” for migration • Service Applications • Swing Upgrade: Prepare Farm for Service Application consumption
- 60. Migration Cycle Prepare Farm Insight • Manual • File / Folder comparison • 15 hive • web.config • GAC • IIS Bindings • Host Headers • SSL Certificates • Service Application / Web Application settings • Secure Store Passphrase • User Profile Import Connection(s) • Blobcache • BrowserFileHandling • Maximum Upload Size
- 61. Migration Cycle Prepare Farm Insight (Continued) • Tools • WinDiff / BeyondCompare • PowerShell • Xcopy • PowerShell • Get-SPServer • Get-SPWebApplication / Get-SPSite / Get-SPWeb • Get-SPFeature • Get-SPWebTemplates • Test-SPContentDatabase • Get-SPContentDatabase | %{$_.Repair([bool])} • $true = fix issues • $false = list issues • MANY, MANY MORE…
- 62. Migration Cycle Prepare Moving Content • PowerShell • Move-SPSite • Backup-SPSite / Restore-SPSite • Export-SPWeb / Import-SPWeb • 3rd Party Tools • MANY out there Customization Gathering • PowerShell • Get-SPSolution • Export-SPInfoPathAdministrationFiles
- 63. Migration Cycle Test SharePoint 2016 Environment • Build / Prepare SQL environment • Ensure Max Degree of Parallelism • Migrate Associated Services • Office Online Server • Workflow Manager • Microsoft Identity Manager
- 64. Migration Cycle Test SharePoint 2016 Environment • Build SharePoint environment • Use YOUR real data • Use similar hardware as production • Farm Configurations • Web Applications • Create Managed Paths • Manual web.config changes • Service Applications • Build out new service applications NOT being migrated • Swing Upgrade: Prepare Farm for Service Application publishing (2016) / consumption (2013) • Apps configuration • Get/Set-SPAuthenticationRealm
- 65. Migration Cycle Test Service Applications • Test service applications to upgrade • User Profile: Create Import Connections • Search: Perform crawl to populate index • Swing Upgrade: Publish service applications and consume for validation Content • Run Test-SPContentDatabase prior to Mount- SPContentDatabase • Test Site upgrades outside of database attach • Browse • Scripted
- 66. Migration Cycle Test Perform MULTIPLE test upgrades • Create a checklist • Document your process AND procedures • Create scripts for repeatable process • Take user error out of the equation as much as possible • Identifies YOUR time requirements End user Testing • Real accounts • Customization Testing • They know their sites better than you • Performance / Load Testing
- 67. Migration Cycle Implement Service Application Upgrade Order • Secure Store • Business Connectivity Services (might require SSS) • Managed Metadata • User Profile (requires BCS and MMS) • Search (crawl account needs to have access to UPA) • PerformancePoint • App Management • Project • Make sure associated services are also running
- 68. Migration Cycle Implement Content Database Upgrade Order • Root level site collections • Easy (less customization) • Hard (most customization) • ALWAYS Test-SPContentDatabase before Mount- SPContentDatabase Upgrade Order for Social Experience • Upgrade MySite Host Site Collection • Upgrade Personal • PowerShell initiated • User Initiated (First Accessed)
- 69. Migration Cycle Validate Logs • Server logs • Event Logs • ULS Logs • Upgrade Logs • Site Collection Maintenance Logs • Do NOT ignore “warnings” Issue Resolution Order • Authentication • Customizations • Content
- 70. Migration Cycle Validate Data Integrity • Orphans / DB issues • Missing Data Site Sampling • Choose all high impact / visibility sites • Choose some simple sites • Get at least one of each site definition • Choose most high customized sites • Ensure what you are validating WORKED before upgrade
- 71. Migration Cycle Validate Verify Services • New Service Application functionality • Upgraded Service Application functionality Customizations • Might need to deploy to -CompatibilityLevel All User Experience • Master Pages, Page Layouts • CSS and Themes
Editor's Notes
- #10: Customizations Available Disk Space (leave room for current production, new production and GROWTH requirements) Customizations (Integrations like Workflow manager, SharePoint Apps now need to keep the Authentication Realm if forklifting) Testing (most migrations, include SOME testing time… but ask the WHO, WHAT, WHEN, WHY and HOW of testing) Customizations (Branding always changes between versions… colors, master pages, page layouts) Resources (Make sure you have enough I/O, Memory and TIME!!!! Customizations (Configurations that you make at the farm level that you haven’t changed in years like upload size, farm features, alternate access mappings, etc) Knowledge (Learning the changes between platforms… what’s new, what’s not there anymore… This is CONTINUAL) Customizations (3rd party code, developers who don’t exist anymore,
- #11: 2010: MOSS 2007 needed to be @ SP1 + October 09 CU 2013: SharePoint 2010 just needed to be RTM 2016: SharePoint 2013 needs to be the “Real” SP1
- #12: No need to have an intermediate server level (can jump from 07 to 16) Other restrictions such as GUID resets (SiteId, WebID, ListId, ItemId) Users that no longer exists cannot be resolved Alerts and Workflows are not part of the “content” - Workflows can be dealt with 3rd party tools
- #13: Scenarios – Online Manual… YUCK SharePoint Online Migration API PowerShell 3.0 required (NOT supported in SharePoint 2010 … workaround available through cmd parameters) 3rd Party Tools… more on these later
- #15: Migration Team Makeup: Stakeholders – Decision makers, budget holders and people who WANT you to succeed Server Admins – Can also include network admins, but they hold the keys to the kingdom Database Admins – Yes, SharePoint needs a health SQL environment and they need to support your system SharePoint Admins – We didn’t forget about you Site Admins – The people who know the content and usage scenarios the best Security Admins – With great power comes great responsibility… darn firewalls, security hardening and GPO’s Designers – Those masterpages and page layouts need to be dusted off Developers – 01100111 01100101 01100101 01101011 Site Users – End user testing NEEDS to happen for success
- #21: All of these cmdlets are specific to SharePoint 2016, however much are the same process as upgrading to SharePoint 2013
- #22: All of these cmdlets are specific to SharePoint 2016, however much are the same process as upgrading to SharePoint 2013, except App Management and Project
- #23: By default, when upgrading content databases it will upgrade site collections as well unless you use the -SkipSiteUpgrade switch parameter
- #26: BitTitan – MigrationWiz: Focuses on documents, but can also pull from other sources (e.g. Google Docs) Sharegate – Also does some site admin management AvePoint – Migrator: Part of their suite of products Microsoft – PowerShell and SharePoint Online Migration API Metalogix – Content Matrix and Content Matrix Express Dell – Migration Suite: Previously the Quest migration tools
- #27: The SPO Migration API does not create any structure, it’s primarily used for moving content
- #28: The SharePoint Migration Tool does not create any structure, it’s primarily used for moving content … currently
- #34: Is your current architecture ancient like the existing Greek architecture Is it classical like the Tower of London Is it practical like the Chicago Skyline Is it, and does it NEED to be “modern”
- #48: Migration Team Communications Roles: What each role is responsible for Timelines: High level timelines and when they will be needed Issue Tracking: How to submit issues and what is the process for remediation Site Owner Communications Surveys (Who, What, Where, When, Why, How) Training Site User Communications Reason: Provide what will make their work easier Plan: Timeline and how it will effect them Status Updates: Regular scheduled updates