Downloaded 42 times
Uploaded byShehap Elnagar
Performance dreams of sql server 2014
This document profiles Shehap El Nagar, an expert in SQL Server who has worked as a consultant and architect for many organizations in the Gulf region. It outlines his experience and credentials working with SQL Server, as well as his roles moderating communities and creating tutorial content. The document then previews topics that El Nagar plans to cover in upcoming presentations, including new features in SQL Server 2014 like In-Memory OLTP, cluster columnstore indexes, and improvements to online index rebuilding and hardware resource management.
More Related Content
Similar to Performance dreams of sql server 2014
![Governance, Deployment & Methodologies for Agentic Automation [2/3]](https://cdn.slidesharecdn.com/ss_thumbnails/agenticcommunityseries-day2-251112135038-a386476d-thumbnail.jpg?width=640&height=640&fit=bounds)
Performance dreams of sql server 2014
- 1. 01/24/14 by ShehapEl Nagar
- 2. Shehap ELNagar I amMVP,MCTS , MCITP SQL Server, I am DB consultant and Architect for lots of Banking, Telecom ,Ministries and governmental organizations all over Gulf ,also he has deep knowledge about T-SQL performance , HW Performance issues, Data Warehousing solutions , SQL Server Replication, Clustering solutions and Database Designs for different kinds of systems ... The founder of the biggest SQL Server community all over the middle east http://sqlserver-performance-tuning.net/ , you can watch its success memories at http://www.youtube.com/user/ShehapElNagar Moderator and author at http://www.sql-server-performance.com , , the 1st SQL Server Author at MSDN Arabia http://msdn.microsoft.com/ar-sa/library/jj149119.aspx , Speaker at SQL Saturday Events worldwide , local events at Saudi Arabia , many online events , more than 90 video tutorials and also many private sessions for .net developers and Database Administrators And also influent participator at Microsoft Forums of SQL Server at http://social.technet.microsoft.com. More about him , you can find him on MVP Microsoft site http://mvp.microsoft.com/en-us/mvp/Shehap%20El-Nagar-5000188 . You can contact him at the below contacts :Mail :[email protected] ….Cellular phone :00966560700733
- 3. First :Overhead lookon new SQL Server 2014 features • • Major Improvements outlines Evolution from SQL Server 2000 to SQL Server 2014 Second :In Memory OLTP built in • • • • • Definition Architectural design Values and benefits Caveats and recommendations Demo Third :CCI (Clustered Columnstore Index) • • • • • • • • Definition Architectural design Values and benefits Caveats and recommendations Demo Third: Single Partition OIR , locks priority management Definition Values and benefits Demo Fifth: New HW Resources supported and IO Resource Governor
- 4. First :Overhead lookon new SQL Server 2014 features
- 5. The Evolution ofMicrosoft Data Platform XML ● KPIs SQL Server 2000 Management Studio ● Mirroring SQL Server 2005 Compression ● Policy-Based Mgmt ● Programmability SQL Server 2008 PowerPivot ● SharePoint Integration ● Master Data Services SQL Server 2008 R2 Always On ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity SQL Server 2012 In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI SQL Server 2014
- 6. Secure Database Vulnerabilities 80 69 53 60 40 20 0 0 5 16 2006 2 28 25 16 11 9 2007 55 53 2008 SQLServer 34 21 29 8 43 8 0 43 29 6 1 6 2009 2010 2011 Oracle MySQL DB2 4 22 20 12 2012 18 0 0 2013 *National Institute of Standards and Technology Comprehensive Vulnerability Database 4/17/2013, Market share from IDC 2013
- 8. In-Memory OLTP 10X-30X fasterfor new and existing SQL Server apps Clustered column store index Updatable clustered columnstore index Single Partition OIR Single partitions for online index rebuild for a less impact Locks priority Management Define priority level and wait times for OIR for a less impact Hardware scalable IO Resource Governor and more HW resources are supported
- 9. First Myth: InMemory OLTP
- 10. Architectural design Hekaton projectto reduce the cost of query engine (35% delay) and access engine (45% delay) Memory optimized tables are working on memory as streamlined No page latch, no buffer pool , no lock manager like disk based table They are supporting Natively compiled Stored procedures which are .dll entry points compiled to machine code using Visual C++ compilers
- 11. In Memory OLTPbenefits and values High-performance data operations Frictionless scale-up Efficient, businesslogic processing Hybrid engine and integrated experience Main-memory optimized High concurrency T-SQL compiled to machine code SQL Server integration • T-SQL compiled to machine code via Visual C compiler • Invoking a procedure is just a DLL entry-point • Aggressive optimizations at compile time • No change whatsoever in your code in your • Same manageability, administration, and development experience • Integrated queries and transactions • Integrated HA and backup/restore • Indexes (hash and range) exist only in memory • No buffer pool • The Highest durability • Columns size from 8060 bytes to 512 GB 512 GB • Multiversion optimistic concurrency control with full ACID support • Core engine uses lockfree algorithms • No lock manager, latches, or spinlocks Hardware trends Steadily declining memory price, NVRAM Many-core processors code Stalling CPU clock rate Business TCO
- 12. In Memory benefitsand values
- 13. Microsoft In-Memory Technologies •In-Memory Analytics in PowerPivot for Excel • StreamInsight • In-Memory OLTP • In-Memory Columnstore Index (in SQL Server 2014) • In-Memory Analytics in SQL Server Analysis Services 201 4 201 4 201 2 201 2 201 4
- 14. Caveats and Recommendations: •Identity and Sequence •Foreign keys and constraints •DML triggers •Some columns types like BLOB columns as image and varbinar (ma), XML, ROWGuid, timestamp, text as well as ntext and CLR columns as hierarchyid,geography and geometry •Data Compression and Clustered index but just only NONCLUSTERED HASH index •Computed columns. •Truncate option but just delete •Table hints like with (nolock)..etc •Alter natively compiled procedure is not supported but just you have to drop it and re-create it again •Natively compiled SPs don’t support merge commands
- 15.
- 16. Second Myth: ClusteredColumnStore Index
- 17. Architectural design • Nonclustered columnstore indexes are based on xVelocity analytics engine and xVelocity columnstore index • Store data in column-wise fashion • Hekaton technique which is in contrast a row-based technology • CCI (Clustered column store index ) is a mix between Hekaton and xVelocity analytics engine and xVelocity columnstore index • CCI is the table itself as CCI includes all columns
- 18. Benefits and valuesof CCI • Columnstores: clustered and updatable No contradiction with DML as Data can be inserted, updated, or deleted • Fast execution for data warehouse queries • Speedups of 10x -30x • No need for separated base table • Saves space and Simpler management • Eliminate need for other indexes • Saves space and simpler management • More data types supported for batch mode execution • Removes many limitations from non-clustered columnstores in SQL Server 2012
- 19. Benefits and valuesof CCI Batch Mode Row Mode
- 20. Caveats and Recommendations: •Foreign keys and constraints •DML triggers •Some columns types like BLOB columns as image and varbinar (max), XML, ROWGuid, timestamp, text as well as ntext and CLR columns as hierarchyid,geography and geometry •Computed columns. • Transactional replication nor peer to peer replication
- 21.
- 22. Third Myth: SinglePartition OIR and locks priority management
- 23. Definitions and terminologies Managed LockPriority is used for determining the lock priority of OIR (online index redbud) or switch partitions relatively to other end users transaction Single Partition Online Index Rebuild is used to allow OIR for single partitions
- 24. Benefits and values •Increased concurrency and application availability • Saving for throughput and thus resources such as CPU , Memory and IO • Log space is reduced much coz not all tables are going to be rebuilt once a time but smaller chunks/partitions which permit for faster checkpoints
- 25. Fourth Myth: NewHW Resources supported and IO Resource Governor
- 26. New HW resourcesand IO Resource Governor
- 27.
- 28. Q&A Post your questionsat: http://www.sqlserver-performance-tuning.net/forums/
- 29. Thank you ..Seeyou again 01/24/14
Editor's Notes
- #7 When it comes to security the results speak for how important we feel providing the best security is for our customers. As you can see per the latest NIST Comprehensive Vunererability Database published on 4/17/2013 we continue to lead the way 5 years in a row as the least vulnerable database amongst the Top data platforms tracked. In addition it is important to note that we ware the most utilized paid database in the market per IDC with 42% market share. When it comes to security features we have achieved CC certification at High Assurance level for SQL Server. When it comes to separation of duties, SQL Server 2014 now separates Database Administrator role from System Administrator role for greater security. In addition you can even create more granular DBA roles, with different access rights for greater compliance. For example you could have a DBA roles that can manage database but cannot see user data. SQL Server offers Transparent Data Encryption capabilities that are becoming even more important in multi-tenant environments like cloud. Encryption key management allows you to store you encryption keys on a separate server than the one running the SQL Server instance for greater security. Also if you want to reduce the attack surface area even further SQL Server 2014 also support Windows Server Core and finally the last item is not a feature but critical when it comes to achieving these great results. We have redefined our entire SQL Server engineering security processes about 6 years ago when SLAMMER hit and it is a big part of why you see the results that you do. Security is a mantra in SQL Server engineering across all disciplines from development to test. Notes: Update as of 4/17/2013 inclusive. Chart counts NIST CVE – Reported Software Flaws by --------- “published” date, utilizing the NIST ND. SQL Server Query = Vendor Name: Microsoft Corporation; Product Names: sql_server, sql_server, sql_server_desktop_engine, sql_server_express_edition, sql_server_reporting services, sql_srvsql_srv_desktop_engine; Oracle Query = Vendor Name: Oracle; Product Name: ‘Any’, all CVEs where “Vulnerable software and versions” lists a database product; DB2 Query = Vendor Name: IBM; Product Names: db2, db2_content_manager, db2_content_manager_toolkit, db2_server, db2_universal_database; MySQL Query = Vendor Name: mysql, mysql-ocaml, mysql_auction, mysql_eventum, mysql_quick_admin, mysqldumper, mysqlnewsengine; Product Name: ‘Any’ CC certification at High Assurance Level Transparent Data Encryption Encryption Key Management – (note for talktrk- mean keys can live on a separate machine than the machine running SQL Server for greater security) Redefined Engineering Security Processes
- #9 Key capabilities at a high level when it comes to mission critical include In-memory capabilities across all workloads including OLTP, DW and BI. When it comes to security SQL Server has consistently been ranked the most secure with the least amount of vulnerabilities 5 years in a row including this year according to National Institute of Standards and Technology Comprehensive Vulnerability Database. SQL Server 2014 with WS 2012 and WS 2012 R2 can provide to cost effective mission critical scale across physical and virtual environments. We know mission critical is all about the 9’s when it comes to High Availability and with SQL Server 2014 we have made the customer favorite AlwaysOn feature even better to give you the 9’s you need for your mission critical applications. Finally none of these features matter unless we are there to support you in case of issues or failures and we certainly offer the live mission critical support you expect for your mission critical workloads.
- #11 Move this to Futures section
- #15 Move this to Futures section
- #21 Move this to Futures section
- #27 Lets take a look at SQL Server Scalability and how new capabilities in Windows Server 2012 and Windows Server 2012 R2 enable SQL Server to scale. When it comes to scaling compute, Windows Server 2012 not only provide scale for large mission critical databases in a physical environment but also in a virtual environment. WS 2012 supports up to 640 logical processers to tackle the largest applications. In a virtual environment you can utilize up to 64 virtual CPUs per VM and up to 1TB of memory per VM. In addition you have now have up to 64 nodes in a SQL Server cluster. You can also scale networking with network virtualization capabilities in WS 2012 R2. This helps SQL Server because it also you to move on workload from one datacenter to another without having to worry about the underlying network. With the Nic Teaming feature in WS 2012 you can pool multiple NICs with allows for greater network flexibility for SQL Server databases. You can also assign minimum and maximum bandwidth criteria to improve Network QoS. With WS2012 you can also virtualize storage allowing you to accumulate all of your storage and assign pieces to different workloads. You can also tier the storage for higher performance for example a mix of SSDs and standard disks allowing you to create tiers so you can keep hot data in the fastest tier and less utilized data in lower tiers improving performance without increasing costs. Just like WS2012 allows you to create pools of infrastructure and refine and tier those pools, SQL Server take that a step further and provides this type of tiering at the SQL Server instance level with Resource Governor. In addition to being able to pool CPU and Memory you can now with SQL Server 2014 pool IO and tier the pool per your criteria ensuring greater scale and performance predictability for your SQL Server workloads.