Moving to SQL Server 2008 codenamed Katmai

Moving to Katmai
Looking ahead to the next version of SQL Server, Microsoft was motivated by a number of trends it saw developing. The first was the data explosion, where organizations are now storing key data both in and outside of databases. The data inside databases tends to be structured data, but there are now all kinds of unstructured data types being organized in the file system, such as document files, XML files, digital images, and so on. These, too, are corporate assets and need to be managed and queried. So Microsoft decided to expand the database to support these kinds of data.

The second trend is around compliance. There's a lot of regulatory pressure on organizations to store, document, secure, and control corporate assets, and new pressures on IT to control that data.

Finally, storage prices are going down dramatically and organizations are now storing more than ever as a result. And it's not just traditional database servers. There are a wide range of devices with integrated storage, and data is now spread out over laptops, phones, point of sales (POS) systems, and other devices. This data all needs to be stored, managed, and secured. "It's challenging," Ajenstat told me. "Users want to get the right data, in the right tools, whenever they need it. But administrators want to make sure the data is locked down and centrally managed."

These trends guided the scenarios SQL Server 2008 delivers on. Here's what you can expect in SQL Server 2008.

Trusted platform
At a 1997 SQL Server 7.0 reviewer workshop, I was astonished by Microsoft's Terra Server, a room full of data refrigerators that contained satellite imagery and was controlled by a custom SQL Server install. Now, SQL Server can manage multiple terabytes of data as seamlessly as previous versions did a gigabyte, and scalability is at the forefront of core SQL Server work. Part of this effort involves disk compression routines that reduce the footprint of on-disk storage. Part of it is new indexing mechanisms to speed queries of ever-increasing data sets. And part is an ongoing effort to improve performance across the board. For example, SQL 2008 prioritizes workloads intelligently so that administrators can configure service level agreements. That way, a reporting application can't consume all of a server's resources while payroll is trying to print paychecks.

Abilities
While SQL Server is traditionally thought of as a relational database, the product has been consistently improved over time to work with non-relational data. This started in SQL 7.0 with the introduction of multi-dimensional OLAP, and continued in SQL 2005 with XML support. In SQL 2008, Microsoft is expanding these capabilities in the most dramatic fashion yet with support for unstructured data, like documents in the file system, through a new file stream data type. This isn't a replacement for the file system, but rather a replacement for the old blob data type, which had no understanding of the underlying data. Microsoft is supporting this feature with native Windows APIs for querying and indexing the data, and is also formalizing the concept of location data, where you can query locations in a spatial way as with a map. I expect this capability to touch off a new era of custom location-aware applications.

Dynamic development
Expanding on the .NET managed code capabilities in SQL Server 2005, SQL Server 2008 includes support for Visual Studio 2008's LINQ framework, which allows C# and Visual Basic developers to work with business objects rather than tables and columns. This removes another layer of abstraction for developers who need to target databases and doesn't require these developers to be database experts as well. "Developers don't care how information is stored internally," Ajenstat explained. "They want to deal with the data-- whether it's a customer , product , store, whatever. The framework takes care of the backend."

SQL Server 2008 also addresses the occasionally connected scenario with SQL Server Compact, which can run on mobile and embedded devices and desktops. That way, mobile applications can access a database that works anywhere and then sync seamlessly with the server whenever they're connected. It works like Outlook and Exchange Server, providing offline access to data and then making sure everything is synced to the backend when possible. Obviously, it is secure and managed, and will work with whatever compliance policies the organization has created as well.

Pervasive insight
Building on the business intelligence (BI) capabilities of SQL Server 2005, SQL Server 2008 offers better scalability--where you can perform BI and data warehousing tasks against multiple terabytes of data--and better performance. SQL Server 2005 customers told Microsoft that while they liked that product's BI capabilities, the performance suffered at 20 TB of data and above. Now, Microsoft says even 40 TB of data will be comfortable.

Another related improvement concerns availability. In addition to scaling the database to accommodate more data, it needs to handle more concurrent users as well. So Microsoft has improved SQL Server 2008 to provide predictable performance regardless of the number of users.

Finally, SQL Server 2008, like its predecessor, will work well with current versions of Microsoft Office, and this time around there's no need for a software upgrade: It works out of the box.

Scheduling and pricing
As with previous versions, SQL 2008 is on a slow burn, and Microsoft says it has settled on a 24 to 36 month development cycle. "We changed how we build the product to be more predictable," Ajenstat told me. This credo has become reality even during the beta process, which thus far has been marked by a few public CTP releases. Expect two more CTP releases before the launch.

The target release date for SQL Server 2008 is the second quarter of 2008. It will launch alongside Windows Server 2008 and Visual Studio 2008, though each of those products will be finalized at different times from SQL Server 2008. As with previous versions, Microsoft will ship compact versions of SQL Server 2008 for the desktop and mobile devices in addition to its enterprise-oriented offerings.

The best news, perhaps, is that Microsoft is not raising the price. Compare this to Oracle, where every new feature seems to come with a new $10,000 charge. But licensing fees for SQL Server 2008 are identical to those for SQL Server 2005, despite the many additional features. That's good stuff, and a continuation of Microsoft's aggressive value proposition for this product line.

--Paul Thurrott
October 9-17, 2007