These are the sessions submitted so far for SQLBits 16.

This *hands-on* two days teaches you the modern, sensible R that so many of us now use. Bring a laptop and learn data manipulation, visualisation, and presentation the way it should be done! Two days of pure R, aimed at anyone looking to use R heavily and effectively.

We'll cover throughout the two days:
- ingesting data from various sources
- working with tabular data in-depth
- visualising data in static and interactive methods
- performing basic statistics
- producing reports and other outputs
- writing data to various destinations
We can write hacky R code but "works on my machine", especially "when I do this, this, and this" is ok for play, but not for sharing. This *hands-on* day teaches you development best practices for R including defensive programming techniques, testing, and package development. Laptops and basic R skills required!

Throughout this one day of training, we'll be covering:
- function writing
- defensive programming techniques
- package development
- unit testing
- code coverage
- continuous integration
The package data.table is super-fast and super-powerful but the acceleration curve is fast. This one day takes you through that process so you come out of it with all your parts and the ability to manipulate data with almost as much ease as you use SQL.

We'll be spending a whole day learning how to work with tabular data in R using data.table. From ingestion of millions of rows of data FAST, to being able to do all the things you know and love in SQL FAST, to doing things SQL can't FAST, to writing data FAST, data.table has it all and it's all FAST. (you may not have noticed that I think it's FAST)

So come spend the day learning how to use data.table!
Agile BI promises to deliver value much quicker to its end users. But how do you keep track of versions and prioritize all the demands users have?
With Visual Studio Online (cloud version of Team Foundation Server) it is possible to start for free with 5 users, with Version Control, Work Item management and much more.
In my session you will get the directions to a quick start with Visual Studio Online. You will learn the possibilities of Version Control and in which way to implement Scrum work item management with all available tools.
Your tabular model is done, approved and ready to be used by the user. By means of using Excel the user gets very excited about the use of tabular Models. For a while the user uses Excel as a self-service business intelligence tool. Then all of a sudden the user starts asking if they can use the program to extract more and other information from the tabular model by the use of Excel. Now it is up to you to familiarize the user with all the possibilities of working with the tabular model by means of Excel.
Given the small amount of documented knowledge about the use of tabular models by means of Excel, I will show you how to get the best of your tabular models by using Excel as a self-service business intelligence tool. Filters, named sets, and calculations in the pivot table: I will explain it all!
Where to start when your SQLServer is under pressure? If your server is
misconfigured or strange things are happening, there are a lot of free tools
and scripts available online.These tools will help you decide whether you have
a problem you can fix yourself or you really need a specialized DBA to solve it.  Those scripts and tools are written by renouwned SQLServer specialists. Those tools provide you with insights of what
might be wrong on your SQLServer in an quick and easy manner. You don’t need extensive knowledge of
SQLServer nor do you need expensive tools to do your primary analysis of what
is going wrong
And in a lot of instances these tools will tell you that you yourself can fix the problem. 
Whether you've dabbled in PowerShell or wondered what all the fuss is about, make no mistake: PowerShell is something worth learning to make your life as a SQL Server professional easier. Whether you're a DBA, a SSIS developer, or security professional, In this session you'll see practical, real world examples of how you can blend SQL Server and PowerShell together, and not just a bunch of regular T-SQL tasks that have been wrapped in PowerShell code.

In this session, you'll first get a brief introduction to the SQL Server PowerShell module. From there, it's nothing but code and examples to show you what's possible and why learning PowerShell is such a fundamentally awesome skill to make part of your portfolio or CV. You don't need to know anything about the language before stopping in, but by the time you leave you'll be excited to learn more!
save

...as well as some you may not even be aware of yet!
We will kick off with a small history on how Columnstore indexes evolved since SQL Server 2012 and the internals of Columnstore indexes, because this is how Operational analytics became possible. Then we will build up the session showing tips and tricks into how to make Operational analytics fit in your environment by lessons learned in the field. In the end we will show you how to make it fit with various techniques and heavy loads to a system.
After this session you will be able to know how to make this fit for your environment, there will be no more mystery in what is your hot and cold data & you will know the different uses of columnstore to make this work.
If your regular SQL Server becomes too slow
for running your data warehouse queries, or uploading the new data takes too
long, you might benefit from the Azure Data Warehouse. Via its “divide and
conquer” approach it provides significant performance improvements, yet most
client applications can connect to it as if it is a regular SQL Server.

But to benefit from these performance
improvements we need to implement our Azure Data Warehouse in the right way. In
this session - through a lot of demos - you will learn how to setup your Azure
Data Warehouse (ADW), review indexing in the context of ADW and see that
monitoring is done slightly different from what you’re used to.
Digital Transformation is much more than just sticking a few Virtual Machines in the cloud; it is real, transformative, long-term change that benefits and impacts the whole organisation.
Digital Transformation is a hot topic with CEOs and the C-level suite, renewing their interest in data and what it can do to empower the organisation.
With the right metrics and data visualisation, Power BI can help to bring clarity and predictability to the CEO to make strategic decisions, understand how their customers behave, and measure what really matters to the organization. This session is aimed at helping you to please your CEO with insightful dashboards in Power BI that are relevant to the CxO in your organisation, or your customers’ organisations.
Using data visualisation principles in Power BI, we will demonstrate how you can help the CEO by giving her the metrics she needs to develop a guiding philosophy based on data-driven leadership. Join this session to get practical advice on how you can help drive your organisation’s short and long term future, using data and Power BI.
As an MBA student and external consultant who delivers solutions worldwide, Jen has experience in advising CEO and C-level executives in terms of strategic and technical direction.
Join this session to learn how to speak their language in order to meet their needs, and impress your CEO with proving it, using Power BI.
We all know about the "Vs" of Big Data: velocity, volume and variety. What about the missing "V?" That would be visualization? What does "big data" look like? It has to be more than beautiful. It must convey information and insights in a way that people understand. Furthermore, people expect to make actionable insights from their data. How can we make big data friendly to users? This session will look at a mix of technologies for visualizing big data sources and ways of achieving BigViz harmony in your Big Data.You will learn:
About Big Data—from machine scale size down to human scale understanding
Technologies for visualizing Big Data, both Microsoft and Open Source
Data Visualization principles
So Azure SQL DataWarehouse is now available and starting to be use, but what does that mean to you and why should you care?

Reflecting on a large-scale Azure DW project, this session gathers together learnings, successes, failures and general opinions into a crash course in using Azure DataWarehouse “properly”.

We'll start by quickly putting the technology in context, so you know WHEN to use it, WHERE it’s appropriate and WHY it works the way it does.
  • Introducing the ADW technology
  • Explaining distributions & performance
  • Explaining polybase
Then we'll dive into HOW to use it, looking at some real-life design patterns, best practice and some “tales from the trenches” from a recent large Azure DW project.
  • Performance tips & tricks (designing for minimal data movement, managing distribution skew, CTAS, Resource classes and more)
  • ETL Patterns (Surrogate keys & Orchestration)
  • Common Mistakes & Pitfalls
  • Conclusions & Recommendations
You’ve probably already seen that R icon in
the Power BI GUI. It shows up when creating sources, transformations and
reports. But the ugly textbox you got when you clicked upon those icons didn’t
encourage you to proceed? In this session you will learn just a few basic
things about R that will greatly extend your Power BI data loading,
transformation and reporting skills in Power BI Desktop and PowerBI.com
In this session, we will look at data visualisation using:

Apache Spark
R
Python
Power BI

We will look at how we can enhance the suite of offerings to your data consumers by opening your toolbox of Open Source data visualisation tools, as well as Microsoft's Power BI.

Using Microsoft SQL Server and Big Data as a source, we will look at these open source and proprietary tools as an accompaniment to Power BI - not a replacement. 

Join us for this demo-heavy session, and be sure to download the code from Jen's blog right before the session in order to try it out as we proceed through the session. The emphasis is on practical takeaways that you can apply when you go back to your office after SQLBits, and try it out for yourself.
So you have made first contact with Biml and are excited? Good!















You're wondering, if Biml can do more than just transfer data from SQL table to another? Great!















Because Biml does so much more than just simple SSIS packages. We'll explore the potential on how to improve your existing packages using BimlScript and LINQ.







Topics covered, amongst others, are derived columns, incremental changes and how to handle flat files.















You'll leave with sample code and hopefully a couple of ideas on how to bring your Biml development to the next level.
In this demo-heavy session, you will learn about the basic concepts of increasing productivity by creating your SSIS packages using Biml.



We will look into manual Biml code to understand the general idea of Biml, then take it from there and generate a whole staging area from scratch and end with a complete manageable solution to completely maintain your staging process using SQL tables.



Have you ever spent hours fixing your SSIS due to a schema change on the source? Ever wanted to add a "load timestamp" to 370 tables in your staging area but refrained because it would have taken you weeks to do so? If so, this is the session for you!
Most of the time pilots are learning to fly, they're actually learning how to recover from emergency conditions. While we as Database Administrators focus on taking backups, how much time do we actually spend practicing recovering with those backups? This session will focus on the kinds of situations that can dramatically affect a data center, and how to use checklists to practice recovery processes to assure business continuity.
Every business needs to guess. From core business (Will this customer default on its loan?) to IT management (How much disk space will this new database need?) they are making lots of decisions daily using some sort of ‘model’: from gut-feeling over averages up to linear regression. Machine learning offers more advanced techniques to build a model on historical data and apply this to new observations. In this one day precon we walk through the full process of building these models on AzureML, the cloud-based machine learning framework Microsoft released in summer 2014.
We start from scratch, so no machine learning nor statistical knowledge is required. First we need to figure out what we try to cook: not all business problems can be solved with AzureML. After discussing which problems can be tackled by AzureML, we start looking for the main ingredients: data. Also we investigate how to clean these ingredients: data preparation is a crucial step! Then it’s time to do the actual cooking: There are many machine learning algorithms available in AzureML: we’ll browse through them and give some intuition on what they do, such that we can configure them properly. Once we’re done cooking it’s time to serve the result. AzureML allows us to convert our process into a web service. We’ll see both how to create and consume such a web service.

 
Most of the time you’ll see ETL being done with a tool such as SSIS, but what if you need near-realtime reporting? This session will demonstrate how to keep your data warehouse updated using Service Broker messages from your OLTP database.
Did you know, you can use Biml for much more than just SSIS? No? This session will probably surprise you - even with some DBA related topics! We will look into deployment, sample data creation, test cases and other ideas, that will show you, how powerful and flexible Biml really is - and that it does way more than you may have thought!
Maintaining a solid set of information about our servers and their performance is critical when issues arise, and often help us see a problem before it occurs.  Building a baseline of performance metrics allows us to know when something is wrong and help us to track it down and fix the problem.  This session will walk you through a series of PowerShell scripts you can schedule which will capture the most important data and a set of reports to show you how to use that data to keep your server running smoothly.

Containers are a new and exciting technology but what does it mean for DBAs?

This session will give an introduction into SQL Server running in containers and what options are available.

Attendees will be taken through the following: -

Defining what containers are (benefits and limitations)
Configuring Windows Server 2016 to run containers
Installing the docker engine
Pulling SQL images from the docker respository
Running SQL Server containers
Committing new SQL Server images
Exploring 3rd party options to run containers on previous versions of Windows Server (real world example)

This sessions assumes that attendees have a good background in SQL Server administration and a basic knowledge of Windows Server administration
SQL Server 2016: Data quality and data cleansing have always been major challenges to any enterprise that deals with data. For those of us who have dealt with Data Profiler Tasks in SQL Server 2008, we were shocked yet pleasantly surprised with the great advances that Microsoft has made with the advent of Data Quality Services, in the SQL Server 2012 release. In this hands-on presentation we shall be looking at how to set up a new knowledge base, based upon an existing one, set up rules, do knowledge discovery within the new knowledge base and finally cleanse the data through a data quality project. The end results being more effective data, guaranteed to keep end users and management happy.
Master Data Services can be readily be employed for Rapid Application Development. We shall be looking at important development, data security and data maintenance aspects, all based upon a recent client implementation.
Ah, SQL Server Transactional Replication. The technology everyone loves to hate. But for all the notoriety, there's some interesting technology to be had in it that might you might want to leverage. In this session, we'll explore what happens when you create a new transactional publication: what happens during a snapshot, how data gets delivered to subscribers, and how you can monitor, tweak, and tune your publications. We'll also look at a couple "gotcha" scenarios regarding replication and high availability, and even how replication can put you out of compliance if you're not careful. There will be plenty of examples and demos and, yes, even some PowerShell!
Tired of Bar Charts? We'll build out a custom PowerBI Visual and show the power of PowerBI whilst going into a deep dive on how this is achieved. We will be exploring web technologies along with data technologies, and seeing how some very powerful constructs are used to produce PowerBI reports. 

We will be covering a variety of content; including: Typescript, Javascript, HTML5, Gulp, Visual Studio Code, the MVVM pattern, D3.js, and without giving the game away too much, Google Maps.
Database maintenance isn’t a single event; it’s a lifecycle. Aside from the maintenance event itself, there’s also reporting, error management, specialized configs, HA/DR and more. In this full day session, we'll explore the many issues surrounding maintenance and how to solve them in a way that is cohesive and comprehensive. If you’re managing more than one server, come to this session.
Learn how to:
  • Deploy maintenance routines to hundreds of servers, effortlessly
  • Standardize configuration throughout the enterprise
  • Set up custom alerts and reports.
  • Manage HA/DR failover scenarios and keep your maintenance intact.
  • Minimize the number of jobs
  • Tune backups and database integrity checks

For maintenance, you'll learn how to:
  • Order index operations to maintain the most important tables first
  • Maximize your maintenance window by fine-tuning your routine.
  • Easily deal with special circumstances like indexes with settings that conflict with maintenance.
  • Make reindex operations fully dynamic to meet your changing environment.
  • Handle the most difficult CheckDB scenarios with dynamic custom snapshots, multi-threading and CheckDB offloading using auto-restore and remote CheckDB operations.
And for backups specifically, you'll learn to:
  • Automate management of failed backups
  • Ensure that certificates and encrypted passwords are securely backed up
  • Automate configuration changes between HA/DR sites, in case of failover.
  • Turn trace flags on or off automatically.
  • Dynamically archive end of month or end of year backups.
  • Tune the backups for your entire enterprise and keep them tuned as the environment changes.
This will be the most complete class on enterprise maintenance you'll ever have.  
Sign-up now.
In this session we will look at how you can use Power BI to analyse you company’s online presence.  

We will look at how you can source data from Google Analytics, Facebook, Twitter, LinkedIn and Instagram.

We will discuss different ways to get the data and what the difficulties/hindrances are when working with API's in Power BI.

We will then show how you can work with the data to get some meaningful analysis from it and ask the question: Can you get a holistic view of your online presence? 

This is a demo rich session where we will go through getting the data in and looking through how we can extend the model before visualizing the results.  

The participants will leave the session with ideas on how they can use Power BI (or indeed some other BI tool) to start analyzing their company's online presence.
Have you ever wondered if there are scored more goals when it rains or if Stoke wins more games on cold weekday evening at bet265 stadium? This session shows how you can use open data sources and web pages to gather data.

How you can then manipulate and extend it and finally report on it. We will look into how you can use data from Azure data market or other open source and combine it with data from web pages to create the dataset you need.

When we have our dataset we will manipulate and extend it using M and DAX so that we can get meaningful insights from it. We will then dive into the data to see if there is anything to report. 

In this end to end Power BI Desktop demo we will use fun data that many can relate to as the English Premier League is one of the most popular football leagues in the world. The audience will take away many nuggets of information as they see how a real world example could look like. I will share with them all the obstacles and learning I got when creating this report so they will see both the limitation of Power BI Desktop and open data as well as its strength. First of all the audience will learn how to use Power BI Desktop to create something real with fun data.

Both the data acquisition and manipulation as well as the reporting is covered in this demo rich session. The audience will learn about Power BI desktops strength and weaknesses as well as the benefits and potential problems with using open data and web pages as source.

In the end the Power BI Desktop file will be available to download for the audience. 
The cloud is here, and you want to start working with it. When starting to work with SQL Server in the cloud, there are many things that need to be taken into account.

Through extensive demos on both Amazon Web Services and Microsoft Azure, and using lessons learnt from the field, this full day seminar will take you through the steps of moving SQL Server to the cloud the right way: from choosing the right cloud
model, to architecture and performance considerations, and finally to performing the actual deployment.

By the end of the day, you will have a firm understanding of the options for running SQL Server in the cloud, when and how to use which, how to do it the right way, and how to leverage the benefits of the cloud.

The seminar will cover:

·        How to choose a cloud vendor

·        How to choose between SQL Server as a service and SQL Server on a virtual machine

·        How to choose the right hardware for your workload

·        Performance considerations and best practices

·        How to work in a hybrid environment where your data is both on-premise and in the cloud

·        Backup, restore, high availability and disaster recovery options

·        Security considerations

·        Scaling options

·        What to watch out for

·        How SQL Server fits in the cloud ecosystem

·        How to automate your work

·        How to cut your expenses

 
The seminar will include a deep dive into both the PaaS options (Azure SQL Database and Amazon RDS) and IaaS options (Azure Virtual Machines and Amazon EC2).

Whether you plan to migrate a current project to the cloud or
start a new one, this seminar is for you.
Understanding how SQL Server stores your data can seem like a daunting task. In this session we'll learn how objects such as tables and indexes are stored in a data file. We’ll also look at how these concepts tie in to your work. We’ll see these concepts in action using demos and see how we can use this knowledge to better design solutions.

We’ll start off by looking at the structure of a row and then move onto the concept of a data page. From there we’ll cover a few special page types like the index allocation map and GAM and SGAM pages. Then we’ll look at index structures and talk about the differences between heaps and clustered indexes.
With partitioning, we can break a table or index into smaller more manageable chunks. We can then perform maintenance on just part of a table or index. We can even move data in and out of tables with quick and easy metadata only operations. We’ll go over basic partitioning concepts and techniques like partitioned views and full blown table partitioning. We’ll look at how partitioning affects things under the hood. Finally you'll see some cool demos/tricks around index maintenance and data movement. At the end of this session you’ll have a firm understanding of how partitioning works and know how and when to implement it.

You'll learn…

• The components of table partitioning and how they fit together

• How to make your index maintenance partition aware

• How Partition elimination can help your queries

• How to split different parts of tables over different storage tiers

• How to manage partitions. We'll demo this by implementing the sliding window technique. 
Microsoft have been positioned as a Leader in the Gartner Magic Quadrant for Business Intelligence and Analytics Platforms. Th "new" Microsoft shows in the "new" Business Intelligence, and SQL Server 2016 provides a plethora of new tools for the Business Intelligence including R, Datazen and Power BI. There is a new emphasis on mobile, too.

In this session, we will have an overview of these tools and learn "what to use, when" so that you have a blueprint for your mobile, cloud, hybrid and on-premise Business Intelligence strategy, using SQL Server 2016 as the supporting technology.

Takeaways: SQL Server Reporting Services (SSRS) has been given the love it deserves; learn about Datazen and how if fits with SSRS and Power BI; see the new capabilities for SQL Server Analysis Services; see Microsoft R Server in SQL Server, explained; mobile business intelligence for everyone!

Join this session to get the inside scoop on SQL Server 2016 from the Business Intelligence perspective.
Digital transformation leverages the changes and opportunities of digital technologies to transform business activities, processes, competencies and models to converge for the benefit of the organisation.

How do you go from building Business Intelligence solutions as a technical team member, to shifting your focus to building businesses as who rely on your data to become data-driven organisations? How do you become part of the Digital Transformation story? 

Today’s hype about the possibilities and opportunities in Data, and particularly Big Data, mean that organisations can find it difficult to know where to start, or even how to start. Very often, businesses simply store all of their data, rather than think proactively about the data that they have, and how they could use it. In order to survive, businesses will have to move forward.

As businesses continue to get excited about the opportunities of Big Data, they will also need Data-Driven Leadership within their organisations in order to guide them effectively towards success. Now is the time
for businesses to bring their data and their strategy together, using the latest technologies.

Join this session to see how you can transition from being a business intelligence technical expert, to a data-driven leader in your organisation that is going through a process of Digital Transformation. This is a rare and valuable skill, and talking the language of the boardroom means that you can have a real impact on transforming your organisation through data.
We will look at the definitions, models and metrics that are essential for a successful Data Transformation strategy using Power BI as a way of articulating useful metrics.
The biggest barrier facing new ML practitioners is the assumption that to become a serious data science practitioner, you need deep knowledge of machine learning theory, deep mathematics, formulation or training methods. In this session, Nabeel will argue that the essential skills needed are: a love for working with data, hard work, and the devotion of a good deal of time to play with lots of data and apply various ML tools on them.

You will learn by an actual R experiment how ML works, and how to transition from a beginner to an expert through a clear roadmap.
Database Professional is always challenged with monitoring and maintenance across the environment. Be it 10 server or a 1000 servers, would it be easier to have a centralized solution? In this session I will walk you through the simple steps of building a centralized database maintenance and monitoring solution. 


This solution will help a database professional to query all the monitored instances, collect performance metrics, run customized scripts and any maintenance task a database professional needs to perform across the database environment. Talk about a easy DBA life, this is a definite simple solution you should build.
Have you ever struggled to get a HA and DR solution for a single instance with more than 50 applications, 100 databases and 4 TB of data? Over the years, HA and DR has been a challenge with SQL Server. As the product evolved so did the options simplified for achieving a feasible HADR solution. 


In this session I will walk you through various projects I have worked on in past 8 years. I will start with the basic DR solution built using Log shipping, an alternate to AGs in SQL 2008 using Powershell/.NET and SAN Replication and the latest 4 node, two site cluster built with Availability Groups.
During the acrimonious US election, both sides used a combination of cherry-picked polls and misleading data visualization to paint different pictures with data.
In this session, we will use a range of Microsoft Power BI and SSRS technologies in order to examine how people can mislead with data and how to fix it. We will also look at best practices with data visualisation.
We will examine the data with Microsoft SSRS and Power BI so that you can see the differences and similarities in these reporting tools when selecting your own Data Visualisation toolkit.
Whether you are a Trump supporter, a Clinton supporter or you don't really care, join this session to spot data lies better in order to make up your own mind.
The biggest barrier facing new ML practitioners is the assumption that to become a serious data science practitioner, you need deep knowledge of machine learning theory, deep mathematics, formulation or training methods. In this session, Nabeel will argue that the essential skills needed are: a love for working with data, hard work, and the devotion of a good deal of time to play with lots of data and apply various ML tools on them.

You will learn by an actual R experiment how ML works, and how to transition from a beginner to an expert through a clear roadmap.
Based on the popular blog series, join me in taking a deep drive and a behind the scenes look at how SQL Server 2016 "Just Runs Faster",focused on scalability and performance enhancements. This talk will discuss specific engine improvements, not only for awareness, but to expose design and internal change details. The beauty behind "It Just Runs Faster" is your ability to just upgrade and gain performance with out lengthy and costly application or infrastructure changes. If you are looking at why SQL Server 2016 makes sense from a technical perspective for your business you won't want to miss this session.
We will explore the details of how In-Memory OLTP ("Hekaton") is integrated into the SQL Server 2016 Engine. This includes internals of threads, data and index design, row formats, transactions and concurrency, logging, storage, and natively compiled procedures. This talk has plenty of demos including a rich use of the Windows Debugger to learn how In-Memory OLTP works. Even though this is a deep session, you will come away with a fundamental knowledge of why In-Memory OLTP can give you a 30x performance boost for OLTP applications.
Storage can be one of the biggest bottlenecks when it comes to database performance. It’s also one of the hardest places to troubleshoot performance issues because storage engineers and database administrators often do not speak the same language. In this session, we’ll be looking at storage from both the database and storage perspectives. We’ll be digging into LUNs, HBAs, the fabric, as well as the storage configuration. After going over the components we'll dig into some advanced storage configurations. This includes RAID groups, multi-pathing software, and proper redundant storage network design. We will also be digging into some advanced storage array backup techniques including taking storage level clones and snapshots. After going over these advanced techniques we will dig into how these can best be used to backup the SQL Server environment to provide maximum redundancy with no recurring tape costs.
In this all day session on Microsoft SQL Server we will be learning about how Microsoft SQL Server works and what needs to be done to keep it up and running smoothly when you don't have a full time database administrator on staff to help you keep it running. In this session we will cover a variety of topics including backups, upgrade paths, indexing, database maintenance, database corruption, patching, virtualization, disk configurations, high availability, database security, database mail, anti-viruses, scheduled jobs, and much, much more. After taking this full day session on SQL Server you'll be prepared to take the information that we go over and get back to the office, get the SQL Server's patched and properly configured so that they run without giving you problems for years to come.

In this day long pre-con session we will explore the various high availability options within SQL Server including how to configure these various options.  We will be looking into Windows and SQL Server Clustering (including what is needed for a geographically dispersed cluster), Database Mirroring, The AlwaysOn features, and SQL Server Log Shipping. In addition to working through these high availability options, we will be discussing the most important part of high availability configuration, making sure that you know how to select the correct high availability solution.  After completing this high availability pre-con session you'll be able to make the correct decision about which high availability decision to deploy, as well as how to correctly deploy the selected solution.

In this 2 day pre-boot camp we'll review a wide variety of Azure and Data Platform topics. These topics include:
  • Storage
  • Networking
  • Compute
  • Scale
  • Cloud Patterns and Anti-Patterns
  • Open Source on Azure
  • SQL DB
  • SQL DW
  • Global Scale Solutions
  • Big Data Solutions
  • Security in Azure
  • Identity and Access Management (Azure Active Directory)
Are you a developer or a systems admin and you've just been handed a SQL Server database and you've got no idea what to do with it?  I've got some of the answers here in this session for you.  During this session we will cover a variety of topics including backup and restore, recovery models, database maintenance, compression, data corruption, database compatibility levels and indexing. While this session won't teach you everything you need to know, it will give you some insights into the SQL Server database engine and give you the ability to better know what to look for.

With the introduction of SQL Server 2014 the line between SQL Server running in your data center and running in the cloud is becoming more and more blurred.  In this session we will review the features which are available with SQL Server 2014 and which integrate with Windows Azure.  After reviewing the available features we'll look at how to configure these features and how to build these features out in the real world to reduce your data center footprint quickly and easily.
In this fun session we'll review a bunch of problem implementations that have been seen in the real world.  Most importantly we will look at why these implementations went horribly wrong so that we can learn from them and never repeat these mistakes.
In this session we will be looking at the best and worse practices for indexing tables within your SQL Server 2000-2016 databases.  We will also be looking into the new indexing features that are available in SQL Server 2012/2014/2016 (and SQL Server 2005/2008) and how you the .NET developer can make the best use of them to get your code running its best.
In this session we will review the new enhancement to SQL Server security available in SQL Server 2016 and Azure SQL DB.  These include Always Encrypted, Row-Level Security and Dynamic Data Masking as well as whatever else Microsoft has released since I've written this abstract. We'll look at how to set these features up, how to use them, and most importantly when to use them.
In this session we will review the differences between deploying Microsoft SQL Server 2016 in Microsoft Azure and on-premises from a Security, Reliability and Scalability perspective.  We'll review the common mistakes which people make when deploying SQL Server Virtual Machines to Azure which can lead to security problems including data breaches. We'll review the common performance problems which people encounter, and how to resolve them. We'll review the common scalability misunderstandings of Azure and SQL Server Virtual Machines. Join us for this fun session and learn how to improve the security, reliability and scalability of your Azure deployments of SQL Server 2016.

Are you a:
  • Production DBA that wants to know which new xEvents and DMVs/DMFs are available to get further insights into SQL Server operations?
  • Production DBA that needs to troubleshoot a performance issue, and needs to collect performance data for others to analyze?
  • Developer that needs to analyze query performance and already has basic knowledge of how to read an execution plan?
Then this session is for you! It just works – performance and scale in SQL Server 2016 database engine and what is being added to in-market versions. This session will showcase several improvements in SQL Server, focusing on the latest enhancements that address some of the most common customer pain points the Database Engine, involving tempdb, new CE, memory management, T-SQL constructs as well as diagnostics for troubleshooting query plans, memory grants, and backup/restore. Understand these changes in performance and scale, and the new and improved diagnostics for faster troubleshooting and mitigation.
BPCheck came to be back in 2011, as a way to empower miscrosoft support engineers onsite with customers to gain insight on best practices not being followed, and evolved to include performance based checks. But this previously internal BPCheck script was released to Microsoft SQL Server GitHub recently and is now free to use. In this session you will learn how to leverage it for a comprehensive perf and health check of your SQL Server instance.

How to read the information, how to interpret results, how to use it for a quick health check, or a full comprehensive performance check as well.

Advanced data analytics does not live only in the realm of data scientists.  The necessary tools now exist in SQL Server 2016 to perform advanced analytical analysis with R and Power BI.  Attendees will see how to apply these techniques to analyze a database server, by showing how to perform in-depth analysis on practical things such as improving database monitoring, create predictive models for server performance load, and determining when disk space is required.
Session Goals
    Learn how to code applications in R to provide data insight and data visualizations for use within SQL Server.
    Develop and understanding of some of the algorithms used in data science and how to apply them.
    Extend the functionality of SQL Server by integrating R code to provide insight into the performance of SQL Server.
    Understand different ways to visualize the results, including storing within SQL Server, creating SSRS reports and visualizing in Power BI.
Session Agenda
    Introduction to Data Science concepts.
    Application of Data Science algorithms in R.
    SQL Server R Internals and Integration.
    Modifying SQL Server to optimally perform and monitor R Code.
    In depth walkthrough of SQL Server running R
    Introduction to Linear Regression.
    Application of linear regression to determine storage space usage over time within SQL Server.
    Predictive and Prescriptive Analysis techniques.
    Application of predictive and prescriptive analysis through analysis of DMVs.
    Common visualization techniques used in data science.
    Demonstration of how visualizations are used in evaluating data algorithms.
    Configuration and methods for displaying visualizations within SQL Server, R and Power BI.
Fast data. Big data. Bad data. As systems get more diverse and data volumes grow, your BI architecture needs to handle anything thrown at it – the traditional MSBI Stack can get you a long way, but not far enough.

2016 wasn’t all bad – it saw the release of several key Azure components that change the BI landscape by removing the technical barriers around the “big data” technologies. These components are radically different than the standard SQL approach, but they’re the future of what we do.

Whether it’s streaming data in real-time from heterogeneous data sources, crunching through petabytes of data, or trawling through vast amounts of unstructured data looking for hidden insights – the design pattern known as the Lambda architecture will enable it.

In this workshop, we want you to leave fully equipped to tackle these challenges. We’ll be providing an overview and practical demonstrations of:
  • The Modern Warehouse & Lambda Architecture
  • Building and maintaining Azure Data Lakes
  • Designing for performance with Azure SQLDW
  • Gaining Real-time Insights through Streaming Analytics
  • Facilitating & Orchestrating data flow using Azure Data Factory
Are you ready for the future? After a day with us you will be!
You have created great cubes and Reporting Services reports but how do you know if it is being used?

Learn how to set up the collection of the usage data and how you can use this data in your decision making.  We will cover what methods are available and their strength and weaknesses. We will talk about how to collect the data, how to build something meaningful from the data and how you can report on top of the data. We will do this for OLAP cubes and for Reporting Services Reports and we will explore ways you can further develop this for your own organization. 

At the end of the session all participants will leave with all the code as well as the know how to get started with the collection of usage statistics for their Microsoft BI Solutions.
A real DBA don’t need a GUI -A Guided Tour of SQL Server Management Studio



SQL Server Management Studio is at the heart of any SQL Server DBA or developer’s day. We take it for granted  but rarely do we take a look at how we can customise or improve it to make our day to day work easier and more productive.



This presentation will take look at many of the hidden features and shortcuts that you had forgotten about or didn’t know were there including some new features in SSMS 2016.







































































At the end of this session you will have learnt at least one new feature of SSMS that you can use to improve your productivity.
Beware of the Dark Side - A Guided Tour of Oracle for the SQL DBA



Today, SQL Server DBAs are more than likely at some point in their careers to come across Oracle and Oracle DBAs. To the unwary this can be very daunting and, at first glance, Oracle can look completely different with little obvious similarities to SQL Server.



This talk sets out to explain some of the terminology, the differences and the similarities between Oracle and SQL Server and hopefully make Oracle not look quite so intimidating.



At the end of this session you will have a better understanding of Oracle and the differences between the Oracle RDBMS and SQL Server. 



Although you won’t be ready to be an Oracle DBA it will give you a foundation to build on.
The word Kerberos can strike fear into a SQL DBA as well as many Windows Server Administrators.



What should be a straight forward and simple process can lead to all sorts of issues and trying to resolve them can turn into a nightmare. This talk looks at the principle of Kerberos, how it applies to SQL Server and what we need to do ensure it works.



We will look at
  • What is the purpose of Kerberos in relation to SQL Server?
  • When do we need to use it?  Do we need to worry about it at all?
  • How  do we configure it?  What tools can we use?
  • Who can configure it?  Is it the DBA job to manage and configure Kerberos?
  • Why does it cause so many issues?
Because on the face of it setting up Kerberos for a SQL Server is actually straightforward but it is very easy to get wrong and then sometimes very difficult to see what is wrong.
Learn how to do text mining in R with the Monty Python movie scripts. A day full of text analysis! From grabbing text off the internet, wrangling text into an analysable format, performing sentiment analysis, working out key topics in a body of text, and more. 

This is a *hands-on* training day. Basic R skills required.

We'll be covering:
- Overview of text analysis in R
- Web scraping
- Wrangling text for analysis
- Performing sentiment analysis and visualising it
- Identifying key words
- Working with phrases
- Working out the topic of text
It seems like every month we hear about another company having a major data breach. Ensuring that your data is secure has become more important than ever.

With this in mind, in SQL Server 2016, Microsoft has given us three new features that have the potential to improve the security of your SQL database, either on premises or in the cloud.

These are Dynamic Data Masking, Row Level Security and Always Encrypted.

This session will provide an overview of these important new security features, how to configure them and make them work.
It's nearly a year since SQL 2016 was launched with lots of new features and functionality such as Always Encrypted, Dynamic Data Masking, temporal tables, stretched tables, Query Store, Live Query stats and more. If you haven't had time to explore these new features then this session is for you This talk gives an overview of what's  new and improved in SQL Server 2016 and demonstrates some of these features
The session covers tested migration strategies for migrating off Teradata to SQL DW on Azure. It covers multiple approaches to the problem, dependent on the size. And suggests various strategies to avoid the pitfalls associated with the migration. At Cognizant we have used this to migrate clients off Teradata resulting in huge savings for the client, as well as improve overall efficiency of the BI and Analytics capabilities.
Query Store is an exciting new feature in SQL Server 2016. It can automatically capture and store a history of queries, query execution plans and execution statistics that makes troubleshooting performance problems caused by query plan changes much easier.

In this session we will examine Query Store, it's architecture, configuration and how it can be used to solve performance problems.
Join this intensive hands-on precon to learn how to use SQL Server 2016 Reporting Services and the Mobile Report Publisher, formerly known as Datazen.  We will ramp up quickly from basic to advanced report delivery, management and creation with an emphasis on data visualisation best practices.
Bring your laptop and join in, with printed out hands-on labs and examples for you to follow. Slides will be provided in download format for you to take away, so that you can be productive and effective as soon as you go back to the office.

Topics Covered. The timings are suggestive; we will work around the official breaks assigned by the SQLBits team. 

8:00 - 9:30 SQL Server 2016 Reporting Evolution and Overview
Report Authoring Architecture
Report Serving Architecture
Comparison with Other Tools

9:30 - 10:00 Data Visualisation Dos and Don'ts - and Why


10:00 - 10:15 - Suggested Break

10:15 - 10:45 SSRS Installation, Repair and Configuration
Installing SQL Server Data Tools and SSMS
Common Install Issues
SSRS Repair utilities and log files

10:45 - 11:15 Reporting Authoring Building Blocks for SSRS and the Mobile Report Publisher
Matrix reports, report parameters, tablix, data regions and basic building blocks


11:30 - 12:30 The Right Chart at the Right Time
Creating Charts; how to create key charts, what works, what doesn't work, and why
Maps and Spatial Data Types


1:30 - 2:30 SSRS Administration Deep Dive
Templating your Reports for usability
Data Caching
Let's crack open the RDL file to understand it


2:30 - 3:30 Advanced Reporting Tips and Tricks
 
Report Interactivity
Reports and Sub-Reports: Yes or No?
Ten Top Tricks in SSRS you didn't know you could do!

3:30 - 4:30 Mobilising Your Enterprise Reporting

Mobile reporting - the Mobile Report Publisher
KPIs - their use and abuse - use of the Kaplan and Norton Business Scorecard framework


4:30 - 5:30 Managing Reports with the SSRS Reporting Services Web Portal
Report Delivery
Report Parts, Shared Datasets
Report Caching configuration and setup
Report Snapshots
Report History - enabling report definitions, report history and snapshots
Report Subscriptions
Branding Reports


5:30 - as long as you like!
Q&A Discussions

SQL Server Management Studio is at the heart of any SQL Server DBA or developer’s day. We take it for
granted  but rarely do we take a look at how we can customise or improve it to make our day to day work easier and more productive. 

This presentation will take look at many of the hidden features and shortcuts that you had forgotten about or didn’t know were there including some new features in SSMS 2016.

At the end of this session you will have learnt at least one new feature of
SSMS that you can use to improve your productivity.
The Internet of Things is the new kid on the block offering a wealth of possibilities for data streaming and rich analytics. Using a Raspberry Pi 3 we will take an end to end look at how to interact with the physical world collecting sensor values and feeding that data in real-time into cloud services for manipulation and consumption. This will be a heavily demonstrated session looking at how such an environment can be setup using Microsoft offerings, including; Windows 10 IoT Core, a C# Universal Windows Platform application, an Azure IoT Event Hub, Azure Stream Analytics, Azure SQL DB and Power BI. This is an overview of what’s possible, but showing exactly how to build such a simplified solution with a session which will be 90% demonstrations. This will hopefully add that level excitement to real-time data with plenty of hardware out there showing what it can do when setup with Microsoft software. In addition, spare Raspberry Pi devices will be available for the audience to pass around and look at. 
In this session we’ll go beyond the Azure Data Factory copy activity normally presented using the limited portal wizard. Extract and load are never the hard parts of the pipeline. It is the ability to transform, manipulate and clean data that normally requires more effort. Sadly, this task doesn’t come so naturally to Azure Data Factory as an orchestration tool so we need to rely on its custom activities to break out the C# or VB to perform such tasks. Using Visual Studio, we’ll look at how to do exactly that and see what’s involved in Azure to utilise this pipeline extensibility feature. What handles the compute for the compiled .Net code and how can does this get deployed by ADF. With real work use cases we’ll learn how to fight back against those poorly formed CSV files and what we could to if Excel files are our only data source. Plus, lots of useful tips and tricks along the way when working with this emerging technology.
The time has come to migrate your SQL Server estate to the Azure cloud.  Your manager has heard it will save them money, it's elastic and he would be silly not to move everything to Azure.  You are undoubtedly a bit more cautious and have a whole bunch of hopes. fears and expectations: 

  • What do I need
  • Can I move my databases
  • how do I move them
  • Will my applications still work
  • what are the restrictions
  • how much will it cost
  • what's all this DTU stuff

You will no doubt have a load more questions as well but this is a good list to get started with.  Don't worry though, during this day long session we'll address all of these questions and more.  During the day we will look how to

  • Plan your SQL Server Migration
  • Implement the move
  • Test that everything still works.

When you leave this session you are going to have a good understanding of what the cloud can offer for SQL Server along with things you need to consider before jumping into the move.  You'll know and understand where things will break and whether by thinking a bit differently you can fix it.


Allan is the CIO of Elastabytes, a Microsoft Gold Partner specializing in migrating data workloads to Azure.
There has been an awakening. SQL Database in Azure is no longer merely useful tool, but essential for your continued innovation. This session outlines the  offerings available in Azure SQL Database and how to move your database loads away from virtual machines and towards Azure SQL Database, as well as gives a glimpse of the astounding force multipliers inherent in the Azure cloud. May the cloud be with you – always.
The Azure Data Lake is one of the newest additions to the Microsoft Azure Cloud Platform, bringing together cheap storage and massive parallel processing in two quick-to-setup and, relatively, easy-to-use technologies. In the session we will dive into the Azure Data lake.

First of all exploring: 
Azure Data Lake Store: How is data stored? What are the best practices?; 
Azure Data Lake Analytics: How does the query optimiser work? What are the best practices?

Second, a practical demonstration of: Tuning U-SQL: Partitioning and distribution: Job Execution in Visual Studio
Have you ever wondered how to design your data warehouse so that users can get the information they want efficiently and effectively?  This session covers ways to make your fact tables work well for you and your users.  It will answer such questions as:



 



How do I make it easy for users to get the information they want?



How can good design make my data warehouse or cube perform better?



What are the different types of fact tables and when should I use them?



What do we mean by grain? Why is it important?



Why and how should I use surrogate keys?



Which data types should I be using?



 



If you’re not sure whether your fact table is transactional or accumulating, whether it’s a bridge or factless, or if it contains degenerates, then this session is for you! "If the facts don't fit the theory, change the facts".  Albert Einstein

It is important to understand where, when, and how to use the myriad of technologies available to us in the Microsoft Data Platform. Here we will look at the essential knowledge and techniques for Aspiring and Accidental Data Platform Engineers. Looking at what our options are for on-premises, Cloud, and Hybrid solutions. Covering the key elements of Azure SQL DB, Azure SQL DW, and traditional SQL Server. When they are appropriate, when they are not, and the key configurations you need to know to start using them. Once we understand which technology to use, we can start looking at how to get the most out of them. Ranging from query performance, through to how to identify and resolve key issues that can impact the effectiveness of your solution. Agenda
  1. Overview of Microsoft Data Platform
    1. Azure SQL Database
    2. Azure SQL Data Warehouse
    3. SQL Server in Azure VMs
    4. SQL Server on-premises
  2. Considerations for using and selecting the appropriate technology.
  3. Important Performance Indicators
  4. Performance Tuning
    1. Azure SQL Database & SQL Server
    2. Azure SQL Data Warehouse
    3. Solutions Architecture Design Considerations
What is Azure SQL Data Warehouse, why and how should I use it? Here we will look at the fundamental basics to answer these questions and more, giving you the foundation knowledge to get started. Looking at key design concepts, query patterns, and loading mechanisms for getting data into and out of Azure SQL Data Warehouse. By the end of this session, you will be able to start using and avoid the major pitfalls of using Azure SQL Data Warehouse.
Azure SQL DB has had Row Level Security and Dynamic Data Masking for a while now, SQL Server 2016 brings that on-premises. But just how can you use it, what changes do you need to make to your model to get the most from it? These new features have the potential to really improve application security, especially in compliance scenarios. Pushing the security restrictions down into the database layer has many benefits, notably only the data needed leaves the database. But there are a number of gotchas that you need to be aware of that can really mess up performance if you get them wrong. In this session we will look at how you can get the most out of these features and retain the performance of your system.
When planning your SQL Server deployments there are a lot of different options to choose from and configurations that you can use, but which ones are for you? Here I will discuss and highlight some of the key recommended practices that you should follow and put in place when you build your SQL Servers and ways that you can automate these in order to standardize your server deployments covering; - Trace Flags, Configuration Options and Design Choices - Maintenance and Monitoring essentials - How to select the right High Availability or Disaster Recovery option - Performance Tuning and Troubleshooting methods
SQL Server normally relies on concurrency models in order to maintain the Isolation in ACID. As systems scale, this method can go from being a benefit to a hindrance, limiting the concurrency for our applications and hurting performance.   Throwing hardware at the problem can help, but does not address the fundamental issues. These can only be resolved with better database design and the correct configurations.   Join John as we work through the different design patterns that exist for increasing concurrency. From using specific data types, and partitioning, to how In-Memory OLTP can help. By the end of this season you will understand the different methods available to boost concurrency regardless of the size of your environment.
Have you ever wondered how to design your data warehouse dimensions so that users can get the information they want efficiently and effectively?  This session covers tried and tested ways to handle time in your dimension tables. How should I store historical values in my dimension tables?

How should I design my Date and Time dimensions?  Should I combine or separate them?

What are SCD Types 0, 1, 2, 3, 6, 7?  How and when should I use them?

My users want the warehouse to do everything and be easy to use - Help! If you’re not sure of your SCD Type 2 from Type 6, or how best to distinguish this morning from last month, then this session is for you! "Time is what keeps everything from happening at once." - Ray Cummings
What is the future going to look like? When are we going to reach true Artificial Intelligence? Is the Singularity going to happen? There is a lot of talk today about AI and what it means for the human society. Let's forget about the future for an hour and focus on what is possible today. We are going to look at the most promising area in AI research, Deep Learning and understand how it fits in the wider picture of Machine Learning. Be prepared for some maths, loads of graphs and deep learning in action.
Ever feel like you are just doing busy work while creating new SSIS packages? Feel like you are doing the same thing over and over while changing the names to protect the innocent? Ever wonder if there is a better way? Well wonder no more. Come learn about the magical world of BIML and how it can help transform your environment by increasing your productivity while reducing the possibility of errors. Come with intrigue and leave with a fundamental understanding of BIML!
We have more information available to us today than ever before. So much so that we run the risk of not being able to tell concise stories. There's a lot more to creating that story than just getting the correct information. Come learn not just the do's and don'ts, but the whys…
Being a BI Professional, you need all the performance tuning the DB folks get and more. In this hour, we will go over important performance tuning tips that you can use to help make your deliverables faster and more effective. We will touch on the MSBI tools of SSIS, SSAS, SSRS and PowerBI as well as some core engine stuff.
I always fancied being mechanical and electrical. But being a DBA is more about working on virtual nuts and bolts. An inspiration got into mind when IoT spread like wild fire with all kinds of applications. A simple thought of why not be a cool DBA and build something at a click of a button.


In this session, I will show you some cool interfacing between my Raspberry Pi and SQL Server. I
will show what a click of a button (not virtual :)) can do for a DBA. This is just the beginning and there will be no limits for what else can be done. Take away this idea from this session and use your imagination to build something cool and innovative.
You know the situation that a query yesterday still worked
quickly and satisfactorily and today it suffers from performance problems?

What will you do in such a situation?

- you may restart SQL Server (did work all the other times before)
- you drop the procedure cache (has been told by a dba)
- you  get yourself a coffee and think about what you learned in this session

Microsoft SQL Server requires statistics for ideal execution
plans. If statistics are not up-to-date, Microsoft SQL Server may create execution
plans that run a query many times slower. In addition to the basic
understanding of statistics, special situations are shown in this session that
are only known to a small group of experts.

After a brief introduction to the functionality of
statistics (Level 100), the special query situations, which lead to wrong
decisions without experience, are immediately apparent. The following topics
are covered by usage of large number of demos:

- When will statistics get updated?
- examples for estimates and how they can go wrong?
- outdated statistics and ascending keys?
- when will outdated statistics updated for unique indexes?
- drawback of statistics in empty tables?

Follow me on an adventurous journey through the world of statistics of Microsoft SQL Server.
In this session we'll look at a range of SQL Server tips, tricks and misconceptions. Ranging from TSQL coding, query plans, statistics and loads in between. 

We'll take a look at some clever TSQL coding practices, some key things to look for in query plans and how to resolve them. We'll also look at statistics and go through a list of things to look out for.

As well as this there will be a whole load of other things from indexing to server settings to look at.

Delivered in a fun and light hearted manner, the emphasis of the session will be learning lots of little take aways that can be applied to your environments and practices when you get back to work 
SQL Server is a mission critical database platform but is sensitive to
misconfigurations, bad practices, sub-optimal indexing strategies and poor
coding mistakes. Even the fastest hardware can end up performing like a ZX-81
if you get things wrong.

If you are a Database Administrator or Consultant who is responsible for
expert performance analysis, problem detection and tuning of the SQL engine
then it is important you are able to analyze and tune SQL Server like a BOSS.

In this full training day, I will explain how to identify and resolve
serious real world performance problems using concrete examples,
demonstrations, possible effects and answers. This workshop will provide over
40 scripts which can be used directly in the workshop on your own machines
during the day and we shall simulate performance problems and look to resolve
them using a top-down approach.

A selection of things you can look forward to learning and experiencing
during the day are:
  • Waits and Queues methodology
  • Instance and database level configuration
  • TempDB importance and optimization
  • Index Analysis and tuning
  • Humour (yes Germans can be funny too!) 
This beginner to intermediate session is aimed at those that want to get a good working knowledge of query plans in sql server.

In the first half we will start off with the basics of reading query plans and understanding them. We'll learn what to look out for and how to spot issues

In the second half we'll gradually move into more intermediate topics such as costing and encouraging sql server to make different choices. We'll also start learn how the query optimiser makes it's decisions  This session is ideal for those who are either just starting out with query plans or those whom are familiar with them 

Attendees will leave the session with a good working knowledge of query plans, being able to read and interpret them and make informed decisions about their SQL Coding