Lab Updates

- Stream Analytics ARM Template Update
- Lab 1 Database Restore Instructions
- Lab Requirements Updated
- Lab Deployment Updated

Deploy/Deploy.md

@@ -87,4 +87,19 @@ In this section you will use automated deployment and ARM templates to automate
 
 7. Once your deployment is complete you are ready to start your labs. Enjoy!
 
-    ![](./Media/Lab0-Image09.png)
+    ![](./Media/Lab0-Image09.png)
+
+**IMPORTANT**|
+-------------|
+The approximate cost to run the resources provisioned for the estimated duration of this workshop (2 days) is around USD 150.00. You can minimise costs by taking the actions below:
+
+Azure Resource | Type | Action |
+---------------|------|--------|
+MDWSQLServer   | Virtual Machine |Stop it after completing Lab 1|
+MDWDataGateway | Virtual Machine |Stop it after completing Lab 1|
+MDWASQLDW      | Azure SQL Data Warehouse | Pause it after completing Lab 3|
+MDWDatabricks | Databricks Workspace | Stop cluster after completing Lab 4
+MDWCosmosDB   | Cosmos DB | Delete ImageMetadata container after completing Lab 4
+MDWDesktop | Virtual Machine | Stop it after completing Lab 4
+MDWLogicApp | Logic App | Disable it after completing Lab 5
+MDWStreamAnalytics | Stream Analytics job | Pause job after completing Lab 5

Deploy/azuredeploy.json

@@ -619,7 +619,7 @@
         {
             "type": "Microsoft.StreamAnalytics/streamingjobs",
             "name": "[variables('MDWStreamAnalyticsName')]",
-            "apiVersion": "2016-03-01",
+            "apiVersion": "2017-04-01-preview",
             "location": "[resourceGroup().location]",
             "scale": null,
             "properties": {
@@ -631,7 +631,16 @@
                 "eventsOutOfOrderMaxDelayInSeconds": 0,
                 "eventsLateArrivalMaxDelayInSeconds": 5,
                 "dataLocale": "en-US",
-                "compatibilityLevel": "1.0"
+                "jobType": "Cloud",
+                "inputs": [],
+                "transformation": {
+                    "name": "Transformation",
+                    "properties": {
+                        "query": "SELECT\r\n    *\r\nINTO\r\n    [YourOutputAlias]\r\nFROM\r\n    [YourInputAlias]",
+                        "streamingUnits": 3
+                    }
+                },
+                "compatibilityLevel": "1.1"
             },
             "dependsOn": []
         },

Lab/Lab1/Lab1.md

@@ -29,7 +29,7 @@ In this section you are going to establish a Remote Desktop Connection to MDWDes
 -------------|
 **Execute these steps on your host computer**|
 
-1.	In the Azure Portal, navigate to the **MDW-Lab** resource group and click the **MDWDesktop** virtual machine.
+1.	In the Azure Portal, navigate to the lab resource group and click the **MDWDesktop** virtual machine.
 
 2.	On the MDWDesktop blade, from the Overview menu, click the Connect button. 
 
@@ -103,6 +103,18 @@ restore database NYCDataSets from url = 'https://mdwresources.blob.core.windows.
 go
 ```
 
+**IMPORTANT** |
+--------------|
+In a classroom environment concurrent restore database operations cannot occur using the same backup file. If you get an error message when restoring the database, please change the backup file name to "NYCDataSets.Full_*nn*.bak", where *nn* is a number between 01 and 10. See example below:
+
+```sql
+restore database NYCDataSets from url = 'https://mdwresources.blob.core.windows.net/nycdatasets/NYCDataSets_01.Full.bak'
+   with move 'NYCDataSets' to 'F:\Data\NYCDataSets.mdf'
+      , move 'NYCDataSets_log' to 'F:\Log\NYCDataSets_log.ldf'
+      , stats = 5
+go
+```
+
 ## Create Azure SQL Data Warehouse database objects
 In this section you will connect to Azure SQL Data Warehouse to create the database objects used to host and process data.
 
@@ -185,7 +197,7 @@ In this section you are going to install and configure required software onto MD
 -------------|
 **Execute these steps on your host computer**|
 
-1.	In the Azure Portal, navigate to the MDW-Lab resource group and locate the Azure Data Factory **MDWDataFactory-*suffix***.
+1.	In the Azure Portal, navigate to the lab resource group and locate the Azure Data Factory **MDWDataFactory-*suffix***.
 
 2.	On the **MDWDataFactory-*suffix*** blade, click the **Author & Monitor** button. The Azure Data Factory portal will open on a new browser tab.
 
@@ -224,7 +236,7 @@ In this section you are going to establish a Remote Desktop Connection to MDWDat
 -------------|
 **Execute these steps on your host computer**|
 
-1.	On the Azure Portal, navigate to the MDW-Lab resource group and locate the **MDWDataGateway** virtual machine.
+1.	On the Azure Portal, navigate to the lab resource group and locate the **MDWDataGateway** virtual machine.
 
 2.	On the **MDWDataGateway** blade, from the **Overview** menu, click the **Connect** button. 
 

README.md

@@ -31,13 +31,20 @@ New York City data used in this lab was obtained from the New York City Open Dat
 
 ## Lab Prerequisites and Deployment
 The following prerequisites must be completed before you start these labs:
-    <br>- You must be connected to the internet;
-    <br>- You must have a Pay-As-You-Go Azure account with administrator- or contributor-level access to your subscription. If you don’t have an account, you can sign up for an account following the instructions here: https://azure.microsoft.com/en-au/pricing/purchase-options/pay-as-you-go/. 
+
+* You must be connected to the internet;
+
+* Use either Edge or Chrome when executing the labs. Internet Explorer may have issues when rendering the UI for specific Azure services.
+
+* You must have a Pay-As-You-Go Azure account with administrator- or contributor-level access to your subscription. If you don’t have an account, you can sign up for an account following the instructions here: https://azure.microsoft.com/en-au/pricing/purchase-options/pay-as-you-go/. 
     <br>**IMPORTANT**: Azure free subscriptions have quota restrictions that prevent the workshop resources from being deployed successfully. Please use a Pay-As-You-Go subscription instead.
-    <br>- Lab 5 requires you to have a Twitter account. If you don’t have an account you can sign up for free following the instructions here: https://twitter.com/signup. 
-    <br>- Lab 5 requires you to have a Power BI Pro account. If you don’t have an account you can sign up for a 60-day trial for free here: https://powerbi.microsoft.com/en-us/power-bi-pro/
-    <br>- The approximate cost to run the resources provisioned  for the estimated duration of this workshop (2 days) is around USD 150.00. You can minimise the costs by turning off MDWSQLServer and MDWDataGateway VMs and also the MDWASQLDW Azure SQL Data Warehouse after Lab 3 as they are not  required for the remaining labs.
 
+* Lab 1 requires you to open a Remote Desktop Connection (RDP) to Azure Virtual Machines. If you are using a Mac, please ensure you have the latest version of the Microsoft Remote Desktop software installed: https://apps.apple.com/us/app/microsoft-remote-desktop-10/id1295203466?mt=12
+
+* Lab 5 requires you to have a Twitter account. If you don’t have an account you can sign up for free following the instructions here: https://twitter.com/signup. 
+
+* Lab 5 requires you to have a Power BI Pro account. If you don’t have an account you can sign up for a 60-day trial for free here: https://powerbi.microsoft.com/en-us/power-bi-pro/
+
 ## Lab Guide
 
 Throughout a series of 5 labs you will progressively implement a modern data platform architecture using datasets from New York City.