20220909 restrict BDC to the SQL 2019 TOC

WilliamDAssafMSFT · WilliamDAssafMSFT · commit a379f92ef93a · 2022-09-09T15:25:01.000-07:00
diff --git a/.openpublishing.redirection.json b/.openpublishing.redirection.json
@@ -59455,6 +59455,11 @@
       "redirect_url": "/sql/tools/sqlpackage/troubleshooting-issues-and-performance-with-sqlpackage",
       "redirect_document_id": false
     }
+    {
+      "source_path": "docs/sql-server/partner-big-data-cluster.md",
+      "redirect_url": "/sql/big-data-cluster/partner-big-data-cluster",
+      "redirect_document_id": false
+    }
   ]
 }
 
diff --git a/docs/big-data-cluster/index.yml b/docs/big-data-cluster/index.yml
@@ -235,13 +235,13 @@ landingContent:
       - linkListType: reference
         links:
         - text: Integration partners
-          url: ../sql-server/partner-big-data-cluster.md
+          url: partner-big-data-cluster.md
         - text: Apache Spark
           url: /azure/hdinsight/spark/apache-spark-overview
         - text: Samples (GitHub)
           url: https://github.com/microsoft/sql-server-samples/tree/master/samples/features/sql-big-data-cluster
         - text: Solution partners
-          url: ../sql-server/partner-big-data-cluster.md
+          url: partner-big-data-cluster.md
       - linkListType: learn
         links:
           - text: Introduction to Kubernetes
diff --git a/docs/big-data-cluster/machine-learning-services.md b/docs/big-data-cluster/machine-learning-services.md
@@ -1,30 +1,30 @@
 ---
 title: Machine Learning Services (Python, R)
 titleSuffix: SQL Server Big Data Clusters
-description: Learn how you can run Python and R scripts on the master instance of a SQL Server Big Data Clusters with Machine Learning Services.
+description: Learn how you can run Python and R scripts on the master instance of a SQL Server 2019 Big Data Clusters with Machine Learning Services.
 author: WilliamDAssafMSFT
 ms.author: wiassaf
 ms.reviewer: wiassaf
-ms.date: 11/19/2020
+ms.date: 09/09/2022
 ms.prod: sql
 ms.technology: machine-learning-bdc
 ms.topic: conceptual
 ---
 
-# Run Python and R scripts with Machine Learning Services on SQL Server Big Data Clusters
+# Run Python and R scripts with Machine Learning Services on SQL Server 2019 Big Data Clusters
 
 [!INCLUDE[SQL Server 2019](../includes/applies-to-version/sqlserver2019.md)]
 
 [!INCLUDE[big-data-clusters-banner-retirement](../includes/bdc-banner-retirement.md)]
 
 You can run Python and R scripts on the master instance of [SQL Server Big Data Clusters](big-data-cluster-overview.md) with [Machine Learning Services](../machine-learning/index.yml).
 
-> [!NOTE]
+> [!NOTE]  
 > You can also run Java code on the master instance of SQL Server Big Data Clusters with the [Java Language Extension](../language-extensions/java-overview.md). Following the steps below will also enable [SQL Server Language Extensions](../language-extensions/language-extensions-overview.md).
 
 ## Enable Machine Learning Services
 
-Machine Learning Services is installed by default on Big Data Clusters and does not require separate installation.
+Machine Learning Services is installed by default on SQL Server 2019 Big Data Clusters and does not require separate installation.
 
 To enable Machine Learning Services, run this statement on the master instance:
 
@@ -36,7 +36,7 @@ GO
 
 You are now ready to run Python and R scripts on the master instance of Big Data Clusters. See the quickstarts under [Next steps](#next-steps) to run your first script.
 
->[!NOTE]
+> [!NOTE]  
 >The configuration setting cannot be set on an availability group listener connection. If Big Data Clusters is deployed with high availability, the set `external scripts enabled` on each replica. See [Enable on cluster with high availability](#enable-on-cluster-with-high-availability).
 
 ## Enable on cluster with high availability
@@ -47,7 +47,7 @@ The following section describes how to enable external scripts on each instance.
 
 ### Create an external load balancer for each instance
 
-For each replica on the availability group, create a load balancer to allow you to connect to the instance. 
+For each replica on the availability group, create a load balancer to allow you to connect to the instance.
 
 `kubectl expose pod <pod-name> --port=<connection port number> --name=<load-balancer-name> --type=LoadBalancer -n <kubernetes namespace>`
 
@@ -61,9 +61,9 @@ The examples in this article use the following values:
 Update the following script for your environment, and run the commands:
 
 ```bash
-kubectl expose pod master-0 --port=1533 --name=mymaster-0 --type=LoadBalancer -n mssql-cluster 
+kubectl expose pod master-0 --port=1533 --name=mymaster-0 --type=LoadBalancer -n mssql-cluster
 kubectl expose pod master-1 --port=1533 --name=mymaster-1 --type=LoadBalancer -n mssql-cluster
-kubectl expose pod master-2 --port=1533 --name=mymaster-2 --type=LoadBalancer -n mssql-cluster 
+kubectl expose pod master-2 --port=1533 --name=mymaster-2 --type=LoadBalancer -n mssql-cluster
 ```
 
 `kubectl` returns the following output.
@@ -80,7 +80,7 @@ Each load balancer is a master replica endpoint.
 
 1. Get the IP address for the master replica endpoint.
 
-   The following command returns the external IP address for the replica endpoint. 
+   The following command returns the external IP address for the replica endpoint.
 
    `kubectl get services <load-balancer-name> -n <kubernetes namespace>`
 
@@ -92,7 +92,7 @@ Each load balancer is a master replica endpoint.
    kubectl get services mymaster-2 -n mssql-cluster
    ```
 
-   >[!NOTE]
+   > [!NOTE]  
    > It may take a little time before the external IP address is available. Run the preceding script periodically until each endpoint returns an external IP address.
 
 1. Connect to the master replica endpoint and enable script execution.
@@ -117,7 +117,7 @@ Each load balancer is a master replica endpoint.
 
 The following image demonstrates this process.
 
-[![Demo](media/machine-learning-services/example-kube-enable-scripts.png "Demonstrate enable feature on Kubernetes")](media/machine-learning-services/example-kube-enable-scripts.png#lightbox)
+:::image type="content" source="media/machine-learning-services/example-kube-enable-scripts.png" alt-text="A screenshot of the command prompt providing a demo of the steps necessary to enable external scripts." lightbox="media/machine-learning-services/example-kube-enable-scripts.png" ::: 
 
 You are now ready to run Python and R scripts on the master instance of Big Data Clusters. See the quickstarts under [Next steps](#next-steps) to run your first script.
 
@@ -137,9 +137,129 @@ kubectl delete svc mymaster-1 -n mssql-cluster
 kubectl delete svc mymaster-2 -n mssql-cluster
 ```
 
+## SQL Server Big Data Clusters machine learning quickstarts
+
+### Python quickstarts
+
+ - [Run Python scripts](../machine-learning/tutorials/quickstart-python-create-script.md?view=sql-server-ver15&preserve-view=true)
+ - [Data structures and objects](../machine-learning/tutorials/quickstart-python-data-structures.md?view=sql-server-ver15&preserve-view=true)
+ - [Python functions](../machine-learning/tutorials/quickstart-python-functions.md?view=sql-server-ver15&preserve-view=true)
+ - [Train and score a model](../machine-learning/tutorials/quickstart-python-train-score-model.md?view=sql-server-ver15&preserve-view=true)
+
+### R quickstarts
+
+ - [Run R scripts](../machine-learning/tutorials/quickstart-r-create-script.md?view=sql-server-ver15&preserve-view=true)
+ - [Data types and objects](../machine-learning/tutorials/quickstart-r-data-types-and-objects.md?view=sql-server-ver15&preserve-view=true)
+ - [R functions](../machine-learning/tutorials/quickstart-r-functions.md?view=sql-server-ver15&preserve-view=true)
+ - [Train and score a model](../machine-learning/tutorials/quickstart-r-train-score-model.md?view=sql-server-ver15&preserve-view=true)
+
+## SQL Server Big Data Clusters machine learning tutorials
+
+### Python tutorial
+
+#### Ski rental (linear regression)
+
+ - [1 - Introduction](../machine-learning/tutorials/python-ski-rental-linear-regression.md?view=sql-server-ver15&preserve-view=true)
+ - [2 - Prepare data](../machine-learning/tutorials/python-ski-rental-linear-regression-prepare-data.md?view=sql-server-ver15&preserve-view=true)
+ - [3 - Train model](../machine-learning/tutorials/python-ski-rental-linear-regression-train-model.md?view=sql-server-ver15&preserve-view=true)
+ - [4 - Deploy model](../machine-learning/tutorials/python-ski-rental-linear-regression-deploy-model.md?view=sql-server-ver15&preserve-view=true)
+
+#### Categorize customers (k-means clustering)
+
+ - [1 - Introduction](../machine-learning/tutorials/python-clustering-model.md?view=sql-server-ver15&preserve-view=true)
+ - [2 - Prepare the data](../machine-learning/tutorials/python-clustering-model-prepare-data.md?view=sql-server-ver15&preserve-view=true)
+ - [3 - Create the model](../machine-learning/tutorials/python-clustering-model-build.md?view=sql-server-ver15&preserve-view=true)
+ - [4 - Deploy the model](../machine-learning/tutorials/python-clustering-model-deploy.md?view=sql-server-ver15&preserve-view=true)
+
+#### NYC taxi tips (classification)
+
+ - [1 - Introduction](../machine-learning/tutorials/python-taxi-classification-introduction.md?view=sql-server-ver15&preserve-view=true)
+ - [2 - Data exploration](../machine-learning/tutorials/python-taxi-classification-explore-data.md?view=sql-server-ver15&preserve-view=true)
+ - [3 - Feature engineering](../machine-learning/tutorials/python-taxi-classification-create-features.md?view=sql-server-ver15&preserve-view=true)
+ - [4 - Train and deploy](../machine-learning/tutorials/python-taxi-classification-train-model.md?view=sql-server-ver15&preserve-view=true)
+ - [5 - Predictions](../machine-learning/tutorials/python-taxi-classification-deploy-model.md?view=sql-server-ver15&preserve-view=true)
+
+### R tutorials
+
+#### Ski rental (decision tree)
+
+ - [1 - Introduction](../machine-learning/tutorials/r-predictive-model-introduction.md?view=sql-server-ver15&preserve-view=true)
+ - [2 - Prepare data](../machine-learning/tutorials/r-predictive-model-prepare-data.md?view=sql-server-ver15&preserve-view=true)
+ - [3 - Train model](../machine-learning/tutorials/r-predictive-model-train.md?view=sql-server-ver15&preserve-view=true)
+ - [4 - Deploy model](../machine-learning/tutorials/r-predictive-model-deploy.md?view=sql-server-ver15&preserve-view=true)
+
+#### Categorize customers (k-means clustering)
+
+ - [1 - Introduction](../machine-learning/tutorials/r-clustering-model-introduction.md?view=sql-server-ver15&preserve-view=true)
+ - [2 - Prepare the data](../machine-learning/tutorials/r-clustering-model-prepare-data.md?view=sql-server-ver15&preserve-view=true)
+ - [3 - Create the model](../machine-learning/tutorials/r-clustering-model-build.md?view=sql-server-ver15&preserve-view=true)
+ - [4 - Deploy the model](../machine-learning/tutorials/r-clustering-model-deploy.md?view=sql-server-ver15&preserve-view=true)
+
+#### NYC taxi tips (classification)
+
+ - [1 - Introduction](../machine-learning/tutorials/r-taxi-classification-introduction.md?view=sql-server-ver15&preserve-view=true)
+ - [2 - Data exploration](../machine-learning/tutorials/r-taxi-classification-explore-data.md?view=sql-server-ver15&preserve-view=true)
+ - [3 - Feature engineering](../machine-learning/tutorials/r-taxi-classification-create-features.md?view=sql-server-ver15&preserve-view=true)
+ - [4 - Train and deploy](../machine-learning/tutorials/r-taxi-classification-train-model.md?view=sql-server-ver15&preserve-view=true)
+ - [5 - Predictions](../machine-learning/tutorials/r-taxi-classification-deploy-model.md?view=sql-server-ver15&preserve-view=true)
+
+## SQL Server Big Data Clusters machine learning how-to guides
+
+### Data exploration and modeling
+
+ - [Plot Histogram in Python](../machine-learning/data-exploration/python-plot-histogram.md?view=sql-server-ver15&preserve-view=true)
+ - [Import data into pandas dataframe](../machine-learning/data-exploration/python-dataframe-pandas.md?view=sql-server-ver15&preserve-view=true)
+ - [Insert dataframe into SQL](../machine-learning/data-exploration/python-dataframe-sql-server.md?view=sql-server-ver15&preserve-view=true)
+
+### Data type conversions
+
+ - [Python to SQL](../machine-learning/python/python-libraries-and-data-types.md?view=sql-server-ver15&preserve-view=true)
+ - [R to SQL](../machine-learning/r/r-libraries-and-data-types.md?view=sql-server-ver15&preserve-view=true)
+
+### Deploy
+
+ - [Operationalize using stored procedures](./machine-learning/tutorials/python-ski-rental-linear-regression-deploy-model.md?preserve-view=true&view=sql-server-ver15)
+ - [Convert R code for SQL Server](./machine-learning/deploy/modify-r-python-code-to-run-in-sql-server.md?preserve-view=true&view=sql-server-ver15)
+
+### Predictions
+
+ - [Native scoring with PREDICT T-SQL](../machine-learning/predictions/native-scoring-predict-transact-sql.md?view=sql-server-ver15&preserve-view=true)
+
+### Package management
+
+#### Install new Python packages
+
+ - [Get Python package information](../machine-learning/package-management/python-package-information.md?view=sql-server-ver15&preserve-view=true)
+ - [Install with sqlmlutils](../machine-learning/package-management/install-additional-python-packages-on-sql-server.md?view=sql-server-ver15&preserve-view=true)
+
+#### Install new R packages
+
+ - [Get R package information](../machine-learning/package-management/r-package-information.md?view=sql-server-ver15&preserve-view=true)
+ - [Install with sqlmlutils](../machine-learning/package-management/install-additional-r-packages-on-sql-server.md?view=sql-server-ver15&preserve-view=true)
+ - [Create a miniCRAN repo](../machine-learning/package-management/create-a-local-package-repository-using-minicran.md?view=sql-server-ver15&preserve-view=true)
+ - [Tips for using R packages](../machine-learning/package-management/tips-for-using-r-packages.md?view=sql-server-ver15&preserve-view=true)
+
+### Monitore
+
+ - [Monitor using SSMS reports](../machine-learning/administration/monitor-sql-server-machine-learning-services-using-custom-reports-management-studio.md?view=sql-server-ver15&preserve-view=true)
+ - [Monitor using DMVs](../machine-learning/administration/monitor-sql-server-machine-learning-services-using-dynamic-management-views.md?view=sql-server-ver15&preserve-view=true)
+
+ - [Monitor using extended events](../machine-learning/administration/extended-events.md?view=sql-server-ver15&preserve-view=true)
+ - [Monitor PREDICT T-SQL](../machine-learning/administration/extended-events-predict-tsql.md?view=sql-server-ver15&preserve-view=true)
+
+### Security
+
+ - [Give users permission](../machine-learning/security/user-permission.md?view=sql-server-ver15&preserve-view=true)
+
+## Spark Machine Learning
+
+ - [Use Spark Machine Learning](spark-machine-learning.md)
+ - [Data wrangling using PROSE Code Accelerator](use-prose-for-big-data-automation.md)
+ - [Spark machine learning models with MLeap](spark-create-machine-learning-model.md)
+
 ## Next steps
 
-+ [Run simple Python scripts](../machine-learning/tutorials/quickstart-python-create-script.md?toc=/sql/toc.json)
-+ [Train and score a predictive model in Python](../machine-learning/tutorials/quickstart-python-train-score-model.md?toc=/sql/toc.json)
-+ [Run simple R scripts](../machine-learning/tutorials/quickstart-r-create-script.md?toc=/sql/toc.json)
-+ [Train and score a predictive model in R](../machine-learning/tutorials/quickstart-r-train-score-model.md?toc=/sql/toc.json)
+ - [Run simple Python scripts](../machine-learning/tutorials/quickstart-python-create-script.md?toc=/sql/toc.json)
+ - [Train and score a predictive model in Python](../machine-learning/tutorials/quickstart-python-train-score-model.md?toc=/sql/toc.json)
+ - [Run simple R scripts](../machine-learning/tutorials/quickstart-r-create-script.md?toc=/sql/toc.json)
+ - [Train and score a predictive model in R](../machine-learning/tutorials/quickstart-r-train-score-model.md?toc=/sql/toc.json)
diff --git a/docs/big-data-cluster/partner-big-data-cluster.md b/docs/big-data-cluster/partner-big-data-cluster.md
@@ -8,7 +8,7 @@ ms.prod: sql
 ms.technology: big-data-cluster
 ms.prod_service: "database-engine"
 ms.author: wiassaf
-ms.reviewer: dacoelho
+ms.reviewer: hudequei
 author: WilliamDAssafMSFT
 ---
 # SQL Server 2019 Big Data Clusters partners
diff --git a/docs/big-data-cluster/release-notes-big-data-cluster.md b/docs/big-data-cluster/release-notes-big-data-cluster.md
@@ -45,14 +45,14 @@ The following table contains the tested configuration matrix for each release of
 Restrictions:
 
 * SQL Server 2019 Big Data Clusters is supported as a *workload*. Microsoft provides support for the software components on the containers installed and configured by SQL Server 2019 Big Data Clusters only. Kubernetes itself, and other containers that may influence SQL Server 2019 Big Data Clusters behavior, are not supported by the support team. For Kubernetes support, contact your certified Kubernetes distribution provider.
-* SQL Server 2019 Big Data Clusters requires block storage for all persisted volumes. Management operation on top of the persisted volumes created and used by a big data cluster is a capability that depends on the storage provider including, for example, operations to expand persistent volumes (PVs). Reference your specific CSI storage provider documentation or the [partner reference architecture and white papers](../sql-server/partner-big-data-cluster.md).
+* SQL Server 2019 Big Data Clusters requires block storage for all persisted volumes. Management operation on top of the persisted volumes created and used by a big data cluster is a capability that depends on the storage provider including, for example, operations to expand persistent volumes (PVs). Reference your specific CSI storage provider documentation or the [partner reference architecture and white papers](partner-big-data-cluster.md).
 * The open-source components included by SQL Server 2019 Big Data Clusters are fixed for that particular release and must not be updated or modified.
 * Container images are provided "as-is". Composability features of Kubernetes aren't supported. Changing the set of container images in a SQL Server 2019 Big Data Cluster release, or to customize the containers, is not supported.
 
 Reference architecture and white papers for [!INCLUDE[big-data-clusters-nover](../includes/ssbigdataclusters-ss-nover.md)] can be found on the following pages:
 
 * [SQL Server 2019](https://www.microsoft.com/sql-server/sql-server-2019)
-* [SQL Server 2019 Big Data Clusters partners](../sql-server/partner-big-data-cluster.md)
+* [SQL Server 2019 Big Data Clusters partners](partner-big-data-cluster.md)
 
 ## Release history
 
diff --git a/docs/big-data-cluster/release-notes-cumulative-update-12.md b/docs/big-data-cluster/release-notes-cumulative-update-12.md
@@ -28,7 +28,7 @@ SQL Server Big Data Clusters CU12 was tested on the following environment combin
 Reference Architecture White Papers for SQL Server Big Data Clusters can be found on the following pages:
 
 * https://www.microsoft.com/sql-server/sql-server-2019
-* [SQL Server Big Data Clusters partners](../sql-server/partner-big-data-cluster.md)
+* [SQL Server Big Data Clusters partners](partner-big-data-cluster.md)
 
 ## System environment
 
diff --git a/docs/big-data-cluster/release-notes-cumulative-update-13.md b/docs/big-data-cluster/release-notes-cumulative-update-13.md
@@ -48,7 +48,7 @@ For detailed SQL Server engine changes, check the [official SQL Server CU13 know
 Reference Architecture White Papers for [!INCLUDE[big-data-clusters-nover](../includes/ssbigdataclusters-ss-nover.md)] can be found on the following pages:
 
 * [SQL Server 2019](https://www.microsoft.com/sql-server/sql-server-2019)
-* [SQL Server Big Data Clusters partners](../sql-server/partner-big-data-cluster.md)
+* [SQL Server Big Data Clusters partners](partner-big-data-cluster.md)
 
 
 ## System environment
diff --git a/docs/big-data-cluster/release-notes-cumulative-update-14.md b/docs/big-data-cluster/release-notes-cumulative-update-14.md
@@ -43,7 +43,7 @@ For detailed SQL Server engine changes, check the [official SQL Server CU14 know
 Reference Architecture White Papers for [!INCLUDE[big-data-clusters-nover](../includes/ssbigdataclusters-ss-nover.md)] can be found on the following pages:
 
 * [SQL Server 2019](https://www.microsoft.com/sql-server/sql-server-2019)
-* [SQL Server Big Data Clusters partners](../sql-server/partner-big-data-cluster.md)
+* [SQL Server Big Data Clusters partners](partner-big-data-cluster.md)
 
 
 ## System environment
diff --git a/docs/big-data-cluster/release-notes-cumulative-update-15.md b/docs/big-data-cluster/release-notes-cumulative-update-15.md
@@ -43,7 +43,7 @@ For detailed SQL Server engine changes, check the [official SQL Server CU15 know
 Reference Architecture White Papers for [!INCLUDE[big-data-clusters-nover](../includes/ssbigdataclusters-ss-nover.md)] can be found on the following pages:
 
 * [SQL Server 2019](https://www.microsoft.com/sql-server/sql-server-2019)
-* [SQL Server Big Data Clusters partners](../sql-server/partner-big-data-cluster.md)
+* [SQL Server Big Data Clusters partners](partner-big-data-cluster.md)
 
 ## System environment
 
diff --git a/docs/big-data-cluster/release-notes-cumulative-update-16.md b/docs/big-data-cluster/release-notes-cumulative-update-16.md
diff --git a/docs/big-data-cluster/release-notes-cumulative-update-17.md b/docs/big-data-cluster/release-notes-cumulative-update-17.md
diff --git a/docs/docfx.json b/docs/docfx.json
diff --git a/docs/toc.yml b/docs/toc.yml

Original file line number	Diff line number	Diff line change
`@@ -59455,6 +59455,11 @@`
`59455`	`59455`	`"redirect_url": "/sql/tools/sqlpackage/troubleshooting-issues-and-performance-with-sqlpackage",`
`59456`	`59456`	`"redirect_document_id": false`
`59457`	`59457`	`}`
	`59458`	`+ {`
	`59459`	`+ "source_path": "docs/sql-server/partner-big-data-cluster.md",`
	`59460`	`+ "redirect_url": "/sql/big-data-cluster/partner-big-data-cluster",`
	`59461`	`+ "redirect_document_id": false`
	`59462`	`+ }`
`59458`	`59463`	`]`
`59459`	`59464`	`}`
`59460`	`59465`