You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/big-data-cluster/big-data-cluster-overview.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -21,14 +21,14 @@ Starting with [!INCLUDE[SQL Server 2019](../includes/sssqlv15-md.md)], [!INCLUDE
21
21
22
22
Use SQL Server Big Data Clusters to:
23
23
24
-
-[Deploy scalable clusters](../big-data-cluster/deploy-get-started.md) of SQL Server, Spark, and HDFS containers running on Kubernetes.
24
+
-[Deploy scalable clusters](./deploy-get-started.md) of SQL Server, Spark, and HDFS containers running on Kubernetes.
25
25
- Read, write, and process big data from Transact-SQL or Spark.
26
26
- Easily combine and analyze high-value relational data with high-volume big data.
27
27
- Query external data sources.
28
28
- Store big data in HDFS managed by SQL Server.
29
29
- Query data from multiple external data sources through the cluster.
30
30
- Use the data for AI, machine learning, and other analysis tasks.
31
-
-[Deploy and run applications](../big-data-cluster/concept-application-deployment.md) in [!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)].
31
+
-[Deploy and run applications](./concept-application-deployment.md) in [!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)].
32
32
- Virtualize data with [PolyBase](../relational-databases/polybase/polybase-guide.md). Query data from external SQL Server, Oracle, Teradata, MongoDB, and ODBC data sources with external tables.
33
33
- Provide high availability for the SQL Server master instance and all databases by using Always On availability group technology.
34
34
@@ -116,4 +116,4 @@ The storage pool consists of storage pool pods comprised of SQL Server on Linux,
116
116
117
117
## Next steps
118
118
119
-
For more information about deploying SQL Server Big Data Clusters, see [Get started with SQL Server Big Data Clusters](deploy-get-started.md).
119
+
For more information about deploying SQL Server Big Data Clusters, see [Get started with SQL Server Big Data Clusters](deploy-get-started.md).
Copy file name to clipboardExpand all lines: docs/big-data-cluster/concept-application-deployment.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -52,7 +52,7 @@ When an application is executed, the Kubernetes service for the application prox
52
52
53
53
SQL Server 2019 CU5 enables support for Big Data Clusters deployment on Red Hat OpenShift as well as an updated security model for BDC so privileged containers no longer required. In addition to non-privileged, containers are running as non-root user by default for all new deployments using SQL Server 2019 CU5.
54
54
55
-
At the time of the CU5 release, the setup step of the applications deployed with [app deploy](concept-application-deployment.md) interfaces will still run as *root* user. This is required since during setup additional packages that application will use are installed. Other user code deployed as part of the application will run as low privilege user.
55
+
At the time of the CU5 release, the setup step of the applications deployed with [app deploy]() interfaces will still run as *root* user. This is required since during setup additional packages that application will use are installed. Other user code deployed as part of the application will run as low privilege user.
56
56
57
57
In addition, **CAP_AUDIT_WRITE** capability is an optional capability necessary to allow scheduling SSIS applications using cron jobs. When the application’s yaml specification file specifies a schedule, the application will be triggered via a cron job, which requires the additional capability. Alternatively, the application can be triggered on demand with *azdata app run* through a web service call, which does not require the CAP_AUDIT_WRITE capability.
58
58
@@ -88,4 +88,4 @@ To learn more about how to create and run applications on [!INCLUDE[big-data-clu
88
88
89
89
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following overview:
90
90
91
-
- [What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ver15.md)]?](big-data-cluster-overview.md)
91
+
- [What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ver15.md)]?](big-data-cluster-overview.md)
Copy file name to clipboardExpand all lines: docs/big-data-cluster/concept-controller.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -52,11 +52,11 @@ All communication to the controller service is conducted via a REST API over HTT
52
52
Authentication to the controller service endpoint is either using an Active Directory identity or based on username and password. These credentials are provisioned at cluster bootstrap time using the input for environment variables `AZDATA_USERNAME` and `AZDATA_PASSWORD`.
53
53
54
54
> [!NOTE]
55
-
> You must provide a password that is in compliance with [SQL Server password complexity requirements](https://docs.microsoft.com/sql/relational-databases/security/password-policy?view=sql-server-2017).
55
+
> You must provide a password that is in compliance with [SQL Server password complexity requirements](../relational-databases/security/password-policy.md?view=sql-server-2017).
56
56
57
57
## Next steps
58
58
59
59
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following resources:
60
60
61
61
-[What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ver15.md)]?](big-data-cluster-overview.md)
62
-
-[Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/microsoft/sqlworkshops-bdc)
62
+
-[Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/microsoft/sqlworkshops-bdc)
Copy file name to clipboardExpand all lines: docs/big-data-cluster/concept-data-persistence.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -23,7 +23,7 @@ A SQL Server big data cluster consumes these persistent volumes by using [storag
23
23
24
24
Here are some important aspects to consider when you're planning storage configuration for your big data cluster:
25
25
26
-
- For a successful big data cluster deployment, make sure you have the required number of persistent volumes available. If you're deploying on an Azure Kubernetes Service (AKS) cluster and you're using a built-in storage class (`default` or `managed-premium`), this class supports dynamic provisioning for the persistent volumes. Therefore, you don't have to pre-create the persistent volumes, but you must make sure the available worker nodes in the AKS cluster can attach as many disks as the number of persistent volumes that are required for the deployment. Depending on the [VM size](https://docs.microsoft.com/azure/virtual-machines/linux/sizes) specified for the worker nodes, each node can attach a certain number of disks. For a default size cluster (with no high availability), a minimum of 24 disks are required. If you're enabling high availability or scaling up any pool, make sure you have at least two persisted volumes per each additional replica, regardless of the resource you're scaling up.
26
+
- For a successful big data cluster deployment, make sure you have the required number of persistent volumes available. If you're deploying on an Azure Kubernetes Service (AKS) cluster and you're using a built-in storage class (`default` or `managed-premium`), this class supports dynamic provisioning for the persistent volumes. Therefore, you don't have to pre-create the persistent volumes, but you must make sure the available worker nodes in the AKS cluster can attach as many disks as the number of persistent volumes that are required for the deployment. Depending on the [VM size](/azure/virtual-machines/linux/sizes) specified for the worker nodes, each node can attach a certain number of disks. For a default size cluster (with no high availability), a minimum of 24 disks are required. If you're enabling high availability or scaling up any pool, make sure you have at least two persisted volumes per each additional replica, regardless of the resource you're scaling up.
27
27
28
28
- If the storage provisioner for the storage class you're providing in the configuration doesn't support dynamic provisioning, you must pre-create the persisted volumes. For example, the `local-storage` provisioner doesn't enable dynamic provisioning. See this [sample script](https://github.com/microsoft/sql-server-samples/tree/master/samples/features/sql-big-data-cluster/deployment/kubeadm/ubuntu) for guidance on how to proceed in a Kubernetes cluster deployed with `kubeadm`.
- For complete documentation about volumes in Kubernetes, see the [Kubernetes documentation on volumes](https://kubernetes.io/docs/concepts/storage/volumes/).
155
155
156
-
- For more information about deploying a SQL Server big data cluster, see [How to deploy SQL Server big data cluster on Kubernetes](deployment-guidance.md).
156
+
- For more information about deploying a SQL Server big data cluster, see [How to deploy SQL Server big data cluster on Kubernetes](deployment-guidance.md).
Copy file name to clipboardExpand all lines: docs/big-data-cluster/deploy-active-directory.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -270,7 +270,7 @@ Below table show the authorization model for application management:
270
270
>[!NOTE]
271
271
>Active Directory requires the account names to be limited to 20 characters. BDC cluster needs to use 8 of the characters for distinguishing pods and StatefulSets. This leaves us 12 characters as a limit for the account prefix
272
272
273
-
[Check AD group scope](https://docs.microsoft.com/powershell/module/activedirectory/get-adgroup?view=winserver2012-ps&viewFallbackFrom=winserver2012r2-ps), to determine if it is DomainLocal.
273
+
[Check AD group scope](/powershell/module/activedirectory/get-adgroup?view=winserver2012-ps&viewFallbackFrom=winserver2012r2-ps), to determine if it is DomainLocal.
274
274
275
275
If you have not already initialized the deployment configuration file, you can run this command to get a copy of the configuration. Examples below use the `kubeadm-prod` profile, same applies to `openshift-prod`.
- Before SQL Server 2019 CU5 release, only one BDC per domain (Active Directory) is allowed. Enabling multiple BDCs per domain is available starting with CU5 release.
431
431
432
-
- None of the AD groups specified in security configurations can be DomainLocal scoped. You can check the scope of an AD group by following [these instructions](https://docs.microsoft.com/powershell/module/activedirectory/get-adgroup?view=winserver2012-ps&viewFallbackFrom=winserver2012r2-ps).
432
+
- None of the AD groups specified in security configurations can be DomainLocal scoped. You can check the scope of an AD group by following [these instructions](/powershell/module/activedirectory/get-adgroup?view=winserver2012-ps&viewFallbackFrom=winserver2012r2-ps).
433
433
434
434
- AD account that can be used to login into BDC are allowed from the same domain that was configured for BDC. Enabling logins from other trusted domain is not supported.
435
435
436
436
## Next steps
437
437
438
438
[Troubleshoot SQL Server Big Data Cluster Active Directory integration](troubleshoot-active-directory.md)
439
439
440
-
[Concept: deploy [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] in Active Directory mode](active-directory-deployment-background.md)
440
+
[Concept: deploy [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] in Active Directory mode](active-directory-deployment-background.md)
Copy file name to clipboardExpand all lines: docs/big-data-cluster/deploy-big-data-tools.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,9 +28,9 @@ The following table lists common big data cluster tools and how to install them:
28
28
|`kubectl`<sup>1</sup> | Yes | Command-line tool for monitoring the underlying Kubernetes cluster ([More info](https://kubernetes.io/docs/tasks/tools/install-kubectl/)). |[Windows](https://kubernetes.io/docs/tasks/tools/install-kubectl/#install-with-powershell-from-psgallery)\|[Linux](https://kubernetes.io/docs/tasks/tools/install-kubectl/#install-using-native-package-management)|
29
29
|**Azure Data Studio**| Yes | Cross-platform graphical tool for querying SQL Server. |[Install](https://aka.ms/getazuredatastudio)|
30
30
|**Data Virtualization extension**| Yes | Extension for Azure Data Studio that provides a Data Virtualization wizard. |[Install](../azure-data-studio/data-virtualization-extension.md)|
31
-
|**Azure CLI**<sup>2</sup> | For AKS | Modern command-line interface for managing Azure services. Used with AKS big data cluster deployments ([More info](https://docs.microsoft.com/cli/azure/?view=azure-cli-latest)). |[Install](https://docs.microsoft.com/cli/azure/install-azure-cli?view=azure-cli-latest)|
31
+
|**Azure CLI**<sup>2</sup> | For AKS | Modern command-line interface for managing Azure services. Used with AKS big data cluster deployments ([More info](/cli/azure/?view=azure-cli-latest)). |[Install](/cli/azure/install-azure-cli?view=azure-cli-latest)|
32
32
|**mssql-cli**| Optional | Modern command-line interface for querying SQL Server ([More info](../tools/mssql-cli.md)). |[Windows](https://github.com/dbcli/mssql-cli/blob/master/doc/installation/windows.md)\|[Linux](https://github.com/dbcli/mssql-cli/blob/master/doc/installation/linux.md)|
33
-
|**sqlcmd**| For some scripts | Legacy command-line tool for querying SQL Server ([More info](https://docs.microsoft.com/sql/tools/sqlcmd-utility?view=sql-server-ver15)). You might need to install the Microsoft ODBC Driver 11 for SQL Server before installing the SQLCMD package. |[Windows](https://www.microsoft.com/download/details.aspx?id=36433)\|[Linux](../linux/sql-server-linux-setup-tools.md)|
33
+
|**sqlcmd**| For some scripts | Legacy command-line tool for querying SQL Server ([More info](../tools/sqlcmd-utility.md?view=sql-server-ver15)). You might need to install the Microsoft ODBC Driver 11 for SQL Server before installing the SQLCMD package. |[Windows](https://www.microsoft.com/download/details.aspx?id=36433)\|[Linux](../linux/sql-server-linux-setup-tools.md)|
34
34
|`curl` <sup>3</sup> | For some scripts | Command-line tool for transferring data with URLs. |[Windows](https://curl.haxx.se/windows/)\| Linux: install curl package |
35
35
| `oc` | Required for Red Hat OpenShift and Azure Redhat OpenShift deployments. |`oc` is the Open Shift command line interface (CLI). | [Installing the CLI](https://docs.openshift.com/container-platform/4.4/cli_reference/openshift_cli/getting-started-cli.html#installing-the-cli)
36
36
@@ -82,7 +82,7 @@ Azure Data Studio provides capabilities and features specifically for SQL Server
82
82
83
83
[Get the latest Azure Data Studio](https://aka.ms/getazuredatastudio).
84
84
85
-
For details about the latest release, see the [release notes](../big-data-cluster/release-notes-big-data-cluster.md).
85
+
For details about the latest release, see the [release notes](./release-notes-big-data-cluster.md).
86
86
87
87
## Next steps
88
88
@@ -91,4 +91,4 @@ After configuring the tools, deploy a SQL Server 2019 big data cluster to Kubern
91
91
-[Quickstart: Deploy SQL Server big data cluster on Azure Kubernetes Service (AKS)](quickstart-big-data-cluster-deploy.md)
92
92
-[How to deploy [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] on Kubernetes](deployment-guidance.md)
93
93
94
-
For More info about big data clusters, see [What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ver15.md)]?](big-data-cluster-overview.md).
94
+
For More info about big data clusters, see [What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ver15.md)]?](big-data-cluster-overview.md).
Copy file name to clipboardExpand all lines: docs/big-data-cluster/deploy-on-aks.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -41,7 +41,7 @@ This article describes the steps to deploy Kubernetes on AKS using Azure CLI. If
41
41
- 24 or more attached disks across all nodes
42
42
43
43
> [!TIP]
44
-
> Azure infrastructure offers multiple size options for VMs, see [here](https://docs.microsoft.com/azure/virtual-machines/windows/sizes) for selections in the region you are planning to deploy.
44
+
> Azure infrastructure offers multiple size options for VMs, see [here](/azure/virtual-machines/windows/sizes) for selections in the region you are planning to deploy.
45
45
46
46
## Create a resource group
47
47
@@ -105,7 +105,7 @@ Choose the latest available version for your cluster. Record the version number.
105
105
106
106
## Create a Kubernetes cluster
107
107
108
-
1. Create a Kubernetes cluster in AKS with the [az aks create](https://docs.microsoft.com/cli/azure/aks) command. The following example creates a Kubernetes cluster named *kubcluster* with one Linux agent node of size **Standard_L8s**.
108
+
1. Create a Kubernetes cluster in AKS with the [az aks create](/cli/azure/aks) command. The following example creates a Kubernetes cluster named *kubcluster* with one Linux agent node of size **Standard_L8s**.
109
109
110
110
Before you run the script, replace `<version number>` with the version number you identified in the previous step.
111
111
@@ -144,7 +144,7 @@ Choose the latest available version for your cluster. Record the version number.
144
144
145
145
## Connect to the cluster
146
146
147
-
1. To configure kubectl to connect to your Kubernetes cluster, run the [az aks get-credentials](https://docs.microsoft.com/cli/azure/aks?view=azure-cli-latest#az-aks-get-credentials) command. This step downloads credentials and configures the kubectl CLI to use them.
147
+
1. To configure kubectl to connect to your Kubernetes cluster, run the [az aks get-credentials](/cli/azure/aks?view=azure-cli-latest#az-aks-get-credentials) command. This step downloads credentials and configures the kubectl CLI to use them.
148
148
149
149
```azurecli
150
150
az aks get-credentials --resource-group=sqlbdcgroup --name kubcluster
@@ -160,12 +160,12 @@ Choose the latest available version for your cluster. Record the version number.
160
160
161
161
If you have any problems creating an Azure Kubernetes Service with the previous commands, try the following resolutions:
162
162
163
-
- Make sure that you have installed the [latest Azure CLI](https://docs.microsoft.com/cli/azure/install-azure-cli?view=azure-cli-latest).
163
+
- Make sure that you have installed the [latest Azure CLI](/cli/azure/install-azure-cli?view=azure-cli-latest).
164
164
- Try the same steps using a different resource group and cluster name.
165
-
- Refer to the detailed [troubleshooting documentation for AKS](https://docs.microsoft.com/azure/aks/troubleshooting).
165
+
- Refer to the detailed [troubleshooting documentation for AKS](/azure/aks/troubleshooting).
166
166
167
167
## Next steps
168
168
169
169
The steps in this article configured a Kubernetes cluster in AKS. The next step is to deploy a SQL Server 2019 big data cluster on the AKS Kubernetes cluster. For more information on how to deploy big data clusters, see the following article:
170
170
171
-
[How to deploy [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] on Kubernetes](deployment-guidance.md)
171
+
[How to deploy [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] on Kubernetes](deployment-guidance.md)
Copy file name to clipboardExpand all lines: docs/big-data-cluster/deployment-guidance.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -29,7 +29,7 @@ See [Supported platforms](release-notes-big-data-cluster.md#supported-platforms)
29
29
30
30
|Edition|Notes|
31
31
|---------|---------|
32
-
|Enterprise<br/>Standard<br/>Developer| Big Data Cluster edition is determined by the edition of SQL Server master instance. At deployment time Developer edition is deployed by default. You can change the edition after deployment. See [Configure SQL Server master instance](../big-data-cluster/configure-sql-server-master-instance.md). |
32
+
|Enterprise<br/>Standard<br/>Developer| Big Data Cluster edition is determined by the edition of SQL Server master instance. At deployment time Developer edition is deployed by default. You can change the edition after deployment. See [Configure SQL Server master instance](./configure-sql-server-master-instance.md). |
33
33
34
34
## <aid="prereqs"></a> Kubernetes
35
35
@@ -431,4 +431,4 @@ To learn more about big data cluster deployment, see the following resources:
431
431
432
432
-[Configure deployment settings for big data clusters](deployment-custom-configuration.md)
433
433
-[Perform an offline deployment of a SQL Server big data cluster](deploy-offline.md)
434
-
-[Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)
434
+
-[Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)
0 commit comments