Skip to content

Commit 21adb22

Browse files
MikeRayMSFTMikeRayMSFT
committed
Add big data cluster include
1 parent 7f907ee commit 21adb22

38 files changed

Lines changed: 89 additions & 88 deletions

‎docs/big-data-cluster/app-deployment-extension.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.prod: sql
1111
ms.technology: big-data-cluster
1212
---
1313

14-
# How to use Visual Studio Code to deploy applications to SQL Server big data clusters
14+
# How to use Visual Studio Code to deploy applications to [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]
1515

1616
[!INCLUDE[tsql-appliesto-ssver15-xxxx-xxxx-xxx](../includes/tsql-appliesto-ssver15-xxxx-xxxx-xxx.md)]
1717

@@ -194,9 +194,9 @@ To delete an app, just click the Trash can button next to the app in the `Deploy
194194

195195
## Next steps
196196

197-
Explore how to integrate apps deployed on SQL Server big data clusters in your own applications at [Consume applications on big data clusters](big-data-cluster-consume-apps.md) for more information. You can also refer to the additional samples at [App Deploy Samples](https://aka.ms/sql-app-deploy) to try with the extension.
197+
Explore how to integrate apps deployed on [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] in your own applications at [Consume applications on big data clusters](big-data-cluster-consume-apps.md) for more information. You can also refer to the additional samples at [App Deploy Samples](https://aka.ms/sql-app-deploy) to try with the extension.
198198

199-
For more information about SQL Server big data clusters, see [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md).
199+
For more information about [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md).
200200

201201

202202
Our goal is to make this extension useful for you and we appreciate you feedback. Please send them to [[!INCLUDE[ssNoVersion](../includes/ssnoversion-md.md)] team](https://aka.ms/sqlfeedback).

‎docs/big-data-cluster/big-data-cluster-consume-apps.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.prod: sql
1111
ms.technology: big-data-cluster
1212
---
1313

14-
# Consume an app deployed on SQL Server big data clusters using a RESTful web service
14+
# Consume an app deployed on [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] using a RESTful web service
1515

1616
[!INCLUDE[tsql-appliesto-ssver15-xxxx-xxxx-xxx](../includes/tsql-appliesto-ssver15-xxxx-xxxx-xxx.md)]
1717

@@ -120,4 +120,4 @@ You have now successfully called the app through the web service. You can follow
120120

121121
You can also check out additional samples at [App Deploy Samples](https://aka.ms/sql-app-deploy).
122122

123-
For more information about SQL Server big data clusters, see [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md).
123+
For more information about [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md).

‎docs/big-data-cluster/big-data-cluster-create-apps.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.prod: sql
1111
ms.technology: big-data-cluster
1212
---
1313

14-
# How to deploy an app on SQL Server big data clusters
14+
# How to deploy an app on [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]
1515

1616
[!INCLUDE[tsql-appliesto-ssver15-xxxx-xxxx-xxx](../includes/tsql-appliesto-ssver15-xxxx-xxxx-xxx.md)]
1717

@@ -290,6 +290,6 @@ azdata app delete --name add-app --version v1
290290

291291
## Next steps
292292

293-
Explore how to integrate apps deployed on SQL Server big data clusters in your own applications at [Consume applications on big data clusters](big-data-cluster-consume-apps.md) for more information. You can also check out additional samples at [App Deploy Samples](https://aka.ms/sql-app-deploy).
293+
Explore how to integrate apps deployed on [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] in your own applications at [Consume applications on big data clusters](big-data-cluster-consume-apps.md) for more information. You can also check out additional samples at [App Deploy Samples](https://aka.ms/sql-app-deploy).
294294

295-
For more information about SQL Server big data clusters, see [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md).
295+
For more information about [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md).

‎docs/big-data-cluster/big-data-cluster-overview.md‎

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -11,23 +11,23 @@ ms.prod: sql
1111
ms.technology: big-data-cluster
1212
---
1313

14-
# What are SQL Server big data clusters?
14+
# What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]?
1515

1616
[!INCLUDE[tsql-appliesto-ssver15-xxxx-xxxx-xxx](../includes/tsql-appliesto-ssver15-xxxx-xxxx-xxx.md)]
1717

18-
Starting with [!INCLUDE[SQL Server 2019](../includes/sssqlv15-md.md)], SQL Server big data clusters allow you to deploy scalable clusters of SQL Server, Spark, and HDFS containers running on Kubernetes. These components are running side by side to enable you to read, write, and process big data from Transact-SQL or Spark, allowing you to easily combine and analyze your high-value relational data with high-volume big data.
18+
Starting with [!INCLUDE[SQL Server 2019](../includes/sssqlv15-md.md)], [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] allow you to deploy scalable clusters of SQL Server, Spark, and HDFS containers running on Kubernetes. These components are running side by side to enable you to read, write, and process big data from Transact-SQL or Spark, allowing you to easily combine and analyze your high-value relational data with high-volume big data.
1919

2020
For more information about new features and known issues for latest release, see the [release notes](release-notes-big-data-cluster.md).
2121

2222
[!INCLUDE [Limited public preview note](../includes/big-data-cluster-preview-note.md)]
2323

2424
## Scenarios
2525

26-
SQL Server big data clusters provide flexibility in how you interact with your big data. You can query external data sources, store big data in HDFS managed by SQL Server, or query data from multiple external data sources through the cluster. You can then use the data for AI, machine learning, and other analysis tasks. The following sections provide more information about these scenarios.
26+
[!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] provide flexibility in how you interact with your big data. You can query external data sources, store big data in HDFS managed by SQL Server, or query data from multiple external data sources through the cluster. You can then use the data for AI, machine learning, and other analysis tasks. The following sections provide more information about these scenarios.
2727

2828
### Data virtualization
2929

30-
By leveraging [SQL Server PolyBase](../relational-databases/polybase/polybase-guide.md), SQL Server big data clusters can query external data sources without moving or copying the data. [!INCLUDE[SQL Server 2019](../includes/sssqlv15-md.md)] introduces new connectors to data sources.
30+
By leveraging [SQL Server PolyBase](../relational-databases/polybase/polybase-guide.md), [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] can query external data sources without moving or copying the data. [!INCLUDE[SQL Server 2019](../includes/sssqlv15-md.md)] introduces new connectors to data sources.
3131

3232
![Data virtualization](media/big-data-cluster-overview/data-virtualization.png)
3333

@@ -39,13 +39,13 @@ A SQL Server big data cluster includes a scalable HDFS *storage pool*. This can
3939

4040
### Scale-out data mart
4141

42-
SQL Server big data clusters provide scale-out compute and storage to improve the performance of analyzing any data. Data from a variety of sources can be ingested and distributed across *data pool* nodes as a cache for further analysis.
42+
[!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] provide scale-out compute and storage to improve the performance of analyzing any data. Data from a variety of sources can be ingested and distributed across *data pool* nodes as a cache for further analysis.
4343

4444
![Data mart](media/big-data-cluster-overview/data-mart.png)
4545

4646
### Integrated AI and Machine Learning
4747

48-
SQL Server big data clusters enable AI and machine learning tasks on the data stored in HDFS storage pools and the data pools. You can use Spark as well as built-in AI tools in SQL Server, using R, Python, Scala, or Java.
48+
[!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] enable AI and machine learning tasks on the data stored in HDFS storage pools and the data pools. You can use Spark as well as built-in AI tools in SQL Server, using R, Python, Scala, or Java.
4949

5050
![AI and ML](media/big-data-cluster-overview/ai-ml-spark.png)
5151

@@ -75,7 +75,7 @@ Kubernetes is an open source container orchestrator, which can scale container d
7575
| **Pod** | A pod is the atomic deployment unit of Kubernetes. A pod is a logical group of one or more containers-and associated resources-needed to run an application. Each pod runs on a node; a node can run one or more pods. The Kubernetes master automatically assigns pods to nodes in the cluster. |
7676
|   ||
7777

78-
In SQL Server big data clusters, Kubernetes is responsible for the state of the SQL Server big data clusters; Kubernetes builds and configures the cluster nodes, assigns pods to nodes, and monitors the health of the cluster.
78+
In [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], Kubernetes is responsible for the state of the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]; Kubernetes builds and configures the cluster nodes, assigns pods to nodes, and monitors the health of the cluster.
7979

8080
### Big data clusters architecture
8181

@@ -100,9 +100,9 @@ The data pool is used for data persistence and caching. The data pool consists o
100100
The storage pool consists of storage pool pods comprised of SQL Server on Linux, Spark, and HDFS. All the storage nodes in a SQL Server big data cluster are members of an HDFS cluster.
101101

102102
> [!TIP]
103-
> For an in-depth look into big data cluster architecture and installation, see [Workshop: Microsoft SQL Server big data clusters Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters).
103+
> For an in-depth look into big data cluster architecture and installation, see [Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters).
104104
105105
## Next steps
106106

107-
SQL Server big data clusters is first available as a limited public preview through the SQL Server 2019
107+
[!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] is first available as a limited public preview through the SQL Server 2019
108108
Early Adoption Program. To request access, register [here](https://aka.ms/eapsignup), and specify your interest to try big data clusters. Microsoft will triage all requests and respond as soon as possible.

‎docs/big-data-cluster/cluster-troubleshooting-commands.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.prod: sql
1111
ms.technology: big-data-cluster
1212
---
1313

14-
# Monitoring and troubleshoot SQL Server big data clusters
14+
# Monitoring and troubleshoot [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]
1515

1616
[!INCLUDE[tsql-appliesto-ssver15-xxxx-xxxx-xxx](../includes/tsql-appliesto-ssver15-xxxx-xxxx-xxx.md)]
1717

@@ -219,4 +219,4 @@ kubectl proxy
219219

220220
## Next steps
221221

222-
For more information about big data clusters, see [What are SQL Server big data clusters](big-data-cluster-overview.md).
222+
For more information about big data clusters, see [What are [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]](big-data-cluster-overview.md).

‎docs/big-data-cluster/concept-application-deployment.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -56,12 +56,12 @@ It is also possible for an application to be executed using a RESTful web servic
5656

5757
## Next steps
5858

59-
To learn more about how to create and run applications on SQL Server big data clusters, see the following:
59+
To learn more about how to create and run applications on [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following:
6060

6161
- [Deploy applications using azdata](big-data-cluster-create-apps.md)
6262
- [Deploy applications using the App Deploy extension](app-deployment-extension.md)
6363
- [Consume applications on big data clusters](big-data-cluster-consume-apps.md)
6464

65-
To learn more about the SQL Server big data clusters, see the following overview:
65+
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following overview:
6666

6767
- [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md)

‎docs/big-data-cluster/concept-compute-pool.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ A compute pool can act as a PolyBase scale-out group for distributed queries ove
2727

2828
## Next steps
2929

30-
To learn more about the SQL Server big data clusters, see the following resources:
30+
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following resources:
3131

3232
- [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md)
33-
- [Workshop: Microsoft SQL Server big data clusters Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)
33+
- [Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)

‎docs/big-data-cluster/concept-controller.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -31,13 +31,13 @@ The controller service provides the following core functionality:
3131

3232
## Deploying the controller service
3333

34-
The controller is deployed and hosted in the same Kubernetes namespace where the customer wants to build out a big data cluster. This service is installed by a Kubernetes administrator during cluster bootstrap, using the **azdata** command-line utility. For more information, see [Get started with SQL Server big data clusters](deploy-get-started.md).
34+
The controller is deployed and hosted in the same Kubernetes namespace where the customer wants to build out a big data cluster. This service is installed by a Kubernetes administrator during cluster bootstrap, using the **azdata** command-line utility. For more information, see [Get started with [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]](deploy-get-started.md).
3535

3636
The buildout workflow will layout on top of Kubernetes a fully functional SQL Server big data cluster that includes all the components described in the [Overview](big-data-cluster-overview.md) article. The bootstrap workflow first creates the controller service, and once this is deployed, the controller service will coordinate the installation and configuration of rest of the services part of master, compute, data, and storage pools.
3737

3838
## Managing the cluster through the controller service
3939

40-
You can manage the cluster through the controller service using either **azdata** commands. If you deploy additional Kubernetes objects like pods into the same namespace, they are not managed or monitored by the controller service. You can also use **kubectl** commands to manage the cluster at the Kubernetes level. For more information, see [Monitoring and troubleshoot SQL Server big data clusters](cluster-troubleshooting-commands.md).
40+
You can manage the cluster through the controller service using either **azdata** commands. If you deploy additional Kubernetes objects like pods into the same namespace, they are not managed or monitored by the controller service. You can also use **kubectl** commands to manage the cluster at the Kubernetes level. For more information, see [Monitoring and troubleshoot [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)]](cluster-troubleshooting-commands.md).
4141

4242
The controller and the Kubernetes objects (stateful sets, pods, secrets, etc.) created for a big data cluster reside in a dedicated Kubernetes namespace. The controller service will be granted permission by the Kubernetes cluster administrator to manage all resources within that namespace. The RBAC policy for this scenario is configured automatically as part of initial cluster deployment using **azdata**.
4343

@@ -56,7 +56,7 @@ Authentication to the controller service endpoint is based on username and passw
5656
5757
## Next steps
5858

59-
To learn more about the SQL Server big data clusters, see the following resources:
59+
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following resources:
6060

6161
- [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md)
62-
- [Workshop: Microsoft SQL Server big data clusters Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)
62+
- [Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)

‎docs/big-data-cluster/concept-data-pool.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ Data pools enable the creation of scale-out data marts, where external data from
2929

3030
## Next steps
3131

32-
To learn more about the SQL Server big data clusters, see the following resources:
32+
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following resources:
3333

3434
- [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md)
35-
- [Workshop: Microsoft SQL Server big data clusters Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)
35+
- [Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)

‎docs/big-data-cluster/concept-master-instance.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -62,7 +62,7 @@ With SQL Server 2019 big data clusters, you can do more with your enterprise dat
6262

6363
## Next steps
6464

65-
To learn more about the SQL Server big data clusters, see the following resources:
65+
To learn more about the [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)], see the following resources:
6666

6767
- [What are SQL Server 2019 big data clusters?](big-data-cluster-overview.md)
68-
- [Workshop: Microsoft SQL Server big data clusters Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)
68+
- [Workshop: Microsoft [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] Architecture](https://github.com/Microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters)

0 commit comments

Comments
 (0)