You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Click **Select a Principal**, insert **[!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)]DSA**, and click Ok
88
+
- Click **Select a Principal**, insert **bdcDSA**, and click Ok
89
89
90
90
- Set **Type** to **Allow**
91
91
@@ -109,7 +109,7 @@ The BDC domain service account (DSA) needs to be able to create users, groups, a
109
109
110
110
- Click **Add**
111
111
112
-
- Click **Select a Principal**, insert **[!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)]DSA**, and click Ok
112
+
- Click **Select a Principal**, insert **bdcDSA**, and click Ok
113
113
114
114
- Set **Type** to **Allow**
115
115
@@ -123,7 +123,7 @@ The BDC domain service account (DSA) needs to be able to create users, groups, a
123
123
124
124
- Click **Add**
125
125
126
-
- Click **Select a Principal**, insert **[!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)]DSA**, and click Ok
126
+
- Click **Select a Principal**, insert **bdcDSA**, and click Ok
127
127
128
128
- Set **Type** to **Allow**
129
129
@@ -162,7 +162,7 @@ AD integration requires the following parameters. Add these parameters to the `c
162
162
163
163
-`security.activeDirectory.ouDistinguishedName`: distinguished name of an organizational unit (OU) where all AD accounts created by cluster deployment will be added. If the domain is called `contoso.local`, the OU distinguished name is: `OU=BDC,DC=contoso,DC=local`.
164
164
165
-
-`security.activeDirectory.dnsIpAddresses`: list of IP addresses of domain controllers
165
+
-`security.activeDirectory.dnsIpAddresses`: contains the list of domain’s DNS servers IP addresses.
166
166
167
167
-`security.activeDirectory.domainControllerFullyQualifiedDns`: List of FQDN of domain controller. The FQDN contains the machine/host name of the domain controller. If you have multiple domain controllers, you can provide a list here. Example: `HOSTNAME.CONTOSO.LOCAL`
168
168
@@ -246,7 +246,7 @@ You can find an example script here for [deploying a SQL Server big data cluster
246
246
247
247
You should now have set all the required parameters for a deployment of BDC with Active Directory integration.
248
248
249
-
For full documentation of how to deploy [!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)], please visit the [official documentation](deployment-guidance.md).
249
+
You can now deploy the BDC cluster integrated with Active Directory using the `azdata` command and the kubeadm-prod deployment profile. For full documentation of how to deploy [!INCLUDE[big-data-clusters](../includes/ssbigdataclusters-nover.md)], please visit the [How to deploy SQL Server Big Data Clusters on Kubernetes](deployment-guidance.md).
- Only one BDC per domain (Active Directory) is allowed at this time. Enabling multiple BDCs per domain is planned for a future release.
322
322
323
323
- None of the AD groups specified in security configurations can be DomainLocal scoped. You can check the scope of an AD group by following [these instructions](https://docs.microsoft.com/powershell/module/activedirectory/get-adgroup?view=winserver2012-ps&viewFallbackFrom=winserver2012r2-ps).
324
+
325
+
- AD account that can be used to login into BDC are allowed from the same domain that was configured for BDC, Enabling logins from other trusted domain is planned for a future release
A key big data usage pattern is high volume data processing in Spark, followed by writing the data to SQL Server for access to line-of-business applications. These usage patterns benefit from a connector that utilizes key SQL optimizations and provides an efficient write mechanism.
17
17
18
-
This article provides an example of how to use the MSSQL Spark connector to read and write to the following locations within a big data cluster:
19
-
18
+
This article provides an overview of the MSSQL Spark connector interface and instantiating it for use with non-AD mode and AD-mode. Then, provides an example of how to use the MSSQL Spark connector to read and write to the following locations within a big data cluster:
- Read a file from HDFS and do some basic processing.
28
-
- Write the dataframe to a SQL Server master instance as a SQL table and then read the table to a dataframe.
29
-
- Write the dataframe to a SQL Server data pool as a SQL external table and then read the external table to a dataframe.
30
-
31
24
## MSSQL Spark Connector Interface
32
25
33
-
SQL Server 2019 provides the **MSSQL Spark connector** for big data clusters that uses SQL Server bulk write APIs for Spark to SQL writes. MSSQL Spark Connector is based on Spark data source APIs and provides a familiar Spark JDBC connector interface. For interface parameters refer [Apache Spark documentation](http://spark.apache.org/docs/latest/sql-data-sources-jdbc.html). The MSSQL Spark connector is referenced by the name **com.microsoft.sqlserver.jdbc.spark**.
26
+
SQL Server 2019 provides the **MSSQL Spark connector** for big data clusters that uses SQL Server bulk write APIs for Spark to SQL writes. MSSQL Spark Connector is based on Spark data source APIs and provides a familiar Spark JDBC connector interface. For interface parameters refer [Apache Spark documentation](http://spark.apache.org/docs/latest/sql-data-sources-jdbc.html). The MSSQL Spark connector is referenced by the name **com.microsoft.sqlserver.jdbc.spark**. The MSSQL Spark connector supports two security modes to connect with SQL Server, non-Active Directory mode and Active Directory(AD)-mode:
27
+
### Non-AD Mode:
28
+
In non-AD mode security, each user has a username and password which need to be provided as parameters during the connector instantiation to perform read and/or writes.
29
+
An example connector instantiation for non-AD mode is below:
30
+
```python
31
+
# Note: '?' is a placeholder for a necessary user-specified value
In AD mode security, after a user has generated a key tab file, the user needs to provide the `principal` and `keytab` as parameters during the connector instantiation.
45
+
46
+
In this mode, the driver loads the keytab file to the respective executor containers. Then, the executors use the principal name and keytab to generate a token that is used to create a JDBC connector for read/write.
47
+
48
+
An example connector instantiation for AD mode is below:
49
+
```python
50
+
# Note: '?' is a placeholder for a necessary user-specified value
The following table describes interface parameters that have changed or are new:
36
65
@@ -40,13 +69,19 @@ The following table describes interface parameters that have changed or are new:
40
69
41
70
The connector uses SQL Server Bulk write APIs. Any bulk write parameters can be passed as optional parameters by the user and are passed as-is by the connector to the underlying API. For more information about bulk write operations, see [SQLServerBulkCopyOptions](../connect/jdbc/using-bulk-copy-with-the-jdbc-driver.md#sqlserverbulkcopyoptions).
42
71
43
-
## Prerequisites
72
+
## MSSQL Spark Connector Sample
73
+
The sample performs the following tasks:
74
+
75
+
- Read a file from HDFS and do some basic processing.
76
+
- Write the dataframe to a SQL Server master instance as a SQL table and then read the table to a dataframe.
77
+
- Write the dataframe to a SQL Server data pool as a SQL external table and then read the external table to a dataframe.
78
+
### Prerequisites
44
79
45
80
- A [SQL Server big data cluster](deploy-get-started.md).
46
81
47
82
-[Azure Data Studio](https://aka.ms/getazuredatastudio).
48
83
49
-
## Create the target database
84
+
###Create the target database
50
85
51
86
1. Open Azure Data Studio, and [connect to the SQL Server master instance of your big data cluster](connect-to-big-data-cluster.md).
52
87
@@ -57,7 +92,7 @@ The connector uses SQL Server Bulk write APIs. Any bulk write parameters can be
57
92
GO
58
93
```
59
94
60
-
## Load sample data into HDFS
95
+
###Load sample data into HDFS
61
96
62
97
1. Download [AdultCensusIncome.csv](https://amldockerdatasets.azureedge.net/AdultCensusIncome.csv) to your local machine.
63
98
@@ -69,9 +104,9 @@ The connector uses SQL Server Bulk write APIs. Any bulk write parameters can be
To demonstrate the use of the MSSQL Spark Connector with this data, you can download a sample notebook, open it in Azure Data Studio, and run each code block. For more information about working with notebooks, see [How to use notebooks in SQL Server](notebooks-guidance.md).
109
+
To demonstrate the use of the MSSQL Spark Connector with this data in non-AD mode, you can download a sample notebook, open it in Azure Data Studio, and run each code block. For more information about working with notebooks, see [How to use notebooks in SQL Server](notebooks-guidance.md).
75
110
76
111
1. From a PowerShell or bash command line, run the following command to download the **mssql_spark_connector_non_ad_pyspark.ipynb** sample notebook:
77
112
@@ -86,3 +121,5 @@ To demonstrate the use of the MSSQL Spark Connector with this data, you can down
86
121
## Next steps
87
122
88
123
For more information about big data clusters, see [How to deploy [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ss-nover.md)] on Kubernetes](deployment-guidance.md)
124
+
125
+
Have feedback or feature recommendations for SQL Server Big Data Clusters? [Leave us a note at SQL Server Big Data Clusters Feedback](https://aka.ms/sql-server-bdc-feedback).
Copy file name to clipboardExpand all lines: docs/linux/quickstart-install-connect-suse.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,7 +25,7 @@ In this quickstart, you install SQL Server 2017 or SQL Server 2019 on SUSE Linux
25
25
In this quickstart, you install SQL Server 2019 on SUSE Linux Enterprise Server (SLES) v12. You then connect with **sqlcmd** to create your first database and run queries.
26
26
27
27
> [!IMPORTANT]
28
-
> SQL Server 2019 is supported on SUSE Enterprise Linux Server v12 SP2, SP3, or SP4.
28
+
> SQL Server 2019 is supported on SUSE Enterprise Linux Server v12 SP2, SP3, SP4 or SP5.
29
29
30
30
::: moniker-end
31
31
@@ -44,7 +44,7 @@ You must have a SLES v12 SP2 machine with **at least 2 GB** of memory. The file
You must have a SLES v12 SP2, SP3, or SP4 machine with **at least 2 GB** of memory. The file system must be **XFS** or **EXT4**. Other file systems, such as **BTRFS**, are unsupported.
47
+
You must have a SLES v12 SP2, SP3, SP4 or SP5 machine with **at least 2 GB** of memory. The file system must be **XFS** or **EXT4**. Other file systems, such as **BTRFS**, are unsupported.
Copy file name to clipboardExpand all lines: docs/linux/sample-unattended-install-ubuntu.md
+3Lines changed: 3 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -26,6 +26,9 @@ This sample Bash script installs SQL Server 2017 on Ubuntu 16.04 without interac
26
26
27
27
## Sample script
28
28
29
+
> [!NOTE]
30
+
> The script might fail if SQL Server is slow to start. That's because the script will exit with a non-zero status. Removing the `-e` switch on the first line may resolve this issue.
Copy file name to clipboardExpand all lines: docs/relational-databases/extended-events/quick-start-extended-events-in-sql-server.md
+1Lines changed: 1 addition & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,6 @@
1
1
---
2
2
title: "Quickstart: Extended events in SQL Server"
3
+
description: This quickstart helps you use Extended Events, a lightweight performance monitoring system, to collect data to monitor and troubleshoot problems in SQL Server.
Copy file name to clipboardExpand all lines: docs/relational-databases/extended-events/selects-and-joins-from-system-views-for-extended-events-in-sql-server.md
+1Lines changed: 1 addition & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,6 @@
1
1
---
2
2
title: "SELECTs and JOINs from system views for extended events"
3
+
description: There are system views of extended events in SQL Server and Azure SQL Database. Learn how event session information is represented in different perspectives.
Copy file name to clipboardExpand all lines: docs/relational-databases/extended-events/sql-server-extended-events-engine.md
+1Lines changed: 1 addition & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,6 @@
1
1
---
2
2
title: "SQL Server Extended Events Engine"
3
+
description: The SQL Server Extended Events engine enables the definition of events and processing of event data, manages Extended Events, and maintains a list of sessions.
0 commit comments