Document that we expect tokenType to be < 65536 (for microsoft#89185)

alexdima · alexdima · commit 4eab357eb8e4 · 2020-01-28T00:11:57.000+01:00
diff --git a/src/vs/vscode.proposed.d.ts b/src/vs/vscode.proposed.d.ts
@@ -240,7 +240,7 @@ declare module 'vscode' {
 		 *  - at index `5*i`   - `deltaLine`: token line number, relative to the previous token
 		 *  - at index `5*i+1` - `deltaStart`: token start character, relative to the previous token (relative to 0 or the previous token's start if they are on the same line)
 		 *  - at index `5*i+2` - `length`: the length of the token. A token cannot be multiline.
-		 *  - at index `5*i+3` - `tokenType`: will be looked up in `SemanticTokensLegend.tokenTypes`
+		 *  - at index `5*i+3` - `tokenType`: will be looked up in `SemanticTokensLegend.tokenTypes`. We currently ask that `tokenType` < 65536.
 		 *  - at index `5*i+4` - `tokenModifiers`: each set bit will be looked up in `SemanticTokensLegend.tokenModifiers`
 		 *
 		 * ---

Original file line number	Diff line number	Diff line change
`@@ -240,7 +240,7 @@ declare module 'vscode' {`
`240`	`240`	* - at index `5*i` - `deltaLine`: token line number, relative to the previous token
`241`	`241`	* - at index `5*i+1` - `deltaStart`: token start character, relative to the previous token (relative to 0 or the previous token's start if they are on the same line)
`242`	`242`	* - at index `5*i+2` - `length`: the length of the token. A token cannot be multiline.
`243`		- * - at index `5*i+3` - `tokenType`: will be looked up in `SemanticTokensLegend.tokenTypes`
	`243`	+ * - at index `5*i+3` - `tokenType`: will be looked up in `SemanticTokensLegend.tokenTypes`. We currently ask that `tokenType` < 65536.
`244`	`244`	* - at index `5*i+4` - `tokenModifiers`: each set bit will be looked up in `SemanticTokensLegend.tokenModifiers`
`245`	`245`	`*`
`246`	`246`	`* ---`