Skip to content

feat(gax-httpjson): Add Post Quantum Cryptography (PQC) Support by default via Conscrypt#13853

Draft
lqiu96 wants to merge 32 commits into
mainfrom
pqc-httpjson-support
Draft

feat(gax-httpjson): Add Post Quantum Cryptography (PQC) Support by default via Conscrypt#13853
lqiu96 wants to merge 32 commits into
mainfrom
pqc-httpjson-support

Conversation

@lqiu96

@lqiu96 lqiu96 commented Jul 21, 2026

Copy link
Copy Markdown
Member

No description provided.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces Post-Quantum Cryptography (PQC) TLS negotiation for HTTP/JSON clients by integrating Conscrypt as a security provider and adding corresponding integration tests. The reviewer feedback focuses on improving the robustness and architecture of this implementation. Specifically, the reviewer recommends removing the undesirable coupling from the core HTTP module to the transport-specific module by defining the PQC groups locally. Additionally, the reviewer suggests wrapping the Conscrypt named groups configuration in a defensive try-catch block and separating the builder creation from the build calls to prevent genuine configuration or mTLS errors from being incorrectly swallowed as Conscrypt loading failures.

Comment on lines +87 to +102
try {
return new NetHttpTransport.Builder()
.setSecurityProvider(Conscrypt.newProvider())
.setSslSocketConfigurator(
socket -> {
if (Conscrypt.isConscrypt(socket)) {
Conscrypt.setNamedGroups(
socket, InstantiatingHttpJsonChannelProvider.DEFAULT_PQC_GROUPS);
}
})
.build();
} catch (Throwable t) {
LOG.log(
Level.FINE, "Conscrypt native libraries not available. Falling back to JDK TLS.", t);
return new NetHttpTransport.Builder().build();
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Refactor the transport builder initialization to:

  1. Use the locally defined PQC_GROUPS instead of referencing InstantiatingHttpJsonChannelProvider.DEFAULT_PQC_GROUPS.
  2. Wrap the Conscrypt.setNamedGroups call in a defensive try-catch block to prevent runtime connection failures if an older or incompatible version of Conscrypt is present on the classpath.
  3. Separate the builder creation from the build() call so that any potential configuration/build exceptions are not incorrectly swallowed and logged as Conscrypt native library loading failures.
      NetHttpTransport.Builder builder = new NetHttpTransport.Builder();
      try {
        builder.setSecurityProvider(Conscrypt.newProvider())
            .setSslSocketConfigurator(
                socket -> {
                  if (Conscrypt.isConscrypt(socket)) {
                    try {
                      Conscrypt.setNamedGroups(socket, PQC_GROUPS);
                    } catch (Exception e) {
                      LOG.log(Level.WARNING, "Failed to set PQC named groups on Conscrypt socket", e);
                    }
                  }
                });
      } catch (Throwable t) {
        LOG.log(
            Level.FINE, "Conscrypt native libraries not available. Falling back to JDK TLS.", t);
      }
      return builder.build();
References
  1. Avoid inverting layering by making lower-level channel implementations depend on higher-level RPC wrappers. If code is duplicated and needs to be shared, move it to a separate helper/utility class.

Comment on lines 220 to 234
try {
NetHttpTransport.Builder builder =
new NetHttpTransport.Builder()
.setSecurityProvider(Conscrypt.newProvider())
.setSslSocketConfigurator(
socket -> {
if (Conscrypt.isConscrypt(socket)) {
Conscrypt.setNamedGroups(socket, DEFAULT_PQC_GROUPS);
}
});
return configureMtls(builder).build();
} catch (Throwable t) {
LOG.log(Level.FINE, "Conscrypt native libraries not available. Falling back to JDK TLS.", t);
return configureMtls(new NetHttpTransport.Builder()).build();
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Refactor the transport builder initialization to:

  1. Wrap the Conscrypt.setNamedGroups call in a defensive try-catch block to prevent runtime connection failures if an older or incompatible version of Conscrypt is present on the classpath.
  2. Separate the builder creation from the configureMtls(builder).build() call. This ensures that any genuine mTLS configuration errors (e.g., key store issues) are correctly propagated to the caller instead of being caught, logged as Conscrypt native library loading failures, and retried.
    NetHttpTransport.Builder builder = new NetHttpTransport.Builder();
    try {
      builder.setSecurityProvider(Conscrypt.newProvider())
          .setSslSocketConfigurator(
              socket -> {
                if (Conscrypt.isConscrypt(socket)) {
                  try {
                    Conscrypt.setNamedGroups(socket, DEFAULT_PQC_GROUPS);
                  } catch (Exception e) {
                    LOG.log(Level.WARNING, "Failed to set PQC named groups on Conscrypt socket", e);
                  }
                }
              });
    } catch (Throwable t) {
      LOG.log(Level.FINE, "Conscrypt native libraries not available. Falling back to JDK TLS.", t);
    }
    return configureMtls(builder).build();

import com.google.api.gax.core.GaxProperties;
import com.google.api.gax.httpjson.HttpHeadersUtils;
import com.google.api.gax.httpjson.HttpJsonStatusCode;
import com.google.api.gax.httpjson.InstantiatingHttpJsonChannelProvider;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

This import is unnecessary and introduces an undesirable coupling from the core HTTP module (google-cloud-core-http) to the transport-specific module (gax-httpjson). We can remove this import by defining the PQC groups array locally within this class.

References
  1. Avoid inverting layering by making lower-level channel implementations depend on higher-level RPC wrappers. If code is duplicated and needs to be shared, move it to a separate helper/utility class.


public static class DefaultHttpTransportFactory implements HttpTransportFactory {

private static final Logger LOG = Logger.getLogger(DefaultHttpTransportFactory.class.getName());

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Define the PQC groups array locally to avoid coupling with gax-httpjson.

Suggested change
private static final Logger LOG = Logger.getLogger(DefaultHttpTransportFactory.class.getName());
private static final Logger LOG = Logger.getLogger(DefaultHttpTransportFactory.class.getName());
private static final String[] PQC_GROUPS =
new String[] {"X25519MLKEM768", "SecP256r1MLKEM768", "X25519"};
References
  1. Avoid inverting layering by making lower-level channel implementations depend on higher-level RPC wrappers. If code is duplicated and needs to be shared, move it to a separate helper/utility class.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is java-core already dependent on gax-httpjson?

@lqiu96 lqiu96 Jul 22, 2026

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment was from an older change didn't seem to want to import InstantiatingHttpJsonChannelProvider for constants. Moved it all to a Util class (HttpJsonTransportUtils) that can be shared between the two instead.

@lqiu96

lqiu96 commented Jul 21, 2026

Copy link
Copy Markdown
Member Author

/gemini review

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces Post-Quantum Cryptography (PQC) TLS negotiation support for HTTP/JSON clients by registering Conscrypt as the security provider and configuring default PQC named groups. The feedback suggests utilizing lazy initialization and caching for the Conscrypt security provider in both InstantiatingHttpJsonChannelProvider and HttpTransportOptions to prevent the performance and memory overhead of instantiating a new provider on every transport creation.

Comment on lines +83 to +84
public static final String[] DEFAULT_PQC_GROUPS =
new String[] {"X25519MLKEM768", "SecP256r1MLKEM768", "X25519"};

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Prefer lazy initialization and caching for resource-intensive objects like the Conscrypt security provider. Creating a new Provider instance on every transport creation can lead to significant performance overhead and high memory usage.

We can introduce a static lazy holder class to cache the Conscrypt provider instance safely, ensuring it is only initialized once and does not cause class-loading issues if Conscrypt is not present on the classpath.

  public static final String[] DEFAULT_PQC_GROUPS =
      new String[] {"X25519MLKEM768", "SecP256r1MLKEM768", "X25519"};

  private static class ConscryptProviderHolder {
    private static final java.security.Provider INSTANCE = createProvider();

    private static java.security.Provider createProvider() {
      try {
        return Conscrypt.newProvider();
      } catch (Throwable t) {
        LOG.log(
            Level.FINE,
            "Conscrypt native libraries not available. Falling back to JDK TLS.",
            t);
        return null;
      }
    }
  }
References
  1. Prefer lazy initialization over eager initialization for resource-intensive objects (such as CharsetEncoder) if they are not guaranteed to be used in all execution paths, to avoid unnecessary performance and memory overhead.

Comment on lines 220 to 244
NetHttpTransport.Builder builder = new NetHttpTransport.Builder();
try {
builder
.setSecurityProvider(Conscrypt.newProvider())
.setSslSocketConfigurator(
socket -> {
if (Conscrypt.isConscrypt(socket)) {
try {
Conscrypt.setNamedGroups(socket, DEFAULT_PQC_GROUPS);
} catch (Throwable t) {
// Catch runtime socket configuration errors (e.g. version mismatch or JNI
// error)
// and fall back to Conscrypt's default TLS groups without failing the request.
LOG.log(
Level.FINE,
"Failed to set PQC named groups on Conscrypt socket. Falling back to"
+ " Conscrypt default TLS groups.",
t);
}
}
});
} catch (Throwable t) {
LOG.log(Level.FINE, "Conscrypt native libraries not available. Falling back to JDK TLS.", t);
builder = new NetHttpTransport.Builder();
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Use the cached Conscrypt provider instance from ConscryptProviderHolder instead of creating a new provider instance on every call to createHttpTransport(). This avoids unnecessary performance and memory overhead.

    NetHttpTransport.Builder builder = new NetHttpTransport.Builder();
    java.security.Provider conscryptProvider = ConscryptProviderHolder.INSTANCE;
    if (conscryptProvider != null) {
      builder
          .setSecurityProvider(conscryptProvider)
          .setSslSocketConfigurator(
              socket -> {
                if (Conscrypt.isConscrypt(socket)) {
                  try {
                    Conscrypt.setNamedGroups(socket, DEFAULT_PQC_GROUPS);
                  } catch (Throwable t) {
                    // Catch runtime socket configuration errors (e.g. version mismatch or JNI
                    // error)
                    // and fall back to Conscrypt's default TLS groups without failing the request.
                    LOG.log(
                        Level.FINE,
                        "Failed to set PQC named groups on Conscrypt socket. Falling back to"
                            + " Conscrypt default TLS groups.",
                        t);
                  }
                }
              });
    }
References
  1. Prefer lazy initialization over eager initialization for resource-intensive objects (such as CharsetEncoder) if they are not guaranteed to be used in all execution paths, to avoid unnecessary performance and memory overhead.

Comment on lines 61 to 63
private static final String[] PQC_GROUPS =
new String[] {"X25519MLKEM768", "SecP256r1MLKEM768", "X25519"};
private static final HttpTransportFactory INSTANCE = new DefaultHttpTransportFactory();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Prefer lazy initialization and caching for resource-intensive objects like the Conscrypt security provider. Creating a new Provider instance on every transport creation can lead to significant performance overhead and high memory usage.

We can introduce a static lazy holder class to cache the Conscrypt provider instance safely, ensuring it is only initialized once and does not cause class-loading issues if Conscrypt is not present on the classpath.

    private static final String[] PQC_GROUPS =
        new String[] {"X25519MLKEM768", "SecP256r1MLKEM768", "X25519"};
    private static final HttpTransportFactory INSTANCE = new DefaultHttpTransportFactory();

    private static class ConscryptProviderHolder {
      private static final java.security.Provider INSTANCE = createProvider();

      private static java.security.Provider createProvider() {
        try {
          return Conscrypt.newProvider();
        } catch (Throwable t) {
          LOG.log(
              Level.FINE,
              "Conscrypt native libraries not available. Falling back to JDK TLS.",
              t);
          return null;
        }
      }
    }
References
  1. Prefer lazy initialization over eager initialization for resource-intensive objects (such as CharsetEncoder) if they are not guaranteed to be used in all execution paths, to avoid unnecessary performance and memory overhead.

Comment on lines +88 to +114
NetHttpTransport.Builder builder = new NetHttpTransport.Builder();
try {
builder
.setSecurityProvider(Conscrypt.newProvider())
.setSslSocketConfigurator(
socket -> {
if (Conscrypt.isConscrypt(socket)) {
try {
Conscrypt.setNamedGroups(socket, PQC_GROUPS);
} catch (Throwable t) {
// Catch runtime socket configuration errors (e.g. version mismatch or JNI
// error)
// and fall back to Conscrypt's default TLS groups without failing the
// request.
LOG.log(
Level.FINE,
"Failed to set PQC named groups on Conscrypt socket. Falling back to"
+ " Conscrypt default TLS groups.",
t);
}
}
});
} catch (Throwable t) {
LOG.log(
Level.FINE, "Conscrypt native libraries not available. Falling back to JDK TLS.", t);
builder = new NetHttpTransport.Builder();
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

Use the cached Conscrypt provider instance from ConscryptProviderHolder instead of creating a new provider instance on every call to create(). This avoids unnecessary performance and memory overhead.

      NetHttpTransport.Builder builder = new NetHttpTransport.Builder();
      java.security.Provider conscryptProvider = ConscryptProviderHolder.INSTANCE;
      if (conscryptProvider != null) {
        builder
            .setSecurityProvider(conscryptProvider)
            .setSslSocketConfigurator(
                socket -> {
                  if (Conscrypt.isConscrypt(socket)) {
                    try {
                      Conscrypt.setNamedGroups(socket, PQC_GROUPS);
                    } catch (Throwable t) {
                      // Catch runtime socket configuration errors (e.g. version mismatch or JNI
                      // error)
                      // and fall back to Conscrypt's default TLS groups without failing the
                      // request.
                      LOG.log(
                          Level.FINE,
                          "Failed to set PQC named groups on Conscrypt socket. Falling back to"
                              + " Conscrypt default TLS groups.",
                          t);
                    }
                  }
                });
      }
References
  1. Prefer lazy initialization over eager initialization for resource-intensive objects (such as CharsetEncoder) if they are not guaranteed to be used in all execution paths, to avoid unnecessary performance and memory overhead.

@lqiu96
lqiu96 force-pushed the pqc-httpjson-support branch from 218f3e6 to 1a08829 Compare July 21, 2026 21:54
}
try {
Conscrypt.setNamedGroups(socket, DEFAULT_PQC_GROUPS);
} catch (Throwable t) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are there known checked exceptions? If not, catching Exception is fine but catching Throwable might hide larger problems. e.g. Even if a version mismatch is ignored here, it might blow up in other places.

*
* <p>Returns {@code null} on failure so that transport creation can fall back to default JDK TLS,
* ensuring that setting Conscrypt as the default security provider does not cause breaking
* failures for customers running on environments where Conscrypt is unsupported or unavailable.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where Conscrypt is unsupported

What error would we run into?


public static class DefaultHttpTransportFactory implements HttpTransportFactory {

private static final Logger LOG = Logger.getLogger(DefaultHttpTransportFactory.class.getName());

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is java-core already dependent on gax-httpjson?

* standard TLS 1.3 endpoints if ML-KEM is not negotiated.
* </ul>
*/
public static final String[] DEFAULT_PQC_GROUPS =

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need to be public?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removed visibility (public was a remnant from an older change)

lqiu96 added 25 commits July 22, 2026 17:30
…t exception and restore HttpTransportOptionsTest to main
@lqiu96
lqiu96 force-pushed the pqc-httpjson-support branch from b27c1ca to 50e0e64 Compare July 22, 2026 17:31
@sonarqubecloud

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed for 'gapic-generator-java-root'

Failed conditions
57.9% Coverage on New Code (required ≥ 80%)

See analysis details on SonarQube Cloud

@sonarqubecloud

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed for 'gapic-generator-java-root'

Failed conditions
0.0% Coverage on New Code (required ≥ 80%)

See analysis details on SonarQube Cloud

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants