Skip to content

Table.exists hangs #2581

Closed
Closed
Table.exists hangs#2581
Assignees
anthmgoogle
Labels
api: bigtableIssues related to the Bigtable API.priority: p1Important issue which blocks shipping the next release. Will be fixed prior to next release.type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.

Description

@talonx
talonx
opened on Nov 6, 2017

I've a Bigtable client that connects to a local emulator. Lately it has started hanging on table.exists - the only thing that was updated recently was the emulator itself via apt. A thread dump reveals (client class names snipped at the bottom)

"main" #1 prio=5 os_prio=0 tid=0x00007ff678010000 nid=0x67c2 waiting on condition [0x00007ff67f143000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000007441b7ad0> (a com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation$GrpcFuture)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:469)
	at com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation.getBlockingResult(AbstractRetryingOperation.java:293)
	at com.google.cloud.bigtable.grpc.BigtableDataGrpcClient.readFlatRowsList(BigtableDataGrpcClient.java:327)
	at com.google.cloud.bigtable.hbase.BigtableTable.getResults(BigtableTable.java:257)
	at com.google.cloud.bigtable.hbase.BigtableTable.exists(BigtableTable.java:166)
..........

Subsequent thread dumps taken at 30 second intervals reveals the the thread is stuck at the same place.

Library versions:
google-cloud-core 1.8.0,
google-cloud-core-grpc 1.8.0,
google-cloud-core 1.8.0,
bigtable-hbase-1.x 1.0.0-pre3

gcloud version output:
Google Cloud SDK 177.0.0
alpha 2017.10.20
beta 2017.10.20
bigtable
bq 2.0.27
cbt
core 2017.10.20
gsutil 4.28
pubsub-emulator 2017.10.20

OS: Ubuntu 17.10

java -version output:
java version "1.8.0_102"
Java(TM) SE Runtime Environment (build 1.8.0_102-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.102-b14, mixed mode)

Activity

  1. talonx commented on Nov 6, 2017

    @talonx
    talonx
    on Nov 6, 2017
    Author

    After about 12 minutes, I get the following error -

    java.io.IOException: Failed to perform operation. Operation='checkAndMutate', projectId='emulator', tableName='mquery', rowKey='149de7d2-272b-4524-ace3-8d977da6faf6#27c893ee-b50c-4b47-b08f-f3824291a62a'
	at com.google.cloud.bigtable.hbase.BigtableTable.logAndCreateIOException(BigtableTable.java:522)
	at com.google.cloud.bigtable.hbase.BigtableTable.checkAndMutate(BigtableTable.java:470)
----snipped----
Caused by: io.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: deadline exceeded after 359999872003ns
	at io.grpc.Status.asRuntimeException(Status.java:517)
	at com.google.cloud.bigtable.grpc.async.AbstractRetryingOperation.getBlockingResult(AbstractRetryingOperation.java:300)
	at com.google.cloud.bigtable.grpc.BigtableDataGrpcClient.checkAndMutateRow(BigtableDataGrpcClient.java:267)
	at com.google.cloud.bigtable.hbase.BigtableTable.checkAndMutate(BigtableTable.java:467)
	... 32 common frames omitted

    This happens for each call. The 12-minute interval occurs in each case. It's brought my development to a grinding halt since I cannot use HBase/Bigtable at all.

  2. talonx commented on Nov 7, 2017

    @talonx
    talonx
    on Nov 7, 2017
    Author

    cloud-bigtable-client seems to be the appropriate repo for this issue - so I've logged it there - googleapis/java-bigtable-hbase#1529

  3. anthmgoogle
    added
    api: bigtableIssues related to the Bigtable API.
    priority: p1Important issue which blocks shipping the next release. Will be fixed prior to next release.
    type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.
    on Nov 8, 2017

  4. anthmgoogle commented on Nov 8, 2017

    @anthmgoogle
    anthmgoogle
    on Nov 8, 2017

    Since this is in the HBase client outside this repo and the issue has been created in the right repo, closing this issue out.

  5. anthmgoogle
    closed this as completedon Nov 8, 2017
  6. JustinBeckwith
    assigned
    anthmgoogle
    on Feb 1, 2021
  7. chingor13
    added a commit that references this issue on Feb 20, 2026

    chore: add plumbing to allow customer to enable reporting OT metrics (#…

    9839d4d
  8. chingor13
    added 2 commits that reference this issue on Mar 24, 2026

    chore(main): release 2.38.1 (#2581)

    48b9b44

    chore(deps): update dependency com.google.cloud:google-cloud-storage-…

    1feebc2
  9. rahul2393
    added a commit that references this issue on May 21, 2026

    deps: update googleapis/sdk-platform-java action to v2.58.0 (googleap…

    e46cecb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

api: bigtableIssues related to the Bigtable API.priority: p1Important issue which blocks shipping the next release. Will be fixed prior to next release.type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions