Skip to content

Add 'auto-detect schema' to bigquery snippet #2148

Closed
Closed
Add 'auto-detect schema' to bigquery snippet#2148
Assignees
garrettjonesgoogle
Labels
api: bigqueryIssues related to the BigQuery API.priority: p2Moderately-important priority. Fix may not be included in next release.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.

Description

@redwrasse
redwrasse
opened on Jun 14, 2017

Add a Java example of loading files from Cloud Storage to BigQuery with the schema not specified, eg. what is 'auto-detect schema' in the BigQuery UI. Cannot find any documentation for this or code examples by way of Google.

Current snippet example:
https://github.com/GoogleCloudPlatform/google-cloud-java/blob/master/google-cloud-examples/src/main/java/com/google/cloud/examples/bigquery/snippets/CreateTableAndLoadData.java

Activity

  1. neozwu
    added
    api: bigqueryIssues related to the BigQuery API.
    on Jun 16, 2017
  2. garrettjonesgoogle
    added
    docs
    type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.
    priority: p2Moderately-important priority. Fix may not be included in next release.
    on Jul 17, 2017

  3. garrettjonesgoogle commented on Jul 17, 2017

    @garrettjonesgoogle
    garrettjonesgoogle
    on Jul 17, 2017
    Contributor

    cc @lesv @tswast

  4. lesv commented on Jul 19, 2017

    @lesv
    lesv
    on Jul 19, 2017
    Contributor

    @tswast Can you do this?

  5. tswast commented on Jul 19, 2017

    @tswast
    tswast
    on Jul 19, 2017
    Contributor

    Added to my backlog.

    The gist is to set the autodetect parameter on the LoadJobConfiguration. http://googlecloudplatform.github.io/google-cloud-java/0.20.2/apidocs/index.html

    P.S. The autodetect parameter is no longer "experimental" in the REST API. The JavaDocs should get updated.

  6. garrettjonesgoogle commented on Aug 10, 2017

    @garrettjonesgoogle
    garrettjonesgoogle
    on Aug 10, 2017
    Contributor

    Closing this out since @tswast is tracking it on his own backlog.

  7. garrettjonesgoogle
    closed this as completedon Aug 10, 2017

  8. TJC commented on Aug 3, 2018

    @TJC
    TJC
    on Aug 3, 2018

    Hey all -- it's been about 13 months since this issue was opened -- and it's a high hit for the Google Search on how to enable autodetection. I still can't see how to do this in the example snippets, or the documentation.

    Any chance of a bump on this issue?

  9. tswast commented on Aug 3, 2018

    @tswast
    tswast
    on Aug 3, 2018
    Contributor

    @TJC thanks for the reminder. Yeah, I'll bump the priority.

  10. TJC commented on Aug 6, 2018

    @TJC
    TJC
    on Aug 6, 2018

    For anyone else who is coming across this issue with the same question -- here was my solution:

        val tableId = TableId.of("my_dataset", "my_table_name")
    val jobBuilder = LoadJobConfiguration.newBuilder(tableId, gcsUri)
    jobBuilder.setAutodetect(true)
    jobBuilder.setFormatOptions(FormatOptions.json())
    val loadJobCfg = jobBuilder.build()
    val loadJob = JobInfo.of(loadJobCfg)

  11. the-dagger commented on Oct 12, 2018

    @the-dagger
    the-dagger
    on Oct 12, 2018

    Bumping this since it hasn't been added yet.
    cc : @tswast

  12. JustinBeckwith
    assigned
    garrettjonesgoogle
    on Feb 1, 2021
  13. chingor13
    added a commit that references this issue on Feb 20, 2026

    chore(main): release 2.38.1-SNAPSHOT (#2148)

    22237a5
  14. suztomo
    added a commit that references this issue on Mar 23, 2026

    deps: update dependency com.fasterxml.jackson.core:jackson-databind t…

    38d059b
  15. meltsufin
    added 3 commits that reference this issue on Apr 29, 2026

    chore(deps): update dependency com.google.cloud:google-cloud-pubsub t…

    ad67413

    chore(deps): update dependency com.google.cloud:google-cloud-pubsub t…

    3e22c1a

    chore(main): release 3.31.7 (#2148)

    1184a5f
  16. benjaminp
    added a commit that references this issue on Jul 13, 2026

    chore(deps): update dependency com.google.cloud:google-cloud-bigtable…

    91bde12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the BigQuery API.priority: p2Moderately-important priority. Fix may not be included in next release.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions