Skip to content

BigQuery: Add dryrun option to magic. #8143

Closed

Description

@jpallas

The BQ API supports the dry_run option, but the ipython magic does not. It would be great if there were a parameter which, when set, would return the (sometimes vital) information about bytes to be read instead of running the query. This would help put the Jupyter environment on a par with the BQ console.

Activity

  1. added
    api: bigqueryIssues related to the BigQuery API.
    type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.
    on May 25, 2019
  2. changed the title [-]Add dryrun option to BigQuery magic[/-] [+]BigQuery: Add dryrun option to magic.[/+] on May 25, 2019
  3. tswast commented on Jun 3, 2019

    @tswast
    Contributor

    FYI: there's an open PR at #8179 which will add context.default_query_job_config, so that this will be possible to set globally.

    I agree that a parameter would make sense for this option. See #8179 for implementation and testing patterns.

  4. added
    good first issueThis issue is a good place to started contributing to this repository.
    on Jun 3, 2019
  5. tswast commented on Jun 4, 2019

    @tswast
    Contributor

    Likely for --dryrun queries we'll want to print out something other than an empty DataFrame the estimated bytes processed and maybe additional stats if relevant.

    Maybe return a QueryJob instead of a DataFrame for inspection.

  6. jpallas commented on Jun 4, 2019

    @jpallas
    Author

    Yes, my thinking was to provide (at least) the same cost feedback that the BQ console interface does.

  7. tswast commented on Aug 23, 2019

    @tswast
    Contributor

    Closed by #9067.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the BigQuery API.good first issueThis issue is a good place to started contributing to this repository.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions