Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Feb 29, 2024

• [Serving] Fix syntax error in generate timeline tool. (#977)

  Show description for 186afd0
  candyzone

  authored
  186afd0

  Copy full SHA for 186afd0

Commits on May 26, 2023

• [Serving] Clear virtual_device configurations before load new checkpoint. (#871)

  Show description for f576e01
  shanshanpt

  authored
  f576e01

  Copy full SHA for f576e01

Commits on May 11, 2023

• [Serving] Optimize inference latency when load increment checkpoint. (#851)

  Show description for 630de92
  shanshanpt

  authored
  630de92

  Copy full SHA for 630de92

Commits on Apr 28, 2023

• [Serving] Add flag for device_placement_optimization. (#840)

  Show description for 023f255
  shanshanpt

  authored
  023f255

  Copy full SHA for 023f255

Commits on Apr 21, 2023

• [Serving] Enable INFERENCE_MODE in processor. (#825)

  Show description for 677757e
  shanshanpt

  authored
  677757e

  Copy full SHA for 677757e

Commits on Apr 6, 2023

• [BUILD] Support to build processor with bazel-5.3.1. (#795)

  shanshanpt

  authored
  32cd400

  Copy full SHA for 32cd400

Commits on Mar 23, 2023

• [BUILD] Update license in workspace.bzl and WORKSPACE. (#776)

  liutongxuan

  authored
  2e52165

  Copy full SHA for 2e52165

Commits on Mar 13, 2023

• [Serving] Use graph signature as the key to get runtime executor. (#743)

  shanshanpt

  authored
  424a0e4

  Copy full SHA for 424a0e4

Commits on Mar 8, 2023

• [Serving] Fix parse input request bug. (#736)

  shanshanpt

  authored
  138f0a1

  Copy full SHA for 138f0a1

Commits on Mar 6, 2023

• [Serving] Skip invalid request and return error msg to client. (#729)

  shanshanpt

  authored
  9b3e483

  Copy full SHA for 9b3e483

Commits on Feb 8, 2023

• [Serving] Support processor to set multi-stream option & update user documents. (#677)

  shanshanpt

  authored
  9e4daf4

  Copy full SHA for 9e4daf4

Commits on Feb 7, 2023

• [Serving] Support processor to use multiple GPUs. (#675)

  shanshanpt

  authored
  96e4a7b

  Copy full SHA for 96e4a7b

Commits on Feb 6, 2023

• [Inference] Support to setup gpu config in SessionGroup. #669

  shanshanpt

  authored
  c3a6561

  Copy full SHA for c3a6561

Commits on Jan 30, 2023

• [Embedding] Support same saver graph for EmbeddingVariable on GPU/CPU devices. (#659)

  lixy9474

  authored
  5a2e85e

  Copy full SHA for 5a2e85e

Commits on Jan 4, 2023

• [CIBUILD] Add gpu processor cibuild workflow. (#617)

  shanshanpt

  authored
  0bed5b6

  Copy full SHA for 0bed5b6

Commits on Dec 30, 2022

• [Serving] Support GPU compilation in processor. (#611)

  shanshanpt

  authored
  dbfdce6

  Copy full SHA for dbfdce6

Commits on Dec 28, 2022

• [Serving] Support processor to load multi-models. (#604)

  shanshanpt

  authored
  2be15f4

  Copy full SHA for 2be15f4

Commits on Dec 14, 2022

• [Runtime] Support multi-model deployment in SessionGroup. (#589)

  shanshanpt

  authored
  4b8c11f

  Copy full SHA for 4b8c11f

Commits on Nov 18, 2022

• [Serving] Fix function definition issue in processor. (#563)

  shanshanpt

  authored
  8670c92

  Copy full SHA for 8670c92

Commits on Nov 1, 2022

• [Serving] Fix warmup failed bug when use session_group. (#520)

  shanshanpt

  authored
  99ade19

  Copy full SHA for 99ade19

• [Serving] Use a unified custom thread pool. (#519)

  shanshanpt

  authored
  524e40b

  Copy full SHA for 524e40b

Commits on Oct 27, 2022

• [Serving] Fix warmup failed bug when user set warmup file path. (#507)

  shanshanpt

  authored
  ca77a04

  Copy full SHA for ca77a04

Commits on Oct 18, 2022

• [Serving] Support user to configure independent update model threadpool. (#487)

  shanshanpt

  authored
  e7fb5ab

  Copy full SHA for e7fb5ab

Commits on Oct 17, 2022

• [Serving] Return error status to user when parse request or repsonse failed. (#483)

  shanshanpt

  authored
  e66a652

  Copy full SHA for e66a652

Commits on Sep 29, 2022

• [Serving] Add serving configure args. (#464)

  shanshanpt

  authored
  0c5ef59

  Copy full SHA for 0c5ef59

Commits on Sep 27, 2022

• [BUILD] Replace deprecated sys_siglist with strsignal to avoid build failure with GLIBC2.35. (#459)

  liutongxuan

  authored
  39fc83c

  Copy full SHA for 39fc83c

Commits on Sep 13, 2022

• [Profiler] Add detail information for RecvTensor in timeline. (#433)

  JackMoriarty

  authored
  1964b50

  Copy full SHA for 1964b50

Commits on Sep 7, 2022

• [Serving] Support user defined storage size of multi-tier Embedding in serving. (#417)

  lixy9474

  authored
  269b95d

  Copy full SHA for 269b95d

Commits on Sep 1, 2022

• [Serving] Processor support serving from saved_model (#411)

  Show description for 843ae1a
  shanshanpt

  authored
  843ae1a

  Copy full SHA for 843ae1a

• [Serving] Fix processor compile issue. (#410)

  marvin-Yu

  authored
  093ffce

  Copy full SHA for 093ffce

Commits on Aug 30, 2022

• [Serving] Set the maximum number of attempts to load the latest model. (#407)

  shanshanpt

  authored
  4f8141d

  Copy full SHA for 4f8141d

Commits on Aug 28, 2022

• [Serving] Avoid loading invalid model when model update. (#400)

  shanshanpt

  authored
  b869a3e

  Copy full SHA for b869a3e

Commits on Aug 18, 2022

• [Serving] Normalize serving feed and fetch format. (#386)

  Show description for 2868b40
  shanshanpt

  authored
  2868b40

  Copy full SHA for 2868b40

Commits on Aug 17, 2022

• [Serving] Support multi-tiered Embedding configuration in serving. (#380)

  candyzone

  authored
  1b0a70b

  Copy full SHA for 1b0a70b

Commits on Aug 16, 2022

• [Runtime] Refactoring session group, add DirectSessionGroup. (#378)

  shanshanpt

  authored
  8b08bba

  Copy full SHA for 8b08bba