Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Feb 11, 2023

• Add decoupled support for BLS (#203)

  Show description for 0aef2c4
  krishung5

  authored
  0aef2c4

  Copy full SHA for 0aef2c4

Commits on Jan 26, 2023

• Atomically increase/read stub process count and fix random boost truncate fail (#205)

  Show description for 3297448
  kthui

  authored
  3297448

  Copy full SHA for 3297448

Commits on Jan 12, 2023

• Move child process code to before fork (#204)

  kthui

  authored
  00468e5

  Copy full SHA for 00468e5

Commits on Dec 29, 2022

• Make sure to use correct shared memory mapping before deallocation (#200)

  Show description for 62fe726
  Tabrizian

  authored
  62fe726

  Copy full SHA for 62fe726

Commits on Dec 14, 2022

• Fix GPU buffers when dynamic batching is enabled (#199)

  Tabrizian

  authored
  54c693e

  Copy full SHA for 54c693e

Commits on Nov 28, 2022

• Acquire GIL lock when releasing DLPack tensors (#198)

  Tabrizian

  authored
  685711d

  Copy full SHA for 685711d

Commits on Sep 29, 2022

• Fix the handling for empty GPU tensor (#187)

  Show description for fdf08af
  krishung5

  authored
  fdf08af

  Copy full SHA for fdf08af

Commits on Sep 13, 2022

• Fix Logging Segfault (#184)

  Show description for cdfd06d
  fpetrini15

  authored
  cdfd06d

  Copy full SHA for cdfd06d

Commits on Aug 26, 2022

• Python Logging Seg Fault Fix (#183)

  fpetrini15

  authored
  6b1d165

  Copy full SHA for 6b1d165

Commits on Aug 24, 2022

• Implement GetBackendAttribute to provide instance kind hint (#181)

  Show description for f11762e
  GuanLuo

  authored
  f11762e

  Copy full SHA for f11762e

Commits on Aug 17, 2022

• Extend Logging to the python backend (#178)

  Show description for 5b2c1a1
  

  fpetrini15

  and

  rmccorm4

  authored
  5b2c1a1

  Copy full SHA for 5b2c1a1

Commits on Jul 29, 2022

• model repository path bug fix (#180)

  erfaneshrati

  authored
  0d24fda

  Copy full SHA for 0d24fda

Commits on Jul 28, 2022

• Add OutputBufferQuery API (#179)

  krishung5

  authored
  f51d29f

  Copy full SHA for f51d29f

Commits on Jul 21, 2022

• Expose Tensor dims (#176)

  Show description for f5e1c9a
  fran6co

  authored
  f5e1c9a

  Copy full SHA for f5e1c9a

Commits on Jul 14, 2022

• Fix requested output names (#173)

  Show description for ae297ac
  Tabrizian

  authored
  ae297ac

  Copy full SHA for ae297ac

Commits on Jul 13, 2022

• Update docs in accordance with the new auto-complete-config behavior (#174)

  Show description for dccee59
  tanmayv25

  authored
  dccee59

  Copy full SHA for dccee59

Commits on Jul 8, 2022

• Use the SetModelConfig backend utility (#172)

  tanmayv25

  authored
  7a6d46d

  Copy full SHA for 7a6d46d

Commits on Jul 7, 2022

• Only return the requested output tensors (#170)

  fpetrini15

  authored
  e9e9c07

  Copy full SHA for e9e9c07

Commits on Jun 8, 2022

• Autocomplete sets dynamic batcher if no scheduler set. (#165)

  Show description for 3a60cfc
  nv-kmcgill53

  authored
  3a60cfc

  Copy full SHA for 3a60cfc

Commits on Jun 6, 2022

• Fix deferred callback when there is an error (#164)

  Tabrizian

  authored
  b106301

  Copy full SHA for b106301

• Add request statistic reporting for decoupled mode (#163)

  Tabrizian

  authored
  73fdcda

  Copy full SHA for 73fdcda

Commits on Jun 1, 2022

• Python models should have API where they can provide max_batch/inputs/outputs for auto-complete (#138)

  Show description for b521096
  krishung5

  authored
  b521096

  Copy full SHA for b521096

• Disable async BLS support in decoupled models (#157)

  Tabrizian

  authored
  03914b2

  Copy full SHA for 03914b2

• Allow FORCE_CPU_ONLY_INPUT to be off for decoupled (#158)

  Tabrizian

  authored
  6edcdd8

  Copy full SHA for 6edcdd8

Commits on May 28, 2022

• Improve decoupled API known issue failure (#155)

  Show description for 85613cf
  

  2 peopleauthored and

  mc-nv

  committed
  85613cf

  Copy full SHA for 85613cf

• Improve lifetime of NumPy objects (#149) (#151)

  Show description for 94a3ed2
  

  mc-nv

  and

  Tabrizian

  committed
  94a3ed2

  Copy full SHA for 94a3ed2

Commits on May 21, 2022

• Add GPU tensor support to decoupled API (#154)

  Tabrizian

  authored
  92245a7

  Copy full SHA for 92245a7

Commits on May 10, 2022

• Improve lifetime of NumPy objects (#149)

  Show description for b62f9f7
  Tabrizian

  authored
  b62f9f7

  Copy full SHA for b62f9f7

Commits on May 6, 2022

• Improve the GPU memory manager (#148)

  Tabrizian

  authored
  84a6405

  Copy full SHA for 84a6405

Commits on May 5, 2022

• Add support for flags in response send (#146)

  Show description for 4d889c7
  Tabrizian

  authored
  4d889c7

  Copy full SHA for 4d889c7

Commits on May 2, 2022

• Implement the decoupled API (#136)

  Show description for c434d47
  

  Tabrizian

  and

  tanmayv25

  authored
  c434d47

  Copy full SHA for c434d47

Commits on Apr 28, 2022

• Add TYPE_BF16 scaffolding (#141)

  Show description for 98ffa0a
  rmccorm4

  authored
  98ffa0a

  Copy full SHA for 98ffa0a

Commits on Apr 21, 2022

• Improve argument type checking (#134)

  Show description for 28c9226
  Tabrizian

  authored
  28c9226

  Copy full SHA for 28c9226

Commits on Apr 14, 2022

• Fix BLS performance (#135)

  Tabrizian

  authored
  b7cec48

  Copy full SHA for b7cec48

Commits on Apr 8, 2022

• Enable optional input support (#133)

  Tabrizian

  authored
  41d6460

  Copy full SHA for 41d6460