Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Nov 9, 2023

• Add support for request rescheduling (#319)

  Show description for 889585c
  krishung5

  authored
  889585c

  Copy full SHA for 889585c

Commits on Nov 8, 2023

• Follow up to autocomplete pr #317 (#320)

  Show description for 60a9091
  oandreeva-nv

  authored
  60a9091

  Copy full SHA for 60a9091

Commits on Oct 25, 2023

• Optimize GPU tensor support for Python backend (#293)

  Show description for 4c0a977
  krishung5

  authored
  4c0a977

  Copy full SHA for 4c0a977

Commits on Oct 12, 2023

• Restructure cleaning up of the futures in decoupled mode (#309)

  Show description for a2e8f9b
  Tabrizian

  authored
  a2e8f9b

  Copy full SHA for a2e8f9b

Commits on Oct 7, 2023

• Add logic to handle Python-based backends instead of platform handlers (#303)

  oandreeva-nv

  authored
  cd68026

  Copy full SHA for cd68026

Commits on Oct 6, 2023

• Add Python backend request cancellation (#304)

  Show description for 67ca860
  kthui

  authored
  67ca860

  Copy full SHA for 67ca860

Commits on Sep 13, 2023

• Fix returning error when tracing is off (#295)

  oandreeva-nv

  authored
  f4e24d7

  Copy full SHA for f4e24d7

Commits on Sep 2, 2023

• Enable Python execute() to return Triton error code (#292)

  Show description for 66f5e1e
  kthui

  authored
  66f5e1e

  Copy full SHA for 66f5e1e

Commits on Aug 22, 2023

• Reduce the default required shm size to 1MB (#291)

  Show description for 6f369ef
  Tabrizian

  authored
  6f369ef

  Copy full SHA for 6f369ef

Commits on Aug 8, 2023

• Use constructor to define InferenceTrace default value (#286)

  krishung5

  authored
  0476ee4

  Copy full SHA for 0476ee4

Commits on Aug 7, 2023

• Adding the support tracing of child models invoked from a BLS model (#277)

  Show description for 3ac4eb1
  oandreeva-nv

  authored
  3ac4eb1

  Copy full SHA for 3ac4eb1

Commits on Aug 1, 2023

• Enable parallel instance loading backend attribute (#284)

  rmccorm4

  authored
  823f628

  Copy full SHA for 823f628

Commits on Jul 8, 2023

• Fallback to CPU tensors if cuInit call fails (#270)

  Show description for d448340
  

  tanmayv25

  and

  Tabrizian

  authored
  d448340

  Copy full SHA for d448340

Commits on Jul 7, 2023

• Interfacing with platform models, support TF model serving

  tanmayv25

  committed
  34cc89f

  Copy full SHA for 34cc89f

Commits on Jun 29, 2023

• Model loading API for Python BLS (#262)

  Show description for c48fd37
  krishung5

  authored
  c48fd37

  Copy full SHA for c48fd37

Commits on Jun 27, 2023

• Add GitHub action to format and lint code (#265)

  Show description for 902df12
  the-david-oy

  authored
  902df12

  Copy full SHA for 902df12

Commits on Jun 22, 2023

• Auto-format (#261)

  the-david-oy

  authored
  5bd5048

  Copy full SHA for 5bd5048

Commits on Jun 6, 2023

• Fix error handling for GPU tensors (#249)

  Show description for 0a54e59
  Tabrizian

  authored
  0a54e59

  Copy full SHA for 0a54e59

Commits on May 4, 2023

• Implement custom metrics API (#235)

  Show description for 894b074
  krishung5

  authored
  894b074

  Copy full SHA for 894b074

Commits on May 2, 2023

• Remove unnecessary round of communication between parent and stub processes (#240)

  krishung5

  authored
  cf5810b

  Copy full SHA for cf5810b

Commits on Mar 30, 2023

• Add healthiness check to avoid hanging during model initialization (#221)

  Show description for 1b6fa77
  krishung5

  authored
  1b6fa77

  Copy full SHA for 1b6fa77

Commits on Mar 15, 2023

• Add request parameters to Python models (#213)

  Show description for 7f5f32e
  Tabrizian

  authored
  7f5f32e

  Copy full SHA for 7f5f32e

Commits on Mar 8, 2023

• Enhancement for BLS decoupled support (#208)

  Show description for 23d2b8f
  krishung5

  authored
  23d2b8f

  Copy full SHA for 23d2b8f

Commits on Feb 11, 2023

• Add decoupled support for BLS (#203)

  Show description for 0aef2c4
  krishung5

  authored
  0aef2c4

  Copy full SHA for 0aef2c4

Commits on Dec 14, 2022

• Fix GPU buffers when dynamic batching is enabled (#199)

  Tabrizian

  authored
  54c693e

  Copy full SHA for 54c693e

Commits on Aug 24, 2022

• Implement GetBackendAttribute to provide instance kind hint (#181)

  Show description for f11762e
  GuanLuo

  authored
  f11762e

  Copy full SHA for f11762e

Commits on Aug 17, 2022

• Extend Logging to the python backend (#178)

  Show description for 5b2c1a1
  

  fpetrini15

  and

  rmccorm4

  authored
  5b2c1a1

  Copy full SHA for 5b2c1a1

Commits on Jul 14, 2022

• Fix requested output names (#173)

  Show description for ae297ac
  Tabrizian

  authored
  ae297ac

  Copy full SHA for ae297ac

Commits on Jul 8, 2022

• Use the SetModelConfig backend utility (#172)

  tanmayv25

  authored
  7a6d46d

  Copy full SHA for 7a6d46d

Commits on Jun 6, 2022

• Fix deferred callback when there is an error (#164)

  Tabrizian

  authored
  b106301

  Copy full SHA for b106301

• Add request statistic reporting for decoupled mode (#163)

  Tabrizian

  authored
  73fdcda

  Copy full SHA for 73fdcda

Commits on Jun 1, 2022

• Python models should have API where they can provide max_batch/inputs/outputs for auto-complete (#138)

  Show description for b521096
  krishung5

  authored
  b521096

  Copy full SHA for b521096

Loading