Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Oct 8, 2024

• Add back 24.05 response sending path to fix performance (#381)

  Show description for a2564ea
  

  krishung5

  and

  Tabrizian

  authored
  a2564ea

  Copy full SHA for a2564ea

Commits on Jun 6, 2024

• Add support for response sender in the default mode (#364)

  Show description for 27f04d1
  kthui

  authored
  27f04d1

  Copy full SHA for 27f04d1

Commits on Apr 11, 2024

• Decoupled Async Execute (#350)

  Show description for 0cdcaf3
  kthui

  authored
  0cdcaf3

  Copy full SHA for 0cdcaf3

Commits on Feb 8, 2024

• Python Backend Windows Support (#294)

  Show description for ba616e2
  fpetrini15

  authored
  ba616e2

  Copy full SHA for ba616e2

Commits on Dec 19, 2023

• Update name of ipc message type (#329)

  krishung5

  authored
  950c47f

  Copy full SHA for 950c47f

Commits on Dec 15, 2023

• Fix segfault for decoupled models (#327)

  Show description for c5f304d
  krishung5

  authored
  c5f304d

  Copy full SHA for c5f304d

Commits on Dec 8, 2023

• Fix BLS decoupled segfault and hang (#325)

  Show description for 8b0fa4c
  krishung5

  authored
  8b0fa4c

  Copy full SHA for 8b0fa4c

Commits on Nov 9, 2023

• Add support for request rescheduling (#319)

  Show description for 889585c
  krishung5

  authored
  889585c

  Copy full SHA for 889585c

Commits on Nov 8, 2023

• Follow up to autocomplete pr #317 (#320)

  Show description for 60a9091
  oandreeva-nv

  authored
  60a9091

  Copy full SHA for 60a9091

Commits on Oct 25, 2023

• Optimize GPU tensor support for Python backend (#293)

  Show description for 4c0a977
  krishung5

  authored
  4c0a977

  Copy full SHA for 4c0a977

Commits on Oct 7, 2023

• Add logic to handle Python-based backends instead of platform handlers (#303)

  oandreeva-nv

  authored
  cd68026

  Copy full SHA for cd68026

Commits on Oct 6, 2023

• Add Python backend request cancellation (#304)

  Show description for 67ca860
  kthui

  authored
  67ca860

  Copy full SHA for 67ca860

Commits on Jul 7, 2023

• Interfacing with platform models, support TF model serving

  tanmayv25

  committed
  34cc89f

  Copy full SHA for 34cc89f

Commits on Jun 29, 2023

• Model loading API for Python BLS (#262)

  Show description for c48fd37
  krishung5

  authored
  c48fd37

  Copy full SHA for c48fd37

Commits on Jun 22, 2023

• Auto-format (#261)

  the-david-oy

  authored
  5bd5048

  Copy full SHA for 5bd5048

Commits on May 4, 2023

• Implement custom metrics API (#235)

  Show description for 894b074
  krishung5

  authored
  894b074

  Copy full SHA for 894b074

Commits on Mar 30, 2023

• Add healthiness check to avoid hanging during model initialization (#221)

  Show description for 1b6fa77
  krishung5

  authored
  1b6fa77

  Copy full SHA for 1b6fa77

Commits on Mar 17, 2023

• Fix shared_ptr thread-safe issue for InferResponseComplete callback (#215)

  Show description for bdf75da
  krishung5

  authored
  bdf75da

  Copy full SHA for bdf75da

Commits on Mar 8, 2023

• Enhancement for BLS decoupled support (#208)

  Show description for 23d2b8f
  krishung5

  authored
  23d2b8f

  Copy full SHA for 23d2b8f

Commits on Feb 11, 2023

• Add decoupled support for BLS (#203)

  Show description for 0aef2c4
  krishung5

  authored
  0aef2c4

  Copy full SHA for 0aef2c4

Commits on Aug 17, 2022

• Extend Logging to the python backend (#178)

  Show description for 5b2c1a1
  

  fpetrini15

  and

  rmccorm4

  authored
  5b2c1a1

  Copy full SHA for 5b2c1a1

Commits on Jun 6, 2022

• Add request statistic reporting for decoupled mode (#163)

  Tabrizian

  authored
  73fdcda

  Copy full SHA for 73fdcda

Commits on Jun 1, 2022

• Python models should have API where they can provide max_batch/inputs/outputs for auto-complete (#138)

  Show description for b521096
  krishung5

  authored
  b521096

  Copy full SHA for b521096

Loading