Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jun 7, 2024

• fix: [precaution fix] Capture Python futures while running in the background (#365)

  Show description for ebc8c6c
  kthui

  authored
  ebc8c6c

  Copy full SHA for ebc8c6c

Commits on Jun 6, 2024

• Add support for response sender in the default mode (#364)

  Show description for 27f04d1
  kthui

  authored
  27f04d1

  Copy full SHA for 27f04d1

Commits on May 9, 2024

• Add error handling in case of AutocompleteStub Failure for DLIS-5819 (#356)

  Show description for 9d2c513
  indrajit96

  authored
  9d2c513

  Copy full SHA for 9d2c513

Commits on Apr 16, 2024

• Reset async_event_loop_ only if initialized (#354)

  kthui

  authored
  ad4a440

  Copy full SHA for ad4a440

Commits on Apr 11, 2024

• Decoupled Async Execute (#350)

  Show description for 0cdcaf3
  kthui

  authored
  0cdcaf3

  Copy full SHA for 0cdcaf3

Commits on Apr 8, 2024

• Randomize Python backend shared memory region naming (#351)

  Show description for 4d42111
  Tabrizian

  authored
  4d42111

  Copy full SHA for 4d42111

Commits on Mar 15, 2024

• Exposing trace context to python backend (#346)

  Show description for 474fb30
  oandreeva-nv

  authored
  474fb30

  Copy full SHA for 474fb30

Commits on Mar 12, 2024

• Delete TRITONSERVER_Error (#345)

  pskiran1

  authored
  537571b

  Copy full SHA for 537571b

Commits on Mar 11, 2024

• Add Correlation Id string support for BLS (#344)

  Show description for 8917c86
  pskiran1

  authored
  8917c86

  Copy full SHA for 8917c86

Commits on Feb 8, 2024

• Python Backend Windows Support (#294)

  Show description for ba616e2
  fpetrini15

  authored
  ba616e2

  Copy full SHA for ba616e2

Commits on Feb 1, 2024

• Add double parameter handling (#333)

  Show description for 0371eb8
  fpetrini15

  authored
  0371eb8

  Copy full SHA for 0371eb8

Commits on Jan 19, 2024

• Improve decoupled shm handling (#337)

  Show description for 37d2902
  kthui

  authored
  37d2902

  Copy full SHA for 37d2902

Commits on Jan 11, 2024

• Clean up response iterator map properly (#335)

  krishung5

  authored
  4ee0fce

  Copy full SHA for 4ee0fce

Commits on Dec 19, 2023

• Update name of ipc message type (#329)

  krishung5

  authored
  950c47f

  Copy full SHA for 950c47f

Commits on Dec 18, 2023

• Fix warning for GPU tensors (#330)

  Tabrizian

  authored
  7551f03

  Copy full SHA for 7551f03

Commits on Dec 15, 2023

• Fix segfault for decoupled models (#327)

  Show description for c5f304d
  krishung5

  authored
  c5f304d

  Copy full SHA for c5f304d

Commits on Dec 8, 2023

• Fix BLS decoupled segfault and hang (#325)

  Show description for 8b0fa4c
  krishung5

  authored
  8b0fa4c

  Copy full SHA for 8b0fa4c

Commits on Dec 4, 2023

• BLS Timeout Fix (#315)

  Show description for ffbac67
  fpetrini15

  authored
  ffbac67

  Copy full SHA for ffbac67

Commits on Nov 9, 2023

• Add support for request rescheduling (#319)

  Show description for 889585c
  krishung5

  authored
  889585c

  Copy full SHA for 889585c

Commits on Nov 8, 2023

• Follow up to autocomplete pr #317 (#320)

  Show description for 60a9091
  oandreeva-nv

  authored
  60a9091

  Copy full SHA for 60a9091

Commits on Nov 2, 2023

• Enhanced python_backend autocomplete (#317)

  Show description for 0f12211
  oandreeva-nv

  authored
  0f12211

  Copy full SHA for 0f12211

Commits on Nov 1, 2023

• Fixing pre-commit issue (#318)

  oandreeva-nv

  authored
  cba7ed3

  Copy full SHA for cba7ed3

Commits on Oct 26, 2023

• Include missing unordered_map in shm (#316)

  piotrm-nvidia

  authored
  f91cbe9

  Copy full SHA for f91cbe9

Commits on Oct 25, 2023

• Optimize GPU tensor support for Python backend (#293)

  Show description for 4c0a977
  krishung5

  authored
  4c0a977

  Copy full SHA for 4c0a977

Commits on Oct 24, 2023

• Add parameters support to InferenceRequest (#313)

  Show description for a8e6193
  kthui

  authored
  a8e6193

  Copy full SHA for a8e6193

Commits on Oct 12, 2023

• Restructure cleaning up of the futures in decoupled mode (#309)

  Show description for a2e8f9b
  Tabrizian

  authored
  a2e8f9b

  Copy full SHA for a2e8f9b

Commits on Oct 7, 2023

• Add logic to handle Python-based backends instead of platform handlers (#303)

  oandreeva-nv

  authored
  cd68026

  Copy full SHA for cd68026

Commits on Oct 6, 2023

• Add Python backend request cancellation (#304)

  Show description for 67ca860
  kthui

  authored
  67ca860

  Copy full SHA for 67ca860

Commits on Sep 26, 2023

• Fix response iterator memory leak (#302)

  Tabrizian

  authored
  b136bf3

  Copy full SHA for b136bf3

Commits on Sep 13, 2023

• Fix returning error when tracing is off (#295)

  oandreeva-nv

  authored
  f4e24d7

  Copy full SHA for f4e24d7

Commits on Sep 2, 2023

• Enable Python execute() to return Triton error code (#292)

  Show description for 66f5e1e
  kthui

  authored
  66f5e1e

  Copy full SHA for 66f5e1e

Commits on Aug 22, 2023

• Reduce the default required shm size to 1MB (#291)

  Show description for 6f369ef
  Tabrizian

  authored
  6f369ef

  Copy full SHA for 6f369ef

Commits on Aug 17, 2023

• Skip dimension of size 1 in contiguous checks. (#281)

  Show description for 0f2ce85
  MatthieuToulemont

  authored
  0f2ce85

  Copy full SHA for 0f2ce85

Commits on Aug 15, 2023

• Add PyTorch platform handler example (#287)

  Show description for 02c9c1c
  kthui

  authored
  02c9c1c

  Copy full SHA for 02c9c1c

Commits on Aug 8, 2023

• Use constructor to define InferenceTrace default value (#286)

  krishung5

  authored
  0476ee4

  Copy full SHA for 0476ee4