Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jun 6, 2024

• Add support for response sender in the default mode (#364)

  Show description for 27f04d1
  kthui

  authored
  27f04d1

  Copy full SHA for 27f04d1

Commits on Apr 11, 2024

• Decoupled Async Execute (#350)

  Show description for 0cdcaf3
  kthui

  authored
  0cdcaf3

  Copy full SHA for 0cdcaf3

Commits on Apr 8, 2024

• Randomize Python backend shared memory region naming (#351)

  Show description for 4d42111
  Tabrizian

  authored
  4d42111

  Copy full SHA for 4d42111

Commits on Mar 15, 2024

• Exposing trace context to python backend (#346)

  Show description for 474fb30
  oandreeva-nv

  authored
  474fb30

  Copy full SHA for 474fb30

Commits on Mar 12, 2024

• Delete TRITONSERVER_Error (#345)

  pskiran1

  authored
  537571b

  Copy full SHA for 537571b

Commits on Mar 11, 2024

• Add Correlation Id string support for BLS (#344)

  Show description for 8917c86
  pskiran1

  authored
  8917c86

  Copy full SHA for 8917c86

Commits on Feb 8, 2024

• Python Backend Windows Support (#294)

  Show description for ba616e2
  fpetrini15

  authored
  ba616e2

  Copy full SHA for ba616e2

Commits on Feb 1, 2024

• Add double parameter handling (#333)

  Show description for 0371eb8
  fpetrini15

  authored
  0371eb8

  Copy full SHA for 0371eb8

Commits on Jan 19, 2024

• Improve decoupled shm handling (#337)

  Show description for 37d2902
  kthui

  authored
  37d2902

  Copy full SHA for 37d2902

Commits on Dec 19, 2023

• Update name of ipc message type (#329)

  krishung5

  authored
  950c47f

  Copy full SHA for 950c47f

Commits on Dec 15, 2023

• Fix segfault for decoupled models (#327)

  Show description for c5f304d
  krishung5

  authored
  c5f304d

  Copy full SHA for c5f304d

Commits on Dec 8, 2023

• Fix BLS decoupled segfault and hang (#325)

  Show description for 8b0fa4c
  krishung5

  authored
  8b0fa4c

  Copy full SHA for 8b0fa4c

Commits on Dec 4, 2023

• BLS Timeout Fix (#315)

  Show description for ffbac67
  fpetrini15

  authored
  ffbac67

  Copy full SHA for ffbac67

Commits on Nov 9, 2023

• Add support for request rescheduling (#319)

  Show description for 889585c
  krishung5

  authored
  889585c

  Copy full SHA for 889585c

Commits on Nov 8, 2023

• Follow up to autocomplete pr #317 (#320)

  Show description for 60a9091
  oandreeva-nv

  authored
  60a9091

  Copy full SHA for 60a9091

Commits on Oct 25, 2023

• Optimize GPU tensor support for Python backend (#293)

  Show description for 4c0a977
  krishung5

  authored
  4c0a977

  Copy full SHA for 4c0a977

Commits on Oct 12, 2023

• Restructure cleaning up of the futures in decoupled mode (#309)

  Show description for a2e8f9b
  Tabrizian

  authored
  a2e8f9b

  Copy full SHA for a2e8f9b

Commits on Oct 7, 2023

• Add logic to handle Python-based backends instead of platform handlers (#303)

  oandreeva-nv

  authored
  cd68026

  Copy full SHA for cd68026

Commits on Oct 6, 2023

• Add Python backend request cancellation (#304)

  Show description for 67ca860
  kthui

  authored
  67ca860

  Copy full SHA for 67ca860

Commits on Sep 13, 2023

• Fix returning error when tracing is off (#295)

  oandreeva-nv

  authored
  f4e24d7

  Copy full SHA for f4e24d7

Commits on Sep 2, 2023

• Enable Python execute() to return Triton error code (#292)

  Show description for 66f5e1e
  kthui

  authored
  66f5e1e

  Copy full SHA for 66f5e1e

Commits on Aug 22, 2023

• Reduce the default required shm size to 1MB (#291)

  Show description for 6f369ef
  Tabrizian

  authored
  6f369ef

  Copy full SHA for 6f369ef

Commits on Aug 8, 2023

• Use constructor to define InferenceTrace default value (#286)

  krishung5

  authored
  0476ee4

  Copy full SHA for 0476ee4

Commits on Aug 7, 2023

• Adding the support tracing of child models invoked from a BLS model (#277)

  Show description for 3ac4eb1
  oandreeva-nv

  authored
  3ac4eb1

  Copy full SHA for 3ac4eb1

Commits on Aug 1, 2023

• Enable parallel instance loading backend attribute (#284)

  rmccorm4

  authored
  823f628

  Copy full SHA for 823f628

Commits on Jul 8, 2023

• Fallback to CPU tensors if cuInit call fails (#270)

  Show description for d448340
  

  tanmayv25

  and

  Tabrizian

  authored
  d448340

  Copy full SHA for d448340

Commits on Jul 7, 2023

• Interfacing with platform models, support TF model serving

  tanmayv25

  committed
  34cc89f

  Copy full SHA for 34cc89f

Commits on Jun 29, 2023

• Model loading API for Python BLS (#262)

  Show description for c48fd37
  krishung5

  authored
  c48fd37

  Copy full SHA for c48fd37

Commits on Jun 27, 2023

• Add GitHub action to format and lint code (#265)

  Show description for 902df12
  the-david-oy

  authored
  902df12

  Copy full SHA for 902df12

Commits on Jun 22, 2023

• Auto-format (#261)

  the-david-oy

  authored
  5bd5048

  Copy full SHA for 5bd5048

Commits on Jun 6, 2023

• Fix error handling for GPU tensors (#249)

  Show description for 0a54e59
  Tabrizian

  authored
  0a54e59

  Copy full SHA for 0a54e59

Commits on May 4, 2023

• Implement custom metrics API (#235)

  Show description for 894b074
  krishung5

  authored
  894b074

  Copy full SHA for 894b074

Commits on May 2, 2023

• Remove unnecessary round of communication between parent and stub processes (#240)

  krishung5

  authored
  cf5810b

  Copy full SHA for cf5810b

Commits on Mar 30, 2023

• Add healthiness check to avoid hanging during model initialization (#221)

  Show description for 1b6fa77
  krishung5

  authored
  1b6fa77

  Copy full SHA for 1b6fa77

Commits on Mar 15, 2023

• Add request parameters to Python models (#213)

  Show description for 7f5f32e
  Tabrizian

  authored
  7f5f32e

  Copy full SHA for 7f5f32e