GitHub

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently ...

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor ...
GitHub

Segmentation fault on shutdown when using Python backend metrics

When shutting down the Triton Inference Server with Python backend while using Triton metrics, a segmentation fault occurs in python_backend process. This happens because Metric::Clear attempts to ...
IEEE

FD-DeCap: A Front-Door Causal Inference-based Framework for Debiasing Automatic Audio Captioning

Abstract: Automatic Audio Captioning (AAC) aims at generating natural language descriptions for audio content. However, existing methods are often affected by latent confounders and spurious ...