Documentation
Templates
Discover building blocks across the AI ecosystem. Browse by repository folder in the Templates sidebar, or search by template class, name, package, and tags.
◇ vLLMvLLMBatchTextCompletion ↗
Template for batched text completion using vLLM's continuous batching engine.
sinapsis-vllm
◇ vLLMvLLMMultiModal ↗Template for multimodal (text + image) completion using vLLM.
sinapsis-vllm
◇ vLLMvLLMStreamingTextCompletion ↗Streaming version of the vLLM text completion template.
sinapsis-vllm
◇ vLLMvLLMTextCompletion ↗Template for configuring and running a vLLM-based text completion model.
sinapsis-vllm