Docs /Templates/ sinapsis_langchain_readers

AsyncHtmlLoaderWrapper

sinapsis_langchain_readersLangChaindocumentsdocument_loadingdynamicfiles

Python template · sinapsis_langchain_readers.templates.langchain_data_readers

Overview

Dynamic Template to load documents from Langchain document_loaders module The template loads the document either as a Document object in the generic_data field of DataContainer of each string as a TextPacket if add_document_as_text_packet is set as True

AsyncHtmlLoader — inherited documentation

Load `HTML` asynchronously.Initialize with a webpage path.

Capabilities

Capabilities: not set

Installation

Install the published package using pip or uv.

Terminalbash
pip install sinapsis_langchain_readers==1.0.0
uv pip install sinapsis_langchain_readers==1.0.0
uv add sinapsis_langchain_readers==1.0.0

Configuration

Effective fields from the inspector schema, including nested Pydantic model fields.

metadata
sinapsis_core.template_base.base_models.TemplateMetadata | None
Optional
Default: null
asynchtmlloader_initRequired
__init__Attributes
Required
Default: null
proxies
typing.Optional[dict]
Optional
Default: null
encoding
typing.Optional[str]
Optional
Default: null
web_path
typing.Union[str, typing.List[str]]
Optional
Default: null
trust_env
bool
Optional
Default: false
verify_ssl
typing.Optional[bool]
Optional
Default: true
default_parser
str
Optional
Default: "html.parser"
preserve_order
bool
Optional
Default: true
header_template
typing.Optional[dict]
Optional
Default: null
requests_kwargs
typing.Optional[typing.Dict[str, typing.Any]]
Optional
Default: null
autoset_encoding
bool
Optional
Default: true
raise_for_status
bool
Optional
Default: false
ignore_load_errors
bool
Optional
Default: false
requests_per_second
int
Optional
Default: 2
add_document_as_text_packet
Whether to add document as text packet or not. asynchtmlloader_init web_path typing.Union[str, typing.List[str]]: default: None header_template typing.Optional[dict]: default: None verify_ssl typing.Optional[bool]:… Read full field description

Whether to add document as text packet or not. asynchtmlloader_init web_path typing.Union[str, typing.List[str]]: default: None header_template typing.Optional[dict]: default: None verify_ssl typing.Optional[bool]: default: True proxies typing.Optional[dict]: default: None autoset_encoding <class 'bool'>: default: True encoding typing.Optional[str]: default: None default_parser <class 'str'>: default: html.parser requests_per_second <class 'int'>: default: 2 requests_kwargs typing.Optional[typing.Dict[str, typing.Any]]: default: None raise_for_status <class 'bool'>: default: False ignore_load_errors <class 'bool'>: default: False preserve_order <class 'bool'>: default: True trust_env <class 'bool'>: default: False

bool
Optional
Default: false

Configuration example

Generated from documented defaults. Replace any placeholders and complete required nested settings before running.

yaml
templates:
  - template_name: "AsyncHtmlLoaderWrapper"
    class_name: "AsyncHtmlLoaderWrapper"
    attributes:
      asynchtmlloader_init:
        proxies: null
        encoding: null
        web_path: null
        trust_env: false
        verify_ssl: true
        default_parser: "html.parser"
        preserve_order: true
        header_template: null
        requests_kwargs: null
        autoset_encoding: true
        raise_for_status: false
        ignore_load_errors: false
        requests_per_second: 2
      add_document_as_text_packet: false
View original docstring example

The source example references WikipediaLoaderWrapper, not AsyncHtmlLoaderWrapper.

yaml
agent:
  name: my_test_agent
templates:
- template_name: InputTemplate
  class_name: InputTemplate
  attributes: {}
- template_name: WikipediaLoaderWrapper
  class_name: WikipediaLoaderWrapper    ## note that because it is a dynamic template,
  template_input: InputTemplate         ##  the class name depends on the actual class that is used.
  attributes:
    add_document_as_text_packet: false
    wikipedialoader_init:
        query: the query for wikipedia
        lang: en
        load_max_docs: 5000
        load_all_available_meta: False
        doc_content_chars_max: 4000

Inheritance

Immediate parent: sinapsis_langchain_readers.templates.langchain_data_readers.LangChainDataReaderBase

Environment variables

Environment definitions belong to their canonical Python modules.

SINAPSIS_BUILD_DOCS · defined elsewhere