AsyncHtmlLoaderWrapper
Python template · sinapsis_langchain_readers.templates.langchain_data_readers
Overview
Dynamic Template to load documents from Langchain document_loaders module The template loads the document either as a Document object in the generic_data field of DataContainer of each string as a TextPacket if add_document_as_text_packet is set as True
AsyncHtmlLoader — inherited documentation
Load `HTML` asynchronously.Initialize with a webpage path.
Capabilities
Capabilities: not setInstallation
Install the published package using pip or uv.
pip install sinapsis_langchain_readers==1.0.0uv pip install sinapsis_langchain_readers==1.0.0uv add sinapsis_langchain_readers==1.0.0Configuration
Effective fields from the inspector schema, including nested Pydantic model fields.
Optional
Default: null
Required
Default: null
Optional
Default: null
Optional
Default: null
Optional
Default: null
Optional
Default: false
Optional
Default: true
Optional
Default: "html.parser"
Optional
Default: true
Optional
Default: null
Optional
Default: null
Optional
Default: true
Optional
Default: false
Optional
Default: false
Optional
Default: 2
Whether to add document as text packet or not. asynchtmlloader_init web_path typing.Union[str, typing.List[str]]: default: None header_template typing.Optional[dict]: default: None verify_ssl typing.Optional[bool]:… Read full field description
Whether to add document as text packet or not. asynchtmlloader_init web_path typing.Union[str, typing.List[str]]: default: None header_template typing.Optional[dict]: default: None verify_ssl typing.Optional[bool]: default: True proxies typing.Optional[dict]: default: None autoset_encoding <class 'bool'>: default: True encoding typing.Optional[str]: default: None default_parser <class 'str'>: default: html.parser requests_per_second <class 'int'>: default: 2 requests_kwargs typing.Optional[typing.Dict[str, typing.Any]]: default: None raise_for_status <class 'bool'>: default: False ignore_load_errors <class 'bool'>: default: False preserve_order <class 'bool'>: default: True trust_env <class 'bool'>: default: False
Optional
Default: false
Configuration example
Generated from documented defaults. Replace any placeholders and complete required nested settings before running.
templates:
- template_name: "AsyncHtmlLoaderWrapper"
class_name: "AsyncHtmlLoaderWrapper"
attributes:
asynchtmlloader_init:
proxies: null
encoding: null
web_path: null
trust_env: false
verify_ssl: true
default_parser: "html.parser"
preserve_order: true
header_template: null
requests_kwargs: null
autoset_encoding: true
raise_for_status: false
ignore_load_errors: false
requests_per_second: 2
add_document_as_text_packet: false
View original docstring example
The source example references WikipediaLoaderWrapper, not AsyncHtmlLoaderWrapper.
agent:
name: my_test_agent
templates:
- template_name: InputTemplate
class_name: InputTemplate
attributes: {}
- template_name: WikipediaLoaderWrapper
class_name: WikipediaLoaderWrapper ## note that because it is a dynamic template,
template_input: InputTemplate ## the class name depends on the actual class that is used.
attributes:
add_document_as_text_packet: false
wikipedialoader_init:
query: the query for wikipedia
lang: en
load_max_docs: 5000
load_all_available_meta: False
doc_content_chars_max: 4000Inheritance
sinapsis_langchain_readers.templates.langchain_data_readers.LangChainDataReaderBaseEnvironment variables
Environment definitions belong to their canonical Python modules.