Docs /Templates/ sinapsis_langchain_readers

IMSDbLoaderExecuteNTimes

sinapsis_langchain_readersLangChaindocumentsdocument_loadingdynamicfiles

Python template · sinapsis_langchain_readers.templates.langchain_data_readers

Overview

Dynamic Template to load documents from Langchain document_loaders module The template loads the document either as a Document object in the generic_data field of DataContainer of each string as a TextPacket if add_document_as_text_packet is set as True

IMSDbLoader — inherited documentation

Load `IMSDb` webpages.Initialize loader.

Args: web_paths: Web paths to load from. requests_per_second: Max number of concurrent requests to make. default_parser: Default parser to use for BeautifulSoup. requests_kwargs: kwargs for requests raise_for_status: Raise an exception if http status code denotes an error. bs_get_text_kwargs: kwargs for beatifulsoup4 get_text bs_kwargs: kwargs for beatifulsoup4 web page parsing show_progress: Show progress bar when loading pages. trust_env: set to True if using proxy to make web requests, for example using http(s)_proxy environment variables. Defaults to False.

Capabilities

Capabilities: not set

Installation

Install the published package using pip or uv.

Terminalbash
pip install sinapsis_langchain_readers==1.0.0
uv pip install sinapsis_langchain_readers==1.0.0
uv add sinapsis_langchain_readers==1.0.0

Configuration

Effective fields from the inspector schema, including nested Pydantic model fields.

metadata
sinapsis_core.template_base.base_models.TemplateMetadata | None
Optional
Default: null
n_times_execute
int
Optional
Default: 1
imsdbloader_initRequired
__init__Attributes
Required
Default: null
proxies
typing.Optional[dict]
Optional
Default: null
session
Any
Optional
Default: null
encoding
typing.Optional[str]
Optional
Default: null
web_path
typing.Union[str, typing.Sequence[str]]
Optional
Default: ""
bs_kwargs
typing.Optional[typing.Dict[str, typing.Any]]
Optional
Default: null
trust_env
bool
Optional
Default: false
web_paths
typing.Sequence[str]
Optional
Default: []
verify_ssl
bool
Optional
Default: true
show_progress
bool
Optional
Default: true
default_parser
str
Optional
Default: "html.parser"
header_template
typing.Optional[dict]
Optional
Default: null
requests_kwargs
typing.Optional[typing.Dict[str, typing.Any]]
Optional
Default: null
autoset_encoding
bool
Optional
Default: true
raise_for_status
bool
Optional
Default: false
bs_get_text_kwargs
typing.Optional[typing.Dict[str, typing.Any]]
Optional
Default: null
continue_on_failure
bool
Optional
Default: false
requests_per_second
int
Optional
Default: 2
add_document_as_text_packet
bool
Optional
Default: false

Configuration example

Generated from documented defaults. Replace any placeholders and complete required nested settings before running.

yaml
templates:
  - template_name: "IMSDbLoaderExecuteNTimes"
    class_name: "IMSDbLoaderExecuteNTimes"
    attributes:
      n_times_execute: 1
      imsdbloader_init:
        proxies: null
        session: null
        encoding: null
        web_path: ""
        bs_kwargs: null
        trust_env: false
        web_paths: []
        verify_ssl: true
        show_progress: true
        default_parser: "html.parser"
        header_template: null
        requests_kwargs: null
        autoset_encoding: true
        raise_for_status: false
        bs_get_text_kwargs: null
        continue_on_failure: false
        requests_per_second: 2
      add_document_as_text_packet: false
View original docstring example

The source example references WikipediaLoaderWrapper, not IMSDbLoaderExecuteNTimes.

yaml
agent:
  name: my_test_agent
templates:
- template_name: InputTemplate
  class_name: InputTemplate
  attributes: {}
- template_name: WikipediaLoaderWrapper
  class_name: WikipediaLoaderWrapper    ## note that because it is a dynamic template,
  template_input: InputTemplate         ##  the class name depends on the actual class that is used.
  attributes:
    add_document_as_text_packet: false
    wikipedialoader_init:
        query: the query for wikipedia
        lang: en
        load_max_docs: 5000
        load_all_available_meta: False
        doc_content_chars_max: 4000, 
n_times_execute determines the number of times the template's execute
method is called. By default, it only gets called once. Further calls
to execute are bypassed.

Inheritance

Immediate parent: sinapsis_langchain_readers.templates.langchain_data_readers.ExecuteNTimesLangchainDataReaders

Environment variables

Environment definitions belong to their canonical Python modules.

SINAPSIS_BUILD_DOCS · defined elsewhere