CloudBlobLoaderExecuteNTimes
Python template · sinapsis_langchain_readers.templates.langchain_data_readers
Overview
Dynamic Template to load documents from Langchain document_loaders module The template loads the document either as a Document object in the generic_data field of DataContainer of each string as a TextPacket if add_document_as_text_packet is set as True
CloudBlobLoader — inherited documentation
Load blobs from cloud URL or file:.
Example:
.. code-block:: python
loader = CloudBlobLoader("s3://mybucket/id")
for blob in loader.yield_blobs(): print(blob)Initialize with a url and how to glob over it.
Use [CloudPathLib](https://cloudpathlib.drivendata.org/).
Args: url: Cloud URL to load from. Supports s3://, az://, gs://, file:// schemes. If no scheme is provided, it is assumed to be a local file. If a path to a file is provided, glob/exclude/suffixes are ignored. glob: Glob pattern relative to the specified path by default set to pick up all non-hidden files exclude: patterns to exclude from results, use glob syntax suffixes: Provide to keep only files with these suffixes Useful when wanting to keep files with different suffixes Suffixes must include the dot, e.g. ".txt" show_progress: If true, will show a progress bar as the files are loaded. This forces an iteration through all matching files to count them prior to loading them.
Examples:
.. code-block:: python from langchain_community.document_loaders.blob_loaders import CloudBlobLoader
# Load a single file. loader = CloudBlobLoader("s3://mybucket/id") # az://
# Recursively load all text files in a directory. loader = CloudBlobLoader("az://mybucket/id", glob="**/*.txt")
# Recursively load all non-hidden files in a directory. loader = CloudBlobLoader("gs://mybucket/id", glob="**/[!.]*")
# Load all files in a directory without recursion. loader = CloudBlobLoader("s3://mybucket/id", glob="*")
# Recursively load all files in a directory, except for py or pyc files. loader = CloudBlobLoader( "s3://mybucket/id", glob="**/*.txt", exclude=["**/*.py", "**/*.pyc"] )
Capabilities
Capabilities: not setInstallation
Install the published package using pip or uv.
pip install sinapsis_langchain_readers==1.0.0uv pip install sinapsis_langchain_readers==1.0.0uv add sinapsis_langchain_readers==1.0.0Configuration
Effective fields from the inspector schema, including nested Pydantic model fields.
Optional
Default: null
Optional
Default: 1
Required
Default: null
Optional
Default: null
Optional
Default: "**/[!.]*"
Optional
Default: []
Optional
Default: null
Optional
Default: false
Optional
Default: false
Configuration example
Generated from documented defaults. Replace any placeholders and complete required nested settings before running.
templates:
- template_name: "CloudBlobLoaderExecuteNTimes"
class_name: "CloudBlobLoaderExecuteNTimes"
attributes:
n_times_execute: 1
cloudblobloader_init:
url: null
glob: "**/[!.]*"
exclude: []
suffixes: null
show_progress: false
add_document_as_text_packet: false
View original docstring example
The source example references WikipediaLoaderWrapper, not CloudBlobLoaderExecuteNTimes.
agent:
name: my_test_agent
templates:
- template_name: InputTemplate
class_name: InputTemplate
attributes: {}
- template_name: WikipediaLoaderWrapper
class_name: WikipediaLoaderWrapper ## note that because it is a dynamic template,
template_input: InputTemplate ## the class name depends on the actual class that is used.
attributes:
add_document_as_text_packet: false
wikipedialoader_init:
query: the query for wikipedia
lang: en
load_max_docs: 5000
load_all_available_meta: False
doc_content_chars_max: 4000,
n_times_execute determines the number of times the template's execute
method is called. By default, it only gets called once. Further calls
to execute are bypassed.Inheritance
sinapsis_langchain_readers.templates.langchain_data_readers.ExecuteNTimesLangchainDataReadersEnvironment variables
Environment definitions belong to their canonical Python modules.