GlueCatalogLoaderWrapper
Python template · sinapsis_langchain_readers.templates.langchain_data_readers
Overview
Dynamic Template to load documents from Langchain document_loaders module The template loads the document either as a Document object in the generic_data field of DataContainer of each string as a TextPacket if add_document_as_text_packet is set as True
GlueCatalogLoader — inherited documentation
Load table schemas from AWS Glue.
This loader fetches the schema of each table within a specified AWS Glue database. The schema details include column names and their data types, similar to pandas dtype representation.
AWS credentials are automatically loaded using boto3, following the standard AWS method: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/credentials.html
If a specific AWS profile is required, it can be specified and will be used to establish the session.Initialize Glue database loader.
Args: database: The name of the Glue database from which to load table schemas. session: Optional. A boto3 Session object. If not provided, a new session will be created. profile_name: Optional. The name of the AWS profile to use for credentials. table_filter: Optional. List of table names to fetch schemas for, fetching all if None.
Capabilities
Capabilities: not setInstallation
Install the published package using pip or uv.
pip install sinapsis_langchain_readers==1.0.0uv pip install sinapsis_langchain_readers==1.0.0uv add sinapsis_langchain_readers==1.0.0Configuration
Effective fields from the inspector schema, including nested Pydantic model fields.
Optional
Default: null
Required
Default: null
Optional
Default: null
Optional
Default: null
Optional
Default: null
Optional
Default: null
Whether to add document as text packet or not. gluecatalogloader_init database <class 'str'>: default: None session typing.Any: default: None profile_name typing.Optional[str]: default: None table_filter typing.Optional[typing.List[str]]: default: None
Optional
Default: false
Configuration example
Generated from documented defaults. Replace any placeholders and complete required nested settings before running.
templates:
- template_name: "GlueCatalogLoaderWrapper"
class_name: "GlueCatalogLoaderWrapper"
attributes:
gluecatalogloader_init:
session: null
database: null
profile_name: null
table_filter: null
add_document_as_text_packet: false
View original docstring example
The source example references WikipediaLoaderWrapper, not GlueCatalogLoaderWrapper.
agent:
name: my_test_agent
templates:
- template_name: InputTemplate
class_name: InputTemplate
attributes: {}
- template_name: WikipediaLoaderWrapper
class_name: WikipediaLoaderWrapper ## note that because it is a dynamic template,
template_input: InputTemplate ## the class name depends on the actual class that is used.
attributes:
add_document_as_text_packet: false
wikipedialoader_init:
query: the query for wikipedia
lang: en
load_max_docs: 5000
load_all_available_meta: False
doc_content_chars_max: 4000Inheritance
sinapsis_langchain_readers.templates.langchain_data_readers.LangChainDataReaderBaseEnvironment variables
Environment definitions belong to their canonical Python modules.