dlt.destinations.impl.lancedb.factory

lancedb Objects

class lancedb(Destination[LanceDBClientConfiguration, "LanceDBClient"])

View source on GitHub

create_ibis_backend

def create_ibis_backend(
    client: "LanceDBClient",
    read_only: bool = False,
    schemas: Sequence["Schema"] = ()) -> "BaseBackend"

View source on GitHub

Creates the dlt ibis backend, which runs expressions over the Arrow Flight SQL endpoint.

__init__

def __init__(credentials: Union["RemoteDBConnection", LanceDBCredentials,
                                Dict[str, Any]] = None,
             commit_tag: Optional[str] = None,
             embeddings: Union[LanceEmbeddingsConfiguration, Dict[str,
                                                                  Any]] = None,
             destination_name: str = None,
             environment: str = None,
             **kwargs: Any) -> None

View source on GitHub

Configure the LanceDB destination to use in a pipeline.

Connects to a managed LanceDB Enterprise or Cloud cluster. Each dataset is a database of the cluster and reads go through its Arrow Flight SQL endpoint.

All arguments provided here supersede other configuration sources such as environment variables and dlt config files.

Arguments:

• credentials Union["RemoteDBConnection", LanceDBCredentials, Dict[str, Any]] - Credentials to connect to the managed cluster. Can be an instance of LanceDBCredentials or an already connected managed LanceDB client or a dictionary with the credentials parameters.
• commit_tag Optional[str] - Tag applied to every table of the dataset after a successful load, so the dataset can be read back as one tagged version.
• embeddings Union[LanceEmbeddingsConfiguration, Dict[str, Any]], optional - Embedding provider, model, and credentials. If not provided, no vector column is added.
• destination_name str, optional - Name of the destination, can be used in config section to differentiate between multiple of the same type
• environment str, optional - Environment of the destination
• **kwargs Any, optional - Additional arguments forwarded to the destination config