converter.connector.base

Module Contents

Classes

BaseConnector

Connects to the the data source

class converter.connector.base.BaseConnector(config: converter.config.Config, **options)

Connects to the the data source

Parameters

config – The global config for the system

abstract extract(self) Iterable[Dict[str, Any]]

Extracts the data from the connected source and returns an iterable of dictionaries.

Returns

An iterable of the extracted data

abstract async aextract(self) AsyncIterable[Dict[str, Any]]

Extracts the data from the connected source and returns an asynchronous iterable of dictionaries.

Returns

An iterable of the extracted data

abstract load(self, data: Iterable[Dict[str, Any]])

Loads the data into the connected data object.

Parameters

data – An iterable of dictionaries representing the data to push to the connected source.

abstract async aload(self, data: AsyncIterable[Dict[str, Any]])

Loads the data into the connected data object.

Parameters

data – An iterable of dictionaries representing the data to push to the connected source.