dlt.common.runners.pool_runner

NullExecutor Objects

class NullExecutor(Executor)

View source on GitHub

Dummy executor that runs jobs single-threaded.

Provides a uniform interface for None pool type

submit

def submit(fn: Callable[P, T], *args: P.args, **kwargs: P.kwargs) -> Future[T]

View source on GitHub

Run the job and return a Future

TimeoutThreadPoolExecutor Objects

class TimeoutThreadPoolExecutor(ThreadPoolExecutor)

View source on GitHub

__init__

def __init__(max_workers: int = None,
             timeout: Optional[float] = None,
             thread_name_prefix: str = "",
             initializer: AnyFun = None,
             initargs: Tuple[Any, ...] = ())

View source on GitHub

Initializes a new ThreadPoolExecutor instance.

Arguments:

• max_workers - The maximum number of threads that can be used to execute the given calls.
• timeout - Waits for pool threads to complete, None to wait indefinite
• thread_name_prefix - An optional name prefix to give our threads.
• initializer - A callable used to initialize worker threads.
• initargs - A tuple of arguments to pass to the initializer.

get_default_start_method

def get_default_start_method(method_: str) -> str

View source on GitHub

Sets method to spawn is running in one of orchestrator tasks.

Called when explicit start method is not set on PoolRunnerConfiguration