Manager Functions

class ai.backend.client.manager.Manager[source]

Provides controlling of the gateway/manager servers.

New in version 18.12.

session = None

The client session instance that this function class is bound to.

classmethod await status()[source]

Returns the current status of the configured API server.

classmethod await freeze(force_kill=False)[source]

Freezes the configured API server. Any API clients will no longer be able to create new compute sessions nor create and modify vfolders/keypairs/etc. This is used to enter the maintenance mode of the server for unobtrusive manager and/or agent upgrades.

Parameters

force_kill (bool) – If set True, immediately shuts down all running compute sessions forcibly. If not set, clients who have running compute session are still able to interact with them though they cannot create new compute sessions.

classmethod await unfreeze()[source]

Unfreezes the configured API server so that it resumes to normal operation.