langgraph_agent_toolkit.service.admission module

Bound HTTP work and stop abandoned requests before releasing capacity.

exception langgraph_agent_toolkit.service.admission.ServiceBusyError[source][source]

Bases: Exception

The worker has no request capacity available.

exception langgraph_agent_toolkit.service.admission.ResponseSendTimeout[source][source]

Bases: Exception

The client did not accept response data before the deadline.

class langgraph_agent_toolkit.service.admission.RequestAdmission(capacity, max_waiters, queue_timeout)[source][source]

Bases: object

Limit active requests and queued waiters in one worker.

Parameters:
  • capacity (int)

  • max_waiters (int)

  • queue_timeout (float)

__init__(capacity, max_waiters, queue_timeout)[source][source]
Parameters:
  • capacity (int)

  • max_waiters (int)

  • queue_timeout (float)

acquire()[source]
class langgraph_agent_toolkit.service.admission.RequestAdmissionMiddleware(app)[source][source]

Bases: object

Admit requests before buffering bodies and hold capacity through cleanup.

Parameters:

app (Callable[[MutableMapping[str, Any], Callable[[], Awaitable[MutableMapping[str, Any]]], Callable[[MutableMapping[str, Any]], Awaitable[None]]], Awaitable[None]])

__init__(app)[source][source]
Parameters:

app (Callable[[MutableMapping[str, Any], Callable[[], Awaitable[MutableMapping[str, Any]]], Callable[[MutableMapping[str, Any]], Awaitable[None]]], Awaitable[None]])