artifact-store/src/artifactstore/app.py

89 lines
3.2 KiB
Python
Raw Normal View History

WP-0001-T014: minimal HTTP app and CLI src/artifactstore/app.py (new): composition root. build_registry(settings) wires AsyncEngine + LocalBackend + InProcessDataPlane + RegistryViewWriter into a Registry. Used by both the HTTP app and the CLI. src/artifactstore/registry/__init__.py: adds db_health() (SELECT 1 probe), backend_health() (pass-through to dataplane), and dispose() (engine shutdown) helpers so the HTTP /health endpoint and CLI commands can talk to the registry without reaching for private state. src/artifactstore/api/http/__init__.py: - create_app(settings=None) factory; lifespan owns the registry instance and disposes it on shutdown. - GET / returns the scaffold banner. - GET /health reports overall status + db {healthy, detail} + backend {backend_id, healthy, detail, free_bytes, total_bytes}. Uses FastAPI Depends() with a request->state.registry helper rather than reaching app.state directly. - Module-level `app = create_app()` so `uvicorn artifactstore.api.http:app` keeps working. src/artifactstore/cli/__init__.py: - migrate: `alembic upgrade head` via the alembic command API. - replay: drops + rebuilds materialised views from the event log; prints the highest applied sequence. - health: prints the same payload as the HTTP /health endpoint, as JSON. - version unchanged. Tests: - tests/integration/test_http_health.py (TestClient-based): / scaffold banner; /health reports ok with db.healthy + backend.healthy + free_bytes populated. - tests/integration/test_cli_commands.py (typer CliRunner): version prints; migrate creates the schema (events + retention_classes + alembic_version); replay against an empty log exits ok with "replayed up to sequence 0"; health prints a status=ok JSON payload. Gates: ruff clean, mypy --strict clean on 48 files, 83 tests pass. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-16 08:56:13 +02:00
"""Composition root: build the runtime registry from settings.
The HTTP server, the CLI, and any future host all instantiate the
:class:`Registry` through :func:`build_registry`. Wiring lives here so the
control-plane consumers stay thin (per ADR-0004).
"""
from __future__ import annotations
from collections.abc import Callable
from artifactstore.config import Settings, get_settings, resolve_secret_ref
WP-0001-T014: minimal HTTP app and CLI src/artifactstore/app.py (new): composition root. build_registry(settings) wires AsyncEngine + LocalBackend + InProcessDataPlane + RegistryViewWriter into a Registry. Used by both the HTTP app and the CLI. src/artifactstore/registry/__init__.py: adds db_health() (SELECT 1 probe), backend_health() (pass-through to dataplane), and dispose() (engine shutdown) helpers so the HTTP /health endpoint and CLI commands can talk to the registry without reaching for private state. src/artifactstore/api/http/__init__.py: - create_app(settings=None) factory; lifespan owns the registry instance and disposes it on shutdown. - GET / returns the scaffold banner. - GET /health reports overall status + db {healthy, detail} + backend {backend_id, healthy, detail, free_bytes, total_bytes}. Uses FastAPI Depends() with a request->state.registry helper rather than reaching app.state directly. - Module-level `app = create_app()` so `uvicorn artifactstore.api.http:app` keeps working. src/artifactstore/cli/__init__.py: - migrate: `alembic upgrade head` via the alembic command API. - replay: drops + rebuilds materialised views from the event log; prints the highest applied sequence. - health: prints the same payload as the HTTP /health endpoint, as JSON. - version unchanged. Tests: - tests/integration/test_http_health.py (TestClient-based): / scaffold banner; /health reports ok with db.healthy + backend.healthy + free_bytes populated. - tests/integration/test_cli_commands.py (typer CliRunner): version prints; migrate creates the schema (events + retention_classes + alembic_version); replay against an empty log exits ok with "replayed up to sequence 0"; health prints a status=ok JSON payload. Gates: ruff clean, mypy --strict clean on 48 files, 83 tests pass. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-16 08:56:13 +02:00
from artifactstore.dataplane import InProcessDataPlane
from artifactstore.db.engine import create_engine
from artifactstore.events import RegistryViewWriter
from artifactstore.registry import Registry
from artifactstore.retention import RetentionPolicy
from artifactstore.storage import LocalBackend, S3Backend, S3BackendConfig, StorageBackend
WP-0001-T014: minimal HTTP app and CLI src/artifactstore/app.py (new): composition root. build_registry(settings) wires AsyncEngine + LocalBackend + InProcessDataPlane + RegistryViewWriter into a Registry. Used by both the HTTP app and the CLI. src/artifactstore/registry/__init__.py: adds db_health() (SELECT 1 probe), backend_health() (pass-through to dataplane), and dispose() (engine shutdown) helpers so the HTTP /health endpoint and CLI commands can talk to the registry without reaching for private state. src/artifactstore/api/http/__init__.py: - create_app(settings=None) factory; lifespan owns the registry instance and disposes it on shutdown. - GET / returns the scaffold banner. - GET /health reports overall status + db {healthy, detail} + backend {backend_id, healthy, detail, free_bytes, total_bytes}. Uses FastAPI Depends() with a request->state.registry helper rather than reaching app.state directly. - Module-level `app = create_app()` so `uvicorn artifactstore.api.http:app` keeps working. src/artifactstore/cli/__init__.py: - migrate: `alembic upgrade head` via the alembic command API. - replay: drops + rebuilds materialised views from the event log; prints the highest applied sequence. - health: prints the same payload as the HTTP /health endpoint, as JSON. - version unchanged. Tests: - tests/integration/test_http_health.py (TestClient-based): / scaffold banner; /health reports ok with db.healthy + backend.healthy + free_bytes populated. - tests/integration/test_cli_commands.py (typer CliRunner): version prints; migrate creates the schema (events + retention_classes + alembic_version); replay against an empty log exits ok with "replayed up to sequence 0"; health prints a status=ok JSON payload. Gates: ruff clean, mypy --strict clean on 48 files, 83 tests pass. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-16 08:56:13 +02:00
__all__ = ["build_registry"]
def build_registry(settings: Settings | None = None) -> Registry:
"""Wire engine, local FS backend, in-process data plane, and registry."""
effective = settings or get_settings()
engine = create_engine(effective)
backends = _build_backends(effective)
dataplane = InProcessDataPlane(
backends,
default_backend_id=effective.storage_default_backend,
)
WP-0001-T014: minimal HTTP app and CLI src/artifactstore/app.py (new): composition root. build_registry(settings) wires AsyncEngine + LocalBackend + InProcessDataPlane + RegistryViewWriter into a Registry. Used by both the HTTP app and the CLI. src/artifactstore/registry/__init__.py: adds db_health() (SELECT 1 probe), backend_health() (pass-through to dataplane), and dispose() (engine shutdown) helpers so the HTTP /health endpoint and CLI commands can talk to the registry without reaching for private state. src/artifactstore/api/http/__init__.py: - create_app(settings=None) factory; lifespan owns the registry instance and disposes it on shutdown. - GET / returns the scaffold banner. - GET /health reports overall status + db {healthy, detail} + backend {backend_id, healthy, detail, free_bytes, total_bytes}. Uses FastAPI Depends() with a request->state.registry helper rather than reaching app.state directly. - Module-level `app = create_app()` so `uvicorn artifactstore.api.http:app` keeps working. src/artifactstore/cli/__init__.py: - migrate: `alembic upgrade head` via the alembic command API. - replay: drops + rebuilds materialised views from the event log; prints the highest applied sequence. - health: prints the same payload as the HTTP /health endpoint, as JSON. - version unchanged. Tests: - tests/integration/test_http_health.py (TestClient-based): / scaffold banner; /health reports ok with db.healthy + backend.healthy + free_bytes populated. - tests/integration/test_cli_commands.py (typer CliRunner): version prints; migrate creates the schema (events + retention_classes + alembic_version); replay against an empty log exits ok with "replayed up to sequence 0"; health prints a status=ok JSON payload. Gates: ruff clean, mypy --strict clean on 48 files, 83 tests pass. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-16 08:56:13 +02:00
view_writer = RegistryViewWriter()
retention_policy = RetentionPolicy.from_toml(effective.retention_config_path)
return Registry(
engine,
dataplane,
view_writer,
retention_policy,
backend_selector=_backend_selector(effective),
)
def _build_backends(settings: Settings) -> dict[str, StorageBackend]:
configured = settings.configured_backend_ids or ("local",)
backends: dict[str, StorageBackend] = {}
if "local" in configured:
backends["local"] = LocalBackend(settings.storage_local_root, backend_id="local")
if "s3" in configured:
access_key = (
resolve_secret_ref(settings.s3_access_key_ref)
if settings.s3_access_key_ref
else None
)
secret_key = (
resolve_secret_ref(settings.s3_secret_key_ref)
if settings.s3_secret_key_ref
else None
)
backends["s3"] = S3Backend(
S3BackendConfig(
endpoint_url=settings.s3_endpoint_url,
region=settings.s3_region,
bucket=settings.s3_bucket,
key_prefix=settings.s3_key_prefix,
access_key_id=access_key,
secret_access_key=secret_key,
storage_class=settings.s3_storage_class or None,
sse=settings.s3_sse or None,
multipart_threshold_bytes=settings.s3_multipart_threshold_bytes,
multipart_chunk_bytes=settings.s3_multipart_chunk_bytes,
)
)
unknown = set(configured) - set(backends)
if unknown:
raise ValueError(f"unknown storage backend ids: {sorted(unknown)}")
return backends
def _backend_selector(settings: Settings) -> Callable[[str, str], str | None]:
routes = settings.backend_routes
def select(producer: str, retention_class: str) -> str | None:
for route in routes:
if route.matches(producer=producer, retention_class=retention_class):
return route.backend_id
return settings.storage_default_backend
return select