← astronomer-dataCONTENT HISTORY

Update to astronomer-data

Snapshot Sep 30, 2026 · 23:17 UTC · version 0.1.0

Collection source: not recorded for this historical snapshot.

WHAT CHANGED · RULE-BASED ANALYSIS

First saved snapshot

No earlier snapshot is available to establish a change.

Compare saved observations

Download comparison JSON
Full technical diff · 0 changed fields
Full snapshot data
{
  "name": "managing-astro-local-env",
  "description": "Manage local Airflow environment with Astro CLI (Docker and standalone modes). Use when the user wants to start, stop, or restart Airflow, view logs, query the Airflow API, troubleshoot, or fix environment issues. For project setup, see setting-up-astro-project.",
  "included_files": [],
  "skill_md_contents": "---\nname: managing-astro-local-env\ndescription: Manage local Airflow environment with Astro CLI (Docker and standalone modes). Use when the user wants to start, stop, or restart Airflow, view logs, query the Airflow API, troubleshoot, or fix environment issues. For project setup, see setting-up-astro-project.\n---\n\n# Astro Local Environment\n\nThis skill helps you manage your local Airflow environment using the Astro CLI.\n\nTwo modes: **Docker** (default, uses containers) and **Standalone** (Docker-free, uses a local venv — requires Airflow 3 + `uv`).\n\n> **To set up a new project**, see the **setting-up-astro-project** skill.\n> **When Airflow is running**, use MCP tools from **authoring-dags** and **testing-dags** skills.\n\n---\n\n## Start / Stop / Restart (Docker)\n\n```bash\n# Start local Airflow (webserver at http://localhost:8080)\nastro dev start\n\n# Stop containers (preserves data)\nastro dev stop\n\n# Kill and remove volumes (clean slate)\nastro dev kill\n\n# Restart all containers\nastro dev restart\n\n# Restart specific component\nastro dev restart --scheduler\nastro dev restart --webserver\n```\n\n**Default credentials:** admin / admin\n\n**Restart after modifying:** `requirements.txt`, `packages.txt`, `Dockerfile`\n\n> **Standalone mode?** See the next section.\n\n---\n\n## Standalone Mode\n\nDocker-free local development. Runs Airflow directly on your machine in a `.venv/` managed by `uv`.\n\n**Requirements:** Airflow 3 (runtime 3.x), `uv` on PATH. Not supported on Windows.\n\n> Plain `astro dev init` already pins a runtime 3.x image, so no version flag is needed. See **setting-up-astro-project** for project initialization.\n\n### Start\n\n```bash\n# One-time: set standalone as default mode\nastro config set dev.mode standalone\n\n# Or use the flag per invocation\nastro dev start --standalone\n```\n\n| Flag | Description |\n|------|-------------|\n| `--foreground` / `-f` | Stream output in foreground |\n| `--port` / `-p` | Override webserver port (default: 8080) |\n| `--no-proxy` | Disable reverse proxy |\n\n### Stop / Kill / Restart\n\n```bash\n# Stop (preserves .venv)\nastro dev stop\n\n# Kill (removes .venv and .astro/standalone/ — clean slate)\nastro dev kill\n\n# Restart (preserves .venv for fast restart, use -k to kill first)\nastro dev restart\n```\n\n> If you used `--standalone` on start instead of setting the config, pass `--standalone` on every subsequent command too (stop, kill, restart, bash, run, logs, etc.).\n\n**State locations:** venv in `.venv/`, database and logs in `.astro/standalone/`, DAGs from `dags/`.\n\n---\n\n## Reverse Proxy\n\nRun multiple Airflow projects locally without port conflicts. Works in both Docker and standalone modes.\n\nEach project gets a hostname like `<project-name>.localhost:6563`. Visit `http://localhost:6563` to see all active projects.\n\n```bash\n# Check proxy status and active routes\nastro dev proxy status\n\n# Force-stop proxy (auto-restarts on next astro dev start)\nastro dev proxy stop\n```\n\n| Config | Command |\n|--------|---------|\n| Change proxy port | `astro config set proxy.port <port>` |\n| Disable per-start | `astro dev start --no-proxy` |\n\nDefault proxy port: **6563**\n\n---\n\n## Check Status\n\n```bash\nastro dev ps\n```\n\n---\n\n## View Logs\n\n```bash\n# All logs\nastro dev logs\n\n# Specific component\nastro dev logs --scheduler\nastro dev logs --webserver\n\n# Follow in real-time\nastro dev logs -f\n```\n\n**Standalone:** `astro dev logs` works the same but shows a unified log (no per-component filtering).\n\n---\n\n## Run Airflow CLI Commands\n\n```bash\n# Open a shell with Airflow environment\nastro dev bash\n\n# Run Airflow CLI commands\nastro dev run airflow info\nastro dev run airflow dags list\n```\n\n**Standalone:** Same commands work — `bash` opens a venv-activated shell, `run` executes in the venv.\n\n---\n\n## Querying the Airflow API\n\nUse `astro api airflow` to query a running local Airflow instance. Prefer operation IDs over URL paths.\n\n**Defaults:** localhost:8080, admin/admin (auto-detected). Override with `--api-url`, `--username`, `--password`.\n\n### Discovery\n\n```bash\n# List all endpoints\nastro api airflow ls\n\n# Filter by keyword\nastro api airflow ls dags\nastro api airflow ls task\n\n# Show params and schema for an operation\nastro api airflow describe get_dag\n```\n\n### Key Flags\n\n| Flag | Purpose |\n|------|---------|\n| `-p key=value` | Path parameters |\n| `-F key=value` | Body/query fields (auto-converts booleans/numbers) |\n| `-q` / `--jq` | jq filter on response |\n| `--paginate` | Fetch all pages |\n| `-X` / `--method` | Override HTTP method |\n| `--generate` | Output curl command instead of executing |\n\n### DAGs\n\n```bash\n# List all DAGs\nastro api airflow get_dags\n\n# Filter by pattern (SQL LIKE — use % wildcards)\nastro api airflow get_dags -F dag_id_pattern=%etl%\n\n# Get a specific DAG\nastro api airflow get_dag -p dag_id=my_dag\n\n# Get full details (schedule, params, etc.)\nastro api airflow get_dag_details -p dag_id=my_dag\n\n# Pause / unpause\nastro api airflow patch_dag -p dag_id=my_dag -F is_paused=true\nastro api airflow patch_dag -p dag_id=my_dag -F is_paused=false\n\n# View DAG source code\nastro api airflow get_dag_source -p dag_id=my_dag\n\n# Check import errors\nastro api airflow get_import_errors\n```\n\n### DAG Runs\n\n```bash\n# List runs for a DAG\nastro api airflow get_dag_runs -p dag_id=my_dag\n\n# Trigger a run\nastro api airflow trigger_dag_run -p dag_id=my_dag\n\n# Trigger with config\nastro api airflow trigger_dag_run -p dag_id=my_dag -F conf[key]=value\n\n# Get a specific run\nastro api airflow get_dag_run -p dag_id=my_dag -p dag_run_id=manual__2026-04-07\n\n# Clear (re-run) a DAG run\nastro api airflow clear_dag_run -p dag_id=my_dag -p dag_run_id=manual__2026-04-07 -F dry_run=false\n```\n\n### Task Instances\n\n```bash\n# List task instances for a run\nastro api airflow get_task_instances -p dag_id=my_dag -p dag_run_id=manual__2026-04-07\n\n# Use ~ as wildcard (all DAGs or all runs)\nastro api airflow get_task_instances -p dag_id=my_dag -p dag_run_id=~\n\n# Get a specific task instance\nastro api airflow get_task_instance -p dag_id=my_dag -p dag_run_id=manual__2026-04-07 -p task_id=extract\n\n# Clear/retry failed tasks\nastro api airflow post_clear_task_instances -p dag_id=my_dag \\\n  -F dag_run_id=manual__2026-04-07 -F only_failed=true -F dry_run=false\n\n# Get task logs\nastro api airflow get_log -p dag_id=my_dag -p dag_run_id=manual__2026-04-07 \\\n  -p task_id=extract -p try_number=1\n```\n\n### Config & Connections\n\n```bash\nastro api airflow get_connections\nastro api airflow get_variables\nastro api airflow get_config\n```\n\n### Filtering with jq\n\n```bash\n# List only DAG IDs\nastro api airflow get_dags -q '.dags[].dag_id'\n\n# Get failed task IDs from a run\nastro api airflow get_task_instances -p dag_id=my_dag -p dag_run_id=~ \\\n  -q '[.task_instances[] | select(.state==\"failed\") | .task_id]'\n```\n\n---\n\n## Troubleshooting\n\n| Issue | Solution |\n|-------|----------|\n| Port 8080 in use | Stop other containers or edit `.astro/config.yaml` |\n| Container won't start | `astro dev kill` then `astro dev start` |\n| Package install failed | Check `requirements.txt` syntax |\n| DAG not appearing | Run `astro dev parse` to check for import errors |\n| Out of disk space | `docker system prune` |\n| Standalone won't start | Ensure `uv` is on PATH and runtime is 3.x |\n| Proxy port conflict | `astro config set proxy.port <port>` |\n| `.venv` corrupted | `astro dev kill` then `astro dev start --standalone` |\n\n### Reset Environment\n\nWhen things are broken:\n\n```bash\nastro dev kill\nastro dev start\n```\n\n---\n\n## Upgrade Airflow\n\n### Test compatibility first\n\n```bash\nastro dev upgrade-test\n```\n\n### Change version\n\n1. Edit `Dockerfile`:\n   ```dockerfile\n   FROM quay.io/astronomer/astro-runtime:13.0.0\n   ```\n\n2. Restart:\n   ```bash\n   astro dev kill && astro dev start\n   ```\n\n---\n\n## Related Skills\n\n- **setting-up-astro-project**: Initialize projects and configure dependencies\n- **authoring-dags**: Write DAGs (uses MCP tools, requires running Airflow)\n- **testing-dags**: Test DAGs (uses MCP tools, requires running Airflow)\n- **deploying-airflow**: Deploy DAGs to production (Astro, Docker Compose, Kubernetes)\n"
}

SHA-256: 8d49cdc9c134685d97b41dea8737973965c12f7ab0969ac89fb9cd696d7b9225