{"id":77096,"plugin_id":"plugins_6ab42163e9048191ab6e8c14258a48c3","kind":"skill","collection_source":"plugin_package","comparison_source":null,"observed_at":"2026-11-03T00:12:26.300Z","digest":"173db0b1d9cdce84452710c71d07309e6815588738e3d23b1ec2e703d6bd539b","against":null,"payload":{"description":"Design and troubleshoot RAG source ingestion, parsing, chunking, embeddings, metadata, freshness, and index updates.","included_files":[],"name":"design-ingestion-indexing","skill_md_contents":"---\nname: design-ingestion-indexing\ndescription: Design and troubleshoot RAG source ingestion, parsing, chunking, embeddings, metadata, freshness, and index updates.\n---\n\n\n# Design ingestion, parsing and indexing\n**Trigger:** Missing passages, bad parsing, duplicate chunks, source updates, metadata failure, stale index or ingestion performance.\n\n1. Establish source truth and data rights; identify source connectors, file formats, OCR/parser accuracy, document IDs, source version and deletion behavior.\n2. Profile coverage: eligible source count vs parsed documents vs indexed chunks, empty/failed documents, deduplication and unmatched version IDs.\n3. Test chunk strategies on actual representative documents (tables, headers, code, PDFs, multilingual). Preserve provenance fields: document ID, source URL, section/span, version and auth tags.\n4. Make reingestion idempotent with stable IDs and versioned updates; prevent stale duplicates and orphaned chunks. Track failures and dead letters.\n5. Verify embedding/model/index compatibility, dimensionality, normalization and metadata filter behavior; compare counts and sample retrieval before and after.\n6. Produce coverage matrix, sample failures, proposed scoped changes and reindex/rollback plan. Never recommend broad production purge as first action.\n\nUse `../../references/ingestion-indexing.md` and `../../references/debugging-boundaries.md`.\n"},"changes":[],"summary":"First saved snapshot. No earlier version is available for comparison.","summary_kind":"deterministic","summary_metadata":{}}