Knowledge Worker

Handles ingestion and search of user knowledge/content for SocialTwin.

Overview

The Knowledge Worker ingests external content (URLs, documents) and processes it for the knowledge base. It provides vector search capabilities for semantic content retrieval.

Features

  • URL ingestion and content scraping
  • Document processing
  • Vector storage in Vectorize
  • Content chunking and embedding
  • Semantic search

API Endpoints

POST /api/knowledge/ingest Ingest URL or document
GET /api/knowledge/:userId List knowledge sources
DELETE /api/knowledge/:sourceId Remove source