Skip to main content

Auto-Enrichment

Redline automatically enriches your nodes with additional data from external sources. This happens in the background so you can keep working while nodes are enhanced.

How It Works

When you create certain node types, Redline queues enrichment jobs that run in the background:

  1. You create a node (or the AI creates one)
  2. Enrichment jobs are queued based on node type
  3. Jobs process in the background (3 at a time, with delays)
  4. Node updates automatically with new data

Enrichment Types

Wikipedia Enrichment

Applies to: Actor, Organization

When you create an Actor or Organization node:

  • Redline searches Wikipedia for a matching article
  • Downloads the summary and thumbnail image
  • Populates the description field
  • Stores the Wikipedia URL for reference

Example:

Create an Actor node for "Volodymyr Zelenskyy"

Redline fetches:

  • Summary from Wikipedia
  • Profile photo
  • Key biographical details

Article Extraction

Applies to: Newsfeed

When you add a news article URL:

  • Extracts the full article text
  • Parses author and publish date
  • Downloads the featured image
  • Generates an AI summary (if enabled)

Example:

Paste a news article URL

Redline extracts:

  • Full article content
  • Author name
  • Publication date
  • Featured image

Social Media Enrichment

Applies to: Social

When you create a Social node from a URL:

  • Fetches the full post content
  • Downloads author profile info
  • Captures engagement metrics (likes, reposts)
  • Extracts media attachments
  • Resolves quoted posts

Supported Platforms:

  • Twitter/X
  • Bluesky
  • Reddit
Authentication Required

Social media enrichment requires you to authenticate with the platform in Settings. Without authentication, only public data is accessible.

OpenGraph Metadata

Applies to: Embed, Social (for links within posts)

For web URLs:

  • Fetches OpenGraph metadata (title, description, image)
  • Creates a preview card
  • Downloads the preview image

Media Archiving

Applies to: All nodes with media

Media files (images, videos, avatars) are:

  • Downloaded to local storage for offline access
  • Referenced by local path after archiving
  • Preserved even if source goes offline

Enrichment Queue

Enrichment jobs are processed with care to avoid overwhelming sources:

SettingValue
Concurrent jobs3
Delay between jobs500ms
Queue check interval5 seconds
Priority levels1-10 (lower = higher priority)

Job Priorities

TypePriorityDescription
media_archive4Download media files
actor_profile5Wikipedia for actors
org_profile5Wikipedia for organizations
newsfeed_scrape5Article extraction
rssfeed_poll5RSS feed polling
social_link_enrich6OpenGraph for links

Viewing Enrichment Status

Nodes display enrichment status in the Context Panel:

  • Pending - Job queued, waiting to process
  • Processing - Currently fetching data
  • Complete - Enrichment successful
  • Failed - Enrichment failed (may retry)

Manual Re-Enrichment

If enrichment failed or data is stale:

  1. Select the node
  2. Open Context Panel
  3. Click "Re-enrich" or "Refresh"

This re-queues the enrichment jobs.

RSS Feed Polling

RSS Feed nodes have special enrichment behavior:

  1. Initial Poll - When created, immediately polls the feed
  2. Scheduled Polls - Polls at configured interval (e.g., every 15 minutes)
  3. AI Filtering - Each article is evaluated against your relevance prompt
  4. Node Creation - Matching articles become Newsfeed nodes on your board

Configurable Settings:

  • Poll interval (1 minute to 24 hours)
  • Relevance prompt (what topics are you tracking?)
  • Relevance threshold (0-100%, how strict?)
Effective Relevance Prompts

Be specific about what you're looking for:

"Articles about Tesla stock price, Elon Musk business decisions, or electric vehicle market trends"

This works better than vague prompts like:

"Interesting technology news"

Performance Considerations

Enrichment runs in the background and shouldn't impact your workflow. However:

  • Large imports - Adding many nodes at once queues many jobs
  • Rate limits - Some sources may rate-limit requests
  • Network issues - Jobs retry on failure but may eventually fail

For large-scale data imports, consider adding nodes in batches.

Privacy Note

Enrichment makes external requests to:

  • Wikipedia API
  • Target URLs (for scraping)
  • Social media APIs (when authenticated)

Your investigation structure (which nodes exist, how they're connected) is never sent externally. Only individual URLs and search queries are made.