Overview
The Reddit Scrape Agent Node provides an intelligent agent for searching and extracting content from Reddit. This node enables you to:- Search for posts across subreddits
- Filter posts by relevance, recency, or popularity
- Extract post titles, content, and metadata
- Access comments and discussions
- Sort results by different criteria (hot, new, top, rising)
- Aggregate data from multiple subreddits
Configuration Parameters
The Reddit Scrape Agent uses Pathlit’s Reddit API credentials and does not require individual authentication.Node Configuration
-
Prompt:
Define the search task for the agent to perform.
Search r/technology for posts about artificial intelligence from the past week
Find the top 10 posts in r/stocks about Tesla and summarize the sentiment
Get hot posts from r/programming related to Python
-
Tools
Select which tools the Reddit Agent can use:
Tool name Description Search Posts Search and filter Reddit posts
Advanced Settings
Advanced Settings
- System Prompt: Customize the agent’s behavior and guidelines.
- Model: Select the language model for the agent (must support function calling).
- Max Steps: Set the maximum number of steps the agent can take (1-20).
- Enable Model Fallbacks: Allow automatic fallback to alternative models if the primary model fails.
Expected Inputs and Outputs
-
Inputs:
- The node accepts text input that can be referenced in the prompt using format strings.
-
Outputs:
- output: The final result from the agent’s actions
- conversation: Detailed log of the agent’s reasoning and operations
Use Case Examples
- Market Research: Monitor relevant subreddits for discussions about your product, industry trends, or competitor mentions.
- Content Aggregation: Collect popular posts from multiple subreddits on specific topics to create curated content or newsletters.
- Sentiment Analysis: Extract posts and comments about specific subjects to analyze community sentiment and opinions.
Error Handling and Troubleshooting
- Rate Limiting: Reddit API has rate limits. If you encounter errors, reduce the number of requests or increase delays between calls.
- Subreddit Not Found: Verify that subreddit names are spelled correctly without the “r/” prefix in the subreddit parameter.
- Empty Results: Try adjusting search criteria, using broader keywords, or different sort methods if no posts are found.