Hi Questflow Community,
We've been listening to your feedback and are excited to announce some new features that address two of the most requested capabilities: web crawling/scraping and monitoring tweets.
Let's dive in!
Web Crawling and Scraping with Jina Integration 🌐
By popular demand, we've integrated Questflow with Jina, a powerful open-source neural search framework. This integration unlocks a new AI worker in Questflow that specializes in web crawling and scraping:
Easily extract content from websites using Jina's pre-built web crawling tools
Customize what data to scrape using simple configurations
Automatically clean, structure, and index the scraped content
Jina's web scraping capabilities, now available in Questflow, will help you quickly gather the data you need to train your AI models.
Simulating Human-like Web Interactions with Induced 🧠
For more advanced web scraping needs, we've also integrated Induced, a tool that simulates human-like behavior to extract web content:
Automate complex interactions like clicking buttons, filling forms, and navigating pages
Bypass common anti-bot measures by mimicking human actions
Execute sophisticated scraping scripts with a human-in-the-loop approach
With Induced, you can scrape even the most challenging websites and build datasets for training intelligent agents.
Searching the Web3 with Adot 🔍
Questflow now integrates with Adot, a search engine for the decentralized web (Web3):
Search across blockchain data, decentralized apps, and peer-to-peer networks
Discover new datasets and insights from the Web3 ecosystem
Combine Web3 data with traditional web content for more comprehensive AI models
Unlock the power of Web3 data for your Questflow projects using the Adot integration.
Monitoring Tweets and Twitter Lists 🐦
You can now monitor tweets and Twitter lists directly from Questflow:
Track tweets from specific accounts, hashtags, or keywords
Follow curated Twitter lists to stay on top of topics and conversations
Visualize tweet data and generate automated insights
Twitter monitoring in Questflow keeps you informed and provides a valuable source of real-time data for your AI applications.
We can't wait to see what you build with these new features! Give them a try and let us know what you think.
As always, thanks for being a part of the Questflow community.
Happy building!
The Questflow Team