Fetchers

Fetchers retrieve content from external sources – URLs, web crawls, or cloud storage such as SharePoint and Google Drive – so you can use it as data for your pipelines.

Component	Description
FirecrawlCrawler	Crawls websites with Firecrawl, following links to discover subpages, and returns them as Documents.
GoogleDriveFetcher	Fetches the full content of Google Drive files via the Drive API v3 and returns it as ByteStreams.
LinkContentFetcher	Fetches the contents of the URLs you give it so you can use them as data for your pipelines.
MSSharePointFetcher	Fetches the full content of Microsoft SharePoint and OneDrive items via the Microsoft Graph API and returns it as ByteStreams.