Every fetch, parse, and diff recorded for fastCRW. Filter by surface to focus the timeline; each row captures what was found, what changed, and the fields returned.
The documentation now includes explicit API reference and SDK documentation. Several new sections have been added, including GitHub links, Discord, and licensing information, with minor updates to existing section names. The 'has_tutorials' field was removed.
The free tier features and limits were updated. Several tiers had their billing period format changed to 'yearly' from a descriptive string, and some tiers had their features field changed to null.
The positioning statement and social proof summary fields were removed. The target audience statement was changed to be more specific to AI production teams, and two key differentiators were removed.
The primary topics covered by the blog have been updated to be more descriptive and developer-focused. Additionally, 10 new blog posts have been added, expanding the content on various technical aspects of web scraping and AI agent integration.
The 'sections' array is now empty, meaning specific section names previously listed are no longer present in this field.
Multiple tier billing periods and features were updated. The free tier limits description was also updated.
The key differentiators list has been significantly expanded with new marketing messages. The target audience has been narrowed to "AI agents," and the social proof highlights performance metrics and development activity rather than a long list of company logos. The positioning statement has been removed.
The 'has_api_reference', 'has_sdk_docs', and 'has_tutorials' fields changed from true to false. The 'last_update_date' field changed from a string "null" to a JSON null. All entries from the 'sections' array have been removed.
Features for most tiers have been added, with specific changes to the Free and Enterprise tiers.
Multiple key differentiators have been added, while the previous social proof and positioning statements have been removed. The primary tagline was also slightly updated with HTML tags.
The primary topics have been updated to reflect a slightly different focus in the content offerings.
The 'sections' array is now empty, and 'last_update_date' and 'has_tutorials' have changed from string 'null'/'true' to JSON null values.
The primary change is the explicit detailing of features for various tiers, particularly for the Free, Self-Host, and Enterprise plans, where previously they were either null or more broadly described within the 'features' field.
The key differentiators and social proof summary have been updated to reflect new information and expanded lists.
The primary_topics list was updated, with new phrasing for several topics and one topic removed. The ordering of primary_topics and recent_post_urls has also changed.
The 'sections' array was updated with new content and an empty 'last_update_date' field. Additionally, the 'has_tutorials' field was changed to null.
The primary changes involve the 'features' field across all tiers. For most tiers, the 'features' list has been removed, while the 'Enterprise' tier now has a more detailed 'features' list. Additionally, the 'free_tier_limits' description has been expanded.
The key differentiators section has been completely revised, removing a specific benchmark claim and adding several new claims emphasizing ease of use, auditable code, reproducibility, and zero operations. The social proof statement has also been updated to include more developer-focused metrics.
The primary topics have been rephrased and slightly expanded to include more specific web scraping aspects, such as "Self-hosting web scraping tools" and "Developer tutorials for web scraping and AI".
The website's navigation sections have been completely overhauled, replacing generic categories like 'Product', 'Community', and 'Legal' with more specific documentation and resource links. Additionally, the 'has_tutorials' flag has been removed.
The 'free_tier_limits' value was simplified, and a 'features' property with specific details was added to each pricing tier. The billing period for the free tier is now explicitly stated as one-time.
The social proof summary was reformatted, and the target audience statement was updated. The positioning statement was removed.
The key differentiators were updated to highlight specific performance metrics against Firecrawl. The social proof summary was also slightly refined to include 'by design' in its phrasing.
The blog's primary topics were rephrased for a more specific focus on AI agent web scraping and LLM integration, and one topic was removed. Additionally, two recent blog post URLs were slightly modified.
Tutorials have been added to the platform. The 'last_update_date' field now correctly uses a JSON null value instead of the string "null".
The free, standard, and self-host tiers no longer list specific features within their definitions, with some free tier details moved to the global 'free_tier_limits' field. The Enterprise tier's features list was significantly expanded to include more granular service details.
The page underwent significant revisions, particularly in its value proposition. The positioning statement was rewritten to highlight open-source, self-hostable features and competitive positioning, while the key differentiators list was streamlined.
The page content has been completely restructured, removing all previous technical sections and code examples, and replacing them with high-level navigational categories. The availability flags for API reference and SDK documentation are now true, while the tutorials status and last update date format were also updated.
The pricing page data underwent several modifications to feature listings across various tiers. Explicit credit amounts were removed from the 'features' arrays for Hobby, Standard, Growth, and Scale plans, and the free tier limits string was simplified.
The marketing copy underwent significant revisions, notably in the 'key differentiators' section, where several technical features were replaced by new competitive benchmarking claims and a focus on offloading operational complexity. The site's main positioning statement was also removed.
The page content has been almost entirely cleared, and all indicators for developer resources like SDK documentation, tutorials, and API reference now show as not present.
The free tier limits description now includes "no card". All cloud tiers (Free, Hobby, Standard, Growth, Scale) and the Self-Host tier now explicitly list their primary features. The Enterprise tier's features have been simplified.
The page received a significant update to its key differentiators, shifting focus from initial offers to performance, reliability, and security. The primary tagline was simplified, and the social proof summary and positioning statement were also updated.
The website's primary topics have been rephrased and reordered for clarity. Additionally, one recent blog post URL was updated.
The documentation page has been significantly stripped down, with all previous sections removed. Additionally, the availability of tutorials and the last update date have been reset to null.
The Enterprise tier gained new features. Other tiers had their billing periods standardized and specific feature descriptions were either removed from their 'features' arrays or the arrays were standardized to empty.
Several key differentiators related to benchmark performance were removed. Additionally, the social proof summary and target audience statement were updated.
The page's documentation structure has been completely revamped with new content and examples for CRW, while the explicit indication for tutorials has been removed.
The pricing tiers have been updated with more specific feature descriptions for Free, Standard, and Self-Host plans, and clearer monthly/yearly billing period details for Hobby, Standard, Growth, and Scale plans. Additionally, the Enterprise tier's features list has been streamlined.
The page now highlights specific benchmark achievements under key differentiators, refines the social proof summary by removing 'Trusted by design', and no longer explicitly states the 'target_audience_stated' field.
The primary topics for the blog have been updated with new focus areas, including RAG pipelines and LLM integration, and rephrased existing topics.
The page now explicitly indicates the availability of an API reference and includes new sections for community support and licensing information. Several existing section names have been updated for improved clarity.
The pricing structure was updated with changes to billing periods and pricing formats for several tiers. Feature lists for most tiers were cleared, while new specific feature details were added to the Enterprise tier.
The page's key differentiators have been updated to specify '500 one-time credits' and 'No credit card required', replacing the general 'free tier' mention. Additionally, the social proof summary now highlights a broad range of AI tool integrations, while the detailed positioning statement has been removed.
The documentation sections array is now empty, and the 'has_api_reference' flag has changed from true to false. Additionally, the 'has_sdk_docs', 'has_tutorials', and 'last_update_date' fields have been removed.
The free tier limits and Enterprise plan features were slightly updated. Additionally, the features lists for Free, Hobby, Standard, Growth, and Scale plans were modified, and the billing period descriptions for paid plans were standardized to "yearly".
The page was updated with a simplified primary tagline, revised key differentiators, and a more concise target audience statement. The detailed social proof summary and the entire positioning statement were removed.
The blog's primary topics were updated, and a new post titled 'Giving DeepSeek Harness a web_fetch That Survives Cloudflare' was added to the recent posts, while an older post titled 'Streaming Scrape Results in Node.js with SSE' was removed.
The page now indicates support for tutorials and has updated the `last_update_date` format. The `sections` list has been significantly revised, replacing descriptive titles and external links with concise internal documentation slugs.
The free tier limits value was updated, and the 'Free' plan's billing period was clarified to 'one-time'. This change provides a more explicit definition for the free tier's duration.
The page's content has been significantly updated to list specific AI agents and platforms as social proof, refine the target audience, and simplify key differentiators, while removing a broader positioning statement. The primary tagline also received minor formatting updates.
All navigation sections were removed, and the "has_tutorials" and "last_update_date" fields saw value/type changes.
The Hobby, Standard, Growth, and Scale pricing tiers now display their yearly billed amounts. The Free tier's feature description was updated, and the Enterprise tier gained new feature details.
The 'positioning_statement' and 'target_audience_stated' fields were cleared, indicating their content has been removed.
The primary topics for blog posts have been updated, refining terms like 'Self-Hosting and Infrastructure' to 'Self-Hosted Infrastructure' and adding 'Web Data Extraction'. The list of recent blog posts has also been significantly shortened, with 10 older entries removed.
The 'has_tutorials' field's value changed, and the 'last_update_date' field was updated from a string 'null' to a JSON null value.
The free tier limits description was shortened, the Standard plan received a new feature, and the Enterprise plan's explicit features were removed.
The page significantly pruned its key differentiators and removed the detailed positioning statement. The social proof summary and target audience phrasing were also updated.
The primary topics covered on the blog have been updated and expanded, and ten new blog posts focusing on various developer-facing scraping and AI agent topics were added.
The site's main navigation sections have been completely restructured, adding detailed documentation and community links while removing broader categories. Minor updates include the 'has_tutorials' and 'last_update_date' property values.
The pricing page updated feature descriptions for several paid tiers by removing marketing-oriented text, clarified the free tier's credit limits, and provided more specific features for the Enterprise plan. The billing period for the Free plan was also updated.
The page significantly expanded its list of key differentiators, adding several new technical features like media parsing, smart waiting, and enhanced anti-detection. It also removed the explicit product positioning statement.
The list of primary blog topics was updated, introducing new categories such as 'API Integration and Workflows' and 'Pricing and Cost Models', and consolidating existing ones like 'Rust infrastructure' and 'self-hosted web scraping'. Capitalization was also standardized for some topics.
The site's main navigation sections have been reorganized into broader categories, and the 'has_tutorials' and 'last_update_date' fields have been updated to use null values.
Pricing plans now include more specific features for the Free, Hobby, Growth, and Scale tiers, and features for the Standard and Enterprise tiers have been updated. Billing period descriptions for paid plans have been simplified.
The page removed its 'positioning_statement' and added several new key differentiators focusing on performance, ease of use, and developer tools like PyPI and npm SDKs.
All navigation sections have been removed from the page. Additionally, the 'has_tutorials' and 'last_update_date' fields were updated to 'null'.
Pricing plan details were updated; the 'free_tier_limits' string was simplified, and specific annual billing amounts were added to paid plan 'billing_period' descriptions. Most self-serve plan 'features' were set to null, and the 'Enterprise' plan 'features' were expanded.
The social proof summary was expanded with specific integrations, and the target audience statement was updated. The positioning statement was removed.
The primary topics for the blog have been significantly updated, with several new and more specific topics added, some existing topics removed, and a few rephrased with minor case changes.
The page's content structure has been entirely revamped, with all prior sections removed. However, the presence of SDK documentation and an API reference is now explicitly indicated.
The free tier limits description and 'Free' tier features were updated. The billing period for 'Free' and 'Self-Host' tiers is now null, and 'Enterprise' tier features were simplified.
The page now highlights new key differentiators including free tier benefits and open source status. The detailed positioning statement was removed, and the target audience description was simplified.
The primary topics covered on the blog were updated, with one new topic added, one removed, and four existing topics rephrased or broadened in scope.
Multiple key features including API Reference, SDK documentation, and tutorials have been removed along with all associated navigation links. The `last_update_date` property was updated to use a proper JSON null value.
The Free tier limit description was clarified, and the Self-Host plan is now marked as self-serve with a one-time billing period. The Enterprise plan also received an updated and expanded list of features.
Several key differentiators and the positioning statement were removed, and the social proof summary was significantly shortened.
The structure of the 'sections' list was significantly updated, with old entries removed and new documentation and community links added. The 'has_tutorials' flag was set to null, and 'last_update_date' now uses a proper JSON null.
The free tier limits description was updated, the Standard plan now includes a new feature, and the 'is_self_serve' flag for the Self-Host plan was modified.
The 'positioning_statement' has been removed, and the 'social_proof_summary' was updated to include 'by design'.
All specific sections (introduction, rest-api, mcp, changelog) have been removed, making the 'sections' array empty. Additionally, the 'has_tutorials' property is now null, and the 'last_update_date' property's value changed its data type.
The pricing structure underwent minor refinements, including explicitly defining the Free tier's 'one-time' billing period, updating feature descriptions across several paid tiers, and marking the Self-Host tier as 'self-serve'.
The product's positioning statement was removed. The key differentiators list was completely replaced, shifting from detailed feature descriptions to points about credit model and open-source nature. The social proof summary was significantly expanded to list specific AI tools.
The documentation now includes tutorials and features a restructured navigation with specific sections for introduction, REST API, MCP, and changelog. Additionally, the 'last_update_date' field has been updated to use a proper JSON null value.
Detailed features were added to multiple pricing tiers. The billing period was updated for several tiers, and the 'is_self_serve' flag for the Self-Host tier was changed.
The page's key differentiators were completely overhauled, removing previous technical and pricing details while adding new feature descriptions like PDF conversion, smart waiting, and interactive scraping. The social proof summary was condensed, and the target audience description was updated.
The blog's post frequency increased to daily, and its primary topics were completely revised, now focusing more on web scraping API comparisons, pricing, engineering guides, self-hosting, and AI tool integration.
The page now indicates support for SDK documentation and an API reference, while all previous content sections have been removed. The status for tutorials and last update date are now unset.
Several pricing plan descriptions were updated, including more explicit free tier limits and consistent annual billing periods for paid plans. Specific feature descriptions were also removed from individual tier feature lists.
The key differentiators section was completely rewritten to emphasize technical advantages like the Rust engine, unified credit billing, and competitive benchmarks. Additionally, the social proof summary and positioning statement were removed, and the target audience description was shortened.
The page has removed all previously listed sections and flags indicating the presence of SDK documentation and API reference are now set to false. The 'last_update_date' field has also been standardized to a proper null value.
The Standard plan now includes a new feature, 'Matches your volume'. The Free plan's billing period changed from 'one-time' to null, and some feature descriptions updated their bullet character.
The 'positioning_statement' was removed. Other changes include updated primary tagline, social proof summary, target audience statement, and a completely revised list of key differentiators.
The blog's post frequency decreased from daily to 2-3 times per week. Additionally, the primary topics were updated, shifting focus slightly from RAG pipelines and Rust infrastructure to search APIs and general AI workflow engineering, with one developer tutorial topic removed.
API reference and SDK documentation are now available. The status of tutorials and the last update date format have also been updated.
The pricing tier features have been significantly streamlined, with most 'features' lists simplified or emptied across all plans. Additionally, the Free tier now explicitly indicates a 'one-time' billing period, and the free tier limits description was shortened.
The positioning statement has been removed, and the social proof and target audience descriptions have been updated.
The page has undergone a significant content reduction, with all previous sections removed and flags for SDK documentation, tutorials, and API reference now indicating their absence.
The free tier limits description was updated, and comprehensive feature lists have been added for all pricing tiers (Free, Hobby, Standard, Growth, Scale, Self-Host). The Enterprise plan's feature details were also slightly modified.
The social proof summary was updated, and the positioning statement content was removed.
The primary blog topics were entirely updated to focus more specifically on AI agents, RAG pipelines, Rust infrastructure, pricing analysis, and detailed developer guides for scraping workflows.
All content sections have been removed from the page. Additionally, the metadata now explicitly marks tutorials as unavailable and corrects the data type for the last update date field.
The free tier's billing period and limits display format have been updated. The Enterprise plan's feature descriptions now provide more clarity on its offerings.
The primary tagline and target audience statement were reformatted by removing HTML tags. The social proof summary was significantly expanded to list numerous integrations and partners.
The primary topics for content have been updated, including new focus areas like performance benchmarking and Cloudflare anti-bot, while ten older blog posts were removed from the recent posts list.
The page's primary sections were completely updated with new content. The 'has_tutorials' flag was removed, and the 'last_update_date' field was corrected to a proper null value.
The free tier limits description has been updated, and the features listed for the Enterprise plan have been simplified.
The positioning statement has been removed. Key differentiators and the social proof summary have been updated to reflect new benchmark details and a more concise company endorsement.
Tutorials are now available, and the `sections` array has updated its content for consistency. The `last_update_date` field's data type was also corrected.
The billing period for the Free tier was updated to 'one-time', and the billing periods for the Hobby, Standard, Growth, and Scale plans were updated to 'yearly'.
The key differentiators have been updated with specific benchmark claims, and the social proof summary now lists a comprehensive set of AI agent integrations. The previous positioning statement has been removed.
The blog's primary topics were updated with refined phrasing, and ten new developer-focused blog posts were added covering various web scraping and AI agent subjects.
The page's navigation sections were updated, removing several links and adding 'Introduction' and 'REST API'. Data fields 'has_tutorials' and 'last_update_date' also saw minor value adjustments.
The free tier limits description was expanded, specific yearly billed amounts were added to several paid tiers, the Self-Host tier's self-serve status was clarified, and the Enterprise tier's features were updated with more descriptive text.
The page removed five key product differentiators and significantly reduced the detail in its social proof section.
The page's content structure has been significantly updated, replacing granular code examples and API details with broader navigation categories and direct links to project resources. Minor data type corrections were also applied to two metadata fields.
The free tier limits format was updated. Several pricing tiers had their feature descriptions removed or simplified, and their billing period specifications were updated. The 'Self-Host' tier also saw changes to its features and self-serve status.
The key differentiators section has been completely revised with new claims. The social proof summary and positioning statement were removed, and the target audience statement received minor formatting updates.
The documentation page structure has changed significantly, with all previously listed sections removed. However, SDK documentation and an API reference are now indicated as available.
The main change is the clarification of annual billing details and pricing within the features of several paid plans, alongside a change in their billing period labels from "yearly" to "annually". The Enterprise plan also saw its features rephrased for improved clarity.
The page significantly updated its key differentiators to feature specific benchmark results against competitors and expanded its social proof section to include a comprehensive list of integrated AI tools and frameworks. The previous detailed positioning statement was removed.
All documentation sections and related feature flags have been removed or set to false, indicating a complete removal of content and features from the page. The page now contains no documented content.
An Enterprise pricing tier has been added, and the Free tier's billing period is now explicitly 'one-time'. The description for free tier limits has also been updated.
The positioning statement was removed, and the key differentiators were completely revamped to highlight performance and auditability. The social proof summary was significantly simplified, and minor formatting changes were applied to the primary tagline and target audience statement.
The primary topics for the blog have been updated, with several existing topics rephrased or replaced by new ones focusing on engineering best practices, web search APIs, and pricing models.
All documentation sections have been removed. The has_tutorials flag has changed from true to null, indicating tutorials are no longer available.
The Enterprise pricing tier has been removed. Minor updates were made to the Free and Standard tiers, including a rephrased free tier limit and the removal of a feature from the Standard plan.
Key differentiators have been updated to emphasize self-hostability and a free tier. The positioning statement now highlights open source and competitor alternatives, and the social proof has significantly expanded to list new integration partners.
The website updated its primary topic categories, adding new ones like "Cloudflare and anti-bot measures" and "Developer tutorials," and removing "Pricing and cost analysis" and "Technical tutorials." Additionally, ten older blog posts were removed from the "Recent Posts" section.
The page content has been completely revamped, replacing general documentation and external links with practical, code-focused quick-start guides and API usage examples. Notably, tutorials are no longer explicitly supported.
The pricing structure includes updated billing period descriptions for several paid tiers and a more concise description for free tier limits. Some tiers also had their feature lists updated from null to an empty array.
Three new key differentiators have been added to the page. The primary tagline's formatting was updated, and the social proof summary was significantly extended with more details.
The site's primary topics have been updated, with some rephrased for clarity or scope, and new topics such as 'Pricing and cost analysis' and 'Technical tutorials for web scraping' added, while topics on 'Web scraping infrastructure and costs' and 'Cloudflare and anti-bot strategies' were removed.
The 'sections' array was completely emptied, indicating a significant change in content or navigation structure. Additionally, the 'last_update_date' field's value type was corrected.
The pricing page data has been restructured, primarily by simplifying and consolidating feature descriptions across all tiers. Paid plans now explicitly show annual billing amounts, and the free tier clarifies its one-time nature, while detailed feature breakdowns have been removed from the 'features' arrays.
The primary tagline's formatting was updated, and the social proof was condensed. Additionally, the positioning and target audience statements were removed from the page.
The page updated its primary topics to include a new focus on Cloudflare and anti-bot strategies, while refining existing topics related to AI agents, APIs, web scraping, RAG pipelines, and self-hosting. Additionally, 10 new recent blog posts were added, expanding content on various technical aspects of web scraping and AI agents.
The previous documentation and community sections have been entirely removed, and the 'has_tutorials' flag now indicates no explicit tutorials are present.
Detailed feature lists have been added for all pricing tiers, providing a comprehensive overview of what each plan includes. The description for the free tier limits and the free tier price have also been updated.
The page's tagline was simplified, the social proof summary was significantly expanded to list specific AI agent integrations, and both the positioning statement and target audience description were updated to be more specific regarding production AI use cases.
The primary topics for blog posts have been rephrased and updated, and ten older posts have been removed from the recent posts section.
Several page sections were removed. Additionally, the 'has_tutorials' field was set to null, and the 'last_update_date' field was changed from a string 'null' to a proper JSON null.
The pricing page was significantly simplified by removing the detailed `features` array from all pricing tiers. Minor updates include a more concise free tier limits description and a price update for the 'Free' tier.
The positioning statement and social proof summary have been removed. Additionally, a minor wording change was made to one of the key differentiators.
New sections and external links have been added to the navigation. The has_tutorials field is now null, and the last_update_date has been properly set to null.
The pricing structure has been significantly enhanced with a new Enterprise tier and comprehensive, detailed feature breakdowns for all existing tiers. This update provides much clearer information on credit allowances, concurrent requests, API endpoint capabilities, and support offerings across the board.
The page received significant updates to its key differentiators, primary tagline, and social proof summary. The positioning statement and target audience information have been removed.