Every fetch, parse, and diff recorded for fastCRW. Filter by surface to focus the timeline; each row captures what was found, what changed, and the fields returned.
The primary topics array content has been updated and the order of keys in the JSON object has been changed.
The last update date has been added/updated to 2026. The sections have been reorganized and simplified from a detailed list of documentation and community links to broader categories: Product, Community, and Legal.
The free tier limit description has changed. For the 'Hobby', 'Standard', 'Growth', and 'Scale' tiers, the `billing_period` has changed to '/mo' and the prices no longer include the '/mo' suffix.
The key differentiators have been significantly expanded with more detailed benchmark results and open-source commitments. The social proof summary now explicitly lists a wide array of AI tools and brands that trust the product. The positioning statement has been simplified to emphasize 'fresh web data' and 'production trust'.
The primary topics covered by the blog posts have been updated to be more concise and descriptive.
New sections for documentation, GitHub, issues, Discord, and license information have been added. The 'introduction' section has been removed.
The only change detected is a modification in the description of the "Search" feature for the "Self-Host" tier, indicating that users can "bring your own index."
The target audience statement has been updated. The social proof summary was significantly shortened. One key differentiator item was removed.
The navigation sections have been updated to include new categories like 'introduction', 'MCP Server', and 'Changelog', while the 'Community' and 'Legal' sections have been removed.
The free tier credit limit has increased from 500 to 1,000, and comprehensive feature lists have been added for all self-serve tiers, replacing previous concise descriptions. Enterprise tier details were also expanded.
The social proof summary and positioning statement were changed. The key differentiators and target audience stated were also changed.
The 'sections' array is now empty, 'has_tutorials' is null, and 'last_update_date' is null.
An Enterprise tier was added for custom volume and dedicated clusters. The billing details like "billed $X/yr" were removed from the features arrays of paid tiers. The free tier limits wording was slightly changed.
The positioning statement has been removed. There are numerous new key differentiators added, providing more detailed information about fastCRW's features, capabilities, and pricing model. Existing key differentiators have been updated or removed to reflect these additions and broader benchmarking scope changes in scope.
The primary topics for the blog have been updated to be more specific and relevant to AI agents and web scraping. URLs for recent posts were added.
The 'sections' array in the data has been changed. Previously, it contained developer-focused documentation links. Now, it categorizes content into broader 'Product', 'Community', and 'Legal' sections.
The billing period for all paid tiers (Hobby, Standard, Growth, Scale) has been changed to yearly, with corresponding yearly billing amounts added as features. The 'Enterprise' tier has been removed, and the free tier limits description has been updated.
The positioning statement was updated to focus on the API's versatility. Several key differentiators related to technical details, pricing, and self-hosting were removed, replaced by new differentiators highlighting a free credit offer, no credit card requirement, open-source nature, and faster search performance.
The primary topics for the blog have been re-categorized with updated terminology. The URL for the most recent post has been replaced by an extraneous text string, indicating a potential data extraction error in the current version.
The page now indicates the presence of SDK documentation and API reference, while the list of sections has been cleared.
Several pricing tiers changed their billing period from annual to monthly. The free tier limits description was updated. Some features were removed from the Hobby, Standard, Growth, and Scale tiers.
The 'key_differentiators' have been significantly expanded with detailed performance and pricing information. The 'positioning_statement' was removed, and the 'target_audience_stated' was updated to be more specific. The 'social_proof_summary' now begins with 'Trusted by design'.
The primary topics covered on the blog have been updated and expanded, now including more detailed categories like LLM integration and developer guides. The post frequency has also changed from sporadic to daily.
The API reference and SDK documentation flags were changed to false. All section links were removed, and the tutorials and last update date fields were nulled out.
The free tier limits and `Enterprise` tier features have been updated. The Hobby, Growth, and Scale tiers now have a 'Launch pricing' feature, and the Standard tier has a 'Popular' feature. The `billing_period` for paid tiers has been harmonized to 'annual'.
The 'positioning_statement' has been removed. The 'key_differentiators' array was significantly reduced, and 'social_proof_summary' now only lists trusted companies, omitting benchmark data. The 'target_audience_stated' was also shortened.
The 'has_tutorials' field was added and set to true. The 'last_update_date' field's value type changed from string to null.
The pricing page has been significantly condensed, replacing detailed feature lists for most tiers with simpler billing summaries. Specific features like top-up credits, concurrent requests, and infrastructure details have been removed from the general tier descriptions, while the Enterprise and Self-Host tiers received minor feature updates.
The changes primarily involve a significant reduction in the "key_differentiators" list, the removal of the "positioning_statement", and additions to the "social_proof_summary" focusing on competitive benchmarks and the "target_audience_stated" now highlights "Built for teams shipping production AI".
The primary topics covered by the blog have been updated to reflect new areas of focus, including Cloudflare, search API comparisons, self-hosted web scraping, and document parsing for AI. Additionally, the post frequency has changed from daily to sporadic.
The documentation sections have been updated. "Documentation", "GitHub", "Issues", "Discord", and "License (AGPL-3.0)" were added. "Introduction" was removed.
The free tier limits now specify "no card" requirement, and the descriptions of core features across all tiers have been expanded and reworded for more detail. The Enterprise tier features were reordered and slightly rephrased.
The "Trusted by design" social proof is now a key differentiator, and the target audience has been updated from "for AI agents" to "production AI". Many new key differentiators have been added, providing more details on features like benchmarking, integration, infrastructure management, media parsing, smart waiting, caching, interactive scraping, anti-detection, source attribution, pricing, open-source nature, and operational benefits.
The primary_topics list was slightly reworded. The 'recent_post_urls' field was removed.
The current version includes SDK documentation and API reference, which were missing in the previous version. The order and casing of sections have also changed.
The primary change is the detailed breakdown of features for each tier, replacing previous vague descriptions like "Launch pricing." The description for 'free_tier_limits' also became more specific.
The positioning statement was removed. The social proof summary was rephrased to emphasize integration. The target audience statement was slightly modified.
The primary topics of the blog were updated to reflect a shift in focus from open-source alternatives and technical guides to infrastructure and RAG pipelines.
The documentation has been completely restructured, removing all previous sections, API reference, SDK documentation, and tutorials, and resetting the last update date.
The free tier feature description was split and its billing period was removed. The self-host tier's features were rephrased, and its self-serve status was removed. The Enterprise tier's self-serve status was also removed.
The primary tagline and key differentiators have been updated, and the social proof summary now includes a detailed list of integrations. The positioning statement has been removed.
The primary topics and recent posts have been updated. The changes include rephrased topic descriptions and fewer recent posts listed.
The page now indicates the presence of SDK documentation and tutorials. The API reference status has been updated to true, and the list of sections has been revised to include 'introduction' while removing community and legal links.
The main changes involve updates to the features listed for several tiers, particularly the Free, Hobby, Growth, Scale, Self-Host, and Enterprise plans. The free tier limits description was also updated for clarity.
The list of key differentiators was significantly shortened, removing several specific claims related to benchmarking, auditing, and operational aspects. The social proof summary was also changed from a detailed list of companies to a more general statement about releases and presence on platforms.
The `has_api_reference` and `has_sdk_docs` flags have been set to false. The `sections` array is now empty.
The Free, Hobby, Growth, and Scale tiers now have simplified or empty feature lists. The Self-Host and Enterprise tiers also have simplified feature descriptions. Many specific features, previously listed for each tier, are now removed from individual tier descriptions.
The primary tagline was simplified, and the key differentiators list was significantly updated with new, more specific performance claims and aspects related to auditability and operations. The target audience statement was also rephrased to emphasize production AI teams.
No change since last scan.
The pricing page underwent a significant update, primarily by expanding the feature lists for all tiers, adding detailed specifications for credits, concurrent requests, top-up options, specific extraction endpoints, and support/security information. The billing period for most paid tiers is now explicitly stated as 'yearly'.
Two new key differentiators related to open-source licensing were added. Several existing key differentiators were removed, and one was merged/expanded. The social proof summary was significantly updated with a list of integrations.
No change since last scan.
The 'Free' tier now explicitly includes 'no card' in its description and the 'Self-Host' tier specifies 'AGPL-3.0'. Additionally, yearly billing details have been added to the 'Hobby', 'Standard', 'Growth', and 'Scale' tiers.
The social proof summary has been significantly simplified. The key differentiators list has been completely revised, removing several previous items and adding many new, more detailed technical and feature-oriented points, such as specific functionalities like media parsing and anti-detection capabilities.
The documentation now includes explicit API reference and SDK documentation. Several new sections have been added, including GitHub links, Discord, and licensing information, with minor updates to existing section names. The 'has_tutorials' field was removed.
The free tier features and limits were updated. Several tiers had their billing period format changed to 'yearly' from a descriptive string, and some tiers had their features field changed to null.
The positioning statement and social proof summary fields were removed. The target audience statement was changed to be more specific to AI production teams, and two key differentiators were removed.
The primary topics covered by the blog have been updated to be more descriptive and developer-focused. Additionally, 10 new blog posts have been added, expanding the content on various technical aspects of web scraping and AI agent integration.
The 'sections' array is now empty, meaning specific section names previously listed are no longer present in this field.
Multiple tier billing periods and features were updated. The free tier limits description was also updated.
The key differentiators list has been significantly expanded with new marketing messages. The target audience has been narrowed to "AI agents," and the social proof highlights performance metrics and development activity rather than a long list of company logos. The positioning statement has been removed.
The 'has_api_reference', 'has_sdk_docs', and 'has_tutorials' fields changed from true to false. The 'last_update_date' field changed from a string "null" to a JSON null. All entries from the 'sections' array have been removed.
Features for most tiers have been added, with specific changes to the Free and Enterprise tiers.
Multiple key differentiators have been added, while the previous social proof and positioning statements have been removed. The primary tagline was also slightly updated with HTML tags.
The primary topics have been updated to reflect a slightly different focus in the content offerings.
The 'sections' array is now empty, and 'last_update_date' and 'has_tutorials' have changed from string 'null'/'true' to JSON null values.
The primary change is the explicit detailing of features for various tiers, particularly for the Free, Self-Host, and Enterprise plans, where previously they were either null or more broadly described within the 'features' field.
The key differentiators and social proof summary have been updated to reflect new information and expanded lists.
The primary_topics list was updated, with new phrasing for several topics and one topic removed. The ordering of primary_topics and recent_post_urls has also changed.
The 'sections' array was updated with new content and an empty 'last_update_date' field. Additionally, the 'has_tutorials' field was changed to null.
The primary changes involve the 'features' field across all tiers. For most tiers, the 'features' list has been removed, while the 'Enterprise' tier now has a more detailed 'features' list. Additionally, the 'free_tier_limits' description has been expanded.
The key differentiators section has been completely revised, removing a specific benchmark claim and adding several new claims emphasizing ease of use, auditable code, reproducibility, and zero operations. The social proof statement has also been updated to include more developer-focused metrics.
The primary topics have been rephrased and slightly expanded to include more specific web scraping aspects, such as "Self-hosting web scraping tools" and "Developer tutorials for web scraping and AI".
The website's navigation sections have been completely overhauled, replacing generic categories like 'Product', 'Community', and 'Legal' with more specific documentation and resource links. Additionally, the 'has_tutorials' flag has been removed.
The 'free_tier_limits' value was simplified, and a 'features' property with specific details was added to each pricing tier. The billing period for the free tier is now explicitly stated as one-time.
The social proof summary was reformatted, and the target audience statement was updated. The positioning statement was removed.
The key differentiators were updated to highlight specific performance metrics against Firecrawl. The social proof summary was also slightly refined to include 'by design' in its phrasing.
The blog's primary topics were rephrased for a more specific focus on AI agent web scraping and LLM integration, and one topic was removed. Additionally, two recent blog post URLs were slightly modified.
Tutorials have been added to the platform. The 'last_update_date' field now correctly uses a JSON null value instead of the string "null".
The free, standard, and self-host tiers no longer list specific features within their definitions, with some free tier details moved to the global 'free_tier_limits' field. The Enterprise tier's features list was significantly expanded to include more granular service details.
The page underwent significant revisions, particularly in its value proposition. The positioning statement was rewritten to highlight open-source, self-hostable features and competitive positioning, while the key differentiators list was streamlined.
The page content has been completely restructured, removing all previous technical sections and code examples, and replacing them with high-level navigational categories. The availability flags for API reference and SDK documentation are now true, while the tutorials status and last update date format were also updated.
The pricing page data underwent several modifications to feature listings across various tiers. Explicit credit amounts were removed from the 'features' arrays for Hobby, Standard, Growth, and Scale plans, and the free tier limits string was simplified.
The marketing copy underwent significant revisions, notably in the 'key differentiators' section, where several technical features were replaced by new competitive benchmarking claims and a focus on offloading operational complexity. The site's main positioning statement was also removed.
The page content has been almost entirely cleared, and all indicators for developer resources like SDK documentation, tutorials, and API reference now show as not present.
The free tier limits description now includes "no card". All cloud tiers (Free, Hobby, Standard, Growth, Scale) and the Self-Host tier now explicitly list their primary features. The Enterprise tier's features have been simplified.
The page received a significant update to its key differentiators, shifting focus from initial offers to performance, reliability, and security. The primary tagline was simplified, and the social proof summary and positioning statement were also updated.
The website's primary topics have been rephrased and reordered for clarity. Additionally, one recent blog post URL was updated.
The documentation page has been significantly stripped down, with all previous sections removed. Additionally, the availability of tutorials and the last update date have been reset to null.
The Enterprise tier gained new features. Other tiers had their billing periods standardized and specific feature descriptions were either removed from their 'features' arrays or the arrays were standardized to empty.
Several key differentiators related to benchmark performance were removed. Additionally, the social proof summary and target audience statement were updated.
The page's documentation structure has been completely revamped with new content and examples for CRW, while the explicit indication for tutorials has been removed.
The pricing tiers have been updated with more specific feature descriptions for Free, Standard, and Self-Host plans, and clearer monthly/yearly billing period details for Hobby, Standard, Growth, and Scale plans. Additionally, the Enterprise tier's features list has been streamlined.
The page now highlights specific benchmark achievements under key differentiators, refines the social proof summary by removing 'Trusted by design', and no longer explicitly states the 'target_audience_stated' field.
The primary topics for the blog have been updated with new focus areas, including RAG pipelines and LLM integration, and rephrased existing topics.
The page now explicitly indicates the availability of an API reference and includes new sections for community support and licensing information. Several existing section names have been updated for improved clarity.
The pricing structure was updated with changes to billing periods and pricing formats for several tiers. Feature lists for most tiers were cleared, while new specific feature details were added to the Enterprise tier.
The page's key differentiators have been updated to specify '500 one-time credits' and 'No credit card required', replacing the general 'free tier' mention. Additionally, the social proof summary now highlights a broad range of AI tool integrations, while the detailed positioning statement has been removed.
The documentation sections array is now empty, and the 'has_api_reference' flag has changed from true to false. Additionally, the 'has_sdk_docs', 'has_tutorials', and 'last_update_date' fields have been removed.
The free tier limits and Enterprise plan features were slightly updated. Additionally, the features lists for Free, Hobby, Standard, Growth, and Scale plans were modified, and the billing period descriptions for paid plans were standardized to "yearly".
The page was updated with a simplified primary tagline, revised key differentiators, and a more concise target audience statement. The detailed social proof summary and the entire positioning statement were removed.
The blog's primary topics were updated, and a new post titled 'Giving DeepSeek Harness a web_fetch That Survives Cloudflare' was added to the recent posts, while an older post titled 'Streaming Scrape Results in Node.js with SSE' was removed.
The page now indicates support for tutorials and has updated the `last_update_date` format. The `sections` list has been significantly revised, replacing descriptive titles and external links with concise internal documentation slugs.
The free tier limits value was updated, and the 'Free' plan's billing period was clarified to 'one-time'. This change provides a more explicit definition for the free tier's duration.
The page's content has been significantly updated to list specific AI agents and platforms as social proof, refine the target audience, and simplify key differentiators, while removing a broader positioning statement. The primary tagline also received minor formatting updates.
All navigation sections were removed, and the "has_tutorials" and "last_update_date" fields saw value/type changes.
The Hobby, Standard, Growth, and Scale pricing tiers now display their yearly billed amounts. The Free tier's feature description was updated, and the Enterprise tier gained new feature details.
The 'positioning_statement' and 'target_audience_stated' fields were cleared, indicating their content has been removed.
The primary topics for blog posts have been updated, refining terms like 'Self-Hosting and Infrastructure' to 'Self-Hosted Infrastructure' and adding 'Web Data Extraction'. The list of recent blog posts has also been significantly shortened, with 10 older entries removed.
The 'has_tutorials' field's value changed, and the 'last_update_date' field was updated from a string 'null' to a JSON null value.
The free tier limits description was shortened, the Standard plan received a new feature, and the Enterprise plan's explicit features were removed.
The page significantly pruned its key differentiators and removed the detailed positioning statement. The social proof summary and target audience phrasing were also updated.
The primary topics covered on the blog have been updated and expanded, and ten new blog posts focusing on various developer-facing scraping and AI agent topics were added.
The site's main navigation sections have been completely restructured, adding detailed documentation and community links while removing broader categories. Minor updates include the 'has_tutorials' and 'last_update_date' property values.
The pricing page updated feature descriptions for several paid tiers by removing marketing-oriented text, clarified the free tier's credit limits, and provided more specific features for the Enterprise plan. The billing period for the Free plan was also updated.
The page significantly expanded its list of key differentiators, adding several new technical features like media parsing, smart waiting, and enhanced anti-detection. It also removed the explicit product positioning statement.
The list of primary blog topics was updated, introducing new categories such as 'API Integration and Workflows' and 'Pricing and Cost Models', and consolidating existing ones like 'Rust infrastructure' and 'self-hosted web scraping'. Capitalization was also standardized for some topics.
The site's main navigation sections have been reorganized into broader categories, and the 'has_tutorials' and 'last_update_date' fields have been updated to use null values.
Pricing plans now include more specific features for the Free, Hobby, Growth, and Scale tiers, and features for the Standard and Enterprise tiers have been updated. Billing period descriptions for paid plans have been simplified.
The page removed its 'positioning_statement' and added several new key differentiators focusing on performance, ease of use, and developer tools like PyPI and npm SDKs.
All navigation sections have been removed from the page. Additionally, the 'has_tutorials' and 'last_update_date' fields were updated to 'null'.
Pricing plan details were updated; the 'free_tier_limits' string was simplified, and specific annual billing amounts were added to paid plan 'billing_period' descriptions. Most self-serve plan 'features' were set to null, and the 'Enterprise' plan 'features' were expanded.
The social proof summary was expanded with specific integrations, and the target audience statement was updated. The positioning statement was removed.
The primary topics for the blog have been significantly updated, with several new and more specific topics added, some existing topics removed, and a few rephrased with minor case changes.
The page's content structure has been entirely revamped, with all prior sections removed. However, the presence of SDK documentation and an API reference is now explicitly indicated.
The free tier limits description and 'Free' tier features were updated. The billing period for 'Free' and 'Self-Host' tiers is now null, and 'Enterprise' tier features were simplified.
The page now highlights new key differentiators including free tier benefits and open source status. The detailed positioning statement was removed, and the target audience description was simplified.
The primary topics covered on the blog were updated, with one new topic added, one removed, and four existing topics rephrased or broadened in scope.
Multiple key features including API Reference, SDK documentation, and tutorials have been removed along with all associated navigation links. The `last_update_date` property was updated to use a proper JSON null value.
The Free tier limit description was clarified, and the Self-Host plan is now marked as self-serve with a one-time billing period. The Enterprise plan also received an updated and expanded list of features.
Several key differentiators and the positioning statement were removed, and the social proof summary was significantly shortened.
The structure of the 'sections' list was significantly updated, with old entries removed and new documentation and community links added. The 'has_tutorials' flag was set to null, and 'last_update_date' now uses a proper JSON null.
The free tier limits description was updated, the Standard plan now includes a new feature, and the 'is_self_serve' flag for the Self-Host plan was modified.
The 'positioning_statement' has been removed, and the 'social_proof_summary' was updated to include 'by design'.
All specific sections (introduction, rest-api, mcp, changelog) have been removed, making the 'sections' array empty. Additionally, the 'has_tutorials' property is now null, and the 'last_update_date' property's value changed its data type.
The pricing structure underwent minor refinements, including explicitly defining the Free tier's 'one-time' billing period, updating feature descriptions across several paid tiers, and marking the Self-Host tier as 'self-serve'.
The product's positioning statement was removed. The key differentiators list was completely replaced, shifting from detailed feature descriptions to points about credit model and open-source nature. The social proof summary was significantly expanded to list specific AI tools.
The documentation now includes tutorials and features a restructured navigation with specific sections for introduction, REST API, MCP, and changelog. Additionally, the 'last_update_date' field has been updated to use a proper JSON null value.
Detailed features were added to multiple pricing tiers. The billing period was updated for several tiers, and the 'is_self_serve' flag for the Self-Host tier was changed.
The page's key differentiators were completely overhauled, removing previous technical and pricing details while adding new feature descriptions like PDF conversion, smart waiting, and interactive scraping. The social proof summary was condensed, and the target audience description was updated.
The blog's post frequency increased to daily, and its primary topics were completely revised, now focusing more on web scraping API comparisons, pricing, engineering guides, self-hosting, and AI tool integration.
The page now indicates support for SDK documentation and an API reference, while all previous content sections have been removed. The status for tutorials and last update date are now unset.
Several pricing plan descriptions were updated, including more explicit free tier limits and consistent annual billing periods for paid plans. Specific feature descriptions were also removed from individual tier feature lists.
The key differentiators section was completely rewritten to emphasize technical advantages like the Rust engine, unified credit billing, and competitive benchmarks. Additionally, the social proof summary and positioning statement were removed, and the target audience description was shortened.
The page has removed all previously listed sections and flags indicating the presence of SDK documentation and API reference are now set to false. The 'last_update_date' field has also been standardized to a proper null value.
The Standard plan now includes a new feature, 'Matches your volume'. The Free plan's billing period changed from 'one-time' to null, and some feature descriptions updated their bullet character.
The 'positioning_statement' was removed. Other changes include updated primary tagline, social proof summary, target audience statement, and a completely revised list of key differentiators.