Meta Delays Its Website Crawling Terms 3 Weeks to 20 November as Publishers in 120 Countries Object
Meta has pushed the start of its updated Commercial Terms, which let it crawl websites of businesses that use its products, from 30 October to 20 November 2026. WAN-IFRA, representing more than 20,000 media brands, confirmed the delay on 23 October but says it does not address publishers' concerns about the clause.

Ras Al Khaimah, United Arab Emirates, .
Meta has postponed the date its updated Commercial Terms take effect from 30 October to 20 November 2026, a delay of three weeks, after news publishers objected to a clause that lets Meta crawl the websites of businesses that use its products. The World Association of News Publishers (WAN-IFRA) confirmed the postponement in an addendum dated 23 October, one day after it sent Meta a letter asking it to suspend the provision for news publishers. According to Reuters, as reported by The Keyword, Meta said it is extending the effective date of its updated Commercial Terms and Self-Serve Ad Terms so it can explain the changes to partners and stakeholders.
Nothing in the published reporting indicates that the crawling clause itself has changed. The delay gives site owners, including SaaS and B2B companies that advertise on Facebook or Instagram, three more weeks before continued use of Meta's business tools counts as accepting the terms.
What changed
| Item | Before 23 October | After 23 October |
|---|---|---|
| Effective date of updated Commercial Terms | 30 October 2026 | 20 November 2026 |
| Self-Serve Ad Terms update | 30 October 2026 | 20 November 2026 (per Reuters, via The Keyword) |
| Crawling clause wording | Allows automated tools and test credentials to access sites tied to businesses using Meta products | No reported change |
| robots.txt in the terms | Not written into the terms | No reported change |
What publishers asked for
WAN-IFRA says it represents more than 20,000 media brands and 60 national publishers' associations in 120 countries. Its letter, sent on 22 October to Meta's Chief Global Affairs Officer Joel Kaplan, was signed by WAN-IFRA President Ladina Heimgartner, Irene Lanzaco, chair of its Directors of Member Associations Committee, and chief executive Stig Ørskov. It asks Meta to:
- suspend the crawling provision for news publishers, pending talks with the sector;
- remove the right to create test credentials and commit that paywalls and other access controls will not be circumvented;
- make robots.txt and other machine-readable reservations of rights binding in the terms;
- exclude the use of publishers' content to develop or power AI systems unless it is licensed;
- let publishers decline the provision without losing access to Meta's business tools.
WAN-IFRA says the terms authorise Meta to use automated tools and test credentials to access websites associated with any business that uses its services, and to keep collecting updates from them. It notes that Meta removed an explicit reference to AI training after the clause drew criticism, but argues the revised wording still allows content to be used to develop Meta's business products, which include generative AI services.
After the postponement, Ørskov called it "a welcome step, but it does not address our concerns." He said Meta should use the time to write the requested protections into the terms before they take effect.
Context
The letter added a global voice to national and regional complaints. According to WAN-IFRA, the News/Media Alliance in the United States has condemned the terms, the News Media Association in the United Kingdom has asked the Competition and Markets Authority to secure a pause, and the European press publishers' associations EMMA, ENPA, EPC and NME have asked the European Commission to adopt interim measures. The Keyword, citing Reuters, reports that the European Commission welcomed the delay and that Meta has rejected the publishers' claims.
Before the delay, a Meta spokesperson told Adweek, as reported by The Keyword, that the crawling terms apply only to Meta's ads and business products, that the update does not change how Meta uses web crawlers, and that content owners can use robots.txt to state their preferences. Publishers' central objection is that this assurance is not in the contract.
WAN-IFRA's letter also raises Meta One, Meta's subscription service for businesses. It says Meta is testing limits under which Facebook Pages must pay to post more than two links a month to their own websites, while claiming access to the same content without charge.
This newsroom first reported the clause on 18 October, when we covered Meta's new terms allowing it to crawl business websites for AI, and followed on 21 October when Meta dropped the word "train" but kept broad access. Our own check of 465 top sites' robots.txt files found that 12% block Meta's AI training crawler, but none block its ads crawler.
What this means for SEO teams
- Use the extra three weeks. If your company runs ads or a business Page on Facebook, Instagram, WhatsApp or Messenger, ask legal or procurement to review the updated Commercial Terms before 20 November.
- Write your preferences down in robots.txt. Meta has publicly said content owners can use robots.txt. Make sure your file states clearly what each Meta user agent may and may not fetch, so your position is on record if the contract does not change.
- Review gated content. The clause covers test credentials. Check which login-protected areas, trials or documentation portals could be reached with credentials created for testing, and log any access.
- Monitor server logs. Track requests from Meta's user agents before and after 20 November so you can see whether crawling patterns change.
- Follow the regulators. Responses from the European Commission and the UK Competition and Markets Authority could change the terms or their scope before they apply.
Conclusion
Meta's three-week delay moves the start of its website crawling terms to 20 November but, on current reporting, leaves the clause publishers object to unchanged. WAN-IFRA, speaking for publishers in 120 countries, has said the postponement does not meet its demands, which centre on making robots.txt binding and excluding unlicensed AI use.
For any business that uses Meta's ad and business tools, including SaaS companies, the practical deadline is now 20 November, when continued use counts as acceptance unless the terms change again.
Questions and answers
When do Meta's updated Commercial Terms take effect?
On 20 November 2026. Meta postponed them from 30 October, according to an addendum WAN-IFRA published on 23 October.
Has Meta changed the crawling clause?
No change to the clause has been reported. Reuters, as reported by The Keyword, says Meta extended the date to explain the changes to partners and stakeholders.
What does WAN-IFRA want Meta to do?
Suspend the crawling provision for news publishers, drop test credentials, make robots.txt binding in the terms, exclude unlicensed AI use of publishers' content, and let publishers decline the provision without losing access to business tools.
Who does the crawling clause affect?
According to WAN-IFRA, any business that uses Meta's services, since the terms authorise access to websites associated with those businesses. That includes advertisers and businesses with Pages, not only publishers.
More releases
-
Explainers
Chrome 155 Decodes JPEG XL, but Google Images and Discover Still Don't Support It, Google's Mueller Says
Google Images and Discover do not support JPEG XL, Google's John Mueller said on 15 October, even though Chrome 155, stable since 6 October, now decodes the format. Google's documentation lists seven supported image formats. Serving JPEG XL inside a picture element with a supported img fallback keeps images eligible.
-
Studies
Search Fell to 12% of North American Publisher Pageviews in Q3 2026, From 21%, Chartbeat Data Shows
Search engines drove 12% of pageviews at North American publishers in Chartbeat's network in Q3 2026, down from 21% a year earlier. Our comparison of Chartbeat's quarterly charts finds nine of ten regions lost search share, with a median fall of 8 points, while Chartbeat says overall publisher traffic is steady.
-
Updates
Google Updates 2 Help Pages on 23 October: Hyphens Over Underscores in URLs, Percent-Encoding in Robots.txt
Google revised two core help pages on 23 October 2026. Its URL structure guide now explains why hyphens beat underscores as word separators, and its robots.txt specification now recommends percent-encoding non-ASCII rule paths. The matching rules themselves are unchanged; Google says both edits sync the docs with its Non-Canonical Cabinet videos.
Tell us the site and the goals.
Rankings in Google and visibility in AI answers, from one monthly plan. One call is enough to say which one fits. Email works just as well.