Do you just leave all 200,000 pages in the same forum & sitemap.xml?. Or do you move these into archive?. Thanks.Our forum's latest posts and files get indexed every hour or two.Google sees my forum site at the top level with description.
But it is not crawling down to individual post or topic level immediately...
How old is your forum? Reason I ask is when my forum was under a year old I had it on the default BOTS permissions and our site barely got shown in search results and I found it a huge struggle to get topics indexed. After adjusting the Google [BOT]'s permissions in the ACP to allow it to ignore flood limit and give it access to search the forum, see profiles etc. that's when I started seeing lots of our pages indexed.
By leaving those settings over the past 7 years we have almost 200,000 pages of our site indexed.
(The recent drop was due to me experimenting with blocking certain pages (like "Thanks For Posts" list) using robots.txt)
GSC.png
Statistics: Posted by dextrous — Tue Apr 02, 2024 8:13 pm