IndexNow: link to content restricted to guests being sent out

Was going through IndexNow panel on Bing Console and noticed that it was getting profile post links from XenForo. The one I noticed was for a comment on a profile post. Now the user profiles are blocked from guest usergroup at my end so maybe they should be filtered out based on the same settings that are used for sitemap files?

Also, XenForo is sending post links which a lot of us block through robots.txt file (Disallow: /community/posts/ is part of robots.txt file here.). Should...

Read more

Читать далее...