Skip to content

Google slow to crawl website (Search Console)


  • 1 Votes
    1 Posts
    No one has replied
  • Profil Photos

    Solved Customisation
    1 Votes
    2 Posts

    @cagatay the fastest way to do this would be to modify the auto generated sitemap.xml file so that it does not index users. It might be paint to do the same thing with users in terms of guest permissions.

    Let me have a look.

    Edit - you can do this with permissions. Go to /admin/manage/privileges then look in the left where it says guests - remove the tick from the view users permission for guests then click save

    You can test this out using an incognito or non logged in session. Attempting to view users should then ask you to login.

  • 0 Votes
    6 Posts

    @DownPW Yes, exactly.

  • SEO and Nodebb

    2 Votes
    2 Posts

    @Panda It’s the best it’s ever been to be honest. I’ve used a myriad of systems in the past - most notably, WordPress, and then Flarum (which for SEO, was absolutely dire - they never even had SEO out of the box, and relied on a third party extension to do it), and NodeBB easily fares the best - see below example

    However, this was not without significant effort on my part once I’d migrated from COM to ORG - see below posts

    And also

    It was painful to say the least - as it turns out, there was an issue in NodeBB core that prevented spiders from getting to content, which as far as I understand, is now fixed. SEO in itself is a dark art - a black box that nobody really fully understands, and it’s essentially going to boil down to one thing - “content”.

    Google’s algorithm for indexing has also changed dramatically over the years. They only now crawl content that has value, so if it believes that your site has nothing to offer, it will simply skip it.

  • 4 Votes
    2 Posts

    @phenomlab this is useful 👍 thanks

  • 1 Votes
    1 Posts
    No one has replied
  • SEO

    7 Votes
    19 Posts

    Your google ranking is too low for that. Your clicks on your website have to increase significantly for this. It also helps if you have a lot of links to your website, e.g. on other websites as a reference. So that your posts or your page are high in google and can be found, you have to rise in the ranking

    Sitemap google refresh

    If you do not use WordPress or another CMS whose sitemap automatically sends a ping to Google when it is updated, you can use the "ping" function to request the update. Send an HTTP GET request like this:
  • nginx seo urls

    Solved Configure
    3 Votes
    15 Posts

    @riekmedia that looks fine to me