• Home
  • Categories
  • Recent
  • Popular
  • Top
  • Tags
  • Users
  • Groups
  • Documentation
    • Home
    • Read API
    • Write API
    • Plugin Development
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
v3.5.2 Latest
Buy Hosting

How to increase Number of URLs in sitemap.xml file?

Scheduled Pinned Locked Moved General Discussion
19 Posts 9 Posters 7.2k Views
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • A Offline
    A Offline
    ankitpr89
    wrote on last edited by
    #1

    Currently I see there are only 63 latest urls that appear in /sitemap.xml file
    How can i increase this number?

    1 Reply Last reply
    0
  • julianJ Offline
    julianJ Offline
    julian GNU/Linux
    wrote on last edited by
    #2

    You know, this is a good question.

    NodeBB used to display ALL topics on sitemap.xml, except we were finding that it would take many seconds to load, effectively locking the Node process (if you only had 1 process).

    We restricted it to load recent topics only, although I can imagine that this isn't good for SEO.

    Does anybody know of a standard for paginated sitemaps?

    1 Reply Last reply
    0
  • barisB Offline
    barisB Offline
    <baris> NodeBB
    wrote on last edited by
    #3

    https://github.com/NodeBB/NodeBB/blob/master/src/sitemap.js#L52 you can increase the value 49.

    1 Reply Last reply
    0
  • hekH Offline
    hekH Offline
    hek Plugin & Theme Dev
    wrote on last edited by
    #4

    Does it take several seconds to build it? Maybe caching the sitemap in memory would help? Or simply write all new topics to a static file and rebuild it at startup.

    1 Reply Last reply
    1
  • julianJ Offline
    julianJ Offline
    julian GNU/Linux
    wrote on last edited by
    #5

    The sitemap is cached, although the process to build it takes a couple seconds (if you have many thousand topics).

    Might not be too bad if we optimized it a bit...

    1 Reply Last reply
    0
  • psychobunnyP Offline
    psychobunnyP Offline
    psychobunny
    wrote on last edited by
    #6

    Optimize sitemap? Inb4: https://github.com/NodeBB/NodeBB/commit/006322f3863f5dabbc9b4051cac6b0f466e37916 @baris

    1 Reply Last reply
    0
  • A Offline
    A Offline
    ankitpr89
    wrote on last edited by
    #7

    Guys thank you so much for your reply.
    Since I mostly look into Online Marketing Stuffs, that's why asked this question.
    From our team @vatsal is taking care of tech., he would be happy to give feedback.

    Yes, according to me maintaining a list of sitemap record is quite important for search engines.

    Have a look at sitemap samples from here: http://www.amazon.com/robots.txt ; at the end of file sitemap location is given.
    For large websites and forums .xml.gz format can be followed.

    1 Reply Last reply
    0
  • julianJ Offline
    julianJ Offline
    julian GNU/Linux
    wrote on last edited by
    #8

    There's some info here about sitemap indexes, which we might put into action: http://www.sitemaps.org/protocol.html#index

    A 1 Reply Last reply
    0
  • hekH Offline
    hekH Offline
    hek Plugin & Theme Dev
    wrote on last edited by
    #9

    Yep, this is quite important.

    Did some test googling... and most of our forum thread content has fallen out of the google index. There are a wealth of information in those threads with lots of technical mumbo jumbo keywords which would drive more sensor-nerds to us if they were searchable. 😉

    OT: NodeBB gets appreciation from the members: http://forum.mysensors.org/topic/472/push-notifications
    Thanks for all the effort you put into this!

    1 Reply Last reply
    1
  • A Offline
    A Offline
    ankitpr89
    replied to julian on last edited by
    #10

    @julian @psychobunny hope to see some important update on this.
    As this is quite important for drawing traffic from search engines.

    1 Reply Last reply
    1
  • A Offline
    A Offline
    ankitpr89
    wrote on last edited by
    #11

    @hek my temporary work around is to generate sitemap manually and put on server at different url address; then submit it to search engines.
    This can be done manually.

    Used this to generate sitemap: http://www.web-site-map.com/xml_sitemap.php

    1 Reply Last reply
    0
  • julianJ Offline
    julianJ Offline
    julian GNU/Linux
    wrote on last edited by
    #12

    Good workaround @ankitpr89. We'll try to change up the sitemap, let me issue it now 🙂

    gh#2254

    A 1 Reply Last reply
    1
  • A Offline
    A Offline
    ankitpr89
    replied to julian on last edited by
    #13

    @julian Thank you so much Julian!

    1 Reply Last reply
    0
  • E Offline
    E Offline
    ExperienceOz
    wrote on last edited by
    #14

    Hi guys, sorry to bump such an old thread but couldn't find anything more relevant.

    Has there been any change in the way NodeBB generates sitemaps since back when this was originally posted? We are not seeing a full list of URLs in our sitemap either (using Lavender theme if it makes any difference) and a lot of should-be-popular threads aren't being indexed as a result.

    Thanks!

    1 Reply Last reply
    0
  • J Offline
    J Offline
    joes
    wrote on last edited by
    #15

    @julian @psychobunny Did this get fixed? Does the current sitemap file work with Web master tools etc?

    1 Reply Last reply
    0
  • Vamsi KrishnaV Offline
    Vamsi KrishnaV Offline
    Vamsi Krishna
    wrote on last edited by
    #16

    @julian @psychobunny hey guys, any updates on this? We have been looking for something similar too!

    1 Reply Last reply
    0
  • julianJ Offline
    julianJ Offline
    julian GNU/Linux
    wrote on last edited by
    #17

    Yes, the current sitemap should list all publicly available topics/categories.

    1 Reply Last reply
    1
  • Vamsi KrishnaV Offline
    Vamsi KrishnaV Offline
    Vamsi Krishna
    wrote on last edited by
    #18

    0_1542600348643_132da830-dc89-4132-92ec-d1bfbf620abc-image.png

    hey @julian thanks for your quick reply. I checked the sitemap for our forum, but it shown only the categories & topics headers. Is this how it's meant to be shown or am I missing something?

    PitaJP 1 Reply Last reply
    0
  • PitaJP Offline
    PitaJP Offline
    PitaJ Global Moderator Plugin & Theme Dev
    replied to Vamsi Krishna on last edited by
    #19

    @Vamsi-Krishna what you see there are links to other sitemap files. They are essentially imported when the main sitemap is parsed by Google et al.

    1 Reply Last reply
    1

Copyright © 2023 NodeBB | Contributors
  • Login

  • Don't have an account? Register

  • Login or register to search.
Powered by NodeBB Contributors
  • First post
    Last post
0
  • Home
  • Categories
  • Recent
  • Popular
  • Top
  • Tags
  • Users
  • Groups
  • Documentation
    • Home
    • Read API
    • Write API
    • Plugin Development