Duplicate content pages are generated

vijay kumavat

Hi

I found same page with two different page urls.

for examples : Here announcements is category name.

https://forum.definedgesecurities.com/category/1/announcements

And

https://forum.definedgesecurities.com/category/1/user

How to fix this issue?

vijay kumavat

I found to disallow crawling of URLs with parameters.
we can specify a wildcard rule in robots.txt to target all URLs with parameters :

User-agent: Googlebot 
Disallow: /*?

This rule tells Googlebot not to crawl any URL that contains a question mark.

Please let me know , is this the correct way to do this?

<baris>

I think we should add a canonical url to the /category page that points to /category/1/<current_name>. The reason /category/1/user works is because only the /category/1 part identifies the category and you are free to change the category name without breaking existing links to it.

<baris>

@vijay-kumavat added canonical url to category pages https://github.com/NodeBB/NodeBB/commit/f96b0b7a4ac08a0b9e1473cfe5fa60da722d1fed

julian

Nice catch, thanks!

vijay kumavat

@baris ,

Thank you @baris to your quick reply.

I have implement this on the website now. Our SEO team will check for the same.

I will get back to you.

vijay kumavat

@baris

I have one query here,
because announcements is the category and user is our user page , so how they identify this category and user ?

I have implement this https://github.com/NodeBB/NodeBB/commit/f96b0b7a4ac08a0b9e1473cfe5fa60da722d1fed.