Khoros Global Support Home Start a conversation Sign in
Start a conversation
  1. Khoros Aurora
  2. Troubleshooting
  3. How-To Articles

Resolving Rogue "Category: Top" in Google Search Results

Overview

The rogue "Category: Top" appears in Google search results for your community, displaying a description from a trending topic. This issue arises from search engines indexing a system-generated page not intended for public visibility. The problem is resolved by updating the robots.txt file to disallow the category, with further SEO measures planned.

Information

Issue: Rogue "Category: Top" appearing in Google search results

Cause: Search engines indexed a system-generated page not part of the intended community structure.

Resolution Steps

  1. Update robots.txt (Aurora SEO: Regulate content crawling by search engines using robots.txt)
    • Add the following rule to the custom rules section: 
      Disallow: /category/top
    • Verify the rule is present by visiting https://your_instance_url/robots.txt.
  2. Monitor Search Results:
    • Allow time for search engines to re-crawl and update their indexes.
    • Use Google Search Console's "Removals" tool to expedite removal.
  3. Consider Applying a "noindex" Meta Tag:
    • If needed, apply a <meta name="robots" content="noindex"> tag to the page.
    • Note: This may require developer assistance as it is not available through the standard admin UI.
  4. Coordinate with SEO Team:
    • Implement additional SEO measures as needed.

Note: For system-generated pages, direct admin UI settings for SEO are limited. Custom development may be required for advanced configurations.

Frequently Asked Questions

Q1: How do I block a page from being indexed by search engines?
A1: Use the robots.txt file to disallow the page by adding a rule like Disallow: /category/top. Verify the rule is present in the live robots.txt file.

Q2: How long does it take for search engines to update their indexes after changes?
A2: It can take several days or weeks for search engines to re-crawl and update their indexes after changes to robots.txt or meta tags.

Q3: Can I apply a noindex meta tag through the admin UI?
A3: For system-generated pages, applying a noindex meta tag typically requires custom development, as it is not available through the standard admin UI.

Q4: What should I do if the page is still indexed after updating robots.txt?
A4: Use Google Search Console's "Removals" tool to temporarily hide the page while changes take effect, and ensure the rule is correctly placed in the robots.txt file.
Choose files or drag and drop files
ai_initiated
atlas_studio
kb_automation
Was this article helpful?
Yes
No

  1. Ciprian Nastase

  2. Posted
  3. Updated

Comments