Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • ECO
    --Site Admin--
    • Oct 2007
    • 1360

    Updates on traffic/errors...

    So if you've been here for the last three days you've probably noticed some sporadic performance...apologies for that.

    I'm continuing to monitor it (and please continue emailing me if you run into problems), but it seems like the cause was that Baidu (search engine) has been indexing the wiki and forums with a crazy amount of robotic power. Meaning 6-8 requests per second, from ~30 different IPs, of different complex wiki pages that bring the database server to it's knees.

    I am now blocking their IPs, we'll see if it holds.

    Grrrrrrrrrr.
  • seb567
    Senior Member
    • Jul 2008
    • 260

    #2
    I understand that Baiduspider does not respect the robots.txt !



    User-agent: *
    Disallow: /w/
    Disallow: /wiki/Special:


    User-agent: Baiduspider
    Disallow: /

    Comment

    Latest Articles

    Collapse

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, 06-09-2026, 11:58 AM
    0 responses
    19 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-05-2026, 10:09 AM
    0 responses
    27 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-04-2026, 08:59 AM
    0 responses
    38 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-02-2026, 12:03 PM
    0 responses
    61 views
    0 reactions
    Last Post SEQadmin2  
    Working...