robots.txt

Posted 06-25-2013 at 10:33 PM by moxco

I noticed OWF wasn't coming up in google, so I checked it's robots.txt and saw this:

User-Agent: *
Disallow: /
Crawl-Delay: 10

I've been absent for a while so I might have missed something, but is there a reason for why the mods don't want search engines crawling this site? Has it got to do with bestiality?

Comments 19

Total Comments 19

Comments

	So this means that we can say the z-word again?
	Posted 06-25-2013 at 10:36 PM by Phylum

	I'm guessing that it changed with the vBulletin update and Alcar didn't realise.
	Posted 06-26-2013 at 12:32 AM by Nate

	Although if it's been going on longer, this might explain why we haven't had any new member registrations in weeks.
	Posted 06-26-2013 at 12:35 AM by Nate

	Alcar has been told. He says it was part of the update. He has not yet given an ETA on fixing it.
	Posted 06-26-2013 at 12:40 AM by Nate

	And thus OWF, which is already pretty backwater as is, completely fell off the radar and became the most incestuous place on the net.
	Posted 06-26-2013 at 02:27 AM by STM

	we can get up to all kinds of things without people watching us!
	Posted 06-26-2013 at 02:33 AM by Jordan

	I'm walking around naked.
	Posted 06-26-2013 at 02:36 AM by STM

	We're in the deep web now.
	Posted 06-26-2013 at 04:37 AM by Vyrien

	You were doing those things even before, so It doesn't count.
	Posted 06-26-2013 at 05:47 AM by Varrok

	Don't crush everyone's dreams
	Posted 06-26-2013 at 05:48 AM by Jordan

	Well, I guess it's time for the forum anthem. ♪ Zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia ♫
	Posted 06-26-2013 at 07:57 AM by MeechMunchie

	If this is a result of the recent update, why have we been absent from Google for weeks? Explanation rejected. Unless they can now somehow operate retrospectively, the robots.txt must have been around longer. Hang on, I'll find a cached version on Google to check.
	Posted 06-26-2013 at 11:11 AM by Wil

	Is the lack of new members what nate_test was about?
	Posted 06-26-2013 at 04:36 PM by Phylum

	: If this is a result of the recent update, why have we been absent from Google for weeks? Explanation rejected. Have we been absent from Google for weeks? Or was that just a guess based on the lack of new members? : Is the lack of new members what nate_test was about? Yes. And nate_test2 and nate_test3.
	Posted 06-26-2013 at 07:34 PM by Nate

	I’m very disappointed that there’s no humans.txt
	Posted 06-27-2013 at 03:14 AM by Manco

	: Have we been absent from Google for weeks? Or was that just a guess based on the lack of new members? Yes, for at least a month, I think.
	Posted 06-27-2013 at 03:22 AM by moxco

	Based on what?
	Posted 06-27-2013 at 05:08 AM by Nate

	The fact that I noticed some weeks ago that this website wasn't on the first page of results when "Oddworld Forums" was googled. At the time I legitimately wondered if it was some anti-SEO techniques you guys were employing to combat zoophilia results.
	Posted 06-27-2013 at 05:12 AM by moxco

	Thanks for the information. If you ever see anything like this again, please let us know straight away.
	Posted 06-27-2013 at 06:00 AM by Nate

Recent Blog Entries by moxco

dead forum (07-11-2017)
robots.txt (06-25-2013)
. (04-08-2013)
. (01-10-2012)
. (11-11-2011)


< > 2024
Su	Mo	Tu	We	Th	Fr	Sa
20	21	22	23	24	25	26
27	28	29	30	31	1	2
3	4	5	6	7	8	9
10	11	12	13	14	15	16
17	18	19	20	21	22	23
24	25	26	27	28	29	30