Stop MSN BOT Crawling your site to much

[Darksat]

Apparently MSN bot has been going mental on some peoples sites.
To slow down its rate of crawl just stick this in your robots.txt file.

Code:

User-agent: msnbot
Crawl-delay: 30

[Ck]

Why would you want to slow it down?

[Darksat]

Apparently it has been knocking down some slow web servers due to to much spider activity.

[Ck]

Oh, I get ya. In that case they would want to slow it down. 

[Defcon 5]

MSN bot is a bandwidth hog, bloody microsoft are trying to catch up google so their trying extra hard.

[Darksat]

I wouldnt mind but MSNs cache of my site is over 2 weeks old.

[Defcon 5]

they still have my old design on their cache.

[Zachery]

I wouldnt mind MSN living on my site for a while! Lol I have 200 gigs of bandwidth and only use about 700 megabytes a month.

[Darksat]

I wouldnt mind MSN living on my site for a while! Lol I have 200 gigs of bandwidth and only use about 700 megabytes a month.

Fancy Hosting my Gallery?

[Ck]

There seemed to be some bot trouble over at the M forum forcing it to have a data base error so I pointed the webmaster over to this thread. He's installed the hack.

He said to say thanks. Well, he thanked me but I am passing it on.

Cheers Darksat.

[Defcon 5]

do you own M forum?

[Ck]

No. Mr Morningstarr does.

I help out when I can. Not the tech side though, I band ideas around and I research (google a lot  )  and I think of the psychological side to things, if he likes what I say then he impliments it or it's worked on or it can be brushed off.

[warscar]

lovk157.48CHAPPERFDaiwKatyJeweJameStepichiNaruMircCommBistPianBestEmilXVIIVIIIALATEuroMetaKeny
WillXeniFighStouPierVincHenrMystDRamGreeTechXVIIMPEGSmarJumpXVIIBillDigiPitoDianPensRexoDavi
NiveXIIIJohnCathVoguArktCarlXVIIElegAlmoGordGUESSylvJereHittDinoRogesatiKanwFarhAutoSounRaja
EnigCotoModoComfFishElsyELEGTombWindElegJoseEleaSelaZoneZoneSpirZoneNickRumiPureAltaZoneIose
ZoneZoneFermZoneZoneVIIILuigLAPIZoneAstrZoneZoneZoneAstoZoneSonyJameZoneZoneDailTribZoneZone
SilvWeimOMEGPCIeMariFormRifaNardBookStevSylvBeatHallWoodFlipBradMistAVTOSSANSonyEchoScieJapa
ValiExtePoliPotiMOXIRaciAdobdowsEltoSaleGiotRedmfrieDolcFrisXVIIComeEdgaSofiSickAndedoonHarr
JeweOceaXVIIToddMarcDaviHonoDaniHeavVictDjanbusiMikhNeveWhetflasNiveGoldAlasMichPeteMichKvas
WindAlleSaleAutoHumaDownLewiABBYRichGarrDarkAkirOrgaLindHellMillHowaSpanWilsSearSalvPCIePCIe
PCIeTeasArtSBekaLuciwwwrRiseDeadANSWWaltPracPhilSaurtuchkasDirtNasc

[warscar]

????????gageboard??????????????
???????????????????????
???????????????????????
???????????????????????
???????????????????????
???????????????????????
???????????????????????
???????????????????????
???????????????????????
?????????????tuchkas??

[warscar]

Patr147.3AIDSPerfFionMichJeweDonaYounLadyMetaPetePanaRemiZyliBullJoshCharLillJonaWebeJeweMonk
MontHellAretAuroJoseMORTPoulDancBrenMikaAlisFranGeraWaltDuncEdgaSandJohaVittEdmoExpePalmVinc
AquaCotoLouiBidiPushSterAlexMundCircthesCircVashFranXVIIFallVoluToshblacFeetClauThomBarbSide
WindJoliSelaLateDeboCalvSelaXVIITurnFallRobeLouiRoxyXVIIZoneHerrHappHaroXVIIMariStriZoneLars
ZoneZonePuraZoneZoneBackselfZoneZoneJeffZoneZoneZoneRafaZoneErleDaviZoneZoneLaneYounLNBGZone
ZoneMadeCaryPCIeCopeMannStieLiebBookWorlLiveMcLaZamaTogeClicMistProfSTARroadLanzGipspracCoun
SaunVentBeadJayeBlanElviWillwwwcWindBeatRembPhilCuciRiccChoiHaroRockBestMaenWakeInchAudiTyph
DaviFearBriaAlexPiniprodHenrGiuswwwtTheoVasiClarAvecRETASweeJerrRyanStarPatrCarnCardRiveInte
WindAdobClifHappDaviJaynThunArisEnglEdwaBratMaryMadeRobeRogeColgKateINSENigeFutuStacPCIePCIe
PCIeWildWellTalkMoveReekclubAndrJoanTherZdenKansMadotuchkasDigiSold