Date: Wed, 21 Sep 2005 23:12:47 GMT From: Saab Guy <nothingnospamo.com> Subject: Re: Calling Dexter J, I need to e-mail you the Saabvideo logs
Dexter, I don't have the time now to read the logs, I thought you were offering your time to help given that I have spent approximately 280+ hours to create www.saabvideos.com for each respective video for you folks. :) SG On Wed, 21 Sep 2005 16:09:25 GMT "Dexter J" <lamealameadingdongnospamlamelame.org> wrote: > Salutations: > > On Tue, 20 Sep 2005 22:28:56 -0300, Saab Guy <nothingnospamo.com> wrote: > > > > Dexter J, > > > > I need to e-mail you the Saabvideo logs. I just received them from the > > system administrator in what seems to be a .gz compressed archive. > > > > SG > > Actually - all you need is to pick up compression tool for the file. GZ is > a type of zip file that should have your logs inside. Have a poke around > here for an app to decompress: > > http://www.gzip.org/ > > Once they are decompressed, use a text editor (word wrap off) or spread > sheet to review transactions with the server. Here is a fairly good start > page regarding how read raw Apache Logs: > > http://httpd.apache.org/docs/2.0/logs.html > > .. don't worry about the server set-up detail outlined above just yet, you > just want to get a handle on visit patterns and from what IP ranges. There > is some good detail above on what each item in a given log line means as > you scroll down a bit. > > Most folks wimp out and go for a 'web log analyzer' - I don't recommend > them until you at least have enough basic literacy to understand the raw > log. The features on most log analyzers make *much* more sense if you > understand what they are doing for you. > > So, very basically, each visit should generate several log lines as each > page item is passed to the visitor. You are looking for anomalies in the > pattern where the visiting IP *doesn't* read the top page and all it's > images first - and/or - repeated visits from the same IP on any kind of > schedule - but most importantly - video downloads without any > corresponding top page visit. > > Towards the end of each log entry the 'user agent' is listed. You should > see visits from google, yahoo et al (relatively useful bots/slurpers). > They usually only take the page text body - but not always. Pay attention > to the detail here, because I'm still betting you are seeing a pile of > visits from things like Wget, DA, psbot and a bunch of others. Here is a > good page for reviewing bots and their place in your universe: > > http://www.kloth.net/internet/badbots.php > > Finally - as to tightening up your site security after you figure out what > is going on - that unfortunately is where we get back to the question of > my per diem and your personal responsibilities as a 'webmaster'. > > As I have said previously, I don't think it's worth your money to hire me > for what is simply a hobby site on a shared server. I dearly wish you had > a fat sponsor and it was worth the cash because I like the idea of your > site, but I guess the best you are going to be able to do is enough > reading to stop the obvious packet leaks like most everyone else. > > I will again repeat my advise as regards your basic architecture though. > > You should at least look at a teaser index page with several video > specific sub-pages as your top page now runs better than 1.2 megs every > time it's viewed without downloading any videos. While you are at it - you > might want to look at changing links to specific video's you have already > posted out here - it will help you narrow down who is swiping your vids > (they will now appear in the error logs as dead link attempts) and it > should slow down the transfer totals for a while. > > -- > > Radio Free Dexterdyne Top Tune o'be-do-da-day > Martin Sinatra Davis - Me and My Shadow > http://www.dexterdyne.org/888/064.RAM > > all tunes - no cookies no subscription no weather no ads > no news no phone in no sign up required - all the Time
 |
 |
 |
 |
 |
