FAQ, IP and Web Development - Southern California Tech Central

Search:

DAY

WEEK

MONTH

YEAR

Select your country:
Sign up | Log in

FAQ

Web Development

How brain-amputated developers created the social media plague

SoCal Delicious

JANUARY 15, 2010

ThingFetcher sometimes requests a (shortened) URI 30 times per second, from different IPs. A method to verify the bot All IP addresses used by a bot should resolve to server names having a unique pattern. For example Googlebot comes only from servers named "crawl" + "-" + replace($IP, ".", "-") + ".googlebot.com"

Social Media

Social Media Develop Development Media

How to cleverly integrate your own URI shortener

SoCal Delicious

JANUARY 15, 2010

While handling bots, you should detect search engine crawlers, too: /* lookup your crawler IP database to populate $isCrawler; then, if the IP wasnt identified as search engine crawler: */ if ($isCrawler !== from the IP address range 65.52.0.0 Other rogue bots identify themselves by IP addy, user agent, and/or referrer.

SEO

SEO IP PHP Blogging

How brain-amputated developers created the social media plague

How to cleverly integrate your own URI shortener

Stay Connected