[Tech] meta category
sich
sich at cafe-philo.net
Sat Nov 25 21:48:10 UTC 2006
toad a écrit :
> Why do you need it to survive the HTML filter? Is there some benefit to
> fetching stuff through fproxy?
I currently use mnogosearch as spider to find new freesite, and he use
fproxy (I knon it's not the best way, but I am a poor devl).
If I can find this meta in the site this will be easier ton sort the
sites on the index.
I currently fetch :
- Title
- Content-Language
- Description
When I have find the sites with mnogosearch, I use some php scripts that
I have write (they use FCP), to test if the site is responding, if we
have the last version, etc.
> Secondly, is this a standardised use of http-equiv?
I don't know if this is a standardised use of http-equiv, but I know
this is used on some site (not frequently).
sich
More information about the Tech
mailing list