|
View previous topic
::
View next topic
|
| Author |
Message |
cianjhsert
Joined:
15 Aug 2011
Posts:
74
|
Posted: Mon Aug 15, 2011 9:35 am
Post subject: About robot.txt
|
 |
|
| Hey.I have heard about the robot.txt file and that the bots need it crawl your site.None of my sites have this but i do have pr and see the bots on my stats.What is this file,how do i make it,and is it really nec. to have?.....Thanks |
|
| Back to top |
  |
 |
jonemartine
Joined:
10 Aug 2011
Posts:
35
|
Posted: Sat Sep 17, 2011 4:37 am
Post subject:
|
|
|
Google will not make weigh age for flash file so if you want to hide some file or content of the site then use robot.txt tag.
_________________
search engine submission |
|
| Back to top |
|
|
tech.biztech
Joined:
19 Jul 2011
Posts:
44
|
Posted: Tue Sep 27, 2011 5:24 am
Post subject:
|
|
|
Robots.txt is a text file you put on your site to acquaint search robots which pages you would like them not to visit. The text files includes instructions that acquaint indexing spiders, or "robots," what content and directories on that website they may, or may not.
_________________
Php Development |
|
| Back to top |
 |
|
ujjwal
Joined:
30 Aug 2011
Posts:
33
|
Posted: Tue Sep 27, 2011 8:16 am
Post subject:
|
|
|
Hi,
The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web crawlers and other web robots from accessing all or part of a website which is otherwise publicly viewable. Robots are often used by search engines to categorize and archive web sites, or by webmasters to proofread source code. |
|
| Back to top |
|
|
| View previous topic :: View next topic |
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Private Messages
Log in
