CommanderCool1234
Active Member
I was looking through the members section of the forum and noticed there was a page for robots, is our information being used by the robots?
-
We are looking for you! Always wanted to join our Supporting Team? We are looking for enthusiastic moderators!
Take a look at our recruitement page for more information and how you can apply:
Why is there a section for robots under members?
- Thread starter CommanderCool1234
- Start date
DreadfulCadillac
Well-Known Member
See im not going to explain the innerworkings of the internet mainly cause I don't know how I would explain it, and I don't know enough. But pretty sure they are used by google and other places to do stuff like list the forum on google, etc
CaptainKirk1234
Active Member
Dude, have you seen the matrix, not everyone is a robot because they are in a simulation.
Agent327
Well-Known Member
How many member sections do you see and where is that page for robots?
DreadfulCadillac
Well-Known Member
Bing and google lol
DeletedUser
You tell a search engine to crawl in a directory or not crawl in one. If it is an administrative folder with no searchable content then a crawl will harm your ranking and possibly expose your server assets to the edge. This is expected and normal to see as the classic root file(s) are/is robots.xml (the structure) and robots.txt(the go /no go instructions) . It will be even more fun with the new Google tags being pushed out. They are well worth your while switching to but you better bring your structured data A game to the table before doing so.
Last edited by a moderator:
Kranyar the Mysterious
Well-Known Member
Only one I care about is Robot: Bender