Thanks, I totally forgot that robots.txt existed. Since you are replying, do you know the difference between badges and tags?
I wonder if there some way for instances to use the canonical tag to point to the original and make it less annoying for search engines.
That said, I guess id rather see it crawled and let search engines figure it out then have it not crawled at all. Not really sure where that feedback goes though.
Thanks, I totally forgot that robots.txt existed. Since you are replying, do you know the difference between badges and tags?
I wonder if there some way for instances to use the canonical tag to point to the original and make it less annoying for search engines.
That said, I guess id rather see it crawled and let search engines figure it out then have it not crawled at all. Not really sure where that feedback goes though.