link-followability

Crystal shard: classify links by rel tokens (nofollow/ugc/sponsored), meta robots and X-Robots-Tag