Blocking links from being crawled
-
For my blog, should I block category, "read more" and author links from being crawled by search engine robots? Is it good for SEO?
Thanks
-
Hi, sorry... I just meant if you did have a few other spammy links from other sites, those could hurt you. I doubt the woorank ones are hurting, but perhaps the other 3 spammy sites you mentioned could have been.
-
Thanks Dan. Just to be clear, what do you mean by this "It may not be those links, but if there were even a few others, it could potentially hurt the site." You mean blogroll links in other sites? I have 82 links from Woorank. I did not ask them to put me there and I didnt even know who they were until I saw them on webmaster tools. They're unrelated to my niche but they're not a bad quality site. Could they hurt my site?
I did have spammy unrelated links from 3 other websites. But that's it. I have a few links from general topic websites and most of my links are from relevant sites. I'm also on another blogroll from a relevant site, just not as big as the one I mentioned.
-
Thanks for the details. It may not be those links, but if there were even a few others, it could potentially hurt the site. I had a client who had done some spammy link building in 2011ish with another agency and just those few links hurt the site. I would try removing or disavowing anything you can find that's spammy, and not helping, and see if they helps anything.
The types of things to de-optimize on your own site would be more like keyword stuffing in the titles, URLs, headers and internal anchors - not so much blocking pages from being crawled. Blocking crawling it typically only if you want to improve crawl efficiency on really large sites or you just don't want Google to page attention to that content, but it won't fix a Penguin issue if it's on-site.
-Dan
-
Alicia,
I was hit by penguin 2.0. There's no question about it
-
Dan,
The website's topic is very similar to mine. The link was part of a blogroll of about 15 other sites. The anchor text was my website name. For example, if my website were www.cleanbluecars.com, the anchor was Clean Blue Cars. Maybe Google is considering that to be an exact match commercial anchor text?
The websites on that blogroll were not part of a link exchange, but some of the websites on that blogroll mention the main website on their blog. The main website hosts a blog carnival every Monday so people naturally mention it. The main website was who put me on its blogroll because I normally participate on their weekly blog carnival. The carnival links are and have always been no-follow.
-
agree with Dan. If it's not any of the above and you are sure none of the other links are spam, you might not have been hit with penguin 2.0, but some other penalty.
I would check with other tools as well. Use as many tools you have at your disposal and create a comprehensive list of backlinks.
-
It depends. If the sitewide links were;
- off topic from the site it was on, not as relevant
- among a giant list of other "blogroll" links
- on a site that may have a penalty against it
- exact match commercial anchor text <--big one
- if it's part of a "link exchange"
Those issues could hurt you coming from one site. If the links were exact match commercial anchors I'd see about changing them to brand or domain name anchors. If the site linking to you is a random topic, or you're among a big giant list of links, or part of a link exchange get the links removed or disavow.
-Dan
-
I used Google Webmaster tools and I used Site Explorer to try and find the spam. From Webmaster tools was where I found that 50% of all my backlinks came from just 1 site. But this also happens to be the strongest relevant site I could get backlinks from. Is this something that Penguin penalizes you for? The fact that most links are coming from just 1 website?
-
I agree with David here. Someone made a custom category plugin for WordPress which will do what David is suggesting. I would not block anything, but rather noindex what you don't want in the index, which is typically for me tags, subpages, author and date archives.
-Dan
-
Penguin 2.0 is definitely from webspam and backlinks. I suggest using Google Webmaster Tools as your backlink dataset. They provide links that are more likely to be causing problems. It's extremely unlikely the internal links are hurting you if it is Penguin 2.0.
-
I agree with Alice I would not block them. If the content is unique, they can't hurt you. Category sections show up an SERP's all the time and will increase your CTR (click thru rate)
-
I'm concerned because my website lost 50% of traffic from Penguin 2 and I'm trying to find out why. My website only has about 150 posts. According to the Moz Campaign Link Analysys, I have 168 followed external links and more than 11,000 internal links, which I find to be odd. I thought that may be hurting my rankings
I've read a bunch of articles on Penguin about spam and my website had less than 1% of those types of links. Most of my links are from relevant websites. The only link that I think might have hurt me is from a PR4 relevant website that had me on their blogroll. Over 50% of the links to my site came from just that one website because I was on their blogroll. But this still doesn't make sense to me because that link was 100% natural.
-
Category, you can block it, if you see they are creating duplicate content to the website.
Read More: Why block this? I mean it is link to your post and this is very much ok so I personally will not recommend you this!
Author Link: Hello No, Infect making it more interactive can allow you inspire new readership!
-
If possible add unique content to your category pages, and use unique post extracts. Then no need to block.
Don't block "read more" as these link to full posts.
-
Hi,
I wouldn't block these pages from being crawled by search engines. Category pages are great for making sure more link juice flows to your deeper blog pages and making sure they get indexed. I believe author links give authorrank to the corresponding blog post too. I'm not sure about what you mean by 'read more' links. May I ask why you are concerned that these pages hurt SEO?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What should go in a "Link Juice" cocktail?
The office just got some of those fancy Google Partner bottles, and I want to fill them up with a tasty cocktail that is link juice themed. Any ideas on how to tie Google and/or SEO into a fancy cocktail?
Search Behavior | | WilliamKammer1 -
Personalised Geo-targeted results - How does Google pass link juice?
Hello, Many websites now serve specific home page offers based on the location of the customer, my question is, how does link juice flow around a site when the links (this case from the homepage) are served up based on a visitors location? Internal links from your homepage are valuable for ranking that product well in the SERPs so how does Google deal with this? So, for example, a car hire website based in the UK. If you arrive on the care hire website sat in Manchester (Northern UK city), on the homepage the website serves offers of car hire deals in Manchester, Leeds, London and international destinations. If you arrived on this website from London (Southern UK City), you would not see the Manchester link at all but London, and other cities in the South. In this case, when Google crawls the car hire website, it will see internal links but a)which version and b) is there any way of sharing this link value around? Basically, we want to understand if Manchester in this case will get the benefit of an internal homepage link from Google even though we only show Manchester to people FROM Manchester, OR, do Google only give juice based on one version of the website, a generic UK version? Or to put it another way, is there any way of cashing in on both geo-targetting the customer based on their location AND getting link juice from those geo-specific home page links? Perhaps there is some code or way of telling Google that people from Manchester (a certain % of our visitors) will see a homepage internal link for Manchester that will pass some small % link value?
Search Behavior | | xoffie0 -
What to expect after removing external and sitewide links?
Hello, I've been working on removing some sitewide links and some directory links and I would like to know what to expect to see on my rankings based on your own experience if you've dealt with this before. Cheers 🙂
Search Behavior | | mbulox0 -
WMT reporting big drop in links today
Has anyone else noticed a huge drop in inbound links in WMT tools today? I've seen a 50% slump overnight in 2 of my projects. Definitely something still stirring over at the Google data centres!
Search Behavior | | FDFPres0 -
Is putting/removing Adsense ads on the site affects crawling for seo?
Because I noticed when we totally remove Adsense ads on our site, the pages crawled per day on the google webmastertools suddenly dropped into noticable amount and we tested again to turn it on for a singe day, it jumped up again. So if Adsense affects crawling then, if we have adsense ad on all pages of the site the more chances it gets crawled by the bot? WS76R8w
Search Behavior | | CruiseControl0 -
Only 11 pages being crawled
Hi, Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here?? http://www.lifetimelegal.co.uk Kind Regards Elissa
Search Behavior | | Chris__Chris0 -
Is it my back link profile that is affecting my rankings ?
my website www.funktiongolf.co.uk had been ranking well until January and i'm nearly sure its due to low quality links and poor back-link profile i.e over-optimized money keywords can someone guide me? thanks for anyone that replies. I really do appreciate the
Search Behavior | | funktiongolf
help.0 -
How do i know if my links are being classed as spammy?
I have recently notice that a lot of my domains are dropping positions where they have been in a solid position for nearly a year which was good 🙂
Search Behavior | | Dorzone
I am now wondering if google is dropping them due to spammy links but i don't have the first clue how i would find this out. Does anyone have a good way to figure this out or anything to help with this?0