Google will index us, but Bing won't. Why?
-
This post is deleted! -
Same problem with https://nightmareSolution.com
Bing constantly crawl the website but for some unknown reason, bing won't index the website.However, everything is fine on the side of Google and Yandex, it takes Less than 24 hours for Google to index a new blog post.
I think the problem is with Bing and not the website?
Anyone here found a solution? -
Has anyone solved this problem? My website is not indexed by Bing either. Everything had been checked. Website: https://www.walkingpad.com/
-
@bcammo Hey, may I ask you how did you solve your issue and what exactly was wrong?
I got:
Indexed but cannot be served. URL cannot appear on Bing
Last crawl attempted: 04 Aug 2021 at 18:49
Crawl allowed? Yes.
Page Fetch: Successful.
Indexing allowed? Yes.
Index
Canonical URL - -
The inspected URL has been indexed successfully but there are some issues which might prevent us from serving it to our users. Please contact Bing Webmaster support for more detailsI ask support but got 2 generic replies so far telling me that I need to review their guidelines and fix the issues but I don’t know what those issues are. All I see is 2 dash lines in the last line at “Canonical URL” and I don’t know what that means? I am very frustrated because I got no issues at all in Google and MS won’t tell me what is wrong.
-
Hi
I have same problem. Website is 2 to 3 years old.
Our website is indexed very well on Google and have listing on 1st page of google for many keywords.
However site is not getting indexed on Bing.
We emailed them few times and just a normal reply saying, follow guidelines.
But we have no clue what we need to do.
Error:
Blocked
URL cannot appear on BingWeb site url is: https://www.bulkcheapammo.com
Any one got it fixed? @Moz Any suggestions please?
-
Yes, sorry
I used the form on their support site for the webmaster tools : https://www.bing.com/webmaster/support
Although that doesn't seem to be working at this moment so the email address that it was sent to is :
Hope this helps!
-
Just encase anyone is still having issues with this, or happens to come across this post in the future...
We emailed Bing support who came back and said that they had found their bots were blocked from indexing our site, there was no reason for this but just an error in their system (apparently this is quite common).
They responded pretty quickly and removed the block, a couple of days later we were being indexed and seeing traffic come from Bing!
-
We are having the same issue with one of our sites. We have tried all of the suggestions we can find on the internet.
Submitted out site to Bing webmaster tools, submitted the Sitemap, checked the Robots.txt...
It is now crawling the site but still not indexing any of the pages! The only thing left for us to do is wait and hope that Bing will eventually index it, but it seems weird as its being indexed fine in other search engines and generally getting good search engine rankings for keywords.
The website is www.thriveinlife360.com for reference.
We have a client base of well over 20 websites and all of them are being indexed in Bing, except from this one.
Would be interesting to know how many websites this affects and if there is a pattern within those that Bing doesn't like.
-
This is highly confounding. I've crawled as Bingbot and nothing is in it's way.
There are a few other issues though. You are using the canonical on a large number of pages. In my crawl, I am seeing the crawler going through a large number of pages and only returning a fraction of them. At this moment my crawler is finding 31k things to crawl, has crawled 1044 and returned only 29 pages that might be indexed. 65% of those are without errors.
It is possible that the site structure is causing issues. I suggest taking time to review your site structure and making it easier for bots to find the pages they need to index, telling them what not to crawl (a canonical is a suggestion and should be used when pages are duplicated), and fixing all errors on the site.
-
Thanks, Kate! Unfortunately, we've tried all those idea already too.
- We've contacted ads, but on luck in connection there.
- We've submitted to webmaster tools; the site is getting crawled but not indexed.
- We’ve submitted the sitemap manually, as well.
-
Not seeing anything overtly wrong. I submitted your homepage to Bing for indexing, so we'll see what happens there.
2 other things though.
- You advertise. Get a hold of the ads side and see if they know anything or if they can connect you with anyone. It's a long shot, but worth a try.
- Have you verified your site in Bing Webmaster Tools and submitted your sitemap manually?
-
Yes! The domain is http://www.pamandgela.com/
Thank you!
-
Can you provide your domain please?
-
How to use Fetch as Bingbot
Fetch as Bingbot is a very useful tool for troubleshooting. You will find this tool in the Diagnostics & Tools section in the navigation menu. **Fetch as Bingbot **allows you to see exactly what the Bingbot sees when downloading a page from your site. As such, it’s a great tool for determining if a page on your site can be crawled. To use it, simply enter in the URL from your site and click Fetch. This tool will send the request to Bingbot for processing, so it’s normal that it takes a few seconds to run your request. Just below the URL entry form, the URL you requested (along with any previous requests) will be shown. When Bingbot is finished with your request, the status for the URL will change to Completed. To see what Bingbot found at your URL, simply click the **Completed **link and scroll down the page to view the page source that Bingbot found.
SEE WHAT BINGBOT SEES
Fetch as Bingbot shows you exactly what your HTTP Headers and page source look like to Bingbot. Viewing your page’s source in this manner ensures you know exactly what Bingbot is seeing when it crawls the URL. This is especially useful in helping find areas when you want to make sure content can be indexed or in cases where your site may have been compromised and is for example sending different HTML to Bingbot then to users. By scanning through the page source, you could note things like links injected into blog posts or any other manner of additive items you did not place on your website.
Fetch as Bingbot is also a reliable way to test if a URL is being blocked by your robots.txt file. It’s polite, so sending it to fetch a URL blocked via robots.txt will get you a notice explaining that this barrier is in place.
Also, if Fetch as Bingbot is not able to crawl a page because of other blocks or politeness constraints, for example the maximum amount of crawls we are allowed to make in a given time window, the tool will tell you too.
| NOTE |
| To see the crawled content of a page using the crawlable Ajax protocol using #! notation in the URL, you need to input the static URL instead. The static URL is the URL that contains the ?escaped_fragment= portion. Note that although Bing supports this protocol we do not recommend it for frequent use. |COMMON PROBLEMS
WHAT DOES "REDIRECTION LIMIT REACHED MEAN"?
Unlike the SEO Analyzer tool, Fetch as Bingbot does not follow redirects. Instead it will let you know that the page resulted in a redirect and shows you the HTTP headers it received from your server. The line most commonly starting with HTTP/1.1 shows the status code (301, 302, or in some cases 303 or 307 - see this full list of 3xx status codes) and the location: header shows you where the server tells Bingbot (and other clients) where the redirect should go to. To fetch the page at that location you will need to perform a new fetch using that URL. This is in fact how the Bingbot crawler works: every redirect requires a brand new fetch, and this new fetch does not necessarily happen immediately after encountering the redirect.
WHAT DOES "DOWNLOAD OF ROBOTS.TXT FAILED" MEAN?
When the result of a fetch reads “Download of Robots.txt Failed”, then Bingbot was not able get a proper server response when trying to access your site’s robots.txt. This usually means that your site’s server is configured to refuse Bingbot or the IP addresses from which Bingbot operates a proper connection or simply denies access to this URL. This is a problem, since Bingbot now cannot tell whether or not a robots.txt file actually exists nor read any directives in the robots.txt file should it exist. You should investigate (or ask your ISP to investigate) whether such a configuration is in place.
WHAT DOES "REPRESENT DOWNLOAD NOT ATTEMPTED DUE TO POLITENESS ISSUE" MEAN?
When the result of a fetch reads “Represent download not attempted due to politeness issue”, then Bingbot did not try fetch the page due to restrictions on how much we can crawl the site. This usually means that Bingbot is backing off at this point in time and that it cannot fetch the page "politely", that is, honoring crawl delays or heuristically determined maximum fetches per second for your site. If this issue persists it may point to insufficient bandwidth available to Bingbot to crawl your site efficiently. First, you should check your site's robots.txt for any crawl-delay: directives. Removing or lowering crawl-delay directives can also help with this issue. If there are no crawl-delay directives present, you should check Crawl Control settings to see if they can help improve by setting higher levels (especially during times when you expect fewer visitors).
WHAT DOES "UNEXPECTED ERROR" MEAN?
If you are seeing frequent "Unexpected Error" results in Fetch as Bingbot, this may indicate that our crawler is not able to connect to your server and not getting a server response at all. Your server may be unintentionally blocking Bingbot based on user agent or IP range. To remedy this, look for server configurations or modules that may be dropping connections for Bingbot or work with your ISP to identify whether the issue is on their side.
You can find more information on troubleshooting issues at Bing Webmaster Tools Help & How-To Center
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to stop google from indexing specific sections of a page?
I'm currently trying to find a way to stop googlebot from indexing specific areas of a page, long ago Yahoo search created this tag class=”robots-nocontent” and I'm trying to see if there is a similar manner for google or if they have adopted the same tag? Any help would be much appreciated.
Technical SEO | | Iamfaramon0 -
Google index graph duration in Google Webmaster Tools
Hello guys, I wonder, my sites are currently being indexed every 7 days, exactly. At Index Status page in GWT. However, this new site gets updated almost everyday, how can I ask google to index faster and more frequently/almost daily? Is it about SItemap.xml frequency ? I changed it today to Daily. Thanks!
Technical SEO | | mdmoz0 -
Don't reach to make our site back in rankings
My URL is: http://tinyurl.com/nslu78 Hi, I really hope someone can help because my site seems to be penalized since last year now. Because we were not SEO experts but doctors and wanted to do things in a white hat way so we have given our SEO strategy (on-site and off-site) to the best US SEO agencies and now we are penalized. We was ranking on the 1st page with 15 keywords and now we don't even are in the first 10 pages. I know that our sector is suspicious but we are a real laboratory and our site is 100% transparent. I understand that a lot of people can think that we are all the same but this is not true, we are not a virtual company that don't even show their name or address, we show name, address, phone number, fax, email, chat service, VAT number everything so please help us. We have spent 3 months analysing every paragraph of google guidelines to see if we were violating some rule such as hidden text, link schemes, redirections, keyword stuffing, maleware, duplicate content etc.. and found nothing except little things but maybe we are not good enough to find the problem. In 3 months we have passed from 85 toxic links to 24 and from 750 suspicious links to 300. we have emailed, and call all the webmasters of each site several times to try to delete as many links as possible.We have sent to google a big excel with all our results and attempts to delete those badlinks. We have then sent a reconsideration request explaining all the things that we have verified on-site and off-site but it seems that it didn't worked because we are still penalized. I really hope someone can see where the problem is.
Technical SEO | | andromedical
thank you0 -
Duplicate page errors from pages don't even exist
Hi, I am having this issue within SEOmoz's Crawl Diagnosis report. There are a lot of crawl errors happening with pages don't even exist. My website has around 40-50 pages but SEO report shows that 375 pages have been crawled. My guess is that the errors have something to do with my recent htaccess configuration. I recently configured my htaccess to add trailing slash at the end of URLs. There is no internal linking issue such as infinite loop when navigating the website but the looping is reported in the SEOmoz's report. Here is an example of a reported link: http://www.mywebsite.com/Door/Doors/GlassNow-Services/GlassNow-Services/Glass-Compliance-Audit/GlassNow-Services/GlassNow-Services/Glass-Compliance-Audit/ btw there is no issue such as crawl error in my Google webmaster tool. Any help appreciated
Technical SEO | | mmoezzi0 -
De-indexed from Google
Hi Search Experts! We are just launching a new site for a client with a completely new URL. The client can not provide any access details for their existing site. Any ideas how can we get the existing site de-indexed from Google? Thanks guys!
Technical SEO | | rikmon0 -
No Google cached snapshot image... 'Text-only version' working.
We are having an issue with Googles cached image snapshops... Here is an example: http://webcache.googleusercontent.com/search?q=cache:IyvADsGi10gJ:shop.deliaonline.com/store/home-and-garden/kitchen/morphy-richards-48781-cooking/ean/5011832030948+&cd=308&hl=en&ct=clnk&gl=uk I wondered if anyone knows or can see the cause of this problem? Thanks
Technical SEO | | pekler1 -
Has google panelized us ? If so, why ? How do I know if our website is panelized ?
We were ranked on first page among top 5 position a year ago for most of our pages. On one fine day, google decided to drop us from the results although google keeps indexing our pages. Google index our pages regularly but doesn't show them in its results. All google traffic we receive is for our own site name and its variations. I wanted to know - how do we know if google has panelized us. Why has google panelized us ? If they have panelized us, what can we do to get out of it ? Also I wanted to know if any tool will help me identify such thing. We have not done any link building. Our site page rank is 4 (it was 5 few months ago). All we did was on page optimization. Thanks for your help!
Technical SEO | | seoidea0 -
Title Tag won't update
The Home page Title Tag on my Wordpress CMS Website doesn't update. It has the Thesis Theme and All in One SEO plugin. I've updated it exactly the same on the Home page, for SEO plugin, and in the Thesis Theme - but still it displays the old one.. The site was last cached about a week ago - 3X since I've been attempting to change it. The other page's Title Tags update instantly when updated, but not the Home page. I've been digging for a solution and can't seem to find an answer. What could be the problem? (www.austinfitnessgyms.com -It should be: Austin Gym | Kickboxing in Austin | Impact MMA Fitness)
Technical SEO | | OhYeahSteve0