vir Posted April 10 Share Posted April 10 Hi team, im trying to reach my site via google search but unable to do so. Are we blocking google web crawler? try “site:agriglowbiotech” in Google search and instead of my site our discussion forum appears as a result. Quote Link to comment Share on other sites More sharing options...
qikmob Posted April 10 Share Posted April 10 This means that Google has not yet indexed your site. Add it to Google Search Console and submit an XML sitemap so all your pages can be indexed. https://support.google.com/webmasters/answer/34592 If you are afraid that the Google crawler is being blocked, check your site's robots.txt file. Quote Link to comment Share on other sites More sharing options...
qikmob Posted April 10 Share Posted April 10 Your robots.txt is really blocking Google (in fact it is blocking all crawlers). Instead of Disallow: / use Allow: /, and if you want to block a specific path use Disallow: /admin for example. Quote Link to comment Share on other sites More sharing options...
vir Posted April 10 Author Share Posted April 10 (edited) Thanks for the response , I update the robot.txt and I am still not able to have google crawl through the site. can you add DNS TXT record (Shared in privet message)? Edited April 10 by vir Quote Link to comment Share on other sites More sharing options...
wolstech Posted April 10 Share Posted April 10 Added. Non-authoritative answer: agriglowbiotech.com text = "v=spf1 ip4:65.19.141.67 ip6:2001:470:1:1ee::2009 ~all" agriglowbiotech.com text = "google-site-verification=7NBJ1soWVWT76hs2le6Rq0RDwbd5r-zeXw3fl8a0PB8" > There should be an HTML verification method as well though. Quote Link to comment Share on other sites More sharing options...
Krydos Posted April 10 Share Posted April 10 1 hour ago, wolstech said: There should be an HTML verification method as well though. For anyone who searches and finds this thread. You can verify your own domains via HTML verification without the need to contact an admin or use external DNS. Go to https://search.google.com/ and login or sign up. Click "add property" and when you select property type select "URL Prefix" NOT "Domain", and it will give you an html file to put on your website. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.