Jump to content

Recommended Posts

Posted

Hi team,

im trying to reach my site via google search but unable to do so. Are we blocking google web crawler? 
 

try “site:agriglowbiotech” in Google search and instead of my site our discussion forum appears as a result. 

Posted

Your robots.txt is really blocking Google (in fact it is blocking all crawlers).

Instead of Disallow: / use Allow: /, and if you want to block a specific path use Disallow: /admin for example.

Screenshot_20240410-145139.thumb.png.74a5fe2e7f93599d47f32f55eaa1154a.png

Posted (edited)

Thanks for the response , I update the robot.txt and I am still not able to have google crawl through the site.
can you add DNS TXT record  (Shared in privet message)?

Edited by vir
Posted

Added. 


Non-authoritative answer:
agriglowbiotech.com     text =

        "v=spf1 ip4:65.19.141.67 ip6:2001:470:1:1ee::2009 ~all"
agriglowbiotech.com     text =

        "google-site-verification=7NBJ1soWVWT76hs2le6Rq0RDwbd5r-zeXw3fl8a0PB8"
>

There should be an HTML verification method as well though.

Posted
1 hour ago, wolstech said:

There should be an HTML verification method as well though.

For anyone who searches and finds this thread. You can verify your own domains via HTML verification without the need to contact an admin or use external DNS. Go to https://search.google.com/ and login or sign up. Click "add property" and when you select property type select "URL Prefix" NOT "Domain", and it will give you an html file to put on your website.

image.png.2dd84edac588e2e60ec39f24e120ac05.png

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...