Page 1 of 1
question about robots.txt
Posted: Mon Apr 01, 2024 9:28 am
by goldpompon
Hi all!
Google recently informed me that it does not index the page
https://www.klavierstimmer.com/klavierverkauf.html - error code 404
Therefore, the question is: do I have the robots.txt file installed on my website:
www.klavierstimmer.com and is it configured correctly?
Thanks in advance for the clarification.
Re: question about robots.txt
Posted: Mon Apr 01, 2024 9:36 am
by jerryco
Your robots.txt contains this:
User-agent: *
Allow: /
Allow: /images/
Sitemap:
http://www.yourwebsite.com/sitemap.xml
I'm not an SEO expert but ofcoarse you should list your own domain instead of yourwebsite.
Also, maybe somebody can check if this looks okay:
https://www.klavierstimmer.com/sitemap.xml
Re: question about robots.txt
Posted: Mon Apr 01, 2024 9:50 am
by BaconFries
Have you yourself added a .robots.txt. A robots.txt is not the same as the site map as jerryco has posted but he is correct in saying the you will need to use your own
domain name and not
http://www.yourwebsite.com/ as you have done.
See the following on how to use and add a robots.txt
Adding robots.txt to your website
http://www.klavierstimmer.com/robots.txt
See the following on Sitemaps
Adding a sitemap to your website
Re: question about robots.txt
Posted: Mon Apr 01, 2024 10:52 am
by goldpompon
Thanks everyone. Already changed sitemap.xml to
https://www.klavierstimmer.com
Is it possible to insert https instead of http into my website?
Re: question about robots.txt
Posted: Mon Apr 01, 2024 11:24 am
by Pablo
You can change the URL in the sitemap properties.
Re: question about robots.txt
Posted: Mon Apr 01, 2024 11:36 am
by BaconFries
Is it possible to insert https instead of http into my website?
Yes it is possible but note when using https:// your are saying to your site visitors that it is secure and safe to use. To ensure that you use htps:// correctly you should purchase a ssl certificate that will validate that your site and pages are secure. Youe hosting service may offer this at a small extra cost or freely.
Re: question about robots.txt
Posted: Mon Apr 01, 2024 11:54 am
by goldpompon
Yes, my provider has an SSL certificate that confirms the security of the site and pages.
I saw another problem, when upgrading to version 19. Now I can’t edit old meta data. Is it possible to fix this?
Re: question about robots.txt
Posted: Mon Apr 01, 2024 12:06 pm
by Pablo
You can change the URL of the site map in the site map properties.
Why can't you edit meta data?
What exactly are you trying to do and where do it stop working?
Re: question about robots.txt
Posted: Mon Apr 01, 2024 2:12 pm
by goldpompon
I click on Page Properties/Meta Tags/User defined: and I see that not all Metas that are on my page are there. How can I fix this?
Re: question about robots.txt
Posted: Mon Apr 01, 2024 2:21 pm
by Pablo
Maybe you have added the meta data in another part of the page or in the site properties?
It is difficult to help you without seeing what you have done.
Re: question about robots.txt
Posted: Mon Apr 01, 2024 3:04 pm
by BaconFries
It may be that you have added it to the Site HTML set to all pages
Re: question about robots.txt
Posted: Mon Apr 01, 2024 6:13 pm
by goldpompon
Here is Demo Project. After clicking, the file loads automatically.
Link:
https://www.klavierstimmer.com/demo/demo.wbs
Re: question about robots.txt
Posted: Mon Apr 01, 2024 7:37 pm
by Pablo
I cannot open the project because it uses extensions which I do not have.
Can you please read this before sharing the project?
viewtopic.php?f=10&t=82134
Re: question about robots.txt
Posted: Mon Apr 01, 2024 9:10 pm
by goldpompon
Re: question about robots.txt
Posted: Tue Apr 02, 2024 6:30 am
by Pablo
You have added a lot of custom code in different places.
- via an HTML object
- via Page HTML, between head tags, body attributes, before body
- via Page Properties -> Meta tags
What exactly do you want to change?
Also, note that there should not be code inside "<body> attributes", this section is for attributes only. Adding code here will break the HTML structure.
Re: question about robots.txt
Posted: Wed Apr 03, 2024 5:14 am
by goldpompon
I want to change MetaTags
Code inside <body> attributes - where should I put it?
Re: question about robots.txt
Posted: Wed Apr 03, 2024 6:12 am
by Pablo
I think the googletagmanager code should be placed in an HTML object, because it uses an inline frame.
The meta tags can be changed in the Page Properties -> meta tags.
Re: question about robots.txt
Posted: Wed Apr 03, 2024 7:12 am
by goldpompon
HTML object? Where exactly is this located? Between <head><head>
Re: question about robots.txt
Posted: Wed Apr 03, 2024 8:06 am
by Pablo
The HTML object is available via the toolbox.
Related tutorial:
https://wysiwygwebbuilder.com/add_html.html
Re: question about robots.txt
Posted: Wed Apr 03, 2024 6:47 pm
by goldpompon
Thanks Pablo! I have between <heads><heads> placed.
https://www.klavierstimmer.com/demo/demo.wbs
Re: question about robots.txt
Posted: Wed Apr 03, 2024 7:42 pm
by Pablo
I do not think it is correct to place inline frame code between the head tags. Normally, it should be in the body.
Re: question about robots.txt
Posted: Thu Apr 04, 2024 8:00 am
by goldpompon
Ok! Should it be placed before </body> or after <body>?
Re: question about robots.txt
Posted: Thu Apr 04, 2024 9:08 am
by Pablo
According to the documentation it should be placed immediately after the <body> tag.
https://support.google.com/tagmanager/a ... 3696?hl=en
Re: question about robots.txt
Posted: Thu Apr 04, 2024 1:19 pm
by goldpompon
Fine! I have two Tag Managers, old and new. Both were placed after body.
https://www.klavierstimmer.com/demo/demo.wbs
I have more questions about SEO analysis
Can I ask them here or is it better to post them in a separate?
Thanks!
Re: question about robots.txt
Posted: Thu Apr 04, 2024 1:38 pm
by Pablo
I do not have any experience with the Google tag manager, so I cannot assist you with question related to this script. I can only help you put it in the right place.
However, this is not specific to WWB.
Re: question about robots.txt
Posted: Thu Apr 04, 2024 5:03 pm
by goldpompon
Thanks Pablo, I remembered that a Google employee told me to put Tag Manager in the "body attributes" when we were setting up Google Ads applications.
As for SEO in WWB - when analyzing my project I got the following result:
(Page),Missing keyword: Pianohaus,The page has no headings (h1) containing this keyword.
(Page),Missing keyword: Flügel,The page title does not contain this keyword.
(Page),Missing keyword: Flügel,The page description does not contain this keyword.
(Page),Missing keyword: Flügel,The page has no headings (h1) containing this keyword.
(Page),Missing keyword: Klavierstimmen,The page title does not contain this keyword.
(Page),Missing keyword: Klavierstimmen,The page description does not contain this keyword.
(Page),Missing keyword: Klavierbauer,The page title does not contain this keyword.
(Page),Missing keyword: Klavierbauer,The page description does not contain this keyword.
(Page),Missing keyword: Klavierbauer,The page has no headings (h1) containing this keyword.
(Page),Missing keyword: Düsseldorf,The page title does not contain this keyword.
(Page),Missing keyword: Düsseldorf,The page description does not contain this keyword.
(Page),Missing keyword: Düsseldorf,The page has no headings (h1) containing this keyword.
Image3,Image has no description,Describe the appearance and function of the image on a page
Image4,Image has no description,Describe the appearance and function of the image on a page
Image5,Image has no description,Describe the appearance and function of the image on a page
Image6,Image has no description,Describe the appearance and function of the image on a page
Image7,Image has no description,Describe the appearance and function of the image on a page
Image8,Image has no description,Describe the appearance and function of the image on a page
Image9,Image has no description,Describe the appearance and function of the image on a page
Image10,Image has no description,Describe the appearance and function of the image on a page
Image11,Image has no description,Describe the appearance and function of the image on a page
Image12,Image has no description,Describe the appearance and function of the image on a page
Image13,Image has no description,Describe the appearance and function of the image on a page
Image14,Image has no description,Describe the appearance and function of the image on a page
Image15,Image has no description,Describe the appearance and function of the image on a page
Image16,Image has no description,Describe the appearance and function of the image on a page
Image17,Image has no description,Describe the appearance and function of the image on a page
Image18,Image has no description,Describe the appearance and function of the image on a page
Image19,Image has no description,Describe the appearance and function of the image on a page
Image20,Image has no description,Describe the appearance and function of the image on a page
Image21,Image has no description,Describe the appearance and function of the image on a page
Image22,Image has no description,Describe the appearance and function of the image on a page
Image23,Image has no description,Describe the appearance and function of the image on a page
Image24,Image has no description,Describe the appearance and function of the image on a page
Does it make sense to fix something?
Re: question about robots.txt
Posted: Thu Apr 04, 2024 5:58 pm
by BaconFries
For more information on this and how to fix/resolve see the following.
SEO Assistant
Re: question about robots.txt
Posted: Thu Apr 04, 2024 6:04 pm
by Pablo
I remembered that a Google employee told me to put Tag Manager in the "body attributes" when we were setting up Google Ads applications.
The Google employee is wrong about this. It makes no sense to add this code as 'body attribute'. This is incorrect and breaks the HTML structure.
It is up to want to fix these issues. The tool is just for informational purposes.
You can learn more about these errors here:
https://www.wysiwygwebbuilder.com/seo_assistant.html
Re: question about robots.txt
Posted: Thu Apr 04, 2024 9:06 pm
by goldpompon
Thanks everyone. Should keywords be separated by comma or not? Maybe that’s, why the SEO tool doesn’t see the keyword in h1, as in my case?
Re: question about robots.txt
Posted: Fri Apr 05, 2024 4:15 am
by wwonderfull
yes keywords needs to be separated using comma or else it would become more like a sentence rather than keyword tags.
Re: question about robots.txt
Posted: Fri Apr 05, 2024 6:37 am
by goldpompon
Thanks wwonderfull !