question about robots.txt

All WYSIWYG Web Builder support issues that are not covered in the forums below.
Forum rules
IMPORTANT NOTE!!

DO YOU HAVE A QUESTION OR PROBLEM AND WANT QUICK HELP?
THEN PLEASE SHARE A "DEMO" PROJECT.



PLEASE READ THE FORUM RULES BEFORE YOU POST:
http://www.wysiwygwebbuilder.com/forum/viewtopic.php?f=12&t=1901

MUST READ:
http://www.wysiwygwebbuilder.com/getting_started.html
WYSIWYG Web Builder FAQ
Post Reply
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

question about robots.txt

Post by goldpompon »

Hi all!
Google recently informed me that it does not index the page https://www.klavierstimmer.com/klavierverkauf.html - error code 404
Therefore, the question is: do I have the robots.txt file installed on my website: www.klavierstimmer.com and is it configured correctly?
Thanks in advance for the clarification.
User avatar
jerryco
 
 
Posts: 873
Joined: Fri Mar 27, 2009 2:42 pm
Location: Purmerend, Holland

Re: question about robots.txt

Post by jerryco »

Your robots.txt contains this:

User-agent: *
Allow: /
Allow: /images/
Sitemap: http://www.yourwebsite.com/sitemap.xml

I'm not an SEO expert but ofcoarse you should list your own domain instead of yourwebsite.

Also, maybe somebody can check if this looks okay:

https://www.klavierstimmer.com/sitemap.xml
// Love is the acceptance of nothing / Account age is no guarantee of efficiency ;-) ->

Above, Beyond, and @wwonderfull! <- Genuinely helps you with a powered up site that counts! Four Times Excellence!
User avatar
BaconFries
 
 
Posts: 5619
Joined: Thu Aug 16, 2007 7:32 pm

Re: question about robots.txt

Post by BaconFries »

Have you yourself added a .robots.txt. A robots.txt is not the same as the site map as jerryco has posted but he is correct in saying the you will need to use your own domain name and not http://www.yourwebsite.com/ as you have done.
See the following on how to use and add a robots.txt
Adding robots.txt to your website

http://www.klavierstimmer.com/robots.txt
See the following on Sitemaps
Adding a sitemap to your website
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Thanks everyone. Already changed sitemap.xml to https://www.klavierstimmer.com
Is it possible to insert https instead of http into my website?
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

You can change the URL in the sitemap properties.
User avatar
BaconFries
 
 
Posts: 5619
Joined: Thu Aug 16, 2007 7:32 pm

Re: question about robots.txt

Post by BaconFries »

Is it possible to insert https instead of http into my website?
Yes it is possible but note when using https:// your are saying to your site visitors that it is secure and safe to use. To ensure that you use htps:// correctly you should purchase a ssl certificate that will validate that your site and pages are secure. Youe hosting service may offer this at a small extra cost or freely.
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Yes, my provider has an SSL certificate that confirms the security of the site and pages.
I saw another problem, when upgrading to version 19. Now I can’t edit old meta data. Is it possible to fix this?
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

You can change the URL of the site map in the site map properties.

Why can't you edit meta data?
What exactly are you trying to do and where do it stop working?
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

I click on Page Properties/Meta Tags/User defined: and I see that not all Metas that are on my page are there. How can I fix this?
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

Maybe you have added the meta data in another part of the page or in the site properties?

It is difficult to help you without seeing what you have done.

Image
User avatar
BaconFries
 
 
Posts: 5619
Joined: Thu Aug 16, 2007 7:32 pm

Re: question about robots.txt

Post by BaconFries »

It may be that you have added it to the Site HTML set to all pages
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Here is Demo Project. After clicking, the file loads automatically.

Link: https://www.klavierstimmer.com/demo/demo.wbs
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

I cannot open the project because it uses extensions which I do not have.

Can you please read this before sharing the project?
viewtopic.php?f=10&t=82134
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Hi Pablo, I have renewed the demo file.

https://www.klavierstimmer.com/demo/demo.wbs
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

You have added a lot of custom code in different places.
- via an HTML object
- via Page HTML, between head tags, body attributes, before body
- via Page Properties -> Meta tags

What exactly do you want to change?

Also, note that there should not be code inside "<body> attributes", this section is for attributes only. Adding code here will break the HTML structure.
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

I want to change MetaTags

Code inside <body> attributes - where should I put it?
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

I think the googletagmanager code should be placed in an HTML object, because it uses an inline frame.

The meta tags can be changed in the Page Properties -> meta tags.
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

HTML object? Where exactly is this located? Between <head><head>
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

The HTML object is available via the toolbox.

Related tutorial:
https://wysiwygwebbuilder.com/add_html.html
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Thanks Pablo! I have between <heads><heads> placed.
https://www.klavierstimmer.com/demo/demo.wbs
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

I do not think it is correct to place inline frame code between the head tags. Normally, it should be in the body.
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Ok! Should it be placed before </body> or after <body>?
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

According to the documentation it should be placed immediately after the <body> tag.
https://support.google.com/tagmanager/a ... 3696?hl=en
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Fine! I have two Tag Managers, old and new. Both were placed after body.
https://www.klavierstimmer.com/demo/demo.wbs

I have more questions about SEO analysis
Can I ask them here or is it better to post them in a separate?

Thanks!
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

I do not have any experience with the Google tag manager, so I cannot assist you with question related to this script. I can only help you put it in the right place.
However, this is not specific to WWB.
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Thanks Pablo, I remembered that a Google employee told me to put Tag Manager in the "body attributes" when we were setting up Google Ads applications.

As for SEO in WWB - when analyzing my project I got the following result:

(Page),Missing keyword: Pianohaus,The page has no headings (h1) containing this keyword.
(Page),Missing keyword: Fl&uuml;gel,The page title does not contain this keyword.
(Page),Missing keyword: Fl&uuml;gel,The page description does not contain this keyword.
(Page),Missing keyword: Fl&uuml;gel,The page has no headings (h1) containing this keyword.
(Page),Missing keyword: Klavierstimmen,The page title does not contain this keyword.
(Page),Missing keyword: Klavierstimmen,The page description does not contain this keyword.
(Page),Missing keyword: Klavierbauer,The page title does not contain this keyword.
(Page),Missing keyword: Klavierbauer,The page description does not contain this keyword.
(Page),Missing keyword: Klavierbauer,The page has no headings (h1) containing this keyword.
(Page),Missing keyword: D&uuml;sseldorf,The page title does not contain this keyword.
(Page),Missing keyword: D&uuml;sseldorf,The page description does not contain this keyword.
(Page),Missing keyword: D&uuml;sseldorf,The page has no headings (h1) containing this keyword.
Image3,Image has no description,Describe the appearance and function of the image on a page
Image4,Image has no description,Describe the appearance and function of the image on a page
Image5,Image has no description,Describe the appearance and function of the image on a page
Image6,Image has no description,Describe the appearance and function of the image on a page
Image7,Image has no description,Describe the appearance and function of the image on a page
Image8,Image has no description,Describe the appearance and function of the image on a page
Image9,Image has no description,Describe the appearance and function of the image on a page
Image10,Image has no description,Describe the appearance and function of the image on a page
Image11,Image has no description,Describe the appearance and function of the image on a page
Image12,Image has no description,Describe the appearance and function of the image on a page
Image13,Image has no description,Describe the appearance and function of the image on a page
Image14,Image has no description,Describe the appearance and function of the image on a page
Image15,Image has no description,Describe the appearance and function of the image on a page
Image16,Image has no description,Describe the appearance and function of the image on a page
Image17,Image has no description,Describe the appearance and function of the image on a page
Image18,Image has no description,Describe the appearance and function of the image on a page
Image19,Image has no description,Describe the appearance and function of the image on a page
Image20,Image has no description,Describe the appearance and function of the image on a page
Image21,Image has no description,Describe the appearance and function of the image on a page
Image22,Image has no description,Describe the appearance and function of the image on a page
Image23,Image has no description,Describe the appearance and function of the image on a page
Image24,Image has no description,Describe the appearance and function of the image on a page


Does it make sense to fix something?
User avatar
BaconFries
 
 
Posts: 5619
Joined: Thu Aug 16, 2007 7:32 pm

Re: question about robots.txt

Post by BaconFries »

For more information on this and how to fix/resolve see the following.SEO Assistant
User avatar
Pablo
 
Posts: 22422
Joined: Sun Mar 28, 2004 12:00 pm
Location: Europe
Contact:

Re: question about robots.txt

Post by Pablo »

I remembered that a Google employee told me to put Tag Manager in the "body attributes" when we were setting up Google Ads applications.
The Google employee is wrong about this. It makes no sense to add this code as 'body attribute'. This is incorrect and breaks the HTML structure.

It is up to want to fix these issues. The tool is just for informational purposes.

You can learn more about these errors here:
https://www.wysiwygwebbuilder.com/seo_assistant.html
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Thanks everyone. Should keywords be separated by comma or not? Maybe that’s, why the SEO tool doesn’t see the keyword in h1, as in my case?
wwonderfull
 
 
Posts: 1432
Joined: Fri Aug 21, 2020 8:27 am
Contact:

Re: question about robots.txt

Post by wwonderfull »

yes keywords needs to be separated using comma or else it would become more like a sentence rather than keyword tags.
goldpompon
 
 
Posts: 48
Joined: Sat Nov 23, 2019 1:12 pm

Re: question about robots.txt

Post by goldpompon »

Thanks wwonderfull !
Post Reply