Messy text for SEO spiders

Hi, I'm using this tool to simulate search engine spider crawl, and I'm getting a lot of messy unrelated text.

For example, if I use this simulator http://www.webconfs.com/search-engine-s ... ulator.php on this sites:
1- http://www.mueblesdemaderayjardin.com/m ... -teca.html
2- http://www.mgscreativa.com/en/online-st ... rtuemart3-

Both sites are similar in the way they are displaying a product details page.

For the first site, this is the Spidered Text :

Mesas de Teka. Teka de Indonesia - Muebles de Madera y Jardín Newsletter (011) 5650-7016 (011) 15 3097-9143 Inicio Mesas Mesas de Teka Dejanos tu consulta Aquí Ingrese su nombre: Ingrese su E-mail: Telefono: Ingrese su mensaje: Enviar Mesas de Teka Mesa de Teka. Importamos y distribuimos desde Iindonesia mesas de teka. Disponemos de mesas y sillas de Teka. Disponemos de toda la linea de muebles de teka para exterior. Particularmente disponemos de mesas de teka cuadradas, mesas de teka extensibles, mesas de teka rectangulares, etc. Mantenga nuevos sus muebles de teka con aceite de teka. Consultemos. Mesas de teka para jardin. Muebles de madera para Jardin 1 2 3 4 5 (20 votos, promedio 4.30 de 5) Publicaciones Relacionadas Mesa de Teka para Jardin Si busca una mesa de teka para jardin, seguramente encontrará en nuestra fábrica de muebles el modelo y el tamaño que necesita. Somos especialistas en la fabricación de muebles de exterior y, por supuesto, sabemos de maderas. La mesa de teka... Leer más... Mesa y Sillas de Teka El conjunto de mesa y sillas de teka por las características particulares de su madera resulta ideal para quienes buscan muebles de madera finos y resistentes. La teka, que los portugueses habían llevado a Europa procedente de Indonesia, también... Leer más... Mesas de teka Las mesas de teka, las sillas de teka, juego de mesa y sillas y todos los muebles de teka, pueden ser pensados como muebles de teka para exterior, porque los muebles de teka y aunque parezca redundante, tienen la particularidad de estar fabricados... Leer más... Ubicación Estamos ubicados sobre la calle Coronel Vilela 1777 entre las calles Manuel Quintana y Groussac, en Talar de Pacheco, Partido de Tigre. Otras Secciones Blog de Muebles de Madera y JardinMuebles en ArgentinaTipos de Muebles de JardinDecksFábrica de MueblesSitemap Datos de Contacto (011) 5650-7016 (011) 15 3097-9143 Esta dirección de correo electrónico está protegida contra spambots. Usted necesita tener Javascript activado para poder verla. @MueblesMyJardin /MueblesMyJardin

For the second site, this is the Spidered text:

Payment Plugins : MercadoPago My OrdersMy AccountCheckout Switch Language Loading... HomeServices Professional Web DevelopmentJoomla! WebsitesVirtueMart e-CommerceJoomla! - VirtueMart Development Our ClientsOnline Store VirtueMart 3Payment PluginsShipment PluginsCurrency PluginsVirtueMart 2Payment PluginsShipment PluginsCurrency PluginsMore ProductsHikaShopDJ-ClassiffiedsPayPlansJVArcadeK2StoreredShop Contact Us Menu: HomeServices— Professional Web Development— Joomla! Websites— VirtueMart e-Commerce— Joomla! - VirtueMart DevelopmentOur ClientsOnline Store— VirtueMart 3—— Payment Plugins—— Shipment Plugins—— Currency Plugins— VirtueMart 2—— Payment Plugins—— Shipment Plugins—— Currency Plugins— More Products—— HikaShop—— DJ-Classiffieds—— PayPlans—— JVArcade—— K2Store—— redShopContact Us Home / Online Store / VirtueMart 3 / Payment Plugins / MercadoPago MercadoPago Value:€ 25,00 Ask a question about this product Support and Updates Period 1 Month 3 Months 6 Months 12 Months Choose your desired support and updates period Downloadable Content MercadoPago payment for VirtueMart You get this with your purchase MercadoPago payment plugin for VirtueMart 3 This plugin integrates MercadoPago payment gateway with VirtueMart 3. This plugin, automatically integrates to your VirtueMart store in a way that the store administrator simply installs the plugin and after several simple configuration steps, gets a full fledged payment gateway. With MercadoPago in your store, you can provide lots of payments methods to your customers. This plugin automatically converts currencies for stores that need different currencies for their products. Take a look at our currency plugins, click here MercadoPago supports the following countries: Argentina Brasil México Venezuela Colombia Chile Peru Install Instructions: Install the plugin using Joomla! extensions installer Enable plugin on Joomla! plugin manager Create and configure a new VirtueMart payment method (Components->VirtueMart->Payment Methods->New) Write down the new payment method name Select "Yes" on "Published" Select "VMPayment - Mercadopago Payment Plugin With IPN 2.0 And Checkout API" in "Payment Method" field Click "Save" to enable "Configuration" tab Click "Configuration" tab Set the "Client ID" and "Client Secret" provided by MercadoPago. You can get your credentials through this link http://developers.mercadopago.com/docum ... enticacion and then, click on the button "Obtener credenciales", finally, you may select the correct country according to your MercadoPago account and it will display your credentials Set the other options as you like IPN Instructions: To be able to use the IPN functionality, first configure the payment method in VirtueMart, and the plugin will tell you the correct URL Changelog: Ver 1.0.11: Added support for MercadoPago Peru Ver 1.0.10: Added Spanish localization Ver 1.0.9: Avoid order re-processing when MercadoPago send an approved notification regarding an already confirmed order Fixed issue preventing payment method name being displayed in order details Ver 1.0.8: Fixed calculation issue of plugin extra charge at checkout Ver 1.0.7: Allow option to avoid display of logo in checkout process Ver 1.0.6: Compatibility with MercadoEnvíos shipping plugin Ver 1.0.5: Upgraded MercadoPago SDK Ver 1.0.4: Fixed an issue preventing correct cost per transaction calculation Ver 1.0.3: Added support for MercadoPago Chile! Upgraded MercadoPago SDK Created a little debug tool to provide better support Updated MercadoPago logos Related Products MercadoPago XE Google Finance Yahoo Finance Oanda CSV Exchange Rates Webservicex X-Rates Open Exchange Rates Our Products VirtueMart 3 Payment Plugins Shipment Plugins Currency Plugins VirtueMart 2 Payment Plugins Shipment Plugins Currency Plugins HikaShop DJ-Classifieds PayPlans jVArcade K2Store redSHOP Search in Store Services Professional Web DevelopmentJoomla! WebsitesVirtueMart e-CommerceJoomla! and VirtueMart Development Online Store VirtueMart 3VirtueMart 2HikaShopK2StoreredShopJVArcadeDJ-Classiffieds Your Account My AccountMy OrdersCheckout Our policies Terms of ServicePrivacy StatementReturns & RefoundsCookies StatementPayment Methods MGS Creativa. All rights reserved Log in create an account Username Password Remember Me Forgot your password? Forgot your username?

Is there any way to get the text of the second site more clean, I mean without text grabbed from UI elements or text from menu items, for example My OrdersMy AccountCheckout Switch Language Loading...

Thanks in advise!

Hi

I'm sorry, but I cannot answer this question. Unfortunately Your second link is showing error 500, so I cannot check source code to see if thre are no problems.

Sorry to hear that. It's fixed now, can you check it out again?

Thanks!

Hi

I've compared source code of this pages and I can see that older site simply didn't has most of the options, anyway I'm gonna consult it with programmers, but to be honest I do not think it's a problem that robots can see this extra elements.

Thanks! I really think the same, but my client is kind of a SEO maniac and I need to give him proof of that it's not gonna be a problem!

Thanks a lot!

Hi

Programmers has checked and looks like the main cause of the problem is this test crawler. A regular Google crawler does not include a content from inside select elements.

But there is a way to exclude it for this crawler as well. Add this code to /layout/blocks/head.php

Code: Select all

<script type="text/javascript">(function($) {$(document).ready(function() {
$('select, option').attr('role','navigation');
});})(jQuery)</script>


You can list any other element You wish to not indexed by crawler.

Great! Thanks!

Hi

Have You had a chance to try that ? It should work in theory, but I'm really curious if it did actually.

Hi @teitbite!
I think I can't see much improvement

URl http://www.mgscreativa.com/en/online-store/virtuemart-3/payment-plugins/mercadopago-payment-plugin-for-virtuemart3-

Spidered Text :

Payment Plugins : MercadoPago My OrdersMy AccountCheckout Switch Language Loading... HomeServices Professional Web DevelopmentJoomla! WebsitesVirtueMart e-CommerceJoomla! - VirtueMart Development Our ClientsOnline Store VirtueMart 3Payment PluginsShipment PluginsCurrency PluginsVirtueMart 2Payment PluginsShipment PluginsCurrency PluginsMore ProductsHikaShopDJ-ClassiffiedsPayPlansJVArcadeK2StoreredShop Contact Us Menu: HomeServices— Professional Web Development— Joomla! Websites— VirtueMart e-Commerce— Joomla! - VirtueMart DevelopmentOur ClientsOnline Store— VirtueMart 3—— Payment Plugins—— Shipment Plugins—— Currency Plugins— VirtueMart 2—— Payment Plugins—— Shipment Plugins—— Currency Plugins— More Products—— HikaShop—— DJ-Classiffieds—— PayPlans—— JVArcade—— K2Store—— redShopContact Us Home / Online Store / VirtueMart 3 / Payment Plugins / MercadoPago MercadoPago Value:€ 25,00 Ask a question about this product Support and Updates Period 1 Month 3 Months 6 Months 12 Months Choose your desired support and updates period Downloadable Content MercadoPago payment for VirtueMart You get this with your purchase MercadoPago payment plugin for VirtueMart 3 This plugin integrates MercadoPago payment gateway with VirtueMart 3. This plugin, automatically integrates to your VirtueMart store in a way that the store administrator simply installs the plugin and after several simple configuration steps, gets a full fledged payment gateway. With MercadoPago in your store, you can provide lots of payments methods to your customers. This plugin automatically converts currencies for stores that need different currencies for their products. Take a look at our currency plugins, click here MercadoPago supports the following countries: Argentina Brasil México Venezuela Colombia Chile Peru Install Instructions: Install the plugin using Joomla! extensions installer Enable plugin on Joomla! plugin manager Create and configure a new VirtueMart payment method (Components->VirtueMart->Payment Methods->New) Write down the new payment method name Select "Yes" on "Published" Select "VMPayment - Mercadopago Payment Plugin With IPN 2.0 And Checkout API" in "Payment Method" field Click "Save" to enable "Configuration" tab Click "Configuration" tab Set the "Client ID" and "Client Secret" provided by MercadoPago. You can get your credentials through this link http://developers.mercadopago.com/docum ... enticacion and then, click on the button "Obtener credenciales", finally, you may select the correct country according to your MercadoPago account and it will display your credentials Set the other options as you like IPN Instructions: To be able to use the IPN functionality, first configure the payment method in VirtueMart, and the plugin will tell you the correct URL Changelog: Ver 1.0.11: Added support for MercadoPago Peru Ver 1.0.10: Added Spanish localization Ver 1.0.9: Avoid order re-processing when MercadoPago send an approved notification regarding an already confirmed order Fixed issue preventing payment method name being displayed in order details Ver 1.0.8: Fixed calculation issue of plugin extra charge at checkout Ver 1.0.7: Allow option to avoid display of logo in checkout process Ver 1.0.6: Compatibility with MercadoEnvíos shipping plugin Ver 1.0.5: Upgraded MercadoPago SDK Ver 1.0.4: Fixed an issue preventing correct cost per transaction calculation Ver 1.0.3: Added support for MercadoPago Chile! Upgraded MercadoPago SDK Created a little debug tool to provide better support Updated MercadoPago logos Related Products MercadoPago XE Google Finance Yahoo Finance Oanda CSV Exchange Rates Webservicex X-Rates Open Exchange Rates Our Products VirtueMart 3 Payment Plugins Shipment Plugins Currency Plugins VirtueMart 2 Payment Plugins Shipment Plugins Currency Plugins HikaShop DJ-Classifieds PayPlans jVArcade K2Store redSHOP Search in Store Services Professional Web DevelopmentJoomla! WebsitesVirtueMart e-CommerceJoomla! and VirtueMart Development Online Store VirtueMart 3VirtueMart 2HikaShopK2StoreredShopJVArcadeDJ-Classiffieds Your Account My AccountMy OrdersCheckout Our policies Terms of ServicePrivacy StatementReturns & RefoundsCookies StatementPayment Methods � MGS Creativa. All rights reserved Log in create an account Username Password Remember Me Forgot your password? Forgot your username?

Hi

This probably means that this crawler checker is outdated. All the "role" attributes should not be included, that's why this attribute was created. So if it's seeing it even with that than it's either loading it from cache or is simply not prepared to ignore this elements.

Ok, thanks a lot @teitbite great news! I will inform this to my customer. Feel free to close this as solved!

Regards!

Hi

Ok. Closing as requested.