To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.
Check your robots.txt file. Make sure you learn how to hide content you don’t want indexed from search engines and that search engines can find the content you do want indexed, too. (You will want to hide things such as repeat content, which can be penalized by search engines but is still necessary on your site). You’ll find a link to how to modify the robots.txt at the end of this article.
Did you know that 65% of your audience are visual learners? One of the most powerful methods you can use for video marketing is to educate your audience. And the great thing is that education comes in many forms. For example, you can teach your customers how to use your product or service and provide useful tips on how to make the most of it. Or you can create a webinar to showcase your industry knowledge, position your brand as a thought leader, add value to your consumers’ lives and collect leads in the process.
In order to be a data driven agency, we foster a culture of inspired marketing entrepreneurs that collaborate, innovate, and are constantly pushing the threshold of marketing intelligence. Our analytics team is well versed in mathematics, business analytics, multi-channel attribution modeling, creating custom analytics reporting dashboards, and performing detailed analysis and reporting for each client.