The development of digital marketing is inseparable from technology development. One of the key points in the start of was in 1971, where Ray Tomlinson sent the very first email and his technology set the platform to allow people to send and receive files through different machines. However, the more recognisable period as being the start of Digital Marketing is 1990 as this was where the Archie search engine was created as an index for FTP sites. In the 1980s, the storage capacity of computer was already big enough to store huge volumes of customer information. Companies started choosing online techniques, such as database marketing, rather than limited list broker. This kind of databases allowed companies to track customers' information more effectively, thus transforming the relationship between buyer and seller. However, the manual process was not so efficient.
To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.
Competitor Backlink Audit: Analyze the link profile of your competitors and look for opportunities that can help improve your own link building and search performance. Whenever you perform a competitor backlink check or audit, you must also check the inbound links that are pointing to top ranking pages so you wouldn’t miss out on important link opportunities.