URL Encoding Done Right: Best Practices for Web Developers and SEOs
Introduction Modern web developers and SEO teams share the complex challenge of creating URLs that function seamlessly across languages, platforms,…
Don’t Block What You Want: DuckDuckGo and Common Crawl to Provide IP Address API Endpoints
Your security rules are blocking the traffic you actually want. If search engines and LLM crawlers can’t reach your content,…
Introducing our Bing Webmaster Tools API Python Client
For organisations managing large-scale SEO operations, accessing and analysing Bing Webmaster Tools (“BWT”) data programmatically has become increasingly crucial. Today,…
How Extra HTML Attributes in Canonical Tags Impact Search Engines
TL;DR Our study, sparked by a content management system (CMS) migration anomaly discovered that certain attributes caused Google to ignore…
Google’s JavaScript Rendering Capabilities
In a significant step towards debunking some persistent SEO myths and increasing industry understanding of search engine crawling and rendering,…
Investigating Reddit’s robots.txt Cloaking Strategy
Introduction We recently noticed a post on X by @pandraus regarding Reddit’s robots.txt file. On 25 June 2024, u/traceroo announced…
Discovering and Diagnosing a Google AdSense Rendering Bug
Introduction AdSense is Google’s advertising content platform where publishers can be paid to place advertisements on their webpages. While performing…
Optimising Next.js Image Component for Image Search
All domain and content management systems carry degrees of risk when migrating from one platform to another. Some industries benefit…
Managing Webpages Resources for Efficient Crawling and Rendering
Introduction Search engines have a large, but finite amount of resources. Some websites can be hundreds of millions of webpages…
Strategic Use of Typo Domains: UX, Traffic and Brand Protection
Introduction In an age where the digital presence of businesses is paramount, every click counts. A company’s website is its…