Digital Masters Magazine

Home of Digital Masters

  • Design
  • Photo
  • Video
  • Web
  • Code
  • UX
  • Mobile
Home Code Page Diagnostics For Webmasters: Fetch as Google or How to View the HTTP Headers Your Server Is Sending
Page Diagnostics For Webmasters: Fetch as Google or How to View the HTTP Headers Your Server Is Sending

February 23, 2016 By Digital Masters 2 Comments

Page Diagnostics For Webmasters: Fetch as Google or How to View the HTTP Headers Your Server Is Sending

The HTTP headers your web server is sending can answer a couple of questions and allow you to quickly diagnose problems.

One way to view HTTP headers is by using your web browser’s Developer Tools or Google Webmaster Tools for your web property. Here is how to do it.

In Google Webmaster Tools, this feature is called Fetch as Google and it allows you to see what’s happening under the hood when the crawler is accessing s particular URI. This method requires you to verify the ownership of your web property and does not support spoofing of the user agent string.

If you need to spoof the user agent string to view the response for a particular device (or if verifying the ownership of your web property is out of the question), you can inspect HTTP headers using the Developer Tools feature of your web browser.

View HTTP headers as Google does in Google Search Console

You can conveniently view the HTTP headers in Google Search Console using the Fetch as Google feature.

Step 1. Fetch as Google

In Google Webmaster Tools, navigate to Crawl > Fetch as Google, enter the address of your page, select the device, and hit the Fetch button.

Step 2. View the HTTP response

Click on the >> symbol to view the HTTP response of your web server, beginning with the HTTP headers, followed by the HTML. For example, for a 301 redirect, you will see something to this effect:

HTTP/1.1 301 Moved Permanently
Server: nginx
Date: Tue, 23 Feb 2016 14:34:19 GMT
Content-Type: text/html
Content-Length: 178
Connection: keep-alive
Location: https://www.digitalmastersmag.com/magazine/
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
X-Frame-Options: SAMEORIGIN
X-Content-Type-Options: nosniff
X-XSS-Protection: 1; mode=block
Content-Security-Policy-Report-Only: default-src 'self'; [] report-uri https://report-uri.io/report/f454b82e7d32b8566fe5e2c5adce5e2e/reportOnly
Public-Key-Pins: pin-sha256="PaNtQB4MIif3w2mc+/v1BCFfWCeD7+r9HVrXsYVIdjI="; pin-sha256="v9CghcQci1EC30X1Zdc+ORThG4cjqIHqCSZCxb7cZQY="; max-age=3600
<html>
<head><title>301 Moved Permanently</title></head>
<body bgcolor="white">
<center><h1>301 Moved Permanently</h1></center>
<hr><center>nginx</center>
</body>
</html>
Fetch as Google: 301 permanent redirect headers
Fetch as Google: 301 permanent redirect headers in Google Webmaster Tools

This is how a successful response may look like:

HTTP/1.1 200 OK
Server: nginx
Date: Tue, 23 Feb 2016 22:34:55 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: keep-alive
Vary: Accept-Encoding
X-Powered-By: PHP/7.0.3
Link: <https://www.digitalmastersmag.com/magazine/wp-json/>; rel="https://api.w.org/"
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
X-Frame-Options: SAMEORIGIN
X-Content-Type-Options: nosniff
X-XSS-Protection: 1; mode=block
Content-Security-Policy-Report-Only: default-src 'self'; [more of the policy] ; report-uri https://report-uri.io/report/f454b82e7d32b8566fe5e2c5adce5e2e/reportOnly
Public-Key-Pins: pin-sha256="PaNtQB4MIif3w2mc+/v1BCFfWCeD7+r9HVrXsYVIdjI="; pin-sha256="v9CghcQci1EC30X1Zdc+ORThG4cjqIHqCSZCxb7cZQY="; max-age=3600
<!DOCTYPE html> 
[the rest of the markup]

View HTTP headers in your web browser using Developer Tools

In Google Chrome open your page in a browser window, open the Developer Tools panel,  navigate to the Network tab, find the web resource you want to inspect and click on the Headers tab to view your web server’s response.

Inspecting HTTP headers in a web browser
Inspecting HTTP headers in a web browser

Filed Under: Code, Tips, Webmasters' Insights Tagged With: crawl, Google, HTML, HTTP

Comments

  1. Sophie Currier says

    March 1, 2016 at 7:29 am

    At this time it sounds like Drupal is the best blogging platform out
    there right now. (from what I’ve read) Is that what you are
    using on your blog?

    Reply
  2. admin says

    March 1, 2016 at 4:06 am

    Thank you. Please come back for more.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Treat yourself to the best of our content

Sharing is caring

Tweets by 4digitalmasters
Speed is everything: shiny car engine rendering

$#! No ISO and no upgrade pathways? How to force your PC to upgrade Windows 10 to Windows 11

Photo by Warren Wong on Unsplash

The tech revolt. Say goodbye to your favorite search engine that’s been wasting your precious clicks on silly captchas

Change language settings in Adobe Photoshop 2020

How to change the language of Adobe Photoshop

Apple MacBook Pro (16-Inch, 16GB RAM, 1TB Storage) - Space Gray

The new 16-inch MacBook Pro: Faster, slightly heavier but still ultra-light and #WorthTheWait

iPhone XS

The iPhone XS +++ An Insider Report +++ new 5.8-inch and 6.5-inch OLED iPhones +++ Codename D32 & D33

Apple MacBook Pro (16-Inch, 16GB RAM, 1TB Storage) - Space Gray

Apple’s new 16-inch MacBook Pro sports even cooler looks than its predecessor. It is also truly different.

iPhone XS

If you are playing with the idea of buying a new iPhone, now is the time to wait. All signs are pointing to the launch of a new iPhone. On September 12th, Apple has scheduled a media event. If history is any indication, a new product launch is imminent. The iPhone maker has already released […]

What’s up

ActionScript Adobe Adobe CC All-in-One WP Migration Angular 2 Apache Apple assistive technology CNAME crawl DNG Dreamweaver Event Viewer Google Google Analytics GPU HTML HTTP INTC Intel iOS iPhone JavaScript Microsoft Windows 10 OpenSSH OS X PayPal performance Photoshop PHP product key Qualcomm RAW redirects RSS SEO speed SSD Tim Cook TypeScript Wall Street Windows Windows 10 Windows 10 free upgrade WordPress

Categories

  • Home
  • Subscribe
  • Advertise
  • Privacy Policy
  • Legal
  • Contact Us

Copyright © 2023 ·Streamline Pro Theme · Genesis Framework by StudioPress · WordPress · Log in