Serve robots.txt from the edge

Serve full text of robots.txt as a synthetic response to avoid requests hitting your origin.

VCL

Use this solution in your VCL service (click RUN below to test this solution or clone it to make changes):

Compute

Use this solution in your Compute service:

  1. Go
  2. JavaScript
  3. Rust
This page is part of a series in the Search engine optimization use case.