Glossary
Precise definitions of the vocabulary, cross-linked and cited to the relevant specification.
No term matches that filter. Search the whole site instead
0–9
- HTTP 402 Payment Required: meaning and what to do
- HTTP 402 Payment Required is reserved by HTTP and used by APIs or proxies for paid access and quota refusals. Read the body and identify the layer.
- HTTP 407 Proxy Authentication Required: fixes
- HTTP 407 Proxy Authentication Required means the proxy wants credentials. Read Proxy-Authenticate and send Proxy-Authorization to the proxy.
- 408 Request Timeout: what it means and how to fix it
- 408 Request Timeout means the server stopped waiting for the rest of your request and closed the connection. Resend it once on a new connection.
- HTTP 410 Gone: what it means and how to fix it
- A 410 Gone means the server removed the URL on purpose and expects it to stay gone. What that means for a scraper or proxy, and what to change.
- HTTP 412 Precondition Failed: meaning and how to fix it
- HTTP 412 Precondition Failed means an If-Match, If-None-Match or If-Unmodified-Since check came out false. Causes, a local repro and fixes.
- HTTP 413 Content Too Large: what it means and how to fix it
- HTTP 413 means a server or proxy refused the request because its body is bigger than the limit it accepts. Shrink the body or raise that hop's limit.
- HTTP 414 URI Too Long: what it means and how to fix it
- HTTP 414 URI Too Long means the request target exceeds a server or proxy limit. Shorten the query or move state into a request body.
- HTTP 418 I’m a teapot: what it means and why you got it
- HTTP 418 I'm a teapot is a reserved joke code. Why real sites, WAFs and APIs still send it to scrapers, a local repro, and what to change.
- HTTP 421 Misdirected Request: causes and how to fix it
- HTTP 421 means the server will not answer for that hostname on this connection. Retry on a new connection whose TLS name matches the host.
- HTTP 423 Locked: what it means and how to fix it
- HTTP 423 Locked means a WebDAV resource is protected by a write lock. Find the lock token or wait for expiry before retrying the write.
- HTTP 424 Failed Dependency: what it means and how to fix it
- HTTP 424 Failed Dependency means a request failed because another action it relied on failed. Where it comes from, a local repro and fixes.
- HTTP 428 Precondition Required: meaning and fixes
- HTTP 428 Precondition Required means a write must include a condition such as If-Match. Fetch the current ETag before retrying.
- HTTP 429 Too Many Requests: what it means and how to fix it
- HTTP 429 Too Many Requests means a server or proxy is rate limiting you. Honour Retry-After, lower concurrency and bound retries.
- 431 Request Header Fields Too Large: causes and fixes
- 431 means the server refused your request because its headers are too big, in total or in one field such as Cookie. Trim them before resending.
- HTTP 444 No Response: meaning and troubleshooting
- HTTP 444 is nginx's silent connection close, so clients see an empty reply instead of an HTTP response. Find the edge rule before retrying.
- HTTP 503 Service Unavailable: meaning and fixes
- HTTP 503 Service Unavailable means the responding service cannot handle the request now. Find the layer, honour Retry-After and bound retries.
- HTTP 504 Gateway Timeout: what it means and how to fix it
- HTTP 504 Gateway Timeout means a gateway did not receive an upstream response before its deadline. Locate the timer before changing proxy exits.
- HTTP 505 HTTP Version Not Supported: meaning and fixes
- HTTP 505 means the server does not support the request's HTTP version. Retry with a negotiated version such as HTTP/1.1 after checking the proxy.
- HTTP 507 Insufficient Storage: meaning and fixes
- HTTP 507 Insufficient Storage means the server cannot store the representation needed for the request. Check quota and disk before retrying uploads.
- HTTP 508 Loop Detected: what it means and how to fix it
- HTTP 508 Loop Detected means a WebDAV operation or proxy route found a cycle. Inspect bindings and Via hops before retrying.
A
- What is an anti-bot system?
- Software in front of a website that scores each request on its network, TLS handshake, headers and behaviour, then serves, challenges or blocks it.
- What is an ASN (autonomous system number)?
- The number that identifies a network announcing IP addresses on the internet. For proxies, it decides how an exit is classified before it is used.
B
- What is a backconnect proxy?
- One gateway address that sends each request or session through a different exit in the provider's pool, so your configuration never changes.
- What is bandwidth billing for proxies?
- Paying a proxy provider for each gigabyte transferred, rather than per address or per month of access.
- What is browser fingerprinting?
- Identifying a visitor from properties a page's JavaScript can read, such as screen, GPU, plugins, languages and timezone, combined into one profile.
C
- What is a CAPTCHA, and why do scrapers get one?
- A test a website shows when it doubts that a visitor is human, from distorted text and image grids to a single checkbox.
- What is CGNAT (carrier-grade NAT)?
- Carrier-grade NAT (CGNAT) is address translation inside an operator's network, so that many subscribers share one public IPv4 address.
- What is certificate pinning (SSL pinning)?
- Certificate pinning is when a client accepts only a specific public key or certificate for a host, not any certificate that chains to a trusted root.
- CF-Connecting-IP: what the Cloudflare header means
- CF-Connecting-IP carries a visitor address from Cloudflare to an origin. Learn the trust boundary, Nginx setup and spoofing test.
- What is CIDR notation?
- CIDR is the notation and allocation scheme that writes a block of IP addresses as an address followed by a prefix length, such as 203.0.113.0/24.
- What is proxy concurrency?
- How many requests or connections run at the same time. Often the limit you hit before bandwidth, and the setting that decides when a target pushes back.
- What is a cookie jar in HTTP clients?
- A cookie jar is the store a client keeps of the cookies it has received, keyed by domain and path, and replayed on later requests that match.
- What is crawl budget?
- Crawl budget is Google's term for the set of URLs Googlebot can and wants to crawl on a site, set by server capacity and crawl demand.
- Crawl-delay in robots.txt: what it means and who honors it
- Crawl-delay asks a crawler to wait between requests, but it is not standard and Google ignores it. Learn the safer controls.
D
- What is a datacenter proxy?
- A proxy whose exit address belongs to a hosting or cloud network. Fast and cheap per address, and the easiest type for a site to recognise.
- What is a DNS leak?
- A DNS leak is a name lookup that travels outside the path you intended, so a resolver you did not choose learns the hostname you were about to visit.
E
- What is an exit node?
- The last hop before the destination: the machine whose address the website records, in proxy networks, Tor and Tailscale alike.
- What is exponential backoff?
- Exponential backoff is a retry policy in which the wait before each new attempt grows by a fixed factor, usually doubling, up to a ceiling.
F
- What is a forward proxy?
- A proxy the client chooses and configures. It forwards your requests outward, so the destination connects with the proxy rather than with you.
G
- What is geo-targeting for proxies?
- Asking a proxy service for an exit in a particular country, region, city or network. The site you visit then judges your location with its own data.
H
- What is a headless browser?
- A real browser engine run from code with no visible window. It executes JavaScript like a normal browser, at many times the cost of a plain request.
- What is a honeypot link?
- A honeypot link is a link placed where no human visitor will see or follow it, so that any client requesting it reveals itself as automated.
- What is the HTTP CONNECT method?
- The HTTP method that asks a proxy to open a raw TCP tunnel to a host and port. It is how HTTPS, and anything else, passes through an HTTP proxy.
- What is HTTP/2 fingerprinting?
- An HTTP/2 fingerprint identifies a client from the settings, window size and pseudo-header order it uses to open a connection, not from header values.
I
- What is IP whitelisting?
- Authorising a proxy by the address your traffic comes from instead of a username and password. Simple on a fixed server, fragile anywhere else.
- What is IPv6? Addresses, prefixes and proxies
- IPv6 is the version of the Internet Protocol with 128-bit addresses, written as eight groups of up to four hexadecimal digits.
- What is an ISP proxy (static residential proxy)?
- A static address registered to a consumer ISP but hosted in a datacentre and rented per IP. Often sold as a static residential proxy.
J
- What is a JA3 fingerprint?
- A JA3 fingerprint is an MD5 hash of five fields from the TLS ClientHello, kept in the order the client sent them.
M
- What is a mobile proxy?
- A proxy that exits through a mobile carrier's network, on a public address that real subscribers share behind carrier-grade NAT.
P
- What is a port in networking?
- A port is a 16-bit number identifying one endpoint of a transport connection, so a single address can carry many independent conversations at once.
- What is proxy authentication?
- How a proxy decides you may use it: credentials in a Proxy-Authorization header, or a list of allowed source addresses. A 407 means it said no.
- What is a proxy pool?
- The set of exit addresses a provider can route your requests through. Its depth where you need it matters more than the advertised total.
- Proxy server: meaning and definition
- A server that makes requests on your behalf, so the destination sees the proxy's address instead of yours.
R
- What is rate limiting?
- A cap on how many requests a client may make in a time window. Going over it usually returns 429 Too Many Requests, often with Retry-After.
- What is the HTTP Referer header?
- Referer is the HTTP request header that names the page or resource the requested URL was obtained from.
- What is a residential proxy?
- A proxy whose exit address belongs to a consumer ISP, so the traffic appears to come from an ordinary home connection.
- What is the Retry-After header?
- Retry-After is an HTTP response header telling the client how long to wait, in seconds or until an HTTP-date, before trying again.
- What is a reverse proxy?
- A proxy deployed in front of a server. Clients connect to it as if it were the origin, and it forwards to the real backend.
- What is robots.txt?
- A plain-text file at the root of a site that tells crawlers, by name, which paths to stay out of.
- What is a rotating proxy?
- A proxy gateway that hands out a different exit address over time, per new connection or on a timer, while your client keeps one endpoint.
S
- What is a SOCKS5 proxy?
- A proxy protocol, defined in RFC 1928, that relays any TCP stream and optionally UDP without reading it. socks5h sends the hostname to the proxy.
- socks5h: SOCKS5 with proxy-side DNS resolution
- socks5h sends the hostname to a SOCKS5 proxy for DNS resolution. See the wire difference from socks5 with a real curl capture.
- What is a sticky session?
- A proxy setting that holds one exit address for a period, or, on a load balancer, a cookie that pins each visitor to one backend server.
- What is a subnet?
- A subnet is a contiguous block of addresses that share a common leading prefix and are administered as one network.
- What is a proxy success rate?
- The share of requests that return a usable response. Without a sample size, a target, a date and a definition of success, the number means little.
T
- What is TLS fingerprinting?
- Identifying the software behind a connection from its TLS ClientHello, which is sent in the clear before any HTTP header.
- What is TLS interception (SSL inspection)?
- TLS interception, or SSL inspection, is when a middlebox terminates a client's encrypted connection, reads the plaintext and re-encrypts it onward.
- What is a transparent proxy?
- A transparent proxy usually means one the network routes traffic through without any client setting, so the client does not know it is there.
U
- What is a user agent?
- The User-Agent request header, in which a client names its software and version. The client sets it, so servers treat it as a claim.
V
- What is the Via header in HTTP?
- Via is a standard HTTP header to which each proxy or gateway appends the protocol version it received the message on and a name for itself.
W
- What is web scraping?
- Using software to fetch web pages and turn them into structured records. The hard part is knowing the page you got is the page you wanted.
- What is a WebRTC leak?
- A WebRTC leak is a network address disclosed by the browser's real-time communication stack, outside the path your proxy controls.
X
- What is the X-Forwarded-For header?
- X-Forwarded-For is a de facto request header to which each proxy appends the address of the client it received the request from.
- X-Real-IP: what the header means and when to trust it
- X-Real-IP is a proxy convention for one client address. Learn when Nginx can trust it and how a direct client can forge it.
The same terms, by topic
Anti-bot systems 8
Buying guides 2
HTTP status codes 20
- HTTP 402 Payment Required: meaning and what to do
- HTTP 407 Proxy Authentication Required: fixes
- 408 Request Timeout: what it means and how to fix it
- HTTP 410 Gone: what it means and how to fix it
- HTTP 412 Precondition Failed: meaning and how to fix it
- HTTP 413 Content Too Large: what it means and how to fix it
- HTTP 414 URI Too Long: what it means and how to fix it
- HTTP 418 I’m a teapot: what it means and why you got it
- HTTP 421 Misdirected Request: causes and how to fix it
- HTTP 423 Locked: what it means and how to fix it
- HTTP 424 Failed Dependency: what it means and how to fix it
- HTTP 428 Precondition Required: meaning and fixes
- HTTP 429 Too Many Requests: what it means and how to fix it
- 431 Request Header Fields Too Large: causes and fixes
- HTTP 444 No Response: meaning and troubleshooting
- HTTP 503 Service Unavailable: meaning and fixes
- HTTP 504 Gateway Timeout: what it means and how to fix it
- HTTP 505 HTTP Version Not Supported: meaning and fixes
- HTTP 507 Insufficient Storage: meaning and fixes
- HTTP 508 Loop Detected: what it means and how to fix it
Proxy fundamentals 43
- HTTP 402 Payment Required: meaning and what to do
- HTTP 407 Proxy Authentication Required: fixes
- HTTP 421 Misdirected Request: causes and how to fix it
- HTTP 428 Precondition Required: meaning and fixes
- HTTP 503 Service Unavailable: meaning and fixes
- HTTP 504 Gateway Timeout: what it means and how to fix it
- HTTP 505 HTTP Version Not Supported: meaning and fixes
- What is an ASN (autonomous system number)?
- What is a backconnect proxy?
- What is CGNAT (carrier-grade NAT)?
- What is certificate pinning (SSL pinning)?
- CF-Connecting-IP: what the Cloudflare header means
- What is CIDR notation?
- What is a cookie jar in HTTP clients?
- Crawl-delay in robots.txt: what it means and who honors it
- What is a datacenter proxy?
- What is a DNS leak?
- What is an exit node?
- What is a forward proxy?
- What is geo-targeting for proxies?
- What is the HTTP CONNECT method?
- What is IP whitelisting?
- What is IPv6? Addresses, prefixes and proxies
- What is an ISP proxy (static residential proxy)?
- What is a JA3 fingerprint?
- What is a mobile proxy?
- What is a port in networking?
- What is proxy authentication?
- Proxy server: meaning and definition
- What is the HTTP Referer header?
- What is a residential proxy?
- What is a reverse proxy?
- What is a rotating proxy?
- What is a SOCKS5 proxy?
- socks5h: SOCKS5 with proxy-side DNS resolution
- What is a sticky session?
- What is a subnet?
- What is TLS interception (SSL inspection)?
- What is a transparent proxy?
- What is the Via header in HTTP?
- What is a WebRTC leak?
- What is the X-Forwarded-For header?
- X-Real-IP: what the header means and when to trust it
Web scraping 21
- 408 Request Timeout: what it means and how to fix it
- HTTP 410 Gone: what it means and how to fix it
- HTTP 412 Precondition Failed: meaning and how to fix it
- HTTP 413 Content Too Large: what it means and how to fix it
- HTTP 414 URI Too Long: what it means and how to fix it
- HTTP 423 Locked: what it means and how to fix it
- HTTP 424 Failed Dependency: what it means and how to fix it
- HTTP 429 Too Many Requests: what it means and how to fix it
- 431 Request Header Fields Too Large: causes and fixes
- HTTP 507 Insufficient Storage: meaning and fixes
- HTTP 508 Loop Detected: what it means and how to fix it
- What is proxy concurrency?
- What is crawl budget?
- What is exponential backoff?
- What is a headless browser?
- What is rate limiting?
- What is the Retry-After header?
- What is robots.txt?
- What is a proxy success rate?
- What is a user agent?
- What is web scraping?
One term per entry, defined in the first sentence, then the detail that makes the definition usable: how it works, what it is commonly confused with, and where the specification says so.
Entries are cross-linked, so following a term you do not recognise takes you to its own definition rather than to a search result.