Skip to content
Topic

Proxy fundamentals

How proxies work, what the four categories actually differ on, and the protocol detail underneath.

Nearly every practical proxy question reduces to one of three things: who owns the address, how the connection is carried, and how long you keep the same identity. The rest is detail hanging off those three.

The one idea that explains the categories

The four categories do not differ on protocol. They differ on who the address is registered to, and everything else follows from that.

  • Datacenter — registered to a hosting company, so identifiable from the registration alone.
  • ISP — registered to a consumer provider, hosted in a datacentre, assigned to you exclusively.
  • Residential — a real consumer line, usually shared and rotating.
  • Mobile — a carrier address shared with many real subscribers behind carrier-grade NAT.

The comparison guide works through which to use when. The short version: registration decides how the address is treated before it does anything, and the ASN is where that decision is read from.

How the connection is carried

An HTTPS request through an HTTP proxy is not forwarded, it is tunnelled. The client asks the proxy to open a tunnel with CONNECT, the proxy answers, and the encrypted traffic passes through untouched. This is why the proxy sees the destination hostname and the byte counts but not the contents.

SOCKS5 works one layer lower and carries any TCP stream. It cannot add HTTP headers, which makes it structurally quieter, and it has one option that catches everybody: whether your machine or the proxy resolves the hostname.

Identity over time

A rotating endpoint gives you a different address per request or per interval. A sticky session holds one for a while. Neither is better; they answer different questions.

The guide on choosing between them covers the failure this causes most often: a crawler rotating per request that cannot understand why a paginated list keeps returning page 1. The site bound the cursor to a session, the session to an address, and the address changed.

Getting in

Two authentication models exist and they fail in opposite ways. Credentials travel with the request and survive a changing address, but leak into logs and shell history. An address allow-list sends nothing secret and breaks silently the moment your address changes.

On residential networks the username usually carries more than identity. Country, city, session identifier and rotation behaviour are commonly appended to it, because the gateway hostname is fixed and the credential is the only field a client can vary per request.

Configuring it

The environment variables look like the simplest approach and behave differently in every runtime. Tested across curl, wget, Python, Go and Node, the clients disagree on the case of HTTP_PROXY, on what a leading dot in NO_PROXY matches, and on whether CIDR ranges work at all.

In this section

60 pages
Glossary Term

What is a backconnect proxy?

One gateway address that sends each request or session through a different exit in the provider's pool, so your configuration never changes.

4 min read

Glossary Term

What is a datacenter proxy?

A proxy whose exit address belongs to a hosting or cloud network. Fast and cheap per address, and the easiest type for a site…

4 min read

Glossary Term

What is a DNS leak?

A DNS leak is a name lookup that travels outside the path you intended, so a resolver you did not choose learns the hostname…

3 min read

Glossary Term

What is a forward proxy?

A proxy the client chooses and configures. It forwards your requests outward, so the destination connects with the proxy rather than with you.

4 min read

Glossary Term

What is a JA3 fingerprint?

A JA3 fingerprint is an MD5 hash of five fields from the TLS ClientHello, kept in the order the client sent them.

4 min read

Glossary Term

What is a mobile proxy?

A proxy that exits through a mobile carrier's network, on a public address that real subscribers share behind carrier-grade NAT.

4 min read

Glossary Term

What is a port in networking?

A port is a 16-bit number identifying one endpoint of a transport connection, so a single address can carry many independent conversations at once.

4 min read

Glossary Term

What is a residential proxy?

A proxy whose exit address belongs to a consumer ISP, so the traffic appears to come from an ordinary home connection.

3 min read

Glossary Term

What is a reverse proxy?

A proxy deployed in front of a server. Clients connect to it as if it were the origin, and it forwards to the real…

4 min read

Glossary Term

What is a rotating proxy?

A proxy gateway that hands out a different exit address over time, per new connection or on a timer, while your client keeps one…

4 min read

Glossary Term

What is a SOCKS5 proxy?

A proxy protocol, defined in RFC 1928, that relays any TCP stream and optionally UDP without reading it. socks5h sends the hostname to the…

4 min read

Glossary Term

What is a sticky session?

A proxy setting that holds one exit address for a period, or, on a load balancer, a cookie that pins each visitor to one…

4 min read

Glossary Term

What is a subnet?

A subnet is a contiguous block of addresses that share a common leading prefix and are administered as one network.

4 min read

Glossary Term

What is a transparent proxy?

A transparent proxy usually means one the network routes traffic through without any client setting, so the client does not know it is there.

4 min read

Glossary Term

What is a WebRTC leak?

A WebRTC leak is a network address disclosed by the browser's real-time communication stack, outside the path your proxy controls.

4 min read

Glossary Term

What is an exit node?

The last hop before the destination: the machine whose address the website records, in proxy networks, Tor and Tailscale alike.

4 min read

Glossary Term

What is CGNAT (carrier-grade NAT)?

Carrier-grade NAT (CGNAT) is address translation inside an operator's network, so that many subscribers share one public IPv4 address.

4 min read

Glossary Term

What is CIDR notation?

CIDR is the notation and allocation scheme that writes a block of IP addresses as an address followed by a prefix length, such as…

4 min read

Glossary Term

What is geo-targeting for proxies?

Asking a proxy service for an exit in a particular country, region, city or network. The site you visit then judges your location with…

3 min read

Glossary Term

What is IP whitelisting?

Authorising a proxy by the address your traffic comes from instead of a username and password. Simple on a fixed server, fragile anywhere else.

3 min read

Glossary Term

What is proxy authentication?

How a proxy decides you may use it: credentials in a Proxy-Authorization header, or a list of allowed source addresses. A 407 means it…

4 min read

Glossary Term

What is the HTTP CONNECT method?

The HTTP method that asks a proxy to open a raw TCP tunnel to a host and port. It is how HTTPS, and anything…

4 min read

Glossary Term

What is the Via header in HTTP?

Via is a standard HTTP header to which each proxy or gateway appends the protocol version it received the message on and a name…

4 min read

Glossary Term

What is the X-Forwarded-For header?

X-Forwarded-For is a de facto request header to which each proxy appends the address of the client it received the request from.

4 min read

Glossary Term

What is TLS interception (SSL inspection)?

TLS interception, or SSL inspection, is when a middlebox terminates a client's encrypted connection, reads the plaintext and re-encrypts it onward.

4 min read