NETWORK CONCEPTS

Understand what network numbers actually mean.

Learn how link capacity, traffic, latency, routing and loss shape delivery - and how application limits and protection affect the result.

ThroughputDelivered traffic
Latency / jitterDelay & variation
CapacityUtilization & headroom
Related measurements · one network path
One network number describes only one part of the path.

01 / CAPACITY

How to read network capacity.

One number rarely describes the whole experience. Start by asking whether it describes capacity, achieved delivery, accumulated data or delay.

Read the quantity before the headline

Bandwidth means link capacity in this guide. Throughput is the rate actually achieved at a stated measurement point. Transfer is the volume moved over a period, while latency describes delay. Each answers a different question.

Match the number to the workload

A small interactive request can depend heavily on round-trip delay and application response time. A large download needs sustained throughput. A continuous stream also needs delivery to remain consistent over time.

Keep the scope attached

A port rating applies to an interface. A test result applies to particular endpoints and conditions. A transfer allowance applies to a service and accounting period. Compare like quantities before choosing infrastructure.

02 / TRANSFER

Port speed, throughput & traffic.

A port describes link capacity. Throughput describes the rate delivered at a particular layer; traffic describes data accumulated over time.

Port and uplink

An uplink connects a service toward its upstream network. Labels such as 100 Mbps, 1 Gbps, 10 Gbps, 40 Gbps and 100 Gbps describe link capacities. These are general networking examples, not a list of tiers available on every service.

Useful throughput

Application delivery can be constrained by protocol overhead, the remote endpoint, routing, congestion, CPU, storage, software or service policy. A 10 Gbps interface does not guarantee a 10 Gbps download. There is no universal efficiency percentage.

Transfer and accounting

Metered services count transfer against an allowance or charging model. Unmetered describes how transfer is accounted for; the connection and other resources still have limits. Check the applicable period, direction and service terms.

Port capacity ≠ actual throughputConceptual traffic profile
Provisioned ceiling
Available headroom
Elapsed time →
Actual trafficSustained level
CapacityAvailable rate
ThroughputDelivered rate
TransferData over time
A capacity ceiling constrains delivery; delivered data accumulates over elapsed time. Schematic, not a benchmark.
QuantityUnitWhat it describes
Link rate / throughputMbps or GbpsBits per second at the stated measurement boundary
Byte rateMB/s or GB/sBytes per second; distinguish raw conversion from useful delivery
Transfer volumeGB or TBAccumulated data over a stated period

Bits and bytes

Illustrative calculation
bytes/s = bits/s ÷ 8
1,000 Mbps ÷ 8 = 125 MB/s

Lowercase b means bits; uppercase B means bytes. One byte contains eight bits. Mbps is not MB/s, and Gbps is not GB/s. This decimal conversion excludes protocol overhead and is not a throughput promise. MiB and GiB use binary prefixes based on powers of 1,024.

Transfer over time

Illustrative calculation
volume in bytes = average bit/s × elapsed seconds ÷ 8
20 Mbps × 2,592,000 seconds ÷ 8 = 6.48 TB

This assumes a constant whole-period average over an illustrative 30 days, using decimal TB. A peak rate is not a monthly average. Actual billing periods and traffic-counting directions depend on the service.

03 / QUALITY

Latency, jitter & packet loss.

Capacity describes how much can move per second. Delay, delay variation and loss describe other aspects of delivery.

Latency

Latency is delay between specified events. One-way delay and round-trip time are different measurements. Distance, route selection, transit and peering paths, queues and processing affect network delay; connection setup and application work also affect the response a user sees.

Jitter

Jitter commonly means variation in packet delay. Voice, live media and other real-time applications need to accommodate uneven arrival times. Interpret the measurement method and interval rather than assume a universal acceptable threshold.

Packet loss

Loss means packets did not arrive within the measurement criteria. TCP can retransmit missing data, adding work and delay. Real-time media may instead show missing content or use application-specific recovery; late data may no longer be useful.

04 / PATH

Routing, transit & peering.

Traffic crosses networks whose operators make their own routing decisions. The selected path need not be the shortest line on a map.

Routes and networks

A route determines where traffic is forwarded toward its destination. A hop is a forwarding step visible to a particular observation. An ASN identifies an autonomous routing system; it is not a guarantee of geography or performance.

Transit and peering

Transit provides purchased reachability through another network. Peering exchanges traffic for agreed reachable destinations between networks, directly or through an exchange. Peering can be paid or settlement-free; it does not automatically provide reachability to the whole Internet.

BGP in context

BGP exchanges inter-network reachability and path information. Operators apply policies when selecting routes. Costs, preferences, reachability and conditions can affect the result, and the return path can differ from the outward path.

Transit providers
Peering / IX
Destination networks
Access
Hosting
Content
Conceptual paths · selection depends on routing policy
Path characteristics depend on conditions and measurement. Neither alternative is inherently better.

05 / PATH

Network redundancy & path diversity.

A second link is useful only in the context of the failures it can withstand. Two connections may still share a cable route, device or power source.

Single connection

One link leaves that connection and its dependencies as potential single points of failure. Recovery needs a working alternative and an operational plan.

Multiple links, shared dependency

Two links through one conduit, device or upstream dependency may fail together. Link count alone does not establish independent failure domains.

Genuinely diverse paths

Separate physical paths and independent dependencies can withstand more failure scenarios. Validate device and power dependencies, surviving capacity, detection and routing convergence.

06 / DIAGNOSTICS

Diagnostics - ping, traceroute & MTR.

Choose an observation that matches the symptom. A network probe, an application request and a throughput test answer different questions.

Ping

Observes: echo replies, round-trip time and missing replies.

Useful for: repeatable endpoint reachability symptoms.


Does not prove: application availability or bandwidth.


Common misinterpretation: treating ICMP response handling as the health of all traffic.

Traceroute

Observes: probe replies along parts of a route.

Useful for: comparing visible paths.


Does not prove: that a slow intermediate reply delays forwarded traffic.


Common misinterpretation: treating a silent router as end-to-end loss; filtering, response limits and return paths affect observations.

MTR

Observes: repeated route and response measurements.

Useful for: investigating persistent destination symptoms over time.


Does not prove: the cause of a problem.


Common misinterpretation: blaming an intermediate hop without downstream or application corroboration.

Where iPerf fits

iPerf measures throughput between cooperating endpoints under controlled conditions. Record protocol, direction, duration and concurrency; the endpoints themselves can limit the result. It does not certify application performance. A browser speed test likewise describes its own test path, not a server’s universal capacity.

08 / WORKLOAD PLANNING

High-bandwidth & streaming planning.

Estimate simultaneous delivery demand from concurrent sessions and the bitrate actually served. Total daily viewers do not describe the busiest moment.

Plan sustained delivery

A brief download burst and continuous media delivery impose different demands. Account for variable bitrate peaks, overhead and retransmissions as well as the average payload. Check whether storage I/O and processing or transcoding can supply the output.

Locate the origin’s work

An origin can deliver directly or feed an optional CDN or edge layer. Distribution can change origin demand, but cache misses, cacheability and live delivery behavior still matter. Model the intended arrangement rather than assume every viewer connects to the origin.

Concurrent media payload

Illustrative calculation
payload bit/s ≈ concurrent sessions × mean delivered bitrate
250 concurrent sessions × 6 Mbps = 1.5 Gbps

This assumes the sessions are served by the origin at the same mean bitrate. It excludes variable bitrate peaks, protocol overhead and retransmissions. Distribution and cache behavior may change origin load; measure those conditions before choosing headroom.

09 / WORKLOAD PLANNING

Bottlenecks, headroom & capacity planning.

Upgrade the resource that limits useful work. A larger link cannot make a busy application, slow disk or constrained remote endpoint deliver faster by itself.

Find the limiting resource

Correlate application response time and achieved throughput with CPU, storage, database, TLS and transcoding work. Include the client and remote path. A single transfer and many parallel transfers may expose different constraints.

Choose headroom deliberately

Some spare capacity can absorb demand variation, growth or a maintenance event. Set the reserve from measured peaks, operating scenarios and uncertainty. There is no universal percentage that fits every workload.

Measure comparable conditions

Record the endpoints, direction, duration, protocol and concurrency of each test. Repeat representative work and compare with a normal baseline. A momentary peak is not evidence of sustainable application delivery.

Server NIC
Headroom
Switch / ToR
Headroom
Uplink
Constrained
Edge / transit
Headroom
Upstream
Headroom
Uplink limits this pathCapacity elsewhere does not remove this constraint.
Illustrative uplink bottleneck. Increasing capacity elsewhere cannot remove a constraint at this stage of the network path.

Transfer duration

Illustrative calculation
seconds = data bytes × 8 ÷ sustained bit/s
500 GB × 8 ÷ 500 Mbps = 8,000 seconds = 2 h 13 min 20 s

This uses decimal units and assumes a sustained useful rate. If 500 Mbps is only the nominal port ceiling, the result is an ideal lower bound. Storage, protocol work and live changes can increase the actual time.

10 / WORKLOAD PLANNING

Network checklists & next steps.

Use a concise capacity brief for planning and a repeatable evidence bundle for troubleshooting. Keep requirements separate from conclusions.

Capacity checklist

  1. Workload and required user experience.
  2. User regions and remote endpoints.
  3. Average and peak concurrent activity.
  4. Payload size or bitrate and protocol overhead.
  5. Required direction: ingress, egress or both.
  6. Sustained demand versus short bursts.
  7. Transfer accounting period and applicable service terms.
  8. CPU, storage and application constraints.
  9. Protection scope, normal uplink and failure expectations.
  10. Growth and headroom assumptions, with a repeatable validation plan.

Troubleshooting checklist

  1. Record the symptom, timestamp, timezone and affected application.
  2. Establish affected endpoints and whether all users are affected.
  3. Compare the normal baseline under comparable conditions.
  4. Check application, CPU and storage pressure.
  5. Observe endpoint RTT and loss without treating ICMP as application health.
  6. Compare route observations and seek downstream or destination corroboration.
  7. Use authorized controlled throughput tests only when appropriate.
  8. Share sanitized evidence and scope with support.

TURN UNDERSTANDING INTO REQUIREMENTS

Plan around the work.
Choose the right infrastructure.

Bring your workload, traffic pattern and operating requirements together before comparing infrastructure.