Netflow

from Wikipedia, the free encyclopedia

Netflow is a technique in which a device, usually a router or layer 3 switch , exports information about the IP data stream within the device via UDP . These UDP datagrams are received, stored and processed by a Netflow collector. The resulting data are used for traffic analysis , for capacity planning or QoS used analysis.

technology

Netflow architecture

Netflow was originally a Cisco technology, but is now supported by many manufacturers. In addition to Netflow, there is also jFlow ( Juniper ) and Netstream ( Huawei ). Both are technically identical to Netflow. There are different versions of Netflow. Netflow Version 9 is described as an open standard in RFC 3954 . Netflow version 5 is the most frequently used version in practice. sFlow ( RFC 3176 ) uses statistical sampling and is incompatible with Netflow. However, converters exist . The IPFIX standard ( RFC 3917 ) is developed independently of the manufacturer and represents an extension of Netflow Version 9.

A flow typically contains the following information:

The content of the export datagrams differs slightly depending on the Netflow version. Detailed information can be found on the Cisco site.

application

Like SNMP , Netflow is a passive measurement method , i. H. one observes the traffic without influencing it. Like all passive measurement methods, Netflow also generates volume information, typically kBit / s .

In order to be able to analyze the netflow data, collector software is required. Two types of analysis are typically performed:

In the case of Top-N analyzes, a freely definable period, e.g. B. 24 hours, those elements are searched that generate the most traffic. Criteria can be sender IP addresses ( Top Talker ), TCP ports ( Top Applications ) or other entries from the Netflow datagram. In some systems, this Top-N analysis is generated via SQL queries using "Group-By" at runtime, or special analysis databases are kept ready. These special databases are kept up-to-date by the collector during runtime. The advantage here is that the reporting front end can quickly access finished data sets, on the other hand, the need for storage grows.

Time analyzes show the volume of traffic components over a time axis .

Since the NetFlow datagrams are transmitted via UDP, the collector must be fast enough, the data to receive, process and store. Lost datagrams cannot be recovered. The transmission of Netflow data over WAN links is therefore particularly problematic . Distributed systems have proven themselves particularly well here. Some systems are able to hold evaluations in a central data mart . This has the advantage that data does not have to be transmitted repeatedly and multiple times over WAN routes.

From a technical point of view, manufacturers usually use an initial database as "raw data" in which the netflow datagrams are saved in raw form. Only a subsequent process normalizes the data and saves the result in a database - mostly a relational database, which the reporting front end then accesses. Since the data is saved once as raw data and then a second time in a normalized form, the transfer performance of the storage systems is one of the most important and limiting parameters. The storage is usually expanded locally as a hardware raid. Implementation via a software raid can lead to performance losses.

In the service provider environment, multi-client capability is an important property of Netflow systems. This ensures that participants can only see the data that is relevant to them. Customers then only have access to the flows of "their" interfaces and not to all interfaces of the flow sender.

Free software

  • flowd NetFlow collector
  • NetWork analysis software
  • nfdump, collector and analysis tools and nfsen, web frontend to nfdump
  • PMACCT Netflow, sFlow Collector. Uses libpcap
  • Pandora FMS

Free software

  • SevOne (trial version available)
  • Solarwinds NetFlow Analyzer (Windows), limited to 60 minutes
  • NetFlow Analyzer for Windows, (Trial version available)
  • THB-Netflow flexible and high performance v5, v9 & IPFix receiver

Both of them have the option of purchasing a license key

Commercial software

Product features
product Netflow cFlow jFlow Netstream sFlow IPFIX Distributed Multi-tenant Central data mart Cluster or hierarchy further flow versions Max flow / minute Alarms based on flows
AdvaICT NetHound (online service) Yes No No No No No No Yes Yes
Caligare Flow Inspector Yes Yes Yes Yes No No Yes Yes Yes
Cisco Yes Yes Yes Yes No No No No No
IBM Aurora Yes Yes Yes Yes Yes Yes Yes No No
Info on StableNet Yes Yes Yes Yes Yes Yes Yes Yes Yes
INVEA-TECH FlowMon Yes Yes Yes Yes Yes Yes Yes Yes Yes
Ipswitch WhatsUp Gold Yes Yes Yes Yes Yes Yes Yes Yes Yes
IsarFlow Yes Yes Yes Yes Yes Yes Yes Yes Yes hierarchy
IS-IT-ON NetFlow Analyzer Yes No No No No No Yes Yes Yes
ManageEngine NetFlow Analyzer Yes Yes Yes Yes Yes Yes Yes Yes Yes
Paessler PRTG Network Monitor Yes No Yes No Yes Yes Yes Yes Yes
Riverbed Network Performance Yes Yes Yes Yes Yes Yes Yes yes, based on dashboards Yes Cluster capable NAM, NBAR, NBAR2, Cisco MediaNet, Cisco ASA NSEL, Citrix AppFlow, Packeteer FDR, Palo Alto Networks, and SteelFlow from SteelHead appliances 10 M deduplicated flows / min (cluster capable) Yes
SolarWinds Orion NetFlow Traffic Analyzer Yes No Yes No Yes Yes Yes Yes Yes
SevOne Dedicated Netflow Collector (DNC) (also part of PAS) Yes Yes Yes Yes Yes Yes Yes Yes Yes Cluster SFLow, Cisco-NAM, -NBAR, -Medianet, dFlow, jFlow, NSEL, each flow field can be registered as a key or metric 12M flows / min on DNC1000HFC, cluster capable Yes
IPHost Monitor Networks Monitoring Software Yes Yes Yes No Yes No Yes Yes Yes hierarchy Cisco NAM / NBAR
IPSwitch WhatsUp Gold Yes Yes Yes No Yes No Yes Yes Yes Yes
THB netflow Yes No No No No Yes Yes Yes Yes Cluster Cisco-AVC, -NBAR, Medianet, Barracuda, each flow field can be configured dynamically via Grafana