Decorating a high velocity event stream with contextual information – on PNDA

How to contextualise streaming events with PNDA Often, to do meaningful analytics on data you need to decorate an input event stream with additional information looked up from another data store. In this post I will discuss a design pattern for doing such a task on PNDA. This will provide an efficient implementation of a … Continue reading Decorating a high velocity event stream with contextual information – on PNDA

BGP Security – how Big-data can help detect attacks

https://pixabay.com/en/bigdata-security-technology-digital-1423786/ On the 26th of April, 2017, a ‘prefix hijacking’ event occurred that affected a number of financial services companies around the world. The impact of the event was such that traffic was in part, diverted and directed to another network that claimed to be the owner of the IPv4 address space. The nature of … Continue reading BGP Security – how Big-data can help detect attacks

An analytics-based approach to service assurance: Part 2 – Is analytics the answer?

Service assurance is not something that is well defined within the industry.  So what is it that we are trying to achieve with service assurance?  Simply put: I want to know that my services are working and if they’re not I want to be proactively informed (service health) If they aren’t working, I want to […]

An analytics-based approach to service assurance: Part 1 – What’s the problem?

Service assurance is not something that is well defined within the industry.  So what is it that we are trying to achieve with service assurance?  Simply put: I want to know that my services are working and if they're not I want to be proactively informed (service health) If they aren't working, I want to … Continue reading An analytics-based approach to service assurance: Part 1 – What’s the problem?

Working With Time-series Data in PNDA

In a previous post I talked about integrating OpenDaylight with PNDA. In this post I will start to make use of the data coming from OpenDaylight by building a Spark streaming application to create time-series datasets. This lets us use the Grafana application in PNDA to display time-series graphs. For this example, I have used this if-table-collector OpenDaylight … Continue reading Working With Time-series Data in PNDA

ML-based Security Analytics with Apache SPOT on PNDA

We’ve been really excited to work with the Apache SPOT team to get SPOT up and running on PNDA in recent weeks. Apache SPOT is an award-winning open source cyber security application which detects potentially malicious activity by identifying suspicious network connections, through analysing large amounts of NetFlow, DNS, and proxy data.  Spot applies advanced … Continue reading ML-based Security Analytics with Apache SPOT on PNDA