Data Ingest in PNDA 5.0

PNDA 5.0 brings some interesting new capabilities for data ingest with Gobblin. Previously it was necessary to encapsulate data in an AVRO encoded envelope before sending it to PNDA. All data sent to PNDA had to conform to the same AVRO schema. We can think of this as external AVRO encoding. Now it is possible … Continue reading Data Ingest in PNDA 5.0

Growing the PNDA Community

Now that PNDA 5.0 is released there is time to think of PNDA's evolution. The PNDA project joined the Linux Foundation Networking Fund (LFN) earlier in the year but remained Cisco-sponsor managed. PNDA is now transitioning to be a fully community-driven project. Several things are happening to bootstrap the community development: Establish weekly PNDA community callsEvolve … Continue reading Growing the PNDA Community

Working With Time-series Data in PNDA

In a previous post I talked about integrating OpenDaylight with PNDA. In this post I will start to make use of the data coming from OpenDaylight by building a Spark streaming application to create time-series datasets. This lets us use the Grafana application in PNDA to display time-series graphs. For this example, I have used this if-table-collector OpenDaylight … Continue reading Working With Time-series Data in PNDA

Integrating ODL with PNDA open source data analytics platform

So you want to integrate OpenDaylight with PNDA! It's really easy to aggregate data into a PNDA instance. But it takes a little more work to stream data out of an OpenDaylight instance. There are three steps to set this up: Pick a data source, i.e. an OpenDaylight application that can supply data to an OpenDaylight event … Continue reading Integrating ODL with PNDA open source data analytics platform

Hacking on PNDA at MEF16

During MEF16 in Baltimore we were demonstrating the PNDA Analytics platform to show that PNDA is an excellent choice for the analytics needs of the MEF Lifecycle Services Orchestration architecture. The first step in building any analytics solution is to collect and aggregate data together. We wanted to show that there is increased value in gathering multiple datasets … Continue reading Hacking on PNDA at MEF16