Posts

  • Working with the Official NiFi Docker Image

    Apache Nifi’s latest release, 1.2.0, brought with it an official docker image on the docker hub. So let’s get started.

    Pull the docker image, note after a latest tag is created you can drop the release version.

    docker pull apache/nifi:1.2.0
    

    Next, start the image as is to see it run. The -p 8080:8080 exposes the remote nifi port locally.

    docker run -p 8080:8080 apache/nifi:1.2.0
    

    Read More →

  • Apache Nifi Release 1.2.0 Highlights

    Apache Nifi’s latest release is 1.2.0. I know we skipped the whole 1.0.0 release highglights, so a quick breakdown of overall changes follows for the jump from 0.* to 1.*, since there were quite a few major breaking changes. For 1.2.0, there were 381 issues closed or resolved, with a break down of issues to follow. Apache Nifi 1.2.0 can be downloaded from Apache here, full release notes can be found on their jira, and Highlights of the release on their Confluence page.

    There were a few other tasks and subtasks that were resolved that make up the other 16 items, but since they were pretty basic - updating Jetty and jQuery, we’ll probably skip going over most of them (except for the official Docker image!)

    Read More →

  • Getting Familiar: the ExecuteScript Processor - Groovy

    I came across a question on the nifi dev mailing list and thought it would make a good example solving a real world problem, building off of our previous ExecuteScript post. As a side note, since Elasticsearch uses json for their documents and the PutElasticsearch processors expect the flow file to be json, you could use the EvaluateJsonPath Processor to put the field you want as an attribute.

    Read More →

  • Getting Familiar: The ExecuteScript Processor

    We’ve decided to start a new series for getting familiar with the different Apache Nifi services and processors, and I’m calling it “Getting Familiar”. We’ll try to post fairly often about different processors, using the controller services and configuring certain things in Nifi.The first one in the series will be about the ExecuteScript processor.

    Read More →

  • Apache Nifi Release 0.7.0 Highlights

    Apache Nifi’s newest release is out, 0.7.0. You can grab the binaries from their site as always. So lets dive in and see what to look for in this release!

    As always, a bunch of bug fixes, but this time there are quite a few improvements.

    Read More →

  • Apache Nifi Release 0.6.0 Highlights

    Apache Nifi release 0.6.0 and 0.6.1 recently and I wanted to go throught and highlight some of the key changes that may affect you Nifi users. So far Nifi has kept pretty well to thier 6 week release schedule that they have discussed. That’s a really agressive release schedule so we’ll see if they can keep that up once they hit the 0.7.0/1.0.0 release, which they say is going to actually be pushed back a little. The 0.6.0 release was again substantial with 52 bug fixes, 15 improvements and 7 new features. 0.6.1 didn’t take to long to follow with 11 bug fixes and 1 improvement. The release binaries are on the Apache Nifi download pageThe full release notes are avaialble on Apaches Nifi’s wiki page. The combined 0.6.* release information is below.

    Read More →

  • Apache Nifi Release 0.5.0 Highlights

    Apache Nifi just voted on another release and have annouced and released 0.5.0, probably their most interesting release to date. This release contains quite a few big features that expand what nifi has to offer and also how you can use it; notably script execution in a flow. This new processor allows you to execute scripts in Javascript, Groovy, JRuby, Jython, Lua, and Python. To grab the latest binaries, go to Apache Nifi’s download page The full release notes are also available on Apache Nifi’s wiki page.

    This release is substantial and really expands Apache Nifi’s usablity, specificall for those users who don’t feel comfortable with Java. Lets take a deeper look at what else is included!

    Read More →

  • Developing a Custom Apache Nifi Controller Service

    Controller services are shared between processors, other controller services and reporting tasks. Normally they provide access to a shared resource, such as a database or ssl context, or externally managed content. This post will cover the basics of a controller service through a simple example. This example will take a file path that contains one or more properties files, and provide a processor access to those properties. The full source is hosted on Github.

    Read More →

  • Apache Nifi Release 0.4.0 highlights

    Apache Nifi kicked out thier second release since graduating this past Friday. With the release of 0.4.0, they are one step closer to a 1.0.0 release which will contain some very interesting things. While we look forward to the first big release of Apache Nifi, lets break down the changes in the current build. As always, release 0.4.0 is available on Apache Nifi’s download page.

    The release notes are available on Nifi’s confluence page and a quick highlight can be found below. First lets just say, this is the biggest release so far, with almost double the amount of bug fixes, and over double the amount of improvements and new features!

    • General UI improvements to usability
    • Multiple Authentication Mechanisms
    • New Provenance event types and ability to searh provenance events
    • Idle CPU usage was reduced
    • New Processors!
    • Improved OS support

    Read More →

  • Apache Nifi Release 0.3.0 highlights

    Apache Nifi released their third release, 0.3.0 since graduating to a TLP. It was a minor release but still included a descent number of changes.

    Release Highlights according to nifi can be found on their confluence page, but are also listed below.

    • Performance improvements in handling large volumes of small files.
    • Performance improvements in Provenance repositories.
    • Added Reporting Task for ApacheTM AmbariTM.
    • Improved stability of nifi bootstrap.
    • Added Processors for working with images.
    • Support for interacting with Kerberos enabled Hadoop clusters
    • Added additional Avro capabilities - merging datafiles & converting to json
    • Added processors for performing INSERT, UPDATE, DELETE statements against relational databases

    Read More →

subscribe via RSS