Category: streaming

Posted on

The Complete Apache Spark Collection [Tutorials and Articles]

In this edition of "Best of DZone," we've compiled our best tutorials and articles on one of the most popular analytics engines for data processing, Apache Spark. Whether you're a beginner or are a long-time user, but have run into inevitable bottlenecks, we've got your back!

Before we begin, we'd like need to thank those who were a part of this article. DZone has and continues to be a community powered by contributors like you who are eager and passionate to share what they know with the rest of the world. 

Posted on

Kafka Consumer Delivery Semantics

This article is a continuation of part 1 Kafka technical overview, part 2 Kafka producer overview, part 3 Kafka producer delivery semantics and part 4 Kafka consumer overview. Let's understand different consumer configurations and consumer delivery semantics.

Subscribe

To read records from Kafka topic, create an instance of Kafka consumer and subscribe to one or more of Kafka topics. You can subscribe to a list of topics using regular expressions, for example,  myTopic.*.

Posted on

Atomist: Streaming, Coding, Sharing [Video]

It's hard to explain in a few minutes why Atomist is important, to the software industry and to me. The other day my friend Avdi sat down to find out, and to code together. We streamed this on Twitch.

I show my Atomist software delivery machine in-progress, with all the troubles I'm currently fighting with. It turns into an illustration of many of the ways programming is hard, plus discussions of ideas, as most of my days do. We talk about the Software Delivery Machine and API for Software at 19:37, Atomist fingerprints at 21:08, goal sequencing at 32:35, choosing goals per push at 34:20, local mode at 36:22, GraphQL at 46:10, and a bunch of other stuff in between. Then we continue some of my own work, and in the end, find and fix a frustratingly trivial library bug. Bet you can spot it before we do.

For the record, I figured out that Htmlproofer error a few days later (that process is also on Twitch). That microgrammar PR is now merged.  You can see the Slack channels we're looking at in Atomist community Slack. And you can play along with me as I work on my Twitch channel.

Fuel Your Blog