If you’re new to Kafka and developing event streaming platforms, it’s easy to get overwhelmed. This is an entirely different architecture than most developers are used to, after all. But that fear should only be temporary, as Confluent this week launched a new website (developer.confluent.io) aimed at making it easier for developers to integrate into Kafka and streaming.
There is no shortage of Kafka developers on the web. This is a side effect of Kafka’s immense popularity. But still, since Tim Berglund took over as developer lawyer at Confluent more than four years ago, he’s been eager to build a site like new developer Confluent.
“We have all of this stuff. There are recorded meetings and there are recorded conferences and [Kafka] Lectures, demos and all kinds of code on GitHub, podcasts, blog posts and all, ”says Berglund, whose official title is Senior Director of Developer Advocacy.
“But asking the folks at Google, I mean, that’s normal behavior. But I want them to be at home, ”he continues. “There must be a URL. There must be a place. It is at the heart of my vision of developer relations. It must be a website. This is the website where you send people. And so he has to live there.
The revamped Confluent Developer website (it’s been over a year) is a real assortment of resources for Kafka developers. At a high level, it includes nine recorded video lessons, 50 software design templates, seven “getting started” guides suitable for different programming languages, three new “quickstarts” and 13 learning pages.
The video courses (which feature Berglund and other professionals at Confluent) explore a variety of Kafka topics, ranging from basics (Apache Kafka 101) to more advanced topics (Data Mesh 101). Each of these courses is made up of multiple videos, which are broken down into short pieces (2-10 minutes) that are easier to digest by today’s busy developers.
If you’re entirely new to Kafka, Berglund recommends starting with his Kafka 101 course, which includes over 70 minutes of video and text aimed at outlining the basics of Kafka and the essentials of a streaming architecture. events.
“This is going to give you a very smooth introduction to the idea of what an event is, to the notion of logging events, and then to the layers of the Kafka ecosystem that are kind of added to this very basic core.” , explains Berglund. “You have this event log. I’m trying to get them to understand the idea of an event log.
“But that in itself is easy to understand and difficult to build, so you need those layers on top of it,” he continues. “This Kafka 101 course gently introduces you, piece by piece, to this whole ecosystem. It usually takes people from zero to, if not a hero, at least a comfortable person in the span of about an hour. “
If you are curious about how Kafka works with Java, Python, Go, .NET, REST, SQL, or C / C +, then you might be interested in the tutorials hosted in the “getting started” guides. Users can also start playing with Kafka running on the Confluent Cloud through the ‘quick start’ mechanism.
The models also make their debut with the relaunch of Confluent Developer. The world of corporate computing is no stranger to patterns as first described in the original 1995 book “Design Patterns: Elements of Reusable Object-Oriented Software”, written by the “Gang of Four” . Confluent is now borrowing a page from that book to help the developers at Kafka think more holistically about how things fit together in the new paradigm of event streaming.
“We just take this pattern from models and apply it to event flow issues, like how to do a side database write, or an event source connector, or how to compact an event flow.” , explains Berglund. “These are all the things that you have to do when you build something based on event architecture, and we just collected about fifty of them for a first pass and built them, diagram them, and said, now you have a book. of recipes.
The grounds have been simmering for a while inside Confluent. It’s not so much about giving developers cookie-cutter code that they can remove, but showing them how various components can be used to build streaming data applications.
“If you compare it to the perceived paradigm, like how people create an app by default, now there’s a database and a big app around it and that app is growing and that database is growing,” explains Berglund. “Everyone knows how to build a monolith. They know their favorite language and their favorite framework and their favorite database and they are super comfortable.
“Now come into the world of event streaming, and everyone’s like, now I know what this paradigm can do,” he continues. “It’s proven. There are stories. I get the architectural properties that event streaming gives me, and I need them. But I don’t know how to build these things. [built] A class. So we are trying to facilitate that path.
Access to Confluent Developer is free. In fact, Confluent, which recently went public and just released its first quarterly results, doesn’t even require you to log in. The resources are simply found on a static website, free for everyone.
Confluent raises more than $ 800 million in IPO
Confluent S-1 reveals the theme “Reinventing the company”
Three takeaways from Jay Kreps’ Kafka Summit opening speech