Quantcast
Channel: Stream Processing Archives - Kai Waehner
Browsing all 37 articles
Browse latest View live

Apache Kafka Streams + Machine Learning (Spark, TensorFlow, H2O.ai)

Apache Kafka Streams to build Real Time Streaming Microservices. Apply Machine Learning / Deep Learning using Spark, TensorFlow, H2O.ai, etc. to add AI. Embed Kafka Streams into Java App, Docker,...

View Article



Kafka Streams + H2O.ai + TensorFlow (Video Recording / Live Demo)

I do a lot of presentations these days at meetups and conferences about how to leverage Apache Kafka and Kafka Streams to apply analytic models (built with H2O, TensorFlow, DeepLearning4J and other...

View Article

Deep Learning in Real Time with TensorFlow, H2O.ai and Kafka Streams (Slides...

Apache Kafka + Kafka Streams to Produductionize Neural Networks (Deep Learning). Models built with TensorFlow, DeepLearning4J, H2O. Slides from JavaOne 2017. The post Deep Learning in Real Time with...

View Article

Apache Kafka + Machine Learning => Confluent Blog Post and Github Project

I am happy that my first official Confluent blog post was published and want to link to it from by blog: How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka The post...

View Article

Apache Kafka + Kafka Streams + Mesos = Highly Scalable Microservices

This blog post discusses how to build a highly scalable, mission-critical microservice infrastructure with Apache Kafka, Kafka Streams, and Apache Mesos respectively in their vendor-supported platforms...

View Article


Machine Learning Trends of 2018 combined with the Apache Kafka Ecosystem

Follow At OOP 2018 conference in Munich, I presented an updated version of my talk about building scalable, mission-critical microservices with the Apache Kafka ecosystem and Deep Learning frameworks...

View Article

Video Recording – Apache Kafka as Event-Driven Open Source Streaming Platform...

Follow I spoke at Voxxed Zurich 2018 about Apache Kafka as Event-Driven Open Source Streaming Platform. The talk includes an intro to Apache Kafka and its open source ecosystem (Kafka Streams, Connect,...

View Article

Rethinking Stream Processing with Apache Kafka, Kafka Streams and KSQL

Follow I presented at JavaLand 2018 in Brühl recently. A great developer conference with over 1800 attendees. The location is also awesome! A theme park: Phantasialand. My talk: “New Era of Stream...

View Article


KSQL Deep Dive – The Open Source Streaming SQL Engine for Apache Kafka

KSQL is the open source, Apache 2.0 licensed streaming SQL engine on top of Apache Kafka. This post shows a deep dive (slides + video recording) including its relation to Kafka Connect and Kafka...

View Article


Apache Kafka + KSQL Live Demo (Video Recording) using CSV, JSON, Apache Avro

Apache Kafka + KSQL Live Demo using CSV, JSON, Apache Avro. 10min live demo to get introduced to KSQL - the streaming SQL engine for Apache Kafka. Write and deploy SQL queries for stream processing...

View Article

Model Serving: Stream Processing vs. RPC / REST with Java, gRPC, Apache...

Machine Learning / Deep Learning models can be used in different ways to do predictions. Natively in the application or hosted in a remote model server. Then you combine stream processing with RPC /...

View Article

Apache Kafka vs. ESB / ETL / MQ

Read why enterprises leverage the open source ecosystem of Apache Kafka for successful integration of different legacy and modern applications instead of ESB, ETL or MQ. The post Apache Kafka vs. ESB /...

View Article

Apache Kafka + MQTT = End-to-End IoT Integration (Github Examples)

MQTT and Apache Kafka are a perfect combination for end-to-end IoT integration from edge to data center. This post discusses two different approaches and refers to implementations on Github using...

View Article


Deep Learning Example: Apache Kafka + Python + Keras + TensorFlow +...

"Python + Keras + TensorFlow + DeepLearning4j + Apache Kafka + Kafka Streams" => New example added to my "Machine Learning + Kafka Streams Examples" Github project. The post Deep Learning Example:...

View Article

Apache Kafka + KSQL + TensorFlow for Data Scientists via Python + Jupyter...

Streaming Processing with Apache Kafka and KSQL for Data Scientists via Python and Jupyter Notebooks to build analytic models with TensorFlow and Keras. The post Apache Kafka + KSQL + TensorFlow for...

View Article


Apache Kafka vs. Middleware (MQ, ETL, ESB) – Slides + Video

This post shares a slide deck and video recording of the differences between an event-driven streaming platform like Apache Kafka and middleware like Message Queues (MQ), Extract-Transform-Load (ETL)...

View Article

IoT Integration with Kafka Connect, REST / HTTP, MQTT, OPC-UA – Lightboard Video

Follow I just want to share my lightboard video recording. I talk about IoT integration and processing with Apache Kafka using Kafka Connect, Kafka Streams, KSQL, REST / HTTP,  MQTT and OPC-UA. Use...

View Article


Apache Kafka and Machine Learning for Real Time Supply Chain Optimization in...

Apache Kafka and Machine Learning for Real Time Supply Chain Optimization: Integrate in real time with the legacy world and proprietary IIoT protocols (like Siemens S7, Modbus, Beckhoff ADS, OPC-UA, et...

View Article

Apache Kafka, KSQL and Apache PLC4X for IIoT Data Integration and Processing

Data integration and processing in Industrial IoT (IIoT, aka Industry 4.0 or Automation Industry). Apache Kafka, its ecosystem (Kafka Connect, KSQL) and Apache PLC4X are a great open source choice to...

View Article

Service Mesh and Cloud-Native Microservices with Apache Kafka, Kubernetes and...

This blog post takes a look at cutting edge technologies like Apache Kafka, Kubernetes, Envoy, Linkerd and Istio to implement a cloud-native service mesh for a scalable, robust and observable...

View Article
Browsing all 37 articles
Browse latest View live




Latest Images