distributed systems
kafka
spark
azure
Kubernetes
redis
cassandra
tensorflow
Apache Kafka and Spark Structured Streaming:
With examples of crypto-currency trades processing and reaction on events from multiple data sources
My presentation from O'Reilly OSCON 2018 in Portland, Oregon.
You can find slides here.
Video will be posted as soon as it's available.
07.19.2018
|
distributed systems
kafka
spark
azure
Distributed systems for stream processing: Apache Kafka and Spark Streaming
My presentation from O'Reilly Velocity 2018 in San Jose, California.
You can find slides here.
Video will be posted as soon as it's available.
06.13.2018
|
distributed systems
kafka
spark
azure
Distributed Data Stores on Kubernetes:
Foundations, Concepts, Implementation and Examples
My presentation from GOTO Chicago 2018 in Chicago, Illinois.
You can find slides here.
04.25.2018
|
distributed systems
Kubernetes
Cassandra
Spark
state
Submitting Spark jobs using Kubernetes scheduler (Spark > 2.3.0)
Follow the discussion between Lena and Bernd and learn about a new Kubernetes scheduler option in the latest release of Spark 2.3.0. Lena gives Bernd a quick overview of Spark, and shows him a hands-on example of submitting a job to run on Kubernetes cluster in Azure Container Service (AKS). They go over the necessary steps to prepare for job submission, as well as details of what happens when the job is being created, running or completed. In addition to learning about technical aspects of the topic, enjoy the magnificent view of the pacific-northwestern nature and explore the Treehouses on Microsoft campus!
03.16.2018
|
kubernetes
spark
Data ingestion, stream processing and sentiment analysis pipeline using Twitter data, Event Hubs, Spark and Cognitive Services
Follow the conversation between Lena and Suz and learn about setting up a data ingestion and processing system consisting of event producer, reliable event aggregation and consumer using Twitter client, Event Hubs and Spark on Azure Databricks as an example. Lena and Suz are also discussing alternative options for stream processing, and how it can be used for various scenarios, including IoT, and how to apply machine learning to streaming data by showing an example of sentiment analysis on tweets coming in real-time.
03.05.2018
|
kafka
cognitive services
sentiment analysis
scala
Intuitive Distributed Algorithms with Examples
Presentation Natallia Dzenisenka and I did together at OSCON 2017 in Austin, Texas.
You can find slides here.
05.10.2017
|
distributed systems
algorithms
consensus
gossip
consistency
Keynote at Open F#: FSharp is the Future of OSS .NET
Reactive-interactive approaches to visualization of F# jobs
My presentation from Progressive .NET Tutorials 2015 conference in London, UK. The talk was about various approaches to dynamic visualization with F#, SignalR and JS.
View the presentation...
You can watch the talk on the SkillsMatter page here.
My presentation from .NET FRINGE conference in Portland, OR. The talk was about functional approach for cloud computations and big data using F# language and MBrace framework.
View the presentation...