Disclosure: when you buy through links on our site, we may earn an affiliate commission.

Real Time Streaming using Apache Spark Streaming

Analyze data in real-time using the Apache Spark Streaming API
(19 reviews)
149 students
Created by


CourseMarks Score®







Platform: Udemy
Video: 59m
Language: English
Next start: On Demand

Table of contents


Spark is the technology that allows us to perform big data processing in the MapReduce paradigm very rapidly, due to performing the processing in memory without the need for extensive I/O operations.
Recently, the streaming approach to processing events in near real time became more widely adopted and more necessary. In this course, you will learn how to handle big amount of unbounded infinite streams of data. You will analyze data and draw conclusions from it. Furthermore, we will look at common problems when processing event streams: sorting, watermarks, deduplication, and keeping state (for example, user sessions). You will also implement streaming processing using Spark Streaming and analyze traffic on a web page in real time.
About the Author :

Tomasz Lelek is a Software Engineer, programming mostly in Java, Scala. He is a fan of microservices architecture, and functional programming. He has dedicated considerable time and effort to be better every day. He recently dived into Big Data technologies such as Apache Spark and Hadoop. Tomasz is passionate about nearly everything associated with software development.Recently he was a speaker at conferences in Poland – Confitura and JDD (Java Developers Day) and also at Krakow Scala User Group. He has also conducted a live coding session at Geecon Conference.

You will learn

✓ Implement stream processing using Apache Spark Streaming
✓ Consume events from the source (for instance, Kafka), apply logic on it, and send it to a data sink.
✓ Understand how to deduplicate events when you have a system that ensures at-least-once deliver.
✓ Learn to tackle common stream processing problems.
✓ Create a job to analyze data in real time using the Apache Spark Streaming API.
✓ Master event time and processing time
✓ Single event processing and the micro-batch approach to processing events
✓ Learn to sort infinite event streams


• A basic understanding and functional knowledge of Apache Spark, stream processing, and big data are required.

This course is for

• The course is for software engineers interested in big data processing.
Tech Knowledge in Motion
Browse all courses by on Coursemarks.
Platform: Udemy
Video: 59m
Language: English
Next start: On Demand

Students are also interested in