Sydney King Street

Level 13, 135 King Street, Sydney, Australia, NSW 2000
The business centre in King Street, Sydney is in the energetic heart of Sydney's CBD, surrounded by major financial instituti...

Subcategories (8)

Image for Apache NiFi category
Apache NiFi
Image for Apache Ignite category
Apache Ignite
Image for Apache Apex category
Apache Apex
Image for Apache Storm category
Apache Storm
Image for Apache Flink category
Apache Flink
Image for Apache Beam category
Apache Beam
Image for KSQL category
KSQL
Image for Spark Streaming category
Spark Streaming

Explore Our Courses

Building Kafka Solutions with Confluent

14 Hours
This instructor-led, live training (online or onsite) is aimed at engineers who wish to use Confluent (a distribution of Kafka) to build and manage a real-time data processing platform for their applications. By the end of this training, participants will be able to:
  • Install and configure Confluent Platform.
  • Use Confluent's management tools and services to run Kafka more easily.
  • Store and process incoming stream data.
  • Optimize and manage Kafka clusters.
  • Secure data streams.
Format of the Course
  • Interactive lecture and discussion.
  • Lots of exercises and practice.
  • Hands-on implementation in a live-lab environment.
Course Customization Options
  • This course is based on the open source version of Confluent: Confluent Open Source.
  • To request a customized training for this course, please contact us to arrange.
Read more...

A Practical Introduction to Stream Processing

21 Hours
In this instructor-led, live training in Sydney (onsite or remote), participants will learn how to set up and integrate different Stream Processing frameworks with existing big data storage systems and related software applications and microservices. By the end of this training, participants will be able to:
  • Install and configure different Stream Processing frameworks, such as Spark Streaming and Kafka Streaming.
  • Understand and select the most appropriate framework for the job.
  • Process of data continuously, concurrently, and in a record-by-record fashion.
  • Integrate Stream Processing solutions with existing databases, data warehouses, data lakes, etc.
  • Integrate the most appropriate stream processing library with enterprise applications and microservices.
Read more...

Apache Kafka for Python Programmers

7 Hours
This instructor-led, live training in Sydney (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Apache Kafka features in data streaming with Python. By the end of this training, participants will be able to use Apache Kafka to monitor and manage conditions in continuous data streams using Python programming.
Read more...

Stream Processing with Kafka Streams

7 Hours
Kafka Streams is a client-side library for building applications and microservices whose data is passed to and from a Kafka messaging system. Traditionally, Apache Kafka has relied on Apache Spark or Apache Storm to process data between message producers and consumers. By calling the Kafka Streams API from within an application, data can be processed directly within Kafka, bypassing the need for sending the data to a separate cluster for processing. In this instructor-led, live training, participants will learn how to integrate Kafka Streams into a set of sample Java applications that pass data to and from Apache Kafka for stream processing. By the end of this training, participants will be able to:
  • Understand Kafka Streams features and advantages over other stream processing frameworks
  • Process stream data directly within a Kafka cluster
  • Write a Java or Scala application or microservice that integrates with Kafka and Kafka Streams
  • Write concise code that transforms input Kafka topics into output Kafka topics
  • Build, package and deploy the application
Audience
  • Developers
Format of the course
  • Part lecture, part discussion, exercises and heavy hands-on practice
Notes
  • To request a customized training for this course, please contact us to arrange
Read more...

Samza for Stream Processing

14 Hours
Apache Samza is an open-source near-realtime, asynchronous computational framework for stream processing.  It uses Apache Kafka for messaging, and Apache Hadoop YARN for fault tolerance, processor isolation, security, and resource management. This instructor-led, live training introduces the principles behind messaging systems and distributed stream processing, while walking participants through the creation of a sample Samza-based project and job execution. By the end of this training, participants will be able to:
  • Use Samza to simplify the code needed to produce and consume messages.
  • Decouple the handling of messages from an application.
  • Use Samza to implement near-realtime asynchronous computation.
  • Use stream processing to provide a higher level of abstraction over messaging systems.
Audience
  • Developers
Format of the course
  • Part lecture, part discussion, exercises and heavy hands-on practice
Read more...

Apache Flink Fundamentals

28 Hours
This instructor-led, live training in Sydney (online or onsite) introduces the principles and approaches behind distributed stream and batch data processing, and walks participants through the creation of a real-time, data streaming application in Apache Flink. By the end of this training, participants will be able to:
  • Set up an environment for developing data analysis applications.
  • Understand how Apache Flink's graph-processing library (Gelly) works.
  • Package, execute, and monitor Flink-based, fault-tolerant, data streaming applications.
  • Manage diverse workloads.
  • Perform advanced analytics.
  • Set up a multi-node Flink cluster.
  • Measure and optimize performance.
  • Integrate Flink with different Big Data systems.
  • Compare Flink capabilities with those of other big data processing frameworks.
Read more...

Apache NiFi for Administrators

21 Hours
In this instructor-led, live training in Sydney (onsite or remote), participants will learn how to deploy and manage Apache NiFi in a live lab environment. By the end of this training, participants will be able to:
  • Install and configure Apachi NiFi.
  • Source, transform and manage data from disparate, distributed data sources, including databases and big data lakes.
  • Automate dataflows.
  • Enable streaming analytics.
  • Apply various approaches for data ingestion.
  • Transform Big Data and into business insights.
Read more...

Apache NiFi for Developers

7 Hours
In this instructor-led, live training in Sydney, participants will learn the fundamentals of flow-based programming as they develop a number of demo extensions, components and processors using Apache NiFi. By the end of this training, participants will be able to:
  • Understand NiFi's architecture and dataflow concepts.
  • Develop extensions using NiFi and third-party APIs.
  • Custom develop their own Apache Nifi processor.
  • Ingest and process real-time data from disparate and uncommon file formats and data sources.
Read more...

Apache Storm

28 Hours
Apache Storm is a distributed, real-time computation engine used for enabling real-time business intelligence. It does so by enabling applications to reliably process unbounded streams of data (a.k.a. stream processing). "Storm is for real-time processing what Hadoop is for batch processing!" In this instructor-led live training, participants will learn how to install and configure Apache Storm, then develop and deploy an Apache Storm application for processing big data in real-time. Some of the topics included in this training include:
  • Apache Storm in the context of Hadoop
  • Working with unbounded data
  • Continuous computation
  • Real-time analytics
  • Distributed RPC and ETL processing
Request this course now! Audience
  • Software and ETL developers
  • Mainframe professionals
  • Data scientists
  • Big data analysts
  • Hadoop professionals
Format of the course
  •     Part lecture, part discussion, exercises and heavy hands-on practice
Read more...

Apache Apex: Processing Big Data-in-Motion

21 Hours
Apache Apex is a YARN-native platform that unifies stream and batch processing. It processes big data-in-motion in a way that is scalable, performant, fault-tolerant, stateful, secure, distributed, and easily operable. This instructor-led, live training introduces Apache Apex's unified stream processing architecture, and walks participants through the creation of a distributed application using Apex on Hadoop. By the end of this training, participants will be able to:
  • Understand data processing pipeline concepts such as connectors for sources and sinks, common data transformations, etc.
  • Build, scale and optimize an Apex application
  • Process real-time data streams reliably and with minimum latency
  • Use Apex Core and the Apex Malhar library to enable rapid application development
  • Use the Apex API to write and re-use existing Java code
  • Integrate Apex into other applications as a processing engine
  • Tune, test and scale Apex applications
Format of the Course
  • Interactive lecture and discussion.
  • Lots of exercises and practice.
  • Hands-on implementation in a live-lab environment.
Course Customization Options
  • To request a customized training for this course, please contact us to arrange.
Read more...

Unified Batch and Stream Processing with Apache Beam

14 Hours
Apache Beam is an open source, unified programming model for defining and executing parallel data processing pipelines. It's power lies in its ability to run both batch and streaming pipelines, with execution being carried out by one of Beam's supported distributed processing back-ends: Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Apache Beam is useful for ETL (Extract, Transform, and Load) tasks such as moving data between different storage media and data sources, transforming data into a more desirable format, and loading data onto a new system. In this instructor-led, live training (onsite or remote), participants will learn how to implement the Apache Beam SDKs in a Java or Python application that defines a data processing pipeline for decomposing a big data set into smaller chunks for independent, parallel processing. By the end of this training, participants will be able to:
  • Install and configure Apache Beam.
  • Use a single programming model to carry out both batch and stream processing from withing their Java or Python application.
  • Execute pipelines across multiple environments.
Format of the Course
  • Part lecture, part discussion, exercises and heavy hands-on practice
Note
  • This course will be available Scala in the future. Please contact us to arrange.
Read more...

Apache Ignite for Developers

14 Hours
This instructor-led, live training in Sydney (online or onsite) is aimed at developers who wish to learn the principles behind persistent and pure in-memory storage as they step through the creation of a sample in-memory computing project. By the end of this training, participants will be able to:
  • Use Ignite for in-memory, on-disk persistence as well as a purely distributed in-memory database.
  • Achieve persistence without syncing data back to a relational database.
  • Use Ignite to carry out SQL and distributed joins.
  • Improve performance by moving data closer to the CPU, using RAM as a storage.
  • Spread data sets across a cluster to achieve horizontal scalability.
  • Integrate Ignite with RDBMS, NoSQL, Hadoop and machine learning processors.
Read more...

Confluent KSQL

7 Hours
This instructor-led, live training in Sydney (online or onsite) is aimed at developers who wish to implement Apache Kafka stream processing without writing code. By the end of this training, participants will be able to:
  • Install and configure Confluent KSQL.
  • Set up a stream processing pipeline using only SQL commands (no Java or Python coding).
  • Carry out data filtering, transformations, aggregations, joins, windowing, and sessionization entirely in SQL.
  • Design and deploy interactive, continuous queries for streaming ETL and real-time analytics.
Read more...

Spark Streaming with Python and Kafka

7 Hours
This instructor-led, live training in Sydney (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Spark Streaming features in processing and analyzing real-time data. By the end of this training, participants will be able to use Spark Streaming to process live data streams for use in databases, filesystems, and live dashboards.
Read more...

Last Updated:

Testimonials (5)

Sufficient hands on, trainer is knowledgable

Chris Tan
Course - A Practical Introduction to Stream Processing

Recalling/reviewing keypoints of the topics discussed.

Paolo Angelo Gaton - SMS Global Technologies Inc.
Course - Building Stream Processing Applications with Kafka Streams

Virtual environment working well and trainer positive attitude

Wojciech Lukawski - Orsted Polska sp. z o.o.
Course - Apache NiFi for Developers

I liked trainer's attitude and choice of examples. Trainer was very willing to help and answer questions. Trainer tried to go with as many examples as possible, even though we were short on time.

Waldemar Sobiecki - Orsted Polska sp. z o.o.
Course - Apache NiFi for Developers

The trainer is very polite, tolerant, helpful. I was not afraid to ask for help when I couldn't handle something myself. I like that most of the exercises we did together without splitting into separate groups or by ourselves. That way we could ask questions on regular basis.

Elżbieta Doniek - Orsted Polska sp. z o.o.
Course - Apache NiFi for Developers

Upcoming Courses

Other regions in Australia

Other Countries

These courses are also available in other countries

Consulting

Stream Processing Consulting
Online Stream Processing training in Sydney, Stream Processing training courses in Sydney, Weekend Stream Processing courses in Sydney, Evening Stream Processing training in Sydney, Stream Processing instructor-led in Sydney, Stream Processing classes in Sydney, Weekend Stream Processing training in Sydney, Stream Processing boot camp in Sydney, Stream Processing coaching in Sydney, Evening Stream Processing courses in Sydney, Stream Processing one on one training in Sydney, Stream Processing private courses in Sydney, Stream Processing trainer in Sydney, Online Stream Processing training in Sydney, Stream Processing instructor-led in Sydney, Stream Processing instructor in Sydney, Stream Processing on-site in Sydney
1