Tutorial by Examples

A savepoint stores two things: (a) the positions of all datasources, (b) the states of operators. Savepoints are useful in many circonstances: slight application code updates Flink update changes in parallelism ... As of version 1.3 (also valid for earlier version): checkpoint must be ...

Configuration The configuration is in the file flink/conf/flink-conf.yaml (under Mac OSX via homebrew, it is /usr/local/Cellar/apache-flink/1.1.3/libexec/conf/flink-conf.yaml). Flink < 1.2: The configuration is very similar to the checkpoints configuration (topic available). The only differenc...

Before 1.2, the only way to persist state/retain a checkpoint after a job termination/cancellation/persistant failure was through a savepoint, which is triggered manually. Version 1.2 introduced persistent checkpoints. Persistent checkpoints behave very much like regular periodic checkpoints except...