Flink: Is there a way to find the age of an element in a Global window?
I'm using Global Windows for my application with a custom trigger and custom evictor based on some conditions. Now, I also want to evict those elements from the window that have stayed there for too long, let's say 30 mins. How would I go about doing this? Is there a utility that Flink provides that lets me know what the age of an element in a window is?
apache-flink flink-streaming
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
add a comment |
I'm using Global Windows for my application with a custom trigger and custom evictor based on some conditions. Now, I also want to evict those elements from the window that have stayed there for too long, let's say 30 mins. How would I go about doing this? Is there a utility that Flink provides that lets me know what the age of an element in a window is?
apache-flink flink-streaming
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
add a comment |
I'm using Global Windows for my application with a custom trigger and custom evictor based on some conditions. Now, I also want to evict those elements from the window that have stayed there for too long, let's say 30 mins. How would I go about doing this? Is there a utility that Flink provides that lets me know what the age of an element in a window is?
apache-flink flink-streaming
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
I'm using Global Windows for my application with a custom trigger and custom evictor based on some conditions. Now, I also want to evict those elements from the window that have stayed there for too long, let's say 30 mins. How would I go about doing this? Is there a utility that Flink provides that lets me know what the age of an element in a window is?
apache-flink flink-streaming
apache-flink flink-streaming
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
asked 14 hours ago
Harshith BolarHarshith Bolar
4312
4312
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
An Evictor is passed an EvictorContext that provides access to the current watermark and the current processing time. If you timestamp your stream elements then you should have everything you need.
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54250020%2fflink-is-there-a-way-to-find-the-age-of-an-element-in-a-global-window%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
An Evictor is passed an EvictorContext that provides access to the current watermark and the current processing time. If you timestamp your stream elements then you should have everything you need.
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
add a comment |
An Evictor is passed an EvictorContext that provides access to the current watermark and the current processing time. If you timestamp your stream elements then you should have everything you need.
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
add a comment |
An Evictor is passed an EvictorContext that provides access to the current watermark and the current processing time. If you timestamp your stream elements then you should have everything you need.
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
An Evictor is passed an EvictorContext that provides access to the current watermark and the current processing time. If you timestamp your stream elements then you should have everything you need.
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
answered 14 hours ago
David AndersonDavid Anderson
5,22621121
5,22621121
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54250020%2fflink-is-there-a-way-to-find-the-age-of-an-element-in-a-global-window%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
