Runnning a Job in Apache Flink standalone mode on Zeppelin I have this error “TooLongFrameException:...
I'm trying to run a simple job in apache flink using Zeppelin.
I have created a docker container with zeppelin 0.8.0 running. In the same container I have runnning apache flink 1.6.1. When I run the job using the flink interpreter that zeppelin has by default, works good and I can see the result of the job. But when I do it in my own interpreter with flink 1.6.1 running in standalone mode, I have the following error:
Configuration of my interpreter:
Properties setted in flink-conf.yaml
jobmanager.rpc.address: 0.0.0.0
jobmanager.rpc.port: 6134
jobmanager.heap.size: 1024m
taskmanager.heap.size: 1024m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
The error I get in the flink log (that's means flink receive the job from zeppelin):
2019-01-18 15:30:53,761 WARN
akka.remote.transport.netty.NettyTransport - Remote connection to
[/172.17.0.2:54842] failed with org.apache.flink.shaded.akka.org.jboss.netty.handler.codec.frame.TooLongFrameException: Adjusted frame length exceeds 10485760: 2147549189 - discarded
I know akka has the frame size messages setted 10485760b by default, but I'm receiving this value 2147549189 that is too big. I tried modifying this property akka.framesize: 10485760b in flink-conf.yaml but I can't put that huge size, doesn't have too much sense to me.
docker akka apache-flink apache-zeppelin
asked Jan 18 at 16:13
zetadarozetadaro
192
add a comment |
I'm trying to run a simple job in apache flink using Zeppelin.
I have created a docker container with zeppelin 0.8.0 running. In the same container I have runnning apache flink 1.6.1. When I run the job using the flink interpreter that zeppelin has by default, works good and I can see the result of the job. But when I do it in my own interpreter with flink 1.6.1 running in standalone mode, I have the following error:
Configuration of my interpreter:
Properties setted in flink-conf.yaml
jobmanager.rpc.address: 0.0.0.0
jobmanager.rpc.port: 6134
jobmanager.heap.size: 1024m
taskmanager.heap.size: 1024m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
The error I get in the flink log (that's means flink receive the job from zeppelin):
2019-01-18 15:30:53,761 WARN
akka.remote.transport.netty.NettyTransport - Remote connection to
[/172.17.0.2:54842] failed with org.apache.flink.shaded.akka.org.jboss.netty.handler.codec.frame.TooLongFrameException: Adjusted frame length exceeds 10485760: 2147549189 - discarded
I know akka has the frame size messages setted 10485760b by default, but I'm receiving this value 2147549189 that is too big. I tried modifying this property akka.framesize: 10485760b in flink-conf.yaml but I can't put that huge size, doesn't have too much sense to me.
docker akka apache-flink apache-zeppelin
asked Jan 18 at 16:13
zetadarozetadaro
192
add a comment |
I'm trying to run a simple job in apache flink using Zeppelin.
I have created a docker container with zeppelin 0.8.0 running. In the same container I have runnning apache flink 1.6.1. When I run the job using the flink interpreter that zeppelin has by default, works good and I can see the result of the job. But when I do it in my own interpreter with flink 1.6.1 running in standalone mode, I have the following error:
Configuration of my interpreter:
Properties setted in flink-conf.yaml
jobmanager.rpc.address: 0.0.0.0
jobmanager.rpc.port: 6134
jobmanager.heap.size: 1024m
taskmanager.heap.size: 1024m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
The error I get in the flink log (that's means flink receive the job from zeppelin):
2019-01-18 15:30:53,761 WARN
akka.remote.transport.netty.NettyTransport - Remote connection to
[/172.17.0.2:54842] failed with org.apache.flink.shaded.akka.org.jboss.netty.handler.codec.frame.TooLongFrameException: Adjusted frame length exceeds 10485760: 2147549189 - discarded
I know akka has the frame size messages setted 10485760b by default, but I'm receiving this value 2147549189 that is too big. I tried modifying this property akka.framesize: 10485760b in flink-conf.yaml but I can't put that huge size, doesn't have too much sense to me.
docker akka apache-flink apache-zeppelin
asked Jan 18 at 16:13
zetadarozetadaro
192
I'm trying to run a simple job in apache flink using Zeppelin.
I have created a docker container with zeppelin 0.8.0 running. In the same container I have runnning apache flink 1.6.1. When I run the job using the flink interpreter that zeppelin has by default, works good and I can see the result of the job. But when I do it in my own interpreter with flink 1.6.1 running in standalone mode, I have the following error:
Configuration of my interpreter:
Properties setted in flink-conf.yaml
jobmanager.rpc.address: 0.0.0.0
jobmanager.rpc.port: 6134
jobmanager.heap.size: 1024m
taskmanager.heap.size: 1024m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
The error I get in the flink log (that's means flink receive the job from zeppelin):
2019-01-18 15:30:53,761 WARN
akka.remote.transport.netty.NettyTransport - Remote connection to
[/172.17.0.2:54842] failed with org.apache.flink.shaded.akka.org.jboss.netty.handler.codec.frame.TooLongFrameException: Adjusted frame length exceeds 10485760: 2147549189 - discarded
I know akka has the frame size messages setted 10485760b by default, but I'm receiving this value 2147549189 that is too big. I tried modifying this property akka.framesize: 10485760b in flink-conf.yaml but I can't put that huge size, doesn't have too much sense to me.
docker akka apache-flink apache-zeppelin
docker akka apache-flink apache-zeppelin
asked Jan 18 at 16:13
zetadarozetadaro
192
asked Jan 18 at 16:13
zetadarozetadaro
192
asked Jan 18 at 16:13
zetadarozetadaro
192
asked Jan 18 at 16:13
zetadarozetadaro
192
asked Jan 18 at 16:13
zetadarozetadaro
192
192
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54257671%2frunnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54257671%2frunnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
