Hortonworks webhdfs i try to list all folder it will work on Hortonworks console using curl command but not...
I try to list the name of the folder using webhdfs in C#. URL working fine using curl in sandbox but not in C# in my laptop
Error Message-
SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
Code:
static void Main(string args)
{
Uri myUri = new Uri("http://hostname:50070/webhdfs/v1/user/hive/warehouse");
string userName = "myuser";
WebHDFSClient hdfsClient = new WebHDFSClient(myUri, userName);
string strDirectoryPath= "/user/hive/warehouse";
ArrayList l = new ArrayList();
l.Add(hdfsClient.GetDirectoryStatus(
strDirectoryPath).Result.Directories);
}
c# hadoop webhdfs
add a comment |
I try to list the name of the folder using webhdfs in C#. URL working fine using curl in sandbox but not in C# in my laptop
Error Message-
SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
Code:
static void Main(string args)
{
Uri myUri = new Uri("http://hostname:50070/webhdfs/v1/user/hive/warehouse");
string userName = "myuser";
WebHDFSClient hdfsClient = new WebHDFSClient(myUri, userName);
string strDirectoryPath= "/user/hive/warehouse";
ArrayList l = new ArrayList();
l.Add(hdfsClient.GetDirectoryStatus(
strDirectoryPath).Result.Directories);
}
c# hadoop webhdfs
Stupid test first: can youcurlfrom your laptop? I would not be surprised if there was a firewall blocking your access to the WebHDFS service...
– Samson Scharfrichter
Jan 19 at 12:10
i am running curl on sandbox not on laptop, but C# i am running from laptop visual studio
– user3843858
Jan 19 at 14:29
OK, so you did not understand what I meant. Second attempt: Try. Running.curl. From. Your. Laptop. To check out network connectivity issues.
– Samson Scharfrichter
Jan 20 at 18:36
add a comment |
I try to list the name of the folder using webhdfs in C#. URL working fine using curl in sandbox but not in C# in my laptop
Error Message-
SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
Code:
static void Main(string args)
{
Uri myUri = new Uri("http://hostname:50070/webhdfs/v1/user/hive/warehouse");
string userName = "myuser";
WebHDFSClient hdfsClient = new WebHDFSClient(myUri, userName);
string strDirectoryPath= "/user/hive/warehouse";
ArrayList l = new ArrayList();
l.Add(hdfsClient.GetDirectoryStatus(
strDirectoryPath).Result.Directories);
}
c# hadoop webhdfs
I try to list the name of the folder using webhdfs in C#. URL working fine using curl in sandbox but not in C# in my laptop
Error Message-
SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
Code:
static void Main(string args)
{
Uri myUri = new Uri("http://hostname:50070/webhdfs/v1/user/hive/warehouse");
string userName = "myuser";
WebHDFSClient hdfsClient = new WebHDFSClient(myUri, userName);
string strDirectoryPath= "/user/hive/warehouse";
ArrayList l = new ArrayList();
l.Add(hdfsClient.GetDirectoryStatus(
strDirectoryPath).Result.Directories);
}
c# hadoop webhdfs
c# hadoop webhdfs
edited Jan 19 at 9:18
Ivan Kaloyanov
1,2193918
1,2193918
asked Jan 19 at 9:14
user3843858user3843858
7011
7011
Stupid test first: can youcurlfrom your laptop? I would not be surprised if there was a firewall blocking your access to the WebHDFS service...
– Samson Scharfrichter
Jan 19 at 12:10
i am running curl on sandbox not on laptop, but C# i am running from laptop visual studio
– user3843858
Jan 19 at 14:29
OK, so you did not understand what I meant. Second attempt: Try. Running.curl. From. Your. Laptop. To check out network connectivity issues.
– Samson Scharfrichter
Jan 20 at 18:36
add a comment |
Stupid test first: can youcurlfrom your laptop? I would not be surprised if there was a firewall blocking your access to the WebHDFS service...
– Samson Scharfrichter
Jan 19 at 12:10
i am running curl on sandbox not on laptop, but C# i am running from laptop visual studio
– user3843858
Jan 19 at 14:29
OK, so you did not understand what I meant. Second attempt: Try. Running.curl. From. Your. Laptop. To check out network connectivity issues.
– Samson Scharfrichter
Jan 20 at 18:36
Stupid test first: can you
curl from your laptop? I would not be surprised if there was a firewall blocking your access to the WebHDFS service...– Samson Scharfrichter
Jan 19 at 12:10
Stupid test first: can you
curl from your laptop? I would not be surprised if there was a firewall blocking your access to the WebHDFS service...– Samson Scharfrichter
Jan 19 at 12:10
i am running curl on sandbox not on laptop, but C# i am running from laptop visual studio
– user3843858
Jan 19 at 14:29
i am running curl on sandbox not on laptop, but C# i am running from laptop visual studio
– user3843858
Jan 19 at 14:29
OK, so you did not understand what I meant. Second attempt: Try. Running.
curl. From. Your. Laptop. To check out network connectivity issues.– Samson Scharfrichter
Jan 20 at 18:36
OK, so you did not understand what I meant. Second attempt: Try. Running.
curl. From. Your. Laptop. To check out network connectivity issues.– Samson Scharfrichter
Jan 20 at 18:36
add a comment |
1 Answer
1
active
oldest
votes
few issues:
- your URI is "http://hostname:50070/webhdfs/v1/user/hive/warehouse", and your strDirectoryPath= "/user/hive/warehouse" - so your duplicating the path to be "http://hostname:50070/webhdfs/v1/user/hive/warehouse/user/hive/warehouse" which does not exist
- you user "myuser" may not have permissions access to /user/hive/warehouse - check its permissions by "hdfs dfs -ls /user/hive/warehouse"
- (just checking) the 'hostname' in the URI - is just for the question and not in the actual code, right? you'll need the hostname/ip of the sandbox
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54265617%2fhortonworks-webhdfs-i-try-to-list-all-folder-it-will-work-on-hortonworks-console%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
few issues:
- your URI is "http://hostname:50070/webhdfs/v1/user/hive/warehouse", and your strDirectoryPath= "/user/hive/warehouse" - so your duplicating the path to be "http://hostname:50070/webhdfs/v1/user/hive/warehouse/user/hive/warehouse" which does not exist
- you user "myuser" may not have permissions access to /user/hive/warehouse - check its permissions by "hdfs dfs -ls /user/hive/warehouse"
- (just checking) the 'hostname' in the URI - is just for the question and not in the actual code, right? you'll need the hostname/ip of the sandbox
add a comment |
few issues:
- your URI is "http://hostname:50070/webhdfs/v1/user/hive/warehouse", and your strDirectoryPath= "/user/hive/warehouse" - so your duplicating the path to be "http://hostname:50070/webhdfs/v1/user/hive/warehouse/user/hive/warehouse" which does not exist
- you user "myuser" may not have permissions access to /user/hive/warehouse - check its permissions by "hdfs dfs -ls /user/hive/warehouse"
- (just checking) the 'hostname' in the URI - is just for the question and not in the actual code, right? you'll need the hostname/ip of the sandbox
add a comment |
few issues:
- your URI is "http://hostname:50070/webhdfs/v1/user/hive/warehouse", and your strDirectoryPath= "/user/hive/warehouse" - so your duplicating the path to be "http://hostname:50070/webhdfs/v1/user/hive/warehouse/user/hive/warehouse" which does not exist
- you user "myuser" may not have permissions access to /user/hive/warehouse - check its permissions by "hdfs dfs -ls /user/hive/warehouse"
- (just checking) the 'hostname' in the URI - is just for the question and not in the actual code, right? you'll need the hostname/ip of the sandbox
few issues:
- your URI is "http://hostname:50070/webhdfs/v1/user/hive/warehouse", and your strDirectoryPath= "/user/hive/warehouse" - so your duplicating the path to be "http://hostname:50070/webhdfs/v1/user/hive/warehouse/user/hive/warehouse" which does not exist
- you user "myuser" may not have permissions access to /user/hive/warehouse - check its permissions by "hdfs dfs -ls /user/hive/warehouse"
- (just checking) the 'hostname' in the URI - is just for the question and not in the actual code, right? you'll need the hostname/ip of the sandbox
answered Jan 19 at 19:15
Doron VeederDoron Veeder
4915
4915
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54265617%2fhortonworks-webhdfs-i-try-to-list-all-folder-it-will-work-on-hortonworks-console%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Stupid test first: can you
curlfrom your laptop? I would not be surprised if there was a firewall blocking your access to the WebHDFS service...– Samson Scharfrichter
Jan 19 at 12:10
i am running curl on sandbox not on laptop, but C# i am running from laptop visual studio
– user3843858
Jan 19 at 14:29
OK, so you did not understand what I meant. Second attempt: Try. Running.
curl. From. Your. Laptop. To check out network connectivity issues.– Samson Scharfrichter
Jan 20 at 18:36