I try to setup a hadoop cluser with 1 namenode and 5 datanodes with two
The cluster should use a 192.168 address for its own communication,
client traffic should happen over a 10 network.
Allthough reading a bunch of websides about this I cannot get this to to
work, there are allways connection errors showing up.
Maybe someone has done this and could help me with that...
The setup is:
each node has two nics.
The datanodes are 192.168.10.1 to 192.168.10.5, the namenode is
The second nic in each node has network 10 address.
The clients connect via the 10 network to the cluster, also the dns
resolves to the 10 network
Listed in /etc/host are short names with the corresponding 192.168..
address aand the fqdn with the 10 address.
The cluster nodes should talk to each other via the 192 addresses, with
no firewall between them.
the slaves file contains the short names which are listed in the
With this config the cluster starts up without errors, hdfs dfs -ls /
works too, but "hdfs dfs -put ..." doesn't work:
DFSClient: Exception in createBlockOutputStream, Connection refused.
Excluding DatanodeInfoWithStorage(192.168.10.2 )