CSDN■不看就亏系列!这里有完整的 Hadoop 集群搭建教程,和最易懂的 Hadoop 概念!| 附代码( 三 )
4) obtracker : hadoop的map/reduce调度器 , 负责与任务节点通信分配计算任何并跟踪任务进度 , 这个服务器也是单点的 。
5)DataNode : Hadoop的数据节点 , 负责存储数据
6)tasktracker: hadoop的调度程度 , 负责map和reduce的任务的启动和执行
hadoop集群搭建
本文插图
1)环境 配好IP , 关闭iptables ,关闭selinux,配置hosts
[root@ chenc01 ~]# service iptables stop [root@ chenc01 ~]# setenforce 0 [root@ chenc01 ~]# vim /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 10.0.0.61 chenc01 10.0.0.62 chenc02 10.0.0.63 chenc032)创建普通用户 三台服务器上都要创建普通用户 , hadoop , 配置密码:123456[root@ chenc01 ~]# useradd -u 8000 hadoop ; echo 123456 | passwd --stdin hadoop 更改用户 hadoop 的密码。 passwd: 所有的身份验证令牌已经成功更新 。 3) 设置namenode [root@ chenc01 ~]# ssh-keygen Generating public/private rsa key pair. Enter file in which to save the key (/root/.ssh/id_rsa): Created directory '/root/.ssh'. Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /root/.ssh/id_rsa. Your public key has been saved in /root/.ssh/id_rsa.pub. The key fingerprint is: f1:7c:f6:6c:81:f5:a6:2a:74:d1:f2:95:50:38:ad:6f root@chenc01.localdomain The key's randomart image is: +--[ RSA 2048]----+ | +. | | + . | | . .= .| | + o+.o.| | S o ++o.o| | .o.o.E | | . . * | | . o | | .. | ++ [root@ chenc01 ~]# ssh-copy-id root@10.0.0.62 The authenticity of host '10.0.0.62 (10.0.0.62)' can't be established. RSA key fingerprint is 9b:57:b9:86:84:90:a4:4b:44:3e:18:9f:8a:29:6f:e5. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '10.0.0.62' (RSA) to the list of known hosts. root@10.0.0.62's password: Now try logging into the machine, with "ssh 'root@10.0.0.62'", and check in: .ssh/authorized_keys to make sure we haven't added extra keys that you weren't expecting. [root@ chenc01 ~]# ssh-copy-id root@10.0.0.63 The authenticity of host '10.0.0.63 (10.0.0.63)' can't be established. RSA key fingerprint is 9b:57:b9:86:84:90:a4:4b:44:3e:18:9f:8a:29:6f:e5. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '10.0.0.63' (RSA) to the list of known hosts. root@10.0.0.63's password: Now try logging into the machine, with "ssh 'root@10.0.0.63'", and check in:
推荐阅读
- 联发科5G SoC天玑1000系列性能、拍照火力全开
- 「Small人物大创意」为何九寨沟这么吸引人?还被誉为是人间仙境?,九寨归来不看水
- 『聚牛科技』4T系列官宣|苹果首次取消30%苹果税|全新iPad Pro曝光,荣耀Play
- 『爱生活爱快乐爱自己』英特尔新型5 GHz第十代核心H系列
- 【科学技术宅六六】低配用国产、中配混用、高配用三星!,华为P40系列屏幕差距较大
- 『大梁观察』开封市示范区公安分局城西派出所破获系列盗窃电动车电瓶案件
- [手机中国]网友:一定要买一台,魅族17系列将有梦幻独角兽配色
- 「3C派蚁族」最高直降1600元,国产5G手机能扛得住吗?,iPhone11系列清库存
- [泡泡网资讯] 华为P40系列10倍光学变焦堪比未来科技,华为出品必属精品
- 「腾讯科技」三星:S20系列两年内半价回收,只要状态良好,但只限美国
