Hadoop的HBase组件如何进行详细配置？

本文共计2216个文字，预计阅读时间需要9分钟。

目录 + HBase实验步骤：

1.配置时间同步（所有节点）

2.部署HBase（master节点）

3.配置HBase（master节点）

4.复制文件到slave节点

5.修改权限，切换用户（所有节点）

6.启动zkServer

7.启动HBase

目录

• HBase实验步骤：
  • 1、配置时间同步（所有节点）
  • 2、部署HBase（master节点）
  • 3、配置HBase（master节点）
  • 4、拷贝文件到slave节点
  • 5、修改权限，切换用户（所有节点）
  • 6、启动zkServer
  • 7、启动hadoop（master节点）
  • 8、启动hbase（master节点）
  • 9、查看浏览器页面
  • 10、hbase语法应用（master节点）
  • 11、关闭hbase（master节点）

HBase实验步骤：

需要在4、全分布式配置、5、集群运行、8、ZooKeeper组件的基础上进行配置

1、配置时间同步（所有节点）

[root@master ~]# yum -y install chrony [root@master ~]# vi /etc/chrony.conf server 0.time1.aliyun.com iburst #保存 [root@master ~]# systemctl restart chronyd [root@master ~]# systemctl enable chronyd Created symlink from /etc/systemd/system/multi-user.target.wants/chronyd.service to /usr/lib/systemd/system/chronyd.service. [root@master ~]# systemctl status chronyd ● chronyd.service - NTP client/server Loaded: loaded (/usr/lib/systemd/system/chronyd.service; enabled; vendor preset: enabled) Active: active (running) since Fri 2022-04-15 15:39:55 CST; 23s ago Main PID: 1900 (chronyd) CGroup: /system.slice/chronyd.service └─1900 /usr/sbin/chronyd #看到running则表示成功 2、部署HBase（master节点）

先使用xftp上传hbase软件包至/opt/software

# 解压 [root@master ~]# tar xf /opt/software/hbase-1.2.1-bin.tar.gz -C /usr/local/src/ [root@master ~]# cd /usr/local/src/ [root@master src]# mv hbase-1.2.1 hbase [root@master src]# ls hadoop hbase hive jdk # 配置hbase环境变量 [root@master src]# vi /etc/profile.d/hbase.sh export HBASE_HOME=/usr/local/src/hbase export PATH=${HBASE_HOME}/bin:$PATH #保存 [root@master src]# source /etc/profile.d/hbase.sh [root@master src]# echo $PATH /usr/local/src/hbase/bin:/usr/local/src/jdk/bin:/usr/local/src/hadoop/bin:/usr/local/src/hadoop/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/usr/local/src/hive/bin:/root/bin #看到环境变量中有hbase的路径则表示成功 3、配置HBase（master节点）

# 配置HBase [root@master src]# cd /usr/local/src/hbase/conf/ [root@master conf]# vi hbase-env.sh export JAVA_HOME=/usr/local/src/jdk export HBASE_MANAGES_ZK=true export HBASE_CLASSPATH=/usr/local/src/hadoop/etc/hadoop/ #保存 [root@master conf]# vi hbase-site.xml <configuration> <property> <name>hbase.rootdir</name> <value>hdfs://master:9000/hbase</value> </property> <property> <name>hbase.master.info.port</name> <value>60010</value> </property> <property> <name>hbase.zookeeper.property.clientPort</name> <value>2181</value> </property> <property> <name>zookeeper.session.timeout</name> <value>10000</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>master,slave1,slave2</value> </property> <property> <name>hbase.tmp.dir</name> <value>/usr/local/src/hbase/tmp</value> </property> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> </configuration> #保存 [root@master conf]# vi regionservers 192.168.100.20 192.168.100.30 #保存 [root@master conf]# mkdir -p /usr/local/src/hbase/tmp 4、拷贝文件到slave节点

# master节点 [root@master conf]# scp -r /usr/local/src/hbase slave1:/usr/local/src/ [root@master conf]# scp -r /usr/local/src/hbase slave2:/usr/local/src/ [root@master conf]# scp /etc/profile.d/hbase.sh slave1:/etc/profile.d/ [root@master conf]# scp /etc/profile.d/hbase.sh slave2:/etc/profile.d/ 5、修改权限，切换用户（所有节点）

# master节点 [root@master conf]# chown -R hadoop.hadoop /usr/local/src [root@master conf]# ll /usr/local/src/ total 0 drwxr-xr-x. 12 hadoop hadoop 183 Apr 9 09:57 hadoop drwxr-xr-x 8 hadoop hadoop 171 Apr 15 15:59 hbase drwxr-xr-x. 11 hadoop hadoop 215 Apr 9 10:40 hive drwxr-xr-x. 8 hadoop hadoop 255 Sep 14 2017 jdk [root@master conf]# su - hadoop # slave1节点 [root@slave1 ~]# chown -R hadoop.hadoop /usr/local/src [root@slave1 ~]# ll /usr/local/src/ total 0 drwxr-xr-x. 12 hadoop hadoop 183 Apr 9 09:59 hadoop drwxr-xr-x 8 hadoop hadoop 171 Apr 15 16:19 hbase drwxr-xr-x. 8 hadoop hadoop 255 Apr 8 17:24 jdk [root@slave1 ~]# su - hadoop # slave2节点 [root@slave2 ~]# ll /usr/local/src/ 总用量 0 drwxr-xr-x. 12 hadoop hadoop 183 4月 9 09:59 hadoop drwxr-xr-x 8 hadoop hadoop 171 4月 15 16:19 hbase drwxr-xr-x. 8 hadoop hadoop 255 4月 8 17:24 jdk [root@slave2 ~]# su - hadoop 6、启动zkServer

# 在所有节点上 [hadoop@master ~]$ zkServer.sh start [hadoop@slave1 ~]$ zkServer.sh start [hadoop@slave2 ~]$ zkServer.sh start # 执行以上命令后要在看到有QuorumPeerMain进程 7、启动hadoop（master节点）

#在master上启动分布式hadoop集群 [hadoop@master ~]$ start-all.sh [hadoop@master ~]$ jps 3210 Jps 2571 NameNode 2780 SecondaryNameNode 2943 ResourceManager # 查看slave1节点 [hadoop@slave1 ~]$ jps 2512 DataNode 2756 Jps 2623 NodeManager # 查看slave2节点 [hadoop@slave2 ~]$ jps 3379 Jps 3239 NodeManager 3135 DataNode #确保master上有NameNode、SecondaryNameNode、 ResourceManager进程, slave节点上要有DataNode、NodeManager进程 8、启动hbase（master节点）

[hadoop@master ~]$ start-hbase.sh [hadoop@master ~]$ jps 3569 HMaster 2571 NameNode 2780 SecondaryNameNode 3692 Jps 2943 ResourceManager 3471 HQuorumPeer # 查看slave1节点 [hadoop@slave1 ~]$ jps 2512 DataNode 2818 HQuorumPeer 2933 HRegionServer 3094 Jps 2623 NodeManager # 查看slave2节点 [hadoop@slave2 ~]$ jps 3239 NodeManager 3705 Jps 3546 HRegionServer 3437 HQuorumPeer 3135 DataNode #确保master上有QuorumPeerMain、HMaster进程，slave节点上要有QuorumPeerMain、HRegionServer进程 9、查看浏览器页面

在windows主机上执行:
在C:\windows\system32\drivers\etc\下面把hosts文件拖到桌面上，然后编辑它加入master的主机名与IP地址的映射关系，在浏览器上输入master:60010访问hbase的web界面

192.168.100.10 master master.example.com 192.168.100.20 slave1 slave1.example.com 192.168.100.30 slave2 slave2.example.com

10、hbase语法应用（master节点）

[hadoop@master ~]$ hbase shell SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/src/hbase/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/src/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] HBase Shell; enter 'help<RETURN>' for list of supported commands. Type "exit<RETURN>" to leave the HBase Shell Version 1.2.1, r8d8a7107dc4ccbf36a92f64675dc60392f85c015, Wed Mar 30 11:19:21 CDT 2016 # 创建一张名为scores的表，表内有两个列簇 hbase(main):001:0> create 'scores','grade','course' 0 row(s) in 1.3950 seconds => Hbase::Table - scores # 查看hbase状态 hbase(main):002:0> status 1 active master, 0 backup masters, 2 servers, 0 dead, 1.5000 average load # 查看数据库版本 hbase(main):003:0> version 1.2.1, r8d8a7107dc4ccbf36a92f64675dc60392f85c015, Wed Mar 30 11:19:21 CDT 2016 # 查看表 hbase(main):004:0> list TABLE scores 1 row(s) in 0.0150 seconds => ["scores"] # 插入记录 hbase(main):005:0> put 'scores','jie','grade:','146cloud' 0 row(s) in 0.1000 seconds hbase(main):006:0> put 'scores','jie','course:math','86' 0 row(s) in 0.0160 seconds hbase(main):007:0> put 'scores','jie','course:cloud','92' 0 row(s) in 0.0120 seconds hbase(main):008:0> put 'scores','shi','grade:','133soft' 0 row(s) in 0.0120 seconds hbase(main):009:0> put 'scores','shi','course:math','87' 0 row(s) in 0.0080 seconds hbase(main):010:0> put 'scores','shi','course:cloud','96' 0 row(s) in 0.0080 seconds # 读取的记录 hbase(main):011:0> get 'scores','jie' COLUMN CELL course:cloud timestamp=1650090459825, value=92 course:math timestamp=1650090453152, value=86 grade: timestamp=1650090446128, value=146cloud 3 row(s) in 0.0190 seconds hbase(main):012:0> get 'scores','jie','grade' COLUMN CELL grade: timestamp=1650090446128, value=146cloud 1 row(s) in 0.0080 seconds # 查看整个表记录 hbase(main):013:0> scan 'scores' ROW COLUMN+CELL jie column=course:cloud, timestamp=1650090459825, value=92 jie column=course:math, timestamp=1650090453152, value=86 jie column=grade:, timestamp=1650090446128, value=146cloud shi column=course:cloud, timestamp=1650090479946, value=96 shi column=course:math, timestamp=1650090475684, value=87 shi column=grade:, timestamp=1650090464698, value=133soft 2 row(s) in 0.0200 seconds # 按例查看表记录 hbase(main):014:0> scan 'scores',{COLUMNS=>'course'} ROW COLUMN+CELL jie column=course:cloud, timestamp=1650090459825, value=92 jie column=course:math, timestamp=1650090453152, value=86 shi column=course:cloud, timestamp=1650090479946, value=96 shi column=course:math, timestamp=1650090475684, value=87 2 row(s) in 0.0140 seconds # 删除指定记录 hbase(main):015:0> delete 'scores','shi','grade' 0 row(s) in 0.0190 seconds # 增加新的名为age的列簇 hbase(main):016:0> alter 'scores',NAME=>'age' Updating all regions with the new schema... 1/1 regions updated. Done. 0 row(s) in 1.9080 seconds # 查看表结构 hbase(main):017:0> describe 'scores' Table scores is ENABLED scores COLUMN FAMILIES DESCRIPTION {NAME => 'age', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS = > 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS = > '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} {NAME => 'course', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELL S => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSION S => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} {NAME => 'grade', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 3 row(s) in 0.0230 seconds # 删除名为age的列簇 hbase(main):018:0> alter 'scores',NAME=>'age',METHOD=>'delete' Updating all regions with the new schema... 1/1 regions updated. Done. 0 row(s) in 1.8940 seconds # 删除表 hbase(main):019:0> disable 'scores' 0 row(s) in 2.2400 seconds # 退出hbase hbase(main):020:0> drop 'scores' 0 row(s) in 1.2450 seconds hbase(main):021:0> list TABLE 0 row(s) in 0.0040 seconds => [] # 退出hbase hbase(main):022:0> quit 11、关闭hbase（master节点）

# 关闭hbase [hadoop@master ~]$ stop-hbase.sh stopping hbase............... [hadoop@master ~]$ jps 44952 NameNode 45306 ResourceManager 46988 Jps 45150 SecondaryNameNode # 关闭hadoop [hadoop@master ~]$ stop-all.sh This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh Stopping namenodes on [master] ………… [hadoop@master ~]$ jps 47438 Jps

声明：未经许可，不得转载
原文地址：www.cnblogs.com/wzgwzg/p/16152890.html