Phoenix5.0的部署

1. 官网下载编译好的二进制包

• http://phoenix.apache.org/download.html2

1. 上传并解压到指定目录, 再修改目录名称

   tar -zxvf apache-phoenix-5.0.0-HBase-2.0-bin.tar.gz -C /opt/ronnie/
   
   cd /opt/ronnie/
   
   mv apache-phoenix-5.0.0-HBase-2.0-bin/ phoenix-5.0.0
   
   

2. 将phoenix-5.0.0-HBase-2.0-server.jar这个jar包拷贝到每一台机器的hbase的lib目录下

   • 进入Phoenix目录, 你会发现该目录下有多个jar包

     root@node01:/opt/ronnie# cd phoenix-5.0.0/
     
     root@node01:/opt/ronnie/phoenix-5.0.0# ll
     
     total 474596
     
     drwxr-xr-x  5  502 staff      4096 6月  27  2018 ./
     
     drwxr-xr-x 12 root root       4096 12月 27 10:15 ../
     
     drwxr-xr-x  4  502 staff      4096 12月 27 10:14 bin/
     
     drwxr-xr-x  3  502 staff      4096 12月 27 10:14 examples/
     
     -rw-r--r--  1  502 staff    144163 6月  27  2018 LICENSE
     
     -rw-r--r--  1  502 staff     10509 6月  27  2018 NOTICE
     
     -rw-r--r--  1  502 staff 135109092 6月  27  2018 phoenix-5.0.0-HBase-2.0-client.jar
     
     -rw-r--r--  1  502 staff 110858350 6月  27  2018 phoenix-5.0.0-HBase-2.0-hive.jar
     
     -rw-r--r--  1  502 staff 137968668 6月  27  2018 phoenix-5.0.0-HBase-2.0-pig.jar
     
     -rw-r--r--  1  502 staff   7931132 6月  27  2018 phoenix-5.0.0-HBase-2.0-queryserver.jar
     
     -rw-r--r--  1  502 staff  41800313 6月  27  2018 phoenix-5.0.0-HBase-2.0-server.jar
     
     -rw-r--r--  1  502 staff  34159398 6月  27  2018 phoenix-5.0.0-HBase-2.0-thin-client.jar
     
     -rw-r--r--  1  502 staff   4317285 6月  27  2018 phoenix-core-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff   2582830 6月  27  2018 phoenix-core-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff   2464127 6月  27  2018 phoenix-core-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     47912 6月  27  2018 phoenix-flume-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff     30171 6月  27  2018 phoenix-flume-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     37284 6月  27  2018 phoenix-flume-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff    139358 6月  27  2018 phoenix-hive-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff     85153 6月  27  2018 phoenix-hive-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     78698 6月  27  2018 phoenix-hive-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     27314 6月  27  2018 phoenix-kafka-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff    701717 6月  27  2018 phoenix-kafka-5.0.0-HBase-2.0-minimal.jar
     
     -rw-r--r--  1  502 staff     17292 6月  27  2018 phoenix-kafka-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     23673 6月  27  2018 phoenix-kafka-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     22960 6月  27  2018 phoenix-load-balancer-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff     13043 6月  27  2018 phoenix-load-balancer-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff    166993 6月  27  2018 phoenix-pherf-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff   3649883 6月  27  2018 phoenix-pherf-5.0.0-HBase-2.0-minimal.jar
     
     -rw-r--r--  1  502 staff    117898 6月  27  2018 phoenix-pherf-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     71056 6月  27  2018 phoenix-pherf-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     45806 6月  27  2018 phoenix-pig-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff     29760 6月  27  2018 phoenix-pig-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     46425 6月  27  2018 phoenix-pig-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     30825 6月  27  2018 phoenix-queryserver-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff     22595 6月  27  2018 phoenix-queryserver-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     59481 6月  27  2018 phoenix-queryserver-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     16785 6月  27  2018 phoenix-queryserver-client-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff     13491 6月  27  2018 phoenix-queryserver-client-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff     10914 6月  27  2018 phoenix-queryserver-client-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     88764 6月  27  2018 phoenix-spark-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff      3569 6月  27  2018 phoenix-spark-5.0.0-HBase-2.0-javadoc.jar
     
     -rw-r--r--  1  502 staff     25584 6月  27  2018 phoenix-spark-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff    127007 6月  27  2018 phoenix-spark-5.0.0-HBase-2.0-tests.jar
     
     -rw-r--r--  1  502 staff     16290 6月  27  2018 phoenix-tracing-webapp-5.0.0-HBase-2.0.jar
     
     -rw-r--r--  1  502 staff   2730675 6月  27  2018 phoenix-tracing-webapp-5.0.0-HBase-2.0-runnable.jar
     
     -rw-r--r--  1  502 staff     11826 6月  27  2018 phoenix-tracing-webapp-5.0.0-HBase-2.0-sources.jar
     
     -rw-r--r--  1  502 staff      8043 6月  27  2018 phoenix-tracing-webapp-5.0.0-HBase-2.0-tests.jar
     
     drwxr-xr-x  6  502 staff      4096 12月 27 10:14 python/
     
     -rw-r--r--  1  502 staff      1150 6月  27  2018 README.md
     
     

   • 将与HBase服务端关联的jar包拷贝到每一台机器的hbase的lib目录下

     cp phoenix-5.0.0-HBase-2.0-server.jar /opt/ronnie/hbase-2.0.6/lib/
     
     scp phoenix-5.0.0-HBase-2.0-server.jar root@node02:/opt/ronnie/hbase-2.0.6/lib/
     
     scp phoenix-5.0.0-HBase-2.0-server.jar root@node03:/opt/ronnie/hbase-2.0.6/lib/
     
     scp phoenix-5.0.0-HBase-2.0-server.jar root@node04:/opt/ronnie/hbase-2.0.6/lib/
     
     scp phoenix-5.0.0-HBase-2.0-server.jar root@node05:/opt/ronnie/hbase-2.0.6/lib/
     
     

3. 启动HBase

   • 启动Zookeeper集群

     zkServer.sh start
     
     

   • 启动hdfs和yarn

     start-dfs.sh
     
     start-yarn.sh
     
     

   • 启动HBase

     start-hbase.sh
     
     

4. 验证Phoenix是否部署成功

   root@node01:~# cd /opt/ronnie/phoenix-5.0.0/bin/
   
   root@node01:/opt/ronnie/phoenix-5.0.0/bin# ./sqlline.py node03,node04,node05:2181
   
   

   • ps: 我的Zookeeper集群是在node03, node04, node05上的。

   • 执行结果

     root@node01:/opt/ronnie/phoenix-5.0.0/bin# ./sqlline.py node03,node04,node05:2181
     
     Setting property: [incremental, false]
     
     Setting property: [isolation, TRANSACTION_READ_COMMITTED]
     
     issuing: !connect jdbc:phoenix:node03,node04,node05:2181 none none org.apache.phoenix.jdbc.PhoenixDriver
     
     Connecting to jdbc:phoenix:node03,node04,node05:2181
     
     SLF4J: Class path contains multiple SLF4J bindings.
     
     SLF4J: Found binding in [jar:file:/opt/ronnie/phoenix-5.0.0/phoenix-5.0.0-HBase-2.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
     
     SLF4J: Found binding in [jar:file:/opt/ronnie/hadoop-3.1.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
     
     SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
     
     19/12/27 10:38:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
     
     Connected to: Phoenix (version 5.0)
     
     Driver: PhoenixEmbeddedDriver (version 5.0)
     
     Autocommit status: true
     
     Transaction isolation: TRANSACTION_READ_COMMITTED
     
     Building list of tables and columns for tab-completion (set fastconnect to true to skip)...
     
     133/133 (100%) Done
     
     Done
     
     sqlline version 1.2.0
     
     0: jdbc:phoenix:node03,node04,node05:2181> !tables
     
     +------------+--------------+-------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+---------------+---------------+-----------------+------------+-------------+----------------+------------+
     
     | TABLE_CAT  | TABLE_SCHEM  | TABLE_NAME  |  TABLE_TYPE   | REMARKS  | TYPE_NAME  | SELF_REFERENCING_COL_NAME  | REF_GENERATION  | INDEX_STATE  | IMMUTABLE_ROWS  | SALT_BUCKETS  | MULTI_TENANT  | VIEW_STATEMENT  | VIEW_TYPE  | INDEX_TYPE  | TRANSACTIONAL  | IS_NAMESPA |
     
     +------------+--------------+-------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+---------------+---------------+-----------------+------------+-------------+----------------+------------+
     
     |            | SYSTEM       | CATALOG     | SYSTEM TABLE  |          |            |                            |                 |              | false           | null          | false         |                 |            |             | false          | false      |
     
     |            | SYSTEM       | FUNCTION    | SYSTEM TABLE  |          |            |                            |                 |              | false           | null          | false         |                 |            |             | false          | false      |
     
     |            | SYSTEM       | LOG         | SYSTEM TABLE  |          |            |                            |                 |              | true            | 32            | false         |                 |            |             | false          | false      |
     
     |            | SYSTEM       | SEQUENCE    | SYSTEM TABLE  |          |            |                            |                 |              | false           | null          | false         |                 |            |             | false          | false      |
     
     |            | SYSTEM       | STATS       | SYSTEM TABLE  |          |            |                            |                 |              | false           | null          | false         |                 |            |             | false          | false      |
     
     +------------+--------------+-------------+---------------+----------+------------+----------------------------+-----------------+--------------+-----------------+---------------+---------------+-----------------+------------+-------------+----------------+------------+
     
     0: jdbc:phoenix:node03,node04,node05:2181>
     
     

     • 能进入sql界面并能查到表说明已经安装部署成功

5. 写个简单demo

   • 创建person表, 插入值, 选择所有

     0: jdbc:phoenix:node03,node04,node05:2181> create table person (id integer not null primary key,name varchar,age integer);
     
     No rows affected (0.826 seconds)
     
     0: jdbc:phoenix:node03,node04,node05:2181> upsert into person values (1,'ronnie',22);
     
     1 row affected (0.058 seconds)
     
     0: jdbc:phoenix:node03,node04,node05:2181> upsert into person values (2,'alex',18);
     
     1 row affected (0.008 seconds)
     
     0: jdbc:phoenix:node03,node04,node05:2181> select * from person;
     
     +-----+---------+------+
     
     | ID  |  NAME   | AGE  |
     
     +-----+---------+------+
     
     | 1   | ronnie  | 22   |
     
     | 2   | alex    | 18   |
     
     +-----+---------+------+
     
     2 rows selected (0.027 seconds)
     
     

   • 此时, 在HBase上查看下person表

     hbase(main):001:0> list
     
     TABLE
     
     PERSON
     
     SYSTEM.CATALOG
     
     SYSTEM.FUNCTION
     
     SYSTEM.LOG
     
     SYSTEM.MUTEX
     
     SYSTEM.SEQUENCE
     
     SYSTEM.STATS
     
     stu
     
     student
     
     student_namespace:student_table
     
     www.baidu.com20170630
     
     www.qq.com20170630
     
     12 row(s)
     
     Took 0.2846 seconds
     
     => ["PERSON", "SYSTEM.CATALOG", "SYSTEM.FUNCTION", "SYSTEM.LOG", "SYSTEM.MUTEX", "SYSTEM.SEQUENCE", "SYSTEM.STATS", "stu", "student", "student_namespace:student_table", "www.baidu.com20170630", "www.qq.com20170630"]
     
     hbase(main):002:0> scan 'PERSON'
     
     ROW                                                                  COLUMN+CELL
     
      \x80\x00\x00\x01                                                    column=0:\x00\x00\x00\x00, timestamp=1577415599466, value=x
     
      \x80\x00\x00\x01                                                    column=0:\x80\x0B, timestamp=1577415599466, value=ronnie
     
      \x80\x00\x00\x01                                                    column=0:\x80\x0C, timestamp=1577415599466, value=\x80\x00\x00\x16
     
      \x80\x00\x00\x02                                                    column=0:\x00\x00\x00\x00, timestamp=1577415698218, value=x
     
      \x80\x00\x00\x02                                                    column=0:\x80\x0B, timestamp=1577415698218, value=alex
     
      \x80\x00\x00\x02                                                    column=0:\x80\x0C, timestamp=1577415698218, value=\x80\x00\x00\x12
     
     2 row(s)
     
     Took 0.0833 seconds
     
     

     • 会发现person表只有一个rowkey, 有三列，默认列族名称是0, 这里rowkey，列族和列都是Phoenix处理过的。
     • hbase shell可以把Phoenix的表都列出来，而且都是可以操作的。