nanomsg:https://github.com/nanomsg/nanomsg

PipelineDB:https://github.com/pipelinedb/pipelinedb

nanomsgToPipelineDB:https://github.com/sangli00/nanomsgtopdb

创建extension

pipeline=# create extension nanomsgtopdb ;
CREATE EXTENSION

默认数据接收流

pipeline=# \d generic_stream
Stream "public.generic_stream"
Column | Type
-------------------+-----------------------------
data | text
arrival_timestamp | timestamp(0) with time zone pipeline=#

创建Continuous View

pipeline=# create continuous view cv as select data from generic_stream;
CREATE CONTINUOUS VIEW
pipeline=# \d cv
Continuous view "public.cv"
Column | Type | Modifiers
--------+------+-----------
data | text | pipeline=#

发送数据:

[root@localhost test]# ./send_msg
connect to tcp://127.0.0.1:9999
Send msg size is 64 pipeline=# select * from cv;
data
------
(0 rows) pipeline=# select * from cv;
data
--------------------------
Hello ,from nanomsg msg.
(1 row) pipeline=#

运用PostgreSQL来创建后台进程,如图所示:

nanomsg 如何写数据到PipelineDB-LMLPHP

多nanomsg worker process进行数据写入,提高数据接收速度。

运用场景:

在底层数据采集的时候,原始数据直接写入到Stream生成CV结果。

04-17 00:04
查看更多