Spark_Streaming使用和概要图_时金魁_201606.pdf

立即下载 作者: 滔滔江水
上传时间: 2024-04-13
关键词: HBase 16 Streaming Spark thon mara sos hoenix Thankshttps: github.com pusuo spark 数据
大小 92.2 KB
描述
SPARK STREAMING
4 SPARK MEETUP
@
TEXT
AGENDA
▸ 1.
▸ 2. HBase
▸ 3. phoenix
▸ 4. mesos
▸ 5. Streaming
TEXT
▸ Kafka, Spark Streaming, HBase
▸ source: kafka, flume, mqtt, zeroMQ…
▸ target: HBase, hdfs, tachyon, phoenix…
HBASE
▸ 1. spark hbase
▸ 2.
▸ 3.
▸ 4. rowkey
▸ "16,xxooId#16,xy_id#16,ooxxId"
SCHEMA
HBase Hive Phoenix Parquet…
TEXT
PHOENIX
▸
▸ HFile
▸ elasticsearch kibana
▸ metric
▸ mesos: /metrics/snapshot, /state, /health, /master/health …
▸ marathon: /metrics,
▸ hadoop
MESOS
▸ 1.0.0-RC1
▸ , job
▸ :mesos docker
▸ Restful
▸ marathon
▸ fine-grained
▸ chronos, dcos
▸ /
▸ ...
TEXT
▸ Spark Streaming, Phoenix, HBase
▸ running on: Mesos, Marathon, ES
STREAMING
Thanks
https://github.com/pusuo/spark_meetup
目录
HBase/16/Streaming/Spark/thon/mara/sos/hoenix/Thankshttps://github.com/pusuo/spark_meetup/数据/ HBase/16/Streaming/Spark/thon/mara/sos/hoenix/Thankshttps://github.com/pusuo/spark_meetup/数据/