Hedis - GET HBase via Redis

Hedis - GET HBase via Redis

• 1.
  Hedis - GETHBase via Redis Kewang
• 2.
  2 Live DEMO https://www.youtube.com/watch?v=aAgJaqvgqLU
• 3.
  Who I am ● 王慕羣 ●Java / Node.js / AngularJS ● SQL-like / HBase GitHub: kewang Facebook: kewangtw Linkedin: kewangtw Slideshare: kewang Mail: [email protected]
• 4.
  What Mitake is 三竹資訊
• 5.
  What Mitake is 三竹資訊 ● 企業簡訊平台
• 6.
  What Mitake is 三竹資訊 ● 企業簡訊平台 ●市佔 100% 的行動下單
• 7.
  What Mitake is 三竹資訊 ● 企業簡訊平台 ●市佔 100% 的行動下單 ● 市佔 70% 的行動銀行
• 8.
  What Mitake is 三竹資訊 ● 企業簡訊平台 ●市佔 100% 的行動下單 ● 市佔 70% 的行動銀行 ● 企業內部應用、產壽險、金融相關政府機關
• 9.
  What Mitake is 三竹資訊 ● 企業簡訊平台 ●市佔 100% 的行動下單 ● 市佔 70% 的行動銀行 ● 企業內部應用、產壽險、金融相關政府機關 ● 雲端： Qmi 、 TechMe
• 10.
  What Mitake is 三竹資訊 ● 企業簡訊平台 ●市佔 100% 的行動下單 ● 市佔 70% 的行動銀行 ● 企業內部應用、產壽險、金融相關政府機關 ● 雲端： Qmi 、 TechMe ● 其他：兌彩券、台灣匯率、三竹小股王、行動股市 ... 等
• 11.
  11 Agenda ● Redis brief ●Scenario ● Hedis (aka Hyper Redis) ● Benchmark ● TODO list
• 12.
  12 Redis brief
• 13.
  13 Redis brief
• 14.
  14 Redis brief ● Key-valuepair
• 15.
  15 Redis brief ● Key-valuepair ● Value data type: String, List, Sets, Ordered sets, Hashes
• 16.
  16 Redis brief ● Key-valuepair ● Value data type: String, List, Sets, Ordered sets, Hashes ● Binary-safe
• 17.
  17 Redis brief ● Key-valuepair ● Value data type: String, List, Sets, Ordered sets, Hashes ● Binary-safe ● Single thread
• 18.
  18 Redis brief ● Key-valuepair ● Value data type: String, List, Sets, Ordered sets, Hashes ● Binary-safe ● Single thread ● In-memory database
• 19.
  19 Scenario Get hot data,etc.
• 20.
  20 Redis
• 21.
  21 Redis Application server Redis Database Client
• 22.
  22 Redis - Sendrequest to AP Application server Redis Database Client (1)
• 23.
  23 Redis - APgets data from Redis Application server Redis Database (2) Client (1)
• 24.
  24 Redis - Redishas no data Application server Redis Database (2) Client (1) (3)
• 25.
  25 Redis - Backto get data from DB Application server Redis Database (4) (2) Client (1) (3)
• 26.
  26 Redis - APgot data Application server Redis Database (4) (5) (2) Client (1) (3)
• 27.
  27 Redis - Storedata to Redis Application server Redis Database (6) (4) (5) (2) Client (1) (3)
• 28.
  28 Redis - Returndata to client Application server Redis Database (6) (4) (5) (2) Client (7) (1) (3)
• 29.
  29 Hedis
• 30.
  30 Hedis Application server Hedis Database Client
• 31.
  31 Hedis - Sendrequest to AP Application server Hedis Database Client (1)
• 32.
  32 Hedis - APgets data from Hedis Application server Hedis Database Client (2) (1)
• 33.
  33 Hedis - Turnsto get from DB Application server Hedis Database Client (2) (3) (1)
• 34.
  34 Hedis - Storedata to Hedis Application server Hedis Database Client (2) (3) (4) (1)
• 35.
  35 Hedis - Returndata to AP Application server Hedis Database Client (2) (3) (4) (5) (1)
• 36.
  36 Hedis - Returndata to client Application server Hedis Database Client (2) (3) (4) (5) (1) (6)
• 37.
  37 Hedis Hyper Redis
• 38.
  38 Architecture
• 39.
  39 Architecture Hedis
• 40.
  40 Architecture Redis Hedis
• 41.
  41 Architecture Redis Connector Hedis
• 42.
  42 Architecture Redis Connector MySQLHedis
• 43.
  43 Architecture Redis Connector MySQL HBase Hedis
• 44.
  44 Architecture Redis Connector MySQL HBase others Hedis
• 45.
  45 Architecture Redis Connector MySQL HBase others Hedis
• 46.
  46 Architecture Redis Connector MySQL HBase others Hedis
• 47.
  47 Architecture Redis Connector MySQL HBase others Hedis
• 48.
  48 Architecture Redis Connector MySQL HBase others Hedis
• 49.
  49 Architecture ● Core ● Connector ●Database
• 50.
  50 Architecture ● Core -Redis ● Connector ● Database
• 51.
  51 Architecture ● Core -Redis ● Connector - connect Redis and database together ● Database
• 52.
  52 Architecture ● Core -Redis ● Connector - connect Redis and database together ● Database - any database (includes RDBMS & NoSQL)
• 53.
  53 Configuration
• 54.
  54 Configuration
• 55.
  55 How to startHedis up ?
• 56.
  56 How to startHedis up ?
• 57.
  57 Commands - onlyGET currently
• 58.
  58 Commands - onlyGET currently ● GET "cdh1://user@kewang"
• 59.
  59 Commands - onlyGET currently ● GET "cdh1://user@kewang" – No exists: turns to get "kewang" rowkey at "user" table on "cdh1" connector
• 60.
  60 Commands - onlyGET currently ● GET "cdh1://user@kewang" – No exists: turns to get "kewang" rowkey at "user" table on "cdh1" connector – Exists: gets directly
• 61.
  61 Commands - anotherGET
• 62.
  62 Commands - anotherGET ● GET "cdh1://!user@kewang"
• 63.
  63 Commands - anotherGET ● GET "cdh1://!user@kewang"
• 64.
  64 Commands - anotherGET ● GET "cdh1://!user@kewang" – Always gets "kewang" rowkey at "user" table on "cdh1" connector directly
• 65.
  65 Commands - anotherGET ● GET "cdh1://!user@kewang" – Always gets "kewang" rowkey at "user" table on "cdh1" connector directly – Use ruby's bang sign ( ! ) concept, it will modify original value
• 66.
  66 Benchmark
• 67.
  67 Latency - Loweris better
• 68.
  68 Latency - Loweris better
• 69.
  69 Request - Higheris better
• 70.
  70 Request - Higheris better
• 71.
  71 TODO list
• 72.
  72 TODO list
• 73.
  73 TODO list ● Fixmemory leak
• 74.
  74 TODO list ● Fixmemory leak ● Support multiple Redis version
• 75.
  75 TODO list ● Fixmemory leak ● Support multiple Redis version ● Support more commands
• 76.
  76 TODO list ● Fixmemory leak ● Support multiple Redis version ● Support more commands ● Support more databases
• 77.
  77 TODO list ● Fixmemory leak ● Support multiple Redis version ● Support more commands ● Support more databases ● Support git
• 78.
  78 TODO list ● Fixmemory leak ● Support multiple Redis version ● Support more commands ● Support more databases ● Support git ● Add dockerfile
• 79.
  79 TODO list ● Fixmemory leak ● Support multiple Redis version ● Support more commands ● Support more databases ● Support git ● Add dockerfile ● Redesign official website
• 80.
  80 Live DEMO
• 81.
  81 References ● http://hedis.io ● http://redis.io
• 82.
  82 WE'RE HIRING !!! Backend,System,Web, ... etc.
• 83.
  83