임시

빅데이터2018. 12. 8. 19:29

                    수집                                    검색 (jboss)

             . collection (openapi, tibero)        . ela 검색 api
                     . oozie                                   - RestFul api
                     . logstash
                     . kafka
                     . elasticsearch
              - index 정의
             - spark
             - hive 적재
1. git
    - master
    - develop



2. jenkins
   (주요 용도)
    - compile  : 1.8 Spark app
                     수집   app

                 1.7 검색 
    - deployment : fat jar  (java app) => remote server (ssh)
                   .

    jenkins => port : 9090
            => user : forebig
                  openjdk
          plugin



git init . --bare : 서버 만들어짊
git clone -b 서버 위치
kafka

  

'빅데이터' 카테고리의 다른 글

openapi + elasticsearch + folium  (0) 2019.04.06
JDBC + ELASTIC  (0) 2018.12.08