一、graylog介绍

GrayLog是一个轻量型的分布式日志管理平台，一个开源的日志聚合、分析、审计、展示和预警工具。在功能上来说，和ELK类似，但又比ELK要简单轻量许多。依靠着更加简洁，高效，部署使用简单的优势很快受到许多公司的青睐。GrayLog包含Elasticsearch、MongoDb 和Graylog三个模块

二、graylog环境搭建

这里采用docker-compose来搭建graylog测试环境，具体配置如下

# docker-compose配置参考：https://docs.graylog.org/en/3.3/pages/installation/docker.htmlversion: '3'
services:
  mongo:    image: mongo:3    container_name: graylog_demo_mongo    restart: unless-stopped    #    volumes:    #      - ./graylog/mongo_data:/data/db    networks:      - graylog
  elasticsearch:    image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.10    container_name: graylog_demo_elasticsearch    restart: unless-stopped    #    volumes:    #      - ./graylog/es_data:/usr/share/elasticsearch/data    environment:      - http.host=0.0.0.0      - transport.host=localhost      - network.host=0.0.0.0      - "ES_JAVA_OPTS=-Xms512m -Xmx512m"    ulimits:      memlock:        soft: -1        hard: -1    deploy:      resources:        limits:          memory: 1g    networks:      - graylog
  graylog:    image: graylog/graylog:3.3    container_name: graylog_demo_graylog    restart: unless-stopped    #    volumes:    #      - ./graylog/graylog_data_journal:/usr/share/graylog/data/journal    environment:      - GRAYLOG_PASSWORD_SECRET=somepasswordpepper # CHANGE ME (must be at least 16 characters)!      - GRAYLOG_ROOT_PASSWORD_SHA2=8c6976e5b5410415bde908bd4dee15dfb167a9c873fc4bb8a81f6f2ab448a918 # Password: admin      - GRAYLOG_HTTP_EXTERNAL_URI=http://127.0.0.1:9000/ # TODO 这里填写自己的ip地址    ports:      # Graylog web interface and REST API      - 9000:9000      # Syslog TCP      - 1514:1514      # Syslog UDP      - 1514:1514/udp      # GELF TCP      - 12201:12201      # GELF UDP      - 12201:12201/udp    networks:      - graylog    depends_on:      - mongo      - elasticsearch
# 网桥graylog -> 方便相互通讯networks:  graylog:    driver: bridge

启动服务

docker-compose -f docker-compose-graylog.yml -p graylog_demo up -d

访问地址：http://ip地址:9001 默认登录账号密码：admin/admin

2.1、新建input http input

测试是否正常发送

curl -XPOST http://localhost:12201/gelf -p0 -d '{"message":"hello这是一条消息", "host":"127.0.0.1", "facility":"test", "topic": "meme"}'

2.2、创建 gref udp input

由于http发送效率比较低，所以后面springboot会采用UDP方法来采集日志

三、代码工程

pom.xml

<?xml version="1.0" encoding="UTF-8"?><project xmlns="http://maven.apache.org/POM/4.0.0"         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">    <parent>        <artifactId>springboot-demo</artifactId>        <groupId>com.et</groupId>        <version>1.0-SNAPSHOT</version>    </parent>    <modelVersion>4.0.0</modelVersion>
    <artifactId>grayLog</artifactId>
    <properties>        <maven.compiler.source>8</maven.compiler.source>        <maven.compiler.target>8</maven.compiler.target>    </properties>    <dependencies>
        <dependency>            <groupId>org.springframework.boot</groupId>            <artifactId>spring-boot-starter-web</artifactId>        </dependency>
        <dependency>            <groupId>org.springframework.boot</groupId>            <artifactId>spring-boot-autoconfigure</artifactId>        </dependency>
        <dependency>            <groupId>biz.paluch.logging</groupId>            <artifactId>logstash-gelf</artifactId>            <version>1.11.1</version>        </dependency>
        <dependency>            <groupId>org.projectlombok</groupId>            <artifactId>lombok</artifactId>        </dependency>
    </dependencies></project>

HelloWorldController.java

package com.et.graylog.controller;
import com.et.graylog.service.DemoService;import lombok.extern.slf4j.Slf4j;import org.springframework.beans.factory.annotation.Autowired;import org.springframework.stereotype.Controller;import org.springframework.web.bind.annotation.GetMapping;import org.springframework.web.bind.annotation.RequestMapping;import org.springframework.web.bind.annotation.ResponseBody;
import java.util.HashMap;import java.util.Map;@Slf4j@Controllerpublic class HelloWorldController {    @Autowired    DemoService demoService;
    @RequestMapping("/hello")    @ResponseBody    public Map<String, Object> showHelloWorld(){        Map<String, Object> map = new HashMap<>();        map.put("msg", "HelloWorld");        log.info("my name is HelloWorldController");        demoService.hello();        return map;    }
    @GetMapping("log")    public String log(){
        log.error("error");        log.warn("warn");        log.info("info");        log.debug("debug");        int i = 1/0;        return "success";    }}

DemoApplication.java

package com.et.graylog;
import org.springframework.boot.SpringApplication;import org.springframework.boot.autoconfigure.SpringBootApplication;
@SpringBootApplicationpublic class DemoApplication {
   public static void main(String[] args) {      SpringApplication.run(DemoApplication.class, args);   }}

application.yaml

server:  port: 8088groylog:  ip: 127.0.0.1  port: 12201  maximumMessageSize: 8192

logback.xml

<?xml version="1.0" encoding="UTF-8"?><configuration>
    <appender name="GELF" class="biz.paluch.logging.gelf.logback.GelfLogbackAppender">        <host>udp:127.0.0.1</host><!--graylog 服务器ip-->        <port>12201</port><!--graylog udp端口-->        <version>1.1</version>        <facility>springboot-with-graylog</facility>        <extractStackTrace>true</extractStackTrace>        <filterStackTrace>true</filterStackTrace>        <mdcProfiling>true</mdcProfiling>        <timestampPattern>yyyy-MM-dd HH:mm:ss,SSSS</timestampPattern>        <maximumMessageSize>8192</maximumMessageSize>
        <!-- This are fields using MDC -->        <mdcFields>mdcField1,mdcField2</mdcFields>        <dynamicMdcFields>mdc.*,(mdc|MDC)fields</dynamicMdcFields>        <includeFullMdc>true</includeFullMdc>    </appender>    <appender name="CONSOLE" class="ch.qos.logback.core.ConsoleAppender">        <encoder>            <pattern>%d{HH:mm:ss.SSS} %-5level %logger{36} - %msg%n</pattern>        </encoder>    </appender>
    <root level="INFO">        <appender-ref ref="GELF"/>        <appender-ref ref="CONSOLE"/>    </root>
</configuration>

代码参考

https://github.com/Harries/springboot-demo

四、测试