Grafana log level, log 보관 기간 수정

1. log level 수정

- 아래 ;level = info에서 주석(;)을 풀고 debug, error 등 원하는 log level을 설정한다.

(기본은 info level로 설정된다)

/etc/grafana/grafana.ini 파일 수정

#################################### Logging ##########################
[log]
# Either "console", "file", "syslog". Default is console and  file
# Use space to separate multiple modes, e.g. "console file"
;mode = console file

# Either "trace", "debug", "info", "warn", "error", "critical", default is "info"
;level = info

 

예를 들어 log level에 따른 log를 보면 아래와 같다.

 

- log level이 info인 경우

logger=cleanup t=2023-05-02T13:00:07.77029469+09:00 level=info msg="Completed cleanup jobs" duration=5.339123ms
logger=cleanup t=2023-05-02T13:10:07.77352812+09:00 level=info msg="Completed cleanup jobs" duration=8.886721ms
logger=context userId=1 orgId=1 uname=admin t=2023-05-02T13:11:31.752095024+09:00 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.112.1 time_ms=11 duration=11.100704ms size=0 referer= handler=/api/live/ws
logger=server t=2023-05-02T13:11:42.293099532+09:00 level=info msg="Shutdown started" reason="System signal: terminated"
logger=tracing t=2023-05-02T13:11:42.295632097+09:00 level=info msg="Closing tracing"
logger=ticker t=2023-05-02T13:11:42.301955158+09:00 level=info msg=stopped last_tick=2023-05-02T13:11:40+09:00

 

- log level이 debug인 경우

=> debug로 log level을 바꾸면 info일 때 확인되지 않던 log들도 자세히 확인이 가능하다

하지만 용량을 그만큼 많이 사용하기때문에 반드시 용량을 확인하고 log level을 바꿔야 한다.

logger=analytics.summaries t=2023-05-04T16:51:28.923763546+09:00 level=debug msg="skipping rollup job" reason="has been executed recently"
logger=server t=2023-05-04T16:51:28.923830543+09:00 level=debug msg="Starting background service" service=*service.EnterpriseProvisioningServiceImpl
logger=server t=2023-05-04T16:51:28.923919738+09:00 level=debug msg="Stopped background service" service=*service.EnterpriseProvisioningServiceImpl reason=null
logger=server t=2023-05-04T16:51:28.923979035+09:00 level=debug msg="Starting background service" service=*service.LicenseTokenService
logger=server t=2023-05-04T16:51:28.924797796+09:00 level=debug msg="Starting background service" service=*service.RenewalService
logger=server t=2023-05-04T16:51:28.925636455+09:00 level=debug msg="Stopped background service" service=*service.RenewalService reason=null
logger=ngalert.multiorg.alertmanager t=2023-05-04T16:51:28.925774348+09:00 level=info msg="starting MultiOrg Alertmanager"
logger=ngalert.scheduler t=2023-05-04T16:51:30.004430926+09:00 level=debug msg="Alert rules fetched" rulesCount=0 foldersCount=0
logger=ngalert.scheduler t=2023-05-04T16:51:40.00163974+09:00 level=debug msg="Alert rules fetched" rulesCount=0 foldersCount=0
logger=ngalert.state.manager t=2023-05-04T16:51:43.92629873+09:00 level=debug msg="Recording state cache metrics" now=2023-05-04T16:51:43.926256932+09:00
logger=ngalert.scheduler t=2023-05-04T16:51:50.001350954+09:00 level=debug msg="Alert rules fetched" rulesCount=0 foldersCount=0
logger=ngalert.state.manager t=2023-05-04T16:51:58.926903688+09:00 level=debug msg="Recording state cache metrics" now=2023-05-04T16:51:58.926893388+09:00
logger=ngalert.scheduler t=2023-05-04T16:52:00.000852705+09:00 level=debug msg="Alert rules fetched" rulesCount=0 foldersCount=0

 

2. log 보관주기 변경

- 기본 보관주기는 7일

=> 변경이 필요하다면 아래 파일을 수정하면 된다.

/etc/grafana/grafana.ini 파일 수정

# Expired days of log file(delete after max days), default is 7
;max_days = 7