.NetCore使用skywalking实现实时性能监控
一、簡介
很久之前寫了一篇 《.Net Core 2.0+ InfluxDB+Grafana+App Metrics 實現跨平臺的實時性能監控》關于NetCore性能監控的文章,使用Influxdb+AppMetrics進行項目性能監控,由于技術有限,在正式環境使用一段時間后,莫名的AppMetrics就沒辦法往influxdb中插入數據了,后來我也在App Metrics作者的github上留言了,并且作者也根據我闡述的情況做了測試,沒有復現我的問題,最后這個問題就不了了知了,然后項目性能監控這個事擱置了一段時間,直到2018年參加上海.net線下技術沙龍,在會場首次聽到skywalking,那時候skywalking正在做NetCore的支持,會后回到公司便開始關注skywalking,知道skywalking支持NetCore后,第一時間在公司的項目中運用了skywalking。
二、安裝環境
要想使用skywalking,首先得安裝相關環境。本文以windows為例。
1、安裝java sdk(如果不會配置java環境的話,請參考百度百科:https://jingyan.baidu.com/article/08b6a591bdb18314a80922a0.html)
2、java環境安裝完成后,下載Elasticsearch進行安裝?https://www.elastic.co/downloads/elasticsearch?(本文使用skywalking 6.x版本,6.x版本對應使用ES 6.x版本,請自行下載對應版本)
3、下載完Elasticsearch 后將Elasticsearch解壓到安裝位置,以我電腦為例,我安裝在D:\Program Files
4、修改ES配置,進入ES文件下的:\config,找到elasticsearch.yml,打開后修改如下配置:
# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#? ? ? ?Before you set out to tweak and tune the configuration, make sure you
#? ? ? ?understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: myskywalking
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: D:/Program Files/elasticsearch-6.6.2/path/to/data
#
# Path to log files:
#
path.logs: D:/Program Files/elasticsearch-6.6.2/path/to/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
bootstrap.memory_lock: false
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
network.host: 0.0.0.0
http.port: 9200
http.cors.enabled: true?
http.cors.allow-origin: "*"?
http.cors.allow-methods: OPTIONS,HEAD,GET,POST,PUT,DELETE
http.cors.allow-headers: "X-Requested-With, Content-Type, Content-Length, X-Users"
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when new node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
#discovery.zen.ping.unicast.hosts: ["host1", "host2"]
#
# Prevent the "split brain" by configuring the majority of nodes (total number of master-eligible nodes / 2 + 1):
#
#discovery.zen.minimum_master_nodes:?
#
# For more information, consult the zen discovery module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
#
# For more information, consult the gateway module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true
修改好elasticsearch.yml文件后,打開cmd命令,進入到D:\Program Files\elasticsearch-6.6.2\bin,bin文件夾下,輸入如下命令:??elasticsearch-service.bat install ?將ES安裝成windows,這樣就可以方便系統重啟后自動啟動
然后將服務啟動后即可
5、接下來下載skywalking,http://skywalking.apache.org/downloads/
選擇版本為 :6.0.0-GA 的下載
三、配置和效果
1、在本地電腦中創建一個文件夾(注意:本人親自躺過的坑,skywalking服務必須放在無空格的文件夾,比如:Program Files這個文件是絕對不能放的,不然服務運行的時候只會一閃而過,連log日志都不會生成,切記!切記!切記!)
我在D盤下創建了一個叫skyworkingService文件,路徑如下:D:\skyworkingService
將下好的skywalking解壓到該目錄下,命名為skywalking-apm-GA,路徑如下:D:\skyworkingService\skywalking-apm-GA
接著,打開config文件,找到application.yml文件,修改其配置如下:
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.? See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.? The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.? You may obtain a copy of the License at
#
#? ? ?http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
cluster:
? standalone:
? # Please check your ZooKeeper is 3.5+, However, it is also compatible with ZooKeeper 3.4.x. Replace the ZooKeeper 3.5+
? # library the oap-libs folder with your ZooKeeper 3.4.x library.
#? zookeeper:
#? ? nameSpace: ${SW_NAMESPACE:""}
#? ? hostPort: ${SW_CLUSTER_ZK_HOST_PORT:localhost:2181}
#? ? #Retry Policy
#? ? baseSleepTimeMs: ${SW_CLUSTER_ZK_SLEEP_TIME:1000} # initial amount of time to wait between retries
#? ? maxRetries: ${SW_CLUSTER_ZK_MAX_RETRIES:3} # max number of times to retry
#? kubernetes:
#? ? watchTimeoutSeconds: ${SW_CLUSTER_K8S_WATCH_TIMEOUT:60}
#? ? namespace: ${SW_CLUSTER_K8S_NAMESPACE:default}
#? ? labelSelector: ${SW_CLUSTER_K8S_LABEL:app=collector,release=skywalking}
#? ? uidEnvName: ${SW_CLUSTER_K8S_UID:SKYWALKING_COLLECTOR_UID}
#? consul:
#? ? serviceName: ${SW_SERVICE_NAME:"SkyWalking_OAP_Cluster"}
#? ? ?Consul cluster nodes, example: 10.0.0.1:8500,10.0.0.2:8500,10.0.0.3:8500
#? ? hostPort: ${SW_CLUSTER_CONSUL_HOST_PORT:localhost:8500}
core:
? default:
? ? restHost: ${SW_CORE_REST_HOST:0.0.0.0}
? ? restPort: ${SW_CORE_REST_PORT:12800}
? ? restContextPath: ${SW_CORE_REST_CONTEXT_PATH:/}
? ? gRPCHost: ${SW_CORE_GRPC_HOST:0.0.0.0}
? ? gRPCPort: ${SW_CORE_GRPC_PORT:11800}
? ? downsampling:
? ? - Hour
? ? - Day
? ? - Month
? ? # Set a timeout on metric data. After the timeout has expired, the metric data will automatically be deleted.
? ? recordDataTTL: ${SW_CORE_RECORD_DATA_TTL:90} # Unit is minute
? ? minuteMetricsDataTTL: ${SW_CORE_MINUTE_METRIC_DATA_TTL:90} # Unit is minute
? ? hourMetricsDataTTL: ${SW_CORE_HOUR_METRIC_DATA_TTL:36} # Unit is hour
? ? dayMetricsDataTTL: ${SW_CORE_DAY_METRIC_DATA_TTL:45} # Unit is day
? ? monthMetricsDataTTL: ${SW_CORE_MONTH_METRIC_DATA_TTL:18} # Unit is month
storage:
? # h2:
? ? # driver: ${SW_STORAGE_H2_DRIVER:org.h2.jdbcx.JdbcDataSource}
? ? # url: ${SW_STORAGE_H2_URL:jdbc:h2:mem:skywalking-oap-db}
? ? # user: ${SW_STORAGE_H2_USER:sa}
?elasticsearch:
? ?nameSpace: ${SW_NAMESPACE:"myskywalking"}
? ?clusterNodes: ${SW_STORAGE_ES_CLUSTER_NODES:localhost:9200}
? ?indexShardsNumber: ${SW_STORAGE_ES_INDEX_SHARDS_NUMBER:2}
? ?indexReplicasNumber: ${SW_STORAGE_ES_INDEX_REPLICAS_NUMBER:0}
? ?# Batch process setting, refer to https://www.elastic.co/guide/en/elasticsearch/client/java-api/5.5/java-docs-bulk-processor.html
? ?bulkActions: ${SW_STORAGE_ES_BULK_ACTIONS:2000} # Execute the bulk every 2000 requests
? ?bulkSize: ${SW_STORAGE_ES_BULK_SIZE:20} # flush the bulk every 20mb
? ?flushInterval: ${SW_STORAGE_ES_FLUSH_INTERVAL:10} # flush the bulk every 10 seconds whatever the number of requests
? ?concurrentRequests: ${SW_STORAGE_ES_CONCURRENT_REQUESTS:2} # the number of concurrent requests
receiver-register:
? default:
receiver-trace:
? default:
? ? bufferPath: ${SW_RECEIVER_BUFFER_PATH:../trace-buffer/}? # Path to trace buffer files, suggest to use absolute path
? ? bufferOffsetMaxFileSize: ${SW_RECEIVER_BUFFER_OFFSET_MAX_FILE_SIZE:100} # Unit is MB
? ? bufferDataMaxFileSize: ${SW_RECEIVER_BUFFER_DATA_MAX_FILE_SIZE:500} # Unit is MB
? ? bufferFileCleanWhenRestart: ${SW_RECEIVER_BUFFER_FILE_CLEAN_WHEN_RESTART:false}
? ? sampleRate: ${SW_TRACE_SAMPLE_RATE:10000} # The sample rate precision is 1/10000. 10000 means 100% sample in default.
receiver-jvm:
? default:
#service-mesh:
#? default:
#? ? bufferPath: ${SW_SERVICE_MESH_BUFFER_PATH:../mesh-buffer/}? # Path to trace buffer files, suggest to use absolute path
#? ? bufferOffsetMaxFileSize: ${SW_SERVICE_MESH_OFFSET_MAX_FILE_SIZE:100} # Unit is MB
#? ? bufferDataMaxFileSize: ${SW_SERVICE_MESH_BUFFER_DATA_MAX_FILE_SIZE:500} # Unit is MB
#? ? bufferFileCleanWhenRestart: ${SW_SERVICE_MESH_BUFFER_FILE_CLEAN_WHEN_RESTART:false}
#istio-telemetry:
#? default:
#receiver_zipkin:
#? default:
#? ? host: ${SW_RECEIVER_ZIPKIN_HOST:0.0.0.0}
#? ? port: ${SW_RECEIVER_ZIPKIN_PORT:9411}
#? ? contextPath: ${SW_RECEIVER_ZIPKIN_CONTEXT_PATH:/}
query:
? graphql:
? ? path: ${SW_QUERY_GRAPHQL_PATH:/graphql}
alarm:
? default:
telemetry:
? none:
?修改完成后,進入到bin文件中,右鍵單擊startup.bat,以管理員權限運行,即可看到如下彈框
彈出這兩個框說明服務已經啟動了
這個時候訪問http://localhost:8080,即可看到如下界面:
默認賬號admin,密碼admin,登錄后看看到想要的監控數據和各服務直接的拓撲圖,因為我的服務跑了一段時間,所以下面的界面是有數據的:
2、由于啟動skywalking后會彈出兩個命令窗口,所以如果運維人員不小心關了窗口的話服務自然就停掉了,所以為了避免這種問題,我們還可以將bin文件夾下的oapService.bat和webappService.bat進行配置,如下:
@REM
@REM? Licensed to the Apache Software Foundation (ASF) under one or more
@REM? contributor license agreements.? See the NOTICE file distributed with
@REM? this work for additional information regarding copyright ownership.
@REM? The ASF licenses this file to You under the Apache License, Version 2.0
@REM? (the "License"); you may not use this file except in compliance with
@REM? the License.? You may obtain a copy of the License at
@REM
@REM? ? ? http://www.apache.org/licenses/LICENSE-2.0
@REM
@REM? Unless required by applicable law or agreed to in writing, software
@REM? distributed under the License is distributed on an "AS IS" BASIS,
@REM? WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
@REM? See the License for the specific language governing permissions and
@REM? limitations under the License.
@echo off
setlocal
set OAP_PROCESS_TITLE=Skywalking-Collector
set OAP_HOME=%~dp0%..
set OAP_OPTS="-Xms256M -Xmx512M -Doap.logDir=%OAP_HOME%\logs"
set CLASSPATH=%OAP_HOME%\config;.;
set CLASSPATH=%OAP_HOME%\oap-libs\*;%CLASSPATH%
if defined JAVA_HOME (
?set _EXECJAVA="%JAVA_HOME%\bin\javaw"
)
if not defined JAVA_HOME (
?echo "JAVA_HOME not set."
?set _EXECJAVA=javaw
)
start "%OAP_PROCESS_TITLE%" %_EXECJAVA% "%OAP_OPTS%" -cp "%CLASSPATH%" org.apache.skywalking.oap.server.starter.OAPServerStartUp
endlocal
oapService.bat
@REM
@REM? Licensed to the Apache Software Foundation (ASF) under one or more
@REM? contributor license agreements.? See the NOTICE file distributed with
@REM? this work for additional information regarding copyright ownership.
@REM? The ASF licenses this file to You under the Apache License, Version 2.0
@REM? (the "License"); you may not use this file except in compliance with
@REM? the License.? You may obtain a copy of the License at
@REM
@REM? ? ? http://www.apache.org/licenses/LICENSE-2.0
@REM
@REM? Unless required by applicable law or agreed to in writing, software
@REM? distributed under the License is distributed on an "AS IS" BASIS,
@REM? WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
@REM? See the License for the specific language governing permissions and
@REM? limitations under the License.
@echo off
setlocal
set WEBAPP_PROCESS_TITLE=Skywalking-Webapp
set WEBAPP_HOME=%~dp0%..
set JARPATH=%WEBAPP_HOME%\webapp
set WEBAPP_LOG_DIR=%WEBAPP_HOME%\logs
if exist "%WEBAPP_LOG_DIR%" (
? ? mkdir "%WEBAPP_LOG_DIR%"
)
set LOG_FILE_LOCATION=%WEBAPP_LOG_DIR%\webapp.log
if defined JAVA_HOME (
?set _EXECJAVA="%JAVA_HOME%\bin\javaw"
)
if not defined JAVA_HOME (
?echo "JAVA_HOME not set."
?set _EXECJAVA=javaw
)
start "%WEBAPP_PROCESS_TITLE%" %_EXECJAVA%? -jar %JARPATH%/skywalking-webapp.jar --spring.config.location=%JARPATH%/webapp.yml --logging.file=%LOG_FILE_LOCATION%
endlocal
webappService.bat
其實只是將文件里的java改成了javaw,這樣就可以在后臺運行了,保存后再次運行startup.bat文件,這個時候界面上會有個cmd命令界面一閃而過,不要慌,我們打開資源管理器看看,會發現進程中多了兩個名為“javaw.exe”的進程
這個時候訪問:http://localhost:8080 一樣可以看到上面的ui界面!
至此,skywalking的所有環境皆搭建完畢,接下來,在我們項目中添加skywalking的探針,方便skywalking收集我們項目中的數據
四、項目引用skywalking探針
新建一個NetCore的webapi,然后在引用中引用SkyWalking.AspNetCore,如圖:
項目引用后,在Startup.cs中注入skywalking。
在頭部引用:using SkyWalking.AspNetCore;
然后找到public void ConfigureServices(IServiceCollection services)下輸入一下代碼即可:
services.AddSkyWalking(option =>{
option.ApplicationCode = "AreaServer";
option.DirectServers = 127.0.0.1:11800;
});
運行代碼后,控制臺內每隔幾秒就會有以下信息輸出
證明skywalking探針已經成功,接下來請求一下你的接口,然后進入skywalking的ui中看看你的成果吧!
原文地址:https://www.cnblogs.com/landonzeng/p/10616644.html
.NET社區新聞,深度好文,歡迎訪問公眾號文章匯總 http://www.csharpkit.com
總結
以上是生活随笔為你收集整理的.NetCore使用skywalking实现实时性能监控的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: DDD领域驱动设计理论篇 - 学习笔记
- 下一篇: netcore开发windows普通服务