You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/managing-workflow/platform-logging.md
+14-25Lines changed: 14 additions & 25 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,38 +11,20 @@ If the message is from the [Workflow Router](https://github.com/deis/router) we
11
11
Logger then acts as a consumer reading messages off of the NSQ logs topic storing those messages in a local Redis instance. When a user wants to retrieve log entries using the `deis logs` command we make an HTTP request from Controller to Logger which then fetches the appropriate data from Redis.
12
12
13
13
## Configuring Off Cluster Redis
14
-
Even though we provide a redis instance with the default Workflow install. It is recommended that operators use a 3rd party source like Elasticache or similar offering. This way your data is durable across upgrades or outages. If you have a 3rd party Redis installation you would like to use all you need to do is set the following values in `generate_params.toml` within your chart's tpl directory.
14
+
15
+
Even though we provide a redis instance with the default Workflow install, it is recommended that operators use a third-party source like Elasticache or similar offering. This way your data is durable across upgrades or outages. If you have a third-party Redis installation you would like to use all you need to do is set the following values in your helm chart:
15
16
16
17
* db = "0"
17
18
* host = "my.host.redis"
18
19
* port = "6379"
19
20
* password = ""
20
21
21
-
You can also provide this environment variables when you run your `helm generate` command instead of editing `generate_params.toml`.
22
-
23
-
* LOGGER_REDIS_LOCATION="off-cluster"
24
-
* DEIS_LOGGER_REDIS_DB="0"
25
-
* DEIS_LOGGER_REDIS_SERVICE_HOST="my.host.redis"
26
-
* DEIS_LOGGER_REDIS_SERVICE_PORT="6379"
27
-
28
-
The database password can also be set as a kubernetes secret using the following name: `logger-redis-creds`.
29
-
30
-
```
31
-
apiVersion: v1
32
-
kind: Secret
33
-
metadata:
34
-
name: logger-redis-creds
35
-
namespace: deis
36
-
labels:
37
-
app: deis-logger-redis
38
-
heritage: deis
39
-
annotations:
40
-
helm-keep: "true"
41
-
data:
42
-
password: your-base64-password-here
43
-
```
22
+
These can be changed by running `helm inspect values deis/workflow > values.yaml` before using
23
+
`helm install` to complete the installation. To customize the redis credentials, edit `values.yaml`
24
+
and modify the `redis` section of the file to tune these settings.
44
25
45
26
## Debugging Logger
27
+
46
28
If the `deis logs` command encounters an error it will return the following message:
47
29
48
30
```
@@ -53,6 +35,7 @@ Error: There are currently no log messages. Please check the following things:
53
35
```
54
36
55
37
## Architecture Diagram
38
+
56
39
```
57
40
┌────────┐
58
41
│ Router │ ┌────────┐ ┌─────┐
@@ -84,9 +67,12 @@ Error: There are currently no log messages. Please check the following things:
84
67
```
85
68
86
69
## Default Configuration
70
+
87
71
By default the Fluentd pod can be configured to talk to numerous syslog endpoints. So for example it is possible to have Fluentd send log messages to both the Logger component and [Papertrail](https://papertrailapp.com/). This allows production deployments of Deis to satisfy stringent logging requirements such as offsite backups of log data.
88
72
89
-
Configuring Fluentd to talk to multiple syslog endpoints means adding the following stanzas to the [Fluentd daemonset manifest](https://github.com/deis/charts/blob/master/workflow-v2.9.1/tpl/deis-logger-fluentd-daemon.yaml) -
73
+
Configuring Fluentd to talk to multiple syslog endpoints means modifying the Fluentd daemonset
74
+
manifest. This means you will need to fetch the chart with `helm fetch deis/workflow --untar`, then
75
+
modify `workflow/charts/fluentd/templates/logger-fluentd-daemon.yaml` with the following:
90
76
91
77
```
92
78
env:
@@ -111,5 +97,8 @@ env:
111
97
value: "5144"
112
98
```
113
99
100
+
Then run `helm install ./workflow --namespace deis` to install the modified chart.
101
+
114
102
### Customizing:
103
+
115
104
We currently support logging information to Syslog, Elastic Search, and Sumo Logic. However, we will gladly accept pull requests that add support to other locations. For more information please visit the [fluentd repository](https://github.com/deis/fluentd).
Copy file name to clipboardExpand all lines: src/managing-workflow/platform-monitoring.md
+11-7Lines changed: 11 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,13 +1,15 @@
1
1
# Platform Monitoring
2
2
3
3
## Description
4
+
4
5
We now include a monitoring stack for introspection on a running Kubernetes cluster. The stack includes 3 components:
5
6
6
7
*[Telegraf](https://docs.influxdata.com/telegraf/v0.12/) - Metrics collection daemon written by team behind InfluxDB.
7
8
*[InfluxDB](https://docs.influxdata.com/influxdb/v0.12/) - Time series database
8
9
*[Grafana](http://grafana.org/) - Graphing tool for time series data
9
10
10
11
## Architecture Diagram
12
+
11
13
```
12
14
┌────────┐
13
15
│ Router │ ┌────────┐ ┌─────┐
@@ -55,7 +57,8 @@ instance fails, modified dashboards are lost. Until there is a solution to persi
55
57
them separately in version control.
56
58
57
59
### Off Cluster Grafana
58
-
It is recommended that users provide their own installation for Grafana if possible. The current deployment of Grafana within Workflow is durable across pod restarts which means custom dashboards that are created after startup will not be restored when the pod comes back up. If you wish to provide your own Grafana instance you can either set the `GRAFANA_LOCATION` environment variable when your run `helm generate` or set `grafana_location` in the generate_params.toml.
60
+
61
+
It is recommended that users provide their own installation for Grafana if possible. The current deployment of Grafana within Workflow is not durable across pod restarts which means custom dashboards that are created after startup will not be restored when the pod comes back up. If you wish to provide your own Grafana instance you can set `grafana_location` in the `values.yaml` file before running `helm install`.
59
62
60
63
## InfluxDB
61
64
@@ -73,13 +76,14 @@ You can choose to not expose the Influx UI and API to the world by updating
73
76
following line - `router.deis.io/routable: "true"`.
74
77
75
78
### Off Cluster Influxdb
76
-
To use off-cluster Influx please provide the following values in either the `generate_params.toml` file or as environment variables when running `helm generate`.
0 commit comments