storytold/terraform-aws-observability-accelerator
2
0
Fork 0
mirror of https://github.com/storytold/terraform-aws-observability-accelerator.git synced 2026-10-17 00:23:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Chore

Browse Source
This commit is contained in:
Rodrigue Koffi
2022-08-30 19:59:34 +02:00
parent 837c60b585
commit 05511992e9
34 changed files with 144 additions and 229 deletions
Download Patch File Download Diff File Expand all files Collapse all files
modules/workloads/infra/README.md
+5 -33
View File
@@ -1,7 +1,6 @@
# Observability Pattern for Java/JMX
# Infrastructure monitoring
This module provides an automated experience around Observability for Nginx workloads.
It provides the following resources:
This module provides EKS cluster monitoring with the following resources:
- AWS Distro For OpenTelemetry Operator and Collector
- AWS Managed Grafana Dashboard and data source
@@ -26,47 +25,21 @@ It provides the following resources:
| Name | Source | Version |
|------|--------|---------|
| <a name="module_helm_addon"></a> [helm\_addon](#module\_helm\_addon) | github.com/aws-observability/terraform-aws-eks-blueprints/modules/kubernetes-addons/helm-addon | n/a |
| <a name="module_helm_addon"></a> [helm\_addon](#module\_helm\_addon) | github.com/aws-ia/terraform-aws-eks-blueprints/modules/kubernetes-addons/helm-addon | n/a |
## Resources
| Name | Type |
|------|------|
| [aws_prometheus_rule_group_namespace.api-availability](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.apibr](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.apihg](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.apislos](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.etcd](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.generic](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubeapps](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubelet](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubeprom-recording](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubepromnr](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kuberesources](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubescheduler](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubestm](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubestorage](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubesys](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubesysapi](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubesyschdlr](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubesyscm](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubesyskblt](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubesyskbpxy](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.kubprom](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.ne](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.nodeexporter](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.nodenw](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.noderules](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [grafana_dashboard.alertmanager](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [aws_prometheus_rule_group_namespace.alerting_rules](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [aws_prometheus_rule_group_namespace.recording_rules](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [grafana_dashboard.apis](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.cluster](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.clusternw](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.controller](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.coredns](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.etcd](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.grafana](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.kubelet](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.macos](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.necluster](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.nenode](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.nenodeuse](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
@@ -78,7 +51,6 @@ It provides the following resources:
| [grafana_dashboard.nwworload](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.podnetwork](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.pods](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.prometheus](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.proxy](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.pv](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
| [grafana_dashboard.scheduler](https://registry.terraform.io/providers/grafana/grafana/1.25.0/docs/resources/dashboard) | resource |
modules/workloads/infra/dashboards/apiserver.json
+1 -1
View File
@@ -1582,4 +1582,4 @@
"uid": "09ec8aa1e996d6ffcd6817bbaff4db1b",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/cluster-networking.json
+1 -1
View File
@@ -1742,4 +1742,4 @@
"uid": "ff635a025bcfea7bc3dd4f508990a3e9",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/cluster.json
+1 -1
View File
@@ -2944,4 +2944,4 @@
"uid": "efa86fd1d0c121a26444b636a3f509a8",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/controller.json
+1 -1
View File
@@ -1023,4 +1023,4 @@
"uid": "72e0e05bef5099e5f049b05fdc429ed4",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/coredns.json
+1 -1
View File
@@ -1511,4 +1511,4 @@
"uid": "vkQ0UHxik",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/etcd.json
+1 -1
View File
@@ -1266,4 +1266,4 @@
"uid": "c2f4e12cdf69feb95caa41a5a1b423d9",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/kubelet.json
+1 -1
View File
@@ -1983,4 +1983,4 @@
"uid": "3138fa155d5915769fbded898ac09fd9",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/namespace-networking.json
+1 -1
View File
@@ -1398,4 +1398,4 @@
"uid": "8b7a8b326d7a6f1f04244066368c67af",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/namespace-nw-workloads.json
+1 -1
View File
@@ -1631,4 +1631,4 @@
"uid": "bbb2a765a623ae38130206c7d94a160f",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/namespace-pods.json
+1 -1
View File
@@ -2718,4 +2718,4 @@
"uid": "85a562078cdf77779eaa1add43ccec1e",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/namespace-workloads.json
+1 -1
View File
@@ -2274,4 +2274,4 @@
"uid": "a87fb0d919ec0ea5f6543124e16c42a5",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/networking-workloads.json
+1 -1
View File
@@ -1351,4 +1351,4 @@
"uid": "728bf77cc1166d2f3133bf25846876cc",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/nodeexporter-nodes.json
+1 -1
View File
@@ -1004,4 +1004,4 @@
"uid": "v8yDYJqnz",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/nodeexporter-use-node.json
+1 -1
View File
@@ -1077,4 +1077,4 @@
"uid": "XysDYJ37k",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/nodeexpoter-use-cluster.json
+1 -1
View File
@@ -1075,4 +1075,4 @@
"uid": "h-sDLJ37z",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/nodes.json
+1 -1
View File
@@ -1049,4 +1049,4 @@
"uid": "200ac8fdbfbb74b39aff88118e4d1c2c",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/pesistentvolumes.json
+1 -1
View File
@@ -547,4 +547,4 @@
"uid": "919b92a8e8041bd567af9edab12c840c",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/pods-networking.json
+1 -1
View File
@@ -1178,4 +1178,4 @@
"uid": "7a18067ce943a40ae25454675c19ff5c",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/pods.json
+1 -1
View File
@@ -2483,4 +2483,4 @@
"uid": "6581e46e4e5c7ba40a07646395ef7b23",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/proxy.json
+1 -1
View File
@@ -1126,4 +1126,4 @@
"uid": "632e265de029684c40b21cb76bca4f94",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/scheduler.json
+1 -1
View File
@@ -1035,4 +1035,4 @@
"uid": "2e6b6a3b4bddf1427b3a55aa1311c656",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/dashboards/workloads.json
+1 -1
View File
@@ -2031,4 +2031,4 @@
"uid": "a164a7f0339f99e89cea5cb47e9be617",
"version": 1,
"weekStart": ""
}
}
modules/workloads/infra/otel-config/templates/opentelemetrycollector.yaml
+15 -15
View File
@@ -12,7 +12,7 @@ spec:
config:
global:
scrape_interval: {{ .Values.scrapeInterval }}
scrape_timeout: {{ .Values.scrapeTimeout }}
scrape_timeout: {{ .Values.scrapeTimeout }}
external_labels:
cluster: {{ .Values.ekscluster }}
scrape_configs:
@@ -49,7 +49,7 @@ spec:
- source_labels: [__meta_kubernetes_node_name]
regex: (.+)
target_label: __metrics_path__
replacement: /api/v1/nodes/$${1}/proxy/metrics/cadvisor
replacement: /api/v1/nodes/$${1}/proxy/metrics/cadvisor
- job_name: serviceMonitor/default/kube-prometheus-stack-prometheus-node-exporter/0
honor_timestamps: true
scrape_interval: 30s
@@ -153,7 +153,7 @@ spec:
namespaces:
own_namespace: false
names:
- default
- default
- job_name: serviceMonitor/default/kube-prometheus-stack-prometheus/0
honor_timestamps: true
scrape_interval: 30s
@@ -256,7 +256,7 @@ spec:
namespaces:
own_namespace: false
names:
- default
- default
- job_name: serviceMonitor/default/kube-prometheus-stack-operator/0
honor_labels: true
honor_timestamps: true
@@ -359,7 +359,7 @@ spec:
namespaces:
own_namespace: false
names:
- default
- default
- job_name: serviceMonitor/default/kube-prometheus-stack-kubelet/2
honor_labels: true
honor_timestamps: true
@@ -476,7 +476,7 @@ spec:
namespaces:
own_namespace: false
names:
- kube-system
- kube-system
- job_name: serviceMonitor/default/kube-prometheus-stack-kubelet/1
honor_labels: true
honor_timestamps: true
@@ -711,7 +711,7 @@ spec:
namespaces:
own_namespace: false
names:
- kube-system
- kube-system
- job_name: serviceMonitor/default/kube-prometheus-stack-kube-state-metrics/0
honor_labels: true
honor_timestamps: true
@@ -816,7 +816,7 @@ spec:
namespaces:
own_namespace: false
names:
- default
- default
- job_name: serviceMonitor/default/kube-prometheus-stack-kube-scheduler/0
honor_timestamps: true
scrape_interval: 30s
@@ -923,7 +923,7 @@ spec:
namespaces:
own_namespace: false
names:
- kube-system
- kube-system
- job_name: serviceMonitor/default/kube-prometheus-stack-kube-proxy/0
honor_timestamps: true
scrape_interval: 30s
@@ -1030,7 +1030,7 @@ spec:
namespaces:
own_namespace: false
names:
- kube-system
- kube-system
- job_name: serviceMonitor/default/kube-prometheus-stack-kube-etcd/0
honor_timestamps: true
scrape_interval: 30s
@@ -1349,7 +1349,7 @@ spec:
namespaces:
own_namespace: false
names:
- kube-system
- kube-system
- job_name: serviceMonitor/default/kube-prometheus-stack-apiserver/0
honor_timestamps: true
@@ -1362,7 +1362,7 @@ spec:
credentials_file: /var/run/secrets/kubernetes.io/serviceaccount/token
tls_config:
ca_file: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
server_name: kubernetes
server_name: kubernetes
follow_redirects: true
enable_http2: true
relabel_configs:
@@ -1434,7 +1434,7 @@ spec:
regex: (.*)
target_label: endpoint
replacement: https
action: replace
action: replace
- source_labels: [__address__]
separator: ;
regex: (.*)
@@ -1455,7 +1455,7 @@ spec:
namespaces:
own_namespace: false
names:
- default
- default
- job_name: serviceMonitor/default/kube-prometheus-stack-alertmanager/0
honor_timestamps: true
scrape_interval: 30s
@@ -1558,7 +1558,7 @@ spec:
namespaces:
own_namespace: false
names:
- default
- default
- job_name: 'kube-state-metrics'
static_configs:
- targets: ['kube-state-metrics.kube-system.svc.cluster.local:8080']
modules/workloads/infra/rules.tf
+1 -1
View File
@@ -5,7 +5,7 @@
################################################################################################################################################
resource "aws_prometheus_rule_group_namespace" "recording_rules" {
count = var.enable_recording_rules ? 1 : 0
count = var.enable_recording_rules ? 1 : 0
name = "infra-recording-rules"
workspace_id = var.managed_prometheus_workspace_id
data = <<EOF
modules/workloads/java/README.md
+52
View File
@@ -0,0 +1,52 @@
# Java based workloads monitoring
This module provides monitoring for Java based workloads with the following resources:
- AWS Distro For OpenTelemetry Operator and Collector
- AWS Managed Grafana Dashboard and data source
- Alerts and recording rules with AWS Managed Service for Prometheus
<!-- BEGINNING OF PRE-COMMIT-TERRAFORM DOCS HOOK -->
## Requirements
| Name | Version |
|------|---------|
| <a name="requirement_grafana"></a> [grafana](#requirement\_grafana) | ~> 1.25.0 |
## Providers
| Name | Version |
|------|---------|
| <a name="provider_aws"></a> [aws](#provider\_aws) | n/a |
| <a name="provider_grafana"></a> [grafana](#provider\_grafana) | ~> 1.25.0 |
## Modules
| Name | Source | Version |
|------|--------|---------|
| <a name="module_helm_addon"></a> [helm\_addon](#module\_helm\_addon) | github.com/aws-ia/terraform-aws-eks-blueprints/modules/kubernetes-addons/helm-addon | n/a |
## Resources
| Name | Type |
|------|------|
| [aws_prometheus_rule_group_namespace.this](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/prometheus_rule_group_namespace) | resource |
| [grafana_dashboard.this](https://registry.terraform.io/providers/grafana/grafana/latest/docs/resources/dashboard) | resource |
| [aws_partition.current](https://registry.terraform.io/providers/hashicorp/aws/latest/docs/data-sources/partition) | data source |
## Inputs
| Name | Description | Type | Default | Required |
|------|-------------|------|---------|:--------:|
| <a name="input_addon_context"></a> [addon\_context](#input\_addon\_context) | Input configuration for the addon | <pre>object({<br> aws_caller_identity_account_id = string<br> aws_caller_identity_arn = string<br> aws_eks_cluster_endpoint = string<br> aws_partition_id = string<br> aws_region_name = string<br> eks_cluster_id = string<br> eks_oidc_issuer_url = string<br> eks_oidc_provider_arn = string<br> irsa_iam_permissions_boundary = string<br> irsa_iam_role_path = string<br> tags = map(string)<br> })</pre> | n/a | yes |
| <a name="input_amp_endpoint"></a> [amp\_endpoint](#input\_amp\_endpoint) | Amazon Managed Prometheus endpoint | `string` | n/a | yes |
| <a name="input_amp_id"></a> [amp\_id](#input\_amp\_id) | Managed Prometheus workspace id | `string` | n/a | yes |
| <a name="input_amp_region"></a> [amp\_region](#input\_amp\_region) | Amazon Managed Prometheus Workspace's Region | `string` | `null` | no |
| <a name="input_dashboards_folder_id"></a> [dashboards\_folder\_id](#input\_dashboards\_folder\_id) | n/a | `string` | n/a | yes |
| <a name="input_enable_recording_rules"></a> [enable\_recording\_rules](#input\_enable\_recording\_rules) | Enable AMP recording rules | `bool` | `true` | no |
| <a name="input_helm_config"></a> [helm\_config](#input\_helm\_config) | Helm Config for Prometheus | `any` | `{}` | no |
## Outputs
No outputs.
<!-- END OF PRE-COMMIT-TERRAFORM DOCS HOOK -->