Skip to content

[aws] Add missing fields definition for ec2 data stream #7425

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kaiyan-sheng merged 8 commits into from
Aug 21, 2023
Merged

[aws] Add missing fields definition for ec2 data stream #7425

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
939250c
[aws] Add missing fields definition for ec2 data stream
Aug 16, 2023
75464e5
add changelog
Aug 16, 2023
1d1f92e
change version number
Aug 17, 2023
125050b
add missing field
Aug 17, 2023
9b8d2e6
fix dashboard
Aug 17, 2023
f85a792
revert changes in rds
Aug 17, 2023
63d9d0a
fix changelog
Aug 17, 2023
bddcf4c
Merge branch 'main' into ec2_bug
Aug 21, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add missing field
  • Loading branch information
kaiyan-sheng
kaiyan-sheng committed Aug 17, 2023
commit 125050b98ac23ab9b90f3c622267bd54600a81b6
4 changes: 4 additions & 0 deletions packages/aws/data_stream/ec2_metrics/fields/fields.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,10 @@
type: long
description: |
Bytes read per second from all instance store volumes available to the instance.
- name: DiskReadBytes.sum
type: long
description: |
Total bytes read from all instance store volumes available to the instance.
- name: DiskWriteBytes.rate
type: long
description: |
Expand Down
71 changes: 0 additions & 71 deletions packages/aws/data_stream/rds/elasticsearch/ingest_pipeline/default.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -277,75 +277,4 @@ processors:
- rename:
field: aws.rds.metrics.AuroraVolumeBytesLeftTotal.avg
target_field: aws.rds.aurora_volume_left_total.bytes
ignore_missing: true
- remove:
field:
- aws.rds.metrics.BurstBalance
- aws.rds.metrics.CPUUtilization
- aws.rds.metrics.CPUCreditUsage
- aws.rds.metrics.CPUCreditBalance
- aws.rds.metrics.DatabaseConnections
- aws.rds.metrics.DiskQueueDepth
- aws.rds.metrics.FailedSQLServerAgentJobsCount
- aws.rds.metrics.FreeableMemory
- aws.rds.metrics.FreeStorageSpace
- aws.rds.metrics.MaximumUsedTransactionIDs
- aws.rds.metrics.OldestReplicationSlotLag
- aws.rds.metrics.ReadIOPS.avg
- aws.rds.metrics.CommitThroughput
- aws.rds.metrics.DeleteThroughput
- aws.rds.metrics.DDLThroughput
- aws.rds.metrics.DMLThroughput
- aws.rds.metrics.InsertThroughput
- aws.rds.metrics.NetworkThroughput
- aws.rds.metrics.NetworkReceiveThroughput
- aws.rds.metrics.NetworkTransmitThroughput
- aws.rds.metrics.ReadThroughput
- aws.rds.metrics.SelectThroughput
- aws.rds.metrics.UpdateThroughput
- aws.rds.metrics.WriteThroughput
- aws.rds.metrics.CommitLatency
- aws.rds.metrics.DDLLatency
- aws.rds.metrics.DMLLatency
- aws.rds.metrics.InsertLatency
- aws.rds.metrics.ReadLatency
- aws.rds.metrics.SelectLatency
- aws.rds.metrics.UpdateLatency
- aws.rds.metrics.WriteLatency
- aws.rds.metrics.DeleteLatency
- aws.rds.metrics.ReplicaLag
- aws.rds.metrics.BinLogDiskUsage
- aws.rds.metrics.ReplicationSlotDiskUsage
- aws.rds.metrics.TransactionLogsDiskUsage
- aws.rds.metrics.SwapUsage
- aws.rds.metrics.TransactionLogsGeneration
- aws.rds.metrics.WriteIOPS
- aws.rds.metrics.Queries
- aws.rds.metrics.Deadlocks
- aws.rds.metrics.VolumeBytesUsed
- aws.rds.metrics.FreeLocalStorage
- aws.rds.metrics.ActiveTransactions
- aws.rds.metrics.BlockedTransactions
- aws.rds.metrics.LoginFailures
- aws.rds.metrics.AuroraBinlogReplicaLag
- aws.rds.metrics.aurora_bin_log_replica_lag
- aws.rds.metrics.AuroraGlobalDBDataTransferBytes
- aws.rds.metrics.AuroraGlobalDBReplicationLag
- aws.rds.metrics.AuroraReplicaLag
- aws.rds.metrics.AuroraReplicaLagMaximum
- aws.rds.metrics.AuroraReplicaLagMinimum
- aws.rds.metrics.BacktrackChangeRecordsCreationRate
- aws.rds.metrics.BacktrackChangeRecordsStored
- aws.rds.metrics.BacktrackWindowActual
- aws.rds.metrics.BacktrackWindowAlert
- aws.rds.metrics.BackupRetentionPeriodStorageUsed
- aws.rds.metrics.SnapshotStorageUsed
- aws.rds.metrics.BufferCacheHitRatio
- aws.rds.metrics.ResultSetCacheHitRatio
- aws.rds.metrics.EngineUptime
- aws.rds.metrics.VolumeReadIOPs
- aws.rds.metrics.VolumeWriteIOPs
- aws.rds.metrics.RDSToAuroraPostgreSQLReplicaLag
- aws.rds.metrics.TotalBackupStorageBilled
- aws.rds.metrics.AuroraVolumeBytesLeftTotal
ignore_missing: true
1 change: 1 addition & 0 deletions packages/aws/docs/ec2.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -347,6 +347,7 @@ An example event for `ec2` looks as following:
| aws.ec2.metrics.CPUSurplusCreditsCharged.avg | The number of spent surplus credits that are not paid down by earned CPU credits, and which thus incur an additional charge. | long |
| aws.ec2.metrics.CPUUtilization.avg | The average percentage of physical CPU time that Amazon EC2 uses to run the EC2 instance. | long |
| aws.ec2.metrics.DiskReadBytes.rate | Bytes read per second from all instance store volumes available to the instance. | long |
| aws.ec2.metrics.DiskReadBytes.sum | Total bytes read from all instance store volumes available to the instance. | long |
| aws.ec2.metrics.DiskReadOps.rate | Completed read operations per second from all instance store volumes available to the instance in a specified period of time. | long |
| aws.ec2.metrics.DiskReadOps.sum | Total completed read operations from all instance store volumes available to the instance in a specified period of time. | long |
| aws.ec2.metrics.DiskWriteBytes.rate | Bytes written per second to all instance store volumes available to the instance. | long |
Expand Down