-
Notifications
You must be signed in to change notification settings - Fork 210
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Browse files
Browse the repository at this point in the history
* Add release notes for 2.1.0 Signed-off-by: Hai Yan <[email protected]> (cherry picked from commit 24db8a6) Co-authored-by: Hai Yan <[email protected]>
- Loading branch information
1 parent
94f734b
commit 7203ef5
Showing
1 changed file
with
72 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,72 @@ | ||
## 2023-03-02 Version 2.1.0 | ||
|
||
--- | ||
|
||
### Features | ||
* Support OpenTelementry Logs ([#1372](https://github.com/opensearch-project/data-prepper/pull/1372)) | ||
* New type conversion processor ([#2010](https://github.com/opensearch-project/data-prepper/issues/2010)) | ||
* New anomaly detection processor ([#2040](https://github.com/opensearch-project/data-prepper/issues/2040)) | ||
* Support histogram action in aggregate processor ([#2078](https://github.com/opensearch-project/data-prepper/pull/2078)) | ||
* Support percent sampler action in aggregate processor ([#2094](https://github.com/opensearch-project/data-prepper/issues/2094)) | ||
* Support rate limiter action in aggregate processor ([#2088](https://github.com/opensearch-project/data-prepper/issues/2088)) | ||
* Provide a circuit breaking capability ([#2150](https://github.com/opensearch-project/data-prepper/issues/2150)) | ||
|
||
### Enhancements | ||
* Support custom headers when assuming AWS IAM roles ([#1888](https://github.com/opensearch-project/data-prepper/issues/1888)) | ||
* Provide additional metrics for S3 source ([#2025](https://github.com/opensearch-project/data-prepper/issues/2025)) | ||
* Support "when" condition in aggregate processor actions ([#2021](https://github.com/opensearch-project/data-prepper/issues/2021)) | ||
* Support dynamic index name in OpenSearch sink ([#1459](https://github.com/opensearch-project/data-prepper/issues/1459)) | ||
* Support latest OTEL metrics features ([#1310](https://github.com/opensearch-project/data-prepper/issues/1310)) | ||
* Support loading files from S3 in OpenSearch sink ([#2120](https://github.com/opensearch-project/data-prepper/issues/2120)) | ||
* Support metric tags based on metric name pattern ([#2229](https://github.com/opensearch-project/data-prepper/issues/2229)) | ||
* Support retry when sink fails to initialize ([#936](https://github.com/opensearch-project/data-prepper/issues/936)) | ||
* Add more metrics for OpenSearch sink ([#2168](https://github.com/opensearch-project/data-prepper/issues/2168)) | ||
* Validate file content from S3 for OpenSearch sink ([#2178](https://github.com/opensearch-project/data-prepper/issues/2178)) | ||
* Add more configurable values to OTEL trace raw processor ([#2165](https://github.com/opensearch-project/data-prepper/issues/2165)) | ||
* Add more metrics for OTEL trace raw processor ([#2166](https://github.com/opensearch-project/data-prepper/issues/2166)) | ||
* Provide logging markers to filter sensitive data and events ([#1990](https://github.com/opensearch-project/data-prepper/issues/1990)) | ||
* Support sensitive data masking in logs ([#2187](https://github.com/opensearch-project/data-prepper/issues/2187)) | ||
* Emit Metrics for ACM and AWS CloudMap related calls ([#2087](https://github.com/opensearch-project/data-prepper/issues/2087)) | ||
* Add buffer overflow metric in AbstractBuffer ([#2167](https://github.com/opensearch-project/data-prepper/issues/2167)) | ||
* Support configurable read batch delay for peer-forwarder ([#2158](https://github.com/opensearch-project/data-prepper/issues/2158)) | ||
* Improve ReceiveBuffer Performance ([#2142](https://github.com/opensearch-project/data-prepper/issues/2142)) | ||
* Support OTEL scope logs ([#2115](https://github.com/opensearch-project/data-prepper/issues/2115)) | ||
* Implement batching for peer forwarder request documents ([#2197](https://github.com/opensearch-project/data-prepper/pull/2197)) | ||
* Add more metrics to OTEL metrics source ([#2283](https://github.com/opensearch-project/data-prepper/pull/2283)) | ||
* Support a version property in pipeline YAML configurations ([#2263](https://github.com/opensearch-project/data-prepper/issues/2263)) | ||
* Change the path prefix for OTEL endpoints ([#2257](https://github.com/opensearch-project/data-prepper/issues/2257)) | ||
* Change the path for HTTP source ([#2258](https://github.com/opensearch-project/data-prepper/issues/2258)) | ||
* Improve peer-forwarding serialization ([#2242](https://github.com/opensearch-project/data-prepper/issues/2242)) | ||
* Add null support to Data Prepper Expressions ([#1136](https://github.com/opensearch-project/data-prepper/issues/1136)) | ||
* Support for complex document ID and routing ID ([#1966](https://github.com/opensearch-project/data-prepper/pull/1966)) | ||
* Add PluginMetrics in the Auth Plugin for HTTP, OTEL and Metrics Source ([#2023](https://github.com/opensearch-project/data-prepper/pull/2023)) | ||
* Support Long type in expressions ([#2265](https://github.com/opensearch-project/data-prepper/pull/2265)) | ||
* Add backoff for SQS in S3 source to reduce logging ([#2326](https://github.com/opensearch-project/data-prepper/pull/2326)) | ||
* Add several performance improvement changes ([#2190](https://github.com/opensearch-project/data-prepper/pull/2190), | ||
[#2228](https://github.com/opensearch-project/data-prepper/pull/2228), | ||
[#2238](https://github.com/opensearch-project/data-prepper/pull/2238), | ||
[#2239](https://github.com/opensearch-project/data-prepper/pull/2239), | ||
[#2241](https://github.com/opensearch-project/data-prepper/pull/2241), | ||
[#2246](https://github.com/opensearch-project/data-prepper/pull/2246), | ||
[#2250](https://github.com/opensearch-project/data-prepper/pull/2250), | ||
[#2290](https://github.com/opensearch-project/data-prepper/pull/2290)) | ||
|
||
### Bug Fixes | ||
* Fix logging by updating related packages for SLF4J 2.0 ([#2113](https://github.com/opensearch-project/data-prepper/pull/2113)) | ||
* Fix null pointer exception in remote peer forwarding ([#2124](https://github.com/opensearch-project/data-prepper/pull/2124)) | ||
* Fix Data Prepper to not terminate on invalid open telemetry metric/trace data ([#2176](https://github.com/opensearch-project/data-prepper/pull/2176)) | ||
* Fix Armeria exception when under pressure ([#2274](https://github.com/opensearch-project/data-prepper/pull/2274)) | ||
* Fix release build issue ([#2345](https://github.com/opensearch-project/data-prepper/pull/2345)) | ||
|
||
### Security | ||
* Fix CVE-2022-3509, CVE-2022-3510 ([#2079](https://github.com/opensearch-project/data-prepper/pull/2079)) | ||
* Fix CVE-2022-41881, CVE-2021-21290 and CVE-2022-41915 ([#2093](https://github.com/opensearch-project/data-prepper/pull/2093)) | ||
* Fix CVE-2020-8908, CVE-2018-10237 ([#2254](https://github.com/opensearch-project/data-prepper/pull/2254)) | ||
* Update OpenTelemetry dependencies to address CVE-2023-25577 and CVE-2023-23934 ([#2288](https://github.com/opensearch-project/data-prepper/pull/2288)) | ||
* Use secure Java serialization with Java serialization ([#2310](https://github.com/opensearch-project/data-prepper/issues/2310)) | ||
|
||
### Maintenance | ||
* Test against multiple OTEL version ([#1963](https://github.com/opensearch-project/data-prepper/issues/1963)) | ||
* Document trace_peer_forwarder in README ([#2141](https://github.com/opensearch-project/data-prepper/issues/2141)) | ||
* Use consistent AWS pipeline configurations ([#2184](https://github.com/opensearch-project/data-prepper/issues/2184)) | ||
* Use snake case for all configurations ([#2203](https://github.com/opensearch-project/data-prepper/issues/2203)) |