Skip to content

Commit

Permalink
Add release notes for 2.1.0 (#2354) (#2359)
Browse files Browse the repository at this point in the history
* Add release notes for 2.1.0

Signed-off-by: Hai Yan <[email protected]>
(cherry picked from commit 24db8a6)

Co-authored-by: Hai Yan <[email protected]>
  • Loading branch information
opensearch-trigger-bot[bot] and oeyh authored Mar 2, 2023
1 parent 94f734b commit 7203ef5
Showing 1 changed file with 72 additions and 0 deletions.
72 changes: 72 additions & 0 deletions release/release-notes/data-prepper.release-notes-2.1.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
## 2023-03-02 Version 2.1.0

---

### Features
* Support OpenTelementry Logs ([#1372](https://github.com/opensearch-project/data-prepper/pull/1372))
* New type conversion processor ([#2010](https://github.com/opensearch-project/data-prepper/issues/2010))
* New anomaly detection processor ([#2040](https://github.com/opensearch-project/data-prepper/issues/2040))
* Support histogram action in aggregate processor ([#2078](https://github.com/opensearch-project/data-prepper/pull/2078))
* Support percent sampler action in aggregate processor ([#2094](https://github.com/opensearch-project/data-prepper/issues/2094))
* Support rate limiter action in aggregate processor ([#2088](https://github.com/opensearch-project/data-prepper/issues/2088))
* Provide a circuit breaking capability ([#2150](https://github.com/opensearch-project/data-prepper/issues/2150))

### Enhancements
* Support custom headers when assuming AWS IAM roles ([#1888](https://github.com/opensearch-project/data-prepper/issues/1888))
* Provide additional metrics for S3 source ([#2025](https://github.com/opensearch-project/data-prepper/issues/2025))
* Support "when" condition in aggregate processor actions ([#2021](https://github.com/opensearch-project/data-prepper/issues/2021))
* Support dynamic index name in OpenSearch sink ([#1459](https://github.com/opensearch-project/data-prepper/issues/1459))
* Support latest OTEL metrics features ([#1310](https://github.com/opensearch-project/data-prepper/issues/1310))
* Support loading files from S3 in OpenSearch sink ([#2120](https://github.com/opensearch-project/data-prepper/issues/2120))
* Support metric tags based on metric name pattern ([#2229](https://github.com/opensearch-project/data-prepper/issues/2229))
* Support retry when sink fails to initialize ([#936](https://github.com/opensearch-project/data-prepper/issues/936))
* Add more metrics for OpenSearch sink ([#2168](https://github.com/opensearch-project/data-prepper/issues/2168))
* Validate file content from S3 for OpenSearch sink ([#2178](https://github.com/opensearch-project/data-prepper/issues/2178))
* Add more configurable values to OTEL trace raw processor ([#2165](https://github.com/opensearch-project/data-prepper/issues/2165))
* Add more metrics for OTEL trace raw processor ([#2166](https://github.com/opensearch-project/data-prepper/issues/2166))
* Provide logging markers to filter sensitive data and events ([#1990](https://github.com/opensearch-project/data-prepper/issues/1990))
* Support sensitive data masking in logs ([#2187](https://github.com/opensearch-project/data-prepper/issues/2187))
* Emit Metrics for ACM and AWS CloudMap related calls ([#2087](https://github.com/opensearch-project/data-prepper/issues/2087))
* Add buffer overflow metric in AbstractBuffer ([#2167](https://github.com/opensearch-project/data-prepper/issues/2167))
* Support configurable read batch delay for peer-forwarder ([#2158](https://github.com/opensearch-project/data-prepper/issues/2158))
* Improve ReceiveBuffer Performance ([#2142](https://github.com/opensearch-project/data-prepper/issues/2142))
* Support OTEL scope logs ([#2115](https://github.com/opensearch-project/data-prepper/issues/2115))
* Implement batching for peer forwarder request documents ([#2197](https://github.com/opensearch-project/data-prepper/pull/2197))
* Add more metrics to OTEL metrics source ([#2283](https://github.com/opensearch-project/data-prepper/pull/2283))
* Support a version property in pipeline YAML configurations ([#2263](https://github.com/opensearch-project/data-prepper/issues/2263))
* Change the path prefix for OTEL endpoints ([#2257](https://github.com/opensearch-project/data-prepper/issues/2257))
* Change the path for HTTP source ([#2258](https://github.com/opensearch-project/data-prepper/issues/2258))
* Improve peer-forwarding serialization ([#2242](https://github.com/opensearch-project/data-prepper/issues/2242))
* Add null support to Data Prepper Expressions ([#1136](https://github.com/opensearch-project/data-prepper/issues/1136))
* Support for complex document ID and routing ID ([#1966](https://github.com/opensearch-project/data-prepper/pull/1966))
* Add PluginMetrics in the Auth Plugin for HTTP, OTEL and Metrics Source ([#2023](https://github.com/opensearch-project/data-prepper/pull/2023))
* Support Long type in expressions ([#2265](https://github.com/opensearch-project/data-prepper/pull/2265))
* Add backoff for SQS in S3 source to reduce logging ([#2326](https://github.com/opensearch-project/data-prepper/pull/2326))
* Add several performance improvement changes ([#2190](https://github.com/opensearch-project/data-prepper/pull/2190),
[#2228](https://github.com/opensearch-project/data-prepper/pull/2228),
[#2238](https://github.com/opensearch-project/data-prepper/pull/2238),
[#2239](https://github.com/opensearch-project/data-prepper/pull/2239),
[#2241](https://github.com/opensearch-project/data-prepper/pull/2241),
[#2246](https://github.com/opensearch-project/data-prepper/pull/2246),
[#2250](https://github.com/opensearch-project/data-prepper/pull/2250),
[#2290](https://github.com/opensearch-project/data-prepper/pull/2290))

### Bug Fixes
* Fix logging by updating related packages for SLF4J 2.0 ([#2113](https://github.com/opensearch-project/data-prepper/pull/2113))
* Fix null pointer exception in remote peer forwarding ([#2124](https://github.com/opensearch-project/data-prepper/pull/2124))
* Fix Data Prepper to not terminate on invalid open telemetry metric/trace data ([#2176](https://github.com/opensearch-project/data-prepper/pull/2176))
* Fix Armeria exception when under pressure ([#2274](https://github.com/opensearch-project/data-prepper/pull/2274))
* Fix release build issue ([#2345](https://github.com/opensearch-project/data-prepper/pull/2345))

### Security
* Fix CVE-2022-3509, CVE-2022-3510 ([#2079](https://github.com/opensearch-project/data-prepper/pull/2079))
* Fix CVE-2022-41881, CVE-2021-21290 and CVE-2022-41915 ([#2093](https://github.com/opensearch-project/data-prepper/pull/2093))
* Fix CVE-2020-8908, CVE-2018-10237 ([#2254](https://github.com/opensearch-project/data-prepper/pull/2254))
* Update OpenTelemetry dependencies to address CVE-2023-25577 and CVE-2023-23934 ([#2288](https://github.com/opensearch-project/data-prepper/pull/2288))
* Use secure Java serialization with Java serialization ([#2310](https://github.com/opensearch-project/data-prepper/issues/2310))

### Maintenance
* Test against multiple OTEL version ([#1963](https://github.com/opensearch-project/data-prepper/issues/1963))
* Document trace_peer_forwarder in README ([#2141](https://github.com/opensearch-project/data-prepper/issues/2141))
* Use consistent AWS pipeline configurations ([#2184](https://github.com/opensearch-project/data-prepper/issues/2184))
* Use snake case for all configurations ([#2203](https://github.com/opensearch-project/data-prepper/issues/2203))

0 comments on commit 7203ef5

Please sign in to comment.