Profiler's fuzz tests store corpus files under wrong directories by zhengyu123 · Pull Request #655 · DataDog/java-profiler

zhengyu123 · 2026-07-13T16:10:19Z

What does this PR do?:

Motivation:

Additional Notes:

How to test the change?:

For Datadog employees:

If this PR touches code that signs or publishes builds or packages, or handles
credentials of any kind, I've requested a security review (run the dd:platform-security-review
skill, or file a request via the PSEC review form).
bewaire also runs automatically on every PR.
This PR doesn't touch any of that.
JIRA: PROF-15393

Unsure? Have a question? Request a review!

dd-octo-sts · 2026-07-13T16:19:39Z

Benchmark Results (commit `161b7a2`)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/124354374 Commit: 161b7a2bf796017b646a37c065433599b7d668b2

⚠️ Significant outliers

🟢 fj-kmeans (JDK 21): runtime -4.3% (2816→2694 ms)
🟢 future-genetic (JDK 25): runtime -2.7% (2048→1993 ms)

Runtime details (per benchmark × JDK)

Benchmark	JDK	Latest	Dev	Δ (dev vs latest)	Issues L/D
akka-uct	21	✅ 10323 ms (21 iters)	✅ 10299 ms (21 iters)	≈ -0.2% (±11.2%)	— / —
akka-uct	25	✅ 8912 ms (24 iters)	✅ 8782 ms (24 iters)	≈ -1.5% (±9.4%)	— / —
finagle-chirper	21	✅ 5944 ms (33 iters)	✅ 5945 ms (33 iters)	≈ +0% (±25.2%)	⚠️ W:3 / ⚠️ W:3
finagle-chirper	25	✅ 5572 ms (35 iters)	✅ 5514 ms (36 iters)	≈ -1% (±24.6%)	⚠️ W:3 / ⚠️ W:3
fj-kmeans	21	✅ 2816 ms (67 iters)	✅ 2694 ms (69 iters)	🟢 -4.3%	— / —
fj-kmeans	25	✅ 2818 ms (66 iters)	✅ 2824 ms (66 iters)	≈ +0.2% (±2.6%)	— / —
future-genetic	25	✅ 2048 ms (91 iters)	✅ 1993 ms (93 iters)	🟢 -2.7%	— / —
naive-bayes	21	✅ 1282 ms (134 iters)	✅ 1289 ms (133 iters)	≈ +0.5% (±32.4%)	— / —
naive-bayes	25	✅ 977 ms (175 iters)	✅ 1024 ms (167 iters)	≈ +4.8% (±32.5%)	— / —
reactors	21	✅ 16525 ms (15 iters)	✅ 16856 ms (15 iters)	≈ +2% (±7.3%)	— / —
reactors	25	✅ 18634 ms (15 iters)	✅ 18465 ms (15 iters)	≈ -0.9% (±5.7%)	— / —

Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark	JDK	Dropped rec	Dropped jvmti	Dropped trace	Skipped WC	AGCT fail	Unwind fail
akka-uct	21	✅ / ✅	✅ / ✅	1 / 1	1938 / 2021	✅ / ✅	✅ / ✅
akka-uct	25	✅ / ✅	✅ / ✅	1 / 3	2293 / 2241	✅ / ✅	✅ / ✅
finagle-chirper	21	✅ / ✅	✅ / ✅	3 / 5	8484 / 8373	✅ / ✅	✅ / ✅
finagle-chirper	25	✅ / ✅	✅ / ✅	1 / 1	7902 / 8673	✅ / ✅	✅ / ✅
fj-kmeans	21	✅ / ✅	✅ / ✅	3 / 1	1309 / 1285	✅ / ✅	✅ / ✅
fj-kmeans	25	✅ / ✅	✅ / ✅	7 / 2	1269 / 1258	✅ / ✅	✅ / ✅
future-genetic	21	✅ / ✅	✅ / ✅	2 / 1	3019 / 2958	✅ / ✅	✅ / ✅
future-genetic	25	✅ / ✅	✅ / ✅	2 / 1	2843 / 2790	✅ / ✅	✅ / ✅
naive-bayes	21	✅ / ✅	✅ / ✅	3 / 5	3508 / 3506	✅ / ✅	✅ / ✅
naive-bayes	25	✅ / ✅	✅ / ✅	2 / 5	3541 / 3494	✅ / ✅	✅ / ✅
reactors	21	✅ / ✅	✅ / ✅	2 / 1	1718 / 1750	✅ / ✅	✅ / ✅
reactors	25	✅ / ✅	✅ / ✅	1 / ✅	1963 / 1853	✅ / ✅	✅ / ✅

dd-octo-sts · 2026-07-13T16:29:30Z

CI Test Results

Run: #29268963737 | Commit: 23e7f2b | Duration: 14m 2s (longest job)

✅ All 32 test jobs passed

Status Overview

JDK	glibc-aarch64/debug	glibc-amd64/debug	musl-aarch64/debug	musl-amd64/debug
8	-	✅	-	-
8-ibm	-	✅	-	-
8-j9	✅	✅	-	-
8-librca	-	-	✅	✅
8-orcl	-	✅	-	-
11	-	✅	-	-
11-j9	✅	✅	-	-
11-librca	-	-	✅	✅
17	✅	✅	-	-
17-graal	✅	✅	-	-
17-j9	✅	✅	-	-
17-librca	-	-	✅	✅
21	✅	✅	-	-
21-graal	✅	✅	-	-
21-librca	-	-	✅	✅
25	✅	✅	-	-
25-graal	✅	✅	-	-
25-librca	-	-	✅	✅

Legend: ✅ passed | ❌ failed | ⚪ skipped | 🚫 cancelled

Summary: Total: 32 | Passed: 32 | Failed: 0

Updated: 2026-07-13 17:22:17 UTC

datadog-datadog-prod-us1-2 · 2026-07-13T16:30:19Z

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 4 Pipeline jobs failed

DataDog/java-profiler | reliability-chaos-aarch64: [profiler+tracer, tcmalloc, 21.0.3-tem]

DataDog/java-profiler | reliability-chaos-aarch64: [profiler+tracer, tcmalloc, 25.0.3-tem]

DataDog/java-profiler | reliability-chaos-amd64: [profiler+tracer, tcmalloc, 21.0.3-tem]

View all 4 failed jobs.

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: dff357b | Docs | Datadog PR Page | Give us feedback!}

Copilot

Copilot wasn't able to review this pull request because it exceeds the maximum number of files (300). Try reducing the number of changed files and requesting a review from Copilot again.

dd-octo-sts · 2026-07-13T17:36:17Z

Benchmark Results (commit `dff357b`)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/124370912 Commit: dff357bc52c31e972592da3e4dec9b65d60cade6

⚠️ Significant outliers

🟢 fj-kmeans (JDK 21): runtime -3.1% (2818→2732 ms)
🟢 future-genetic (JDK 21): runtime -2.9% (2134→2072 ms)
🟢 future-genetic (JDK 25): runtime -3.1% (2108→2042 ms)

Runtime details (per benchmark × JDK)

Benchmark	JDK	Latest	Dev	Δ (dev vs latest)	Issues L/D
akka-uct	21	✅ 10287 ms (21 iters)	✅ 10293 ms (21 iters)	≈ +0.1% (±11.3%)	— / —
akka-uct	25	✅ 8899 ms (24 iters)	✅ 8825 ms (24 iters)	≈ -0.8% (±9.6%)	— / —
finagle-chirper	21	✅ 5922 ms (33 iters)	✅ 5999 ms (33 iters)	≈ +1.3% (±24.8%)	⚠️ W:4 / ⚠️ W:3
fj-kmeans	21	✅ 2818 ms (66 iters)	✅ 2732 ms (68 iters)	🟢 -3.1%	— / —
fj-kmeans	25	✅ 2793 ms (67 iters)	✅ 2768 ms (67 iters)	≈ -0.9% (±2.7%)	— / —
future-genetic	21	✅ 2134 ms (87 iters)	✅ 2072 ms (89 iters)	🟢 -2.9%	— / —
future-genetic	25	✅ 2108 ms (89 iters)	✅ 2042 ms (90 iters)	🟢 -3.1%	— / —
naive-bayes	21	✅ 1290 ms (132 iters)	✅ 1287 ms (133 iters)	≈ -0.2% (±32.6%)	— / —
naive-bayes	25	✅ 1021 ms (168 iters)	✅ 975 ms (175 iters)	≈ -4.5% (±30.8%)	— / —
reactors	21	✅ 16926 ms (15 iters)	✅ 16438 ms (15 iters)	≈ -2.9% (±6.4%)	— / —
reactors	25	✅ 18575 ms (15 iters)	✅ 18686 ms (15 iters)	≈ +0.6% (±4.1%)	— / —

Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark	JDK	Dropped rec	Dropped jvmti	Dropped trace	Skipped WC	AGCT fail	Unwind fail
akka-uct	21	✅ / ✅	✅ / ✅	5 / 2	1917 / 1991	✅ / ✅	✅ / ✅
akka-uct	25	✅ / ✅	✅ / ✅	2 / 1	2303 / 2179	✅ / ✅	✅ / ✅
finagle-chirper	21	✅ / ✅	✅ / ✅	5 / 5	8669 / 8422	✅ / ✅	✅ / ✅
finagle-chirper	25	✅ / ✅	✅ / ✅	✅ / 3	8480 / 8549	✅ / ✅	✅ / ✅
fj-kmeans	21	✅ / ✅	✅ / ✅	✅ / 3	1258 / 1290	✅ / ✅	✅ / ✅
fj-kmeans	25	✅ / ✅	✅ / ✅	2 / ✅	1269 / 1281	✅ / ✅	✅ / ✅
future-genetic	21	✅ / ✅	✅ / ✅	6 / 1	3035 / 2963	✅ / ✅	✅ / ✅
future-genetic	25	✅ / ✅	✅ / ✅	3 / 1	2952 / 2762	✅ / ✅	✅ / ✅
naive-bayes	21	✅ / ✅	✅ / ✅	3 / 1	3484 / 3485	✅ / ✅	✅ / ✅
naive-bayes	25	✅ / ✅	✅ / ✅	5 / 4	3479 / 3429	✅ / ✅	✅ / ✅
reactors	21	✅ / ✅	✅ / ✅	✅ / 1	1799 / 1712	✅ / ✅	✅ / ✅
reactors	25	✅ / ✅	✅ / ✅	2 / ✅	1922 / 1881	✅ / ✅	✅ / ✅

dd-octo-sts · 2026-07-13T17:45:25Z

Reliability & Chaos Results

✅ All reliability & chaos checks passed Pipeline: https://gitlab.ddbuild.io/DataDog/java-profiler/-/pipelines/124354367

Profiler's fuzz tests store corpus files under wrong directories

161b7a2

zhengyu123 requested a review from Copilot July 13, 2026 17:03

Merge branch 'main' into zgu/fuzz_corpus_dir

dff357b

Copilot started reviewing on behalf of zhengyu123 July 13, 2026 17:04 View session

Copilot AI reviewed Jul 13, 2026

zhengyu123 closed this Jul 13, 2026

zhengyu123 deleted the zgu/fuzz_corpus_dir branch July 13, 2026 18:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Profiler's fuzz tests store corpus files under wrong directories#655

Profiler's fuzz tests store corpus files under wrong directories#655
zhengyu123 wants to merge 2 commits into
mainfrom
zgu/fuzz_corpus_dir

zhengyu123 commented Jul 13, 2026 •

edited by atlassian Bot

Loading

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1-2 Bot commented Jul 13, 2026 •

edited by datadog-datadog-prod-us1 Bot

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

zhengyu123 commented Jul 13, 2026 • edited by atlassian Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026

Benchmark Results (commit 161b7a2)

⚠️ Significant outliers

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CI Test Results

Status Overview

Uh oh!

datadog-datadog-prod-us1-2 Bot commented Jul 13, 2026 • edited by datadog-datadog-prod-us1 Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚠️ Warnings

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026

Benchmark Results (commit dff357b)

⚠️ Significant outliers

Uh oh!

dd-octo-sts Bot commented Jul 13, 2026

Reliability & Chaos Results

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

zhengyu123 commented Jul 13, 2026 •

edited by atlassian Bot

Loading

Benchmark Results (commit `161b7a2`)

dd-octo-sts Bot commented Jul 13, 2026 •

edited

Loading

datadog-datadog-prod-us1-2 Bot commented Jul 13, 2026 •

edited by datadog-datadog-prod-us1 Bot

Loading

Benchmark Results (commit `dff357b`)