Add releaseDryRun.sh: CI dry run of the release process by dsmiley · Pull Request #5252 · apache/solr

dsmiley · 2026-10-27T21:33:14Z

🤖 Adds dev-tools/scripts/releaseDryRun.sh, a dry run of the release process for the version in build.gradle (e.g. 11.0.0 on main). It's for the Solr-Smoketest-* Jenkins jobs, which have been broken for months, and it can also be run locally.

Steps, mirroring the release wizard:

logchange.py prepare --commit on a local release-dry-run branch (never pushed). Pretending a real version, rather than a SNAPSHOT, exercises the version-specific checks, e.g. "Release X" in Changes.html.
buildAndPushRelease.py --dev-mode --push-local, unsigned. This also covers Changes.html generation, which moved out of the Gradle build in SOLR-18119 (SOLR-18119: Generate changes HTML only for releases #5180).
smokeTestRelease.py --not-signed against the local RC.

The temp dir defaults to outside the checkout. When the unpacked source release sits inside a git checkout, checkWorkingCopyClean finds the parent repo, which fails the smoke test.

Status: Solr-Smoketest-main runs this script inline. Build #1 passed everything up to and including the source-release tests, then failed on the temp-dir issue above, which is now fixed. Once this merges, the job's shell step becomes dev-tools/scripts/releaseDryRun.sh.

Not covered: signing, svn staging, and publishing.

🤖 Generated with Claude Code

Prepares the changelog on a local branch, builds an unsigned RC with buildAndPushRelease.py, and runs smokeTestRelease.py on it. For the Solr-Smoketest-* Jenkins jobs. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

dsmiley · 2026-10-27T21:39:08Z

I'm looking forward to having the release process (namely smoketester) back to green in CI. And a script we can run locally to validate changes to the smoketester and some other scripts.

If no input; will merge in 48 hours.

dsmiley · 2026-10-27T21:43:39Z

BTW won't merge until https://ci-builds.apache.org/job/Solr/job/Solr-Smoketest-main/ is green. I just updated it to match this bash script.

… it also works pasted inline in Jenkins Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

dsmiley · 2026-10-28T19:59:29Z

there is one quirkiness related to git-status that this script works around by CD'ing to another dir...
I'm sharing that below and a possible solution by modifying git-status.gradle. It's not a current problem with this script because of the script puts the temp dir somewhere else. Nonetheless it's worth considering doing in addition or instead. Sharing Claude's description:

🤖
The problem: checkWorkingCopyClean uses JGit's findGitDir(rootProject.projectDir), which walks up the parent directories. If you unpack a source release (which has no .git) inside another git checkout, it finds the parent repo and compares against it. In Jenkins build #1 the temp dir was inside the workspace clone. The check then failed with "Working copy is not a clean git checkout … .asf.yaml (missing)", because the unpacked tree didn't match the parent repo.

What I worked around: releaseDryRun.sh puts the temp dir outside the workspace (${WORKSPACE}_smoke). That avoids the problem without touching Gradle. Build #4 shows it working: the check now prints only a warning, Directory is not a valid git checkout (won't check dirty files).

The optional change: make git-status.gradle ignore a repo whose work tree isn't rootProject.projectDir. Then the check would behave the same wherever an unpacked source release sits. It would help anyone unpacking a release under a checkout, such as a developer testing locally. I haven't looked closely at how large or safe the change is. It's unneeded for the CI job now, so I'd drop it unless that local case matters to you.

…le before cleanup Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

checkWorkingCopyClean and gitStatus now only consider a git repository rooted at the project dir. Previously an unpacked source release inside another git checkout was compared against the parent's index and reported every file as missing. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

…l unit tests smokeTestRelease.py runs the Gradle task named by SMOKETEST_SRC_TEST_TASK (default test) on the unpacked source release. releaseDryRun.sh sets it to testClasses since unit tests run in the regular CI jobs. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

dsmiley · 2026-10-29T19:21:26Z

Jenkins job passed finally! https://ci-builds.apache.org/job/Solr/job/Solr-Smoketest-main/7/

dsmiley

Will merge tonight.

dsmiley · 2026-10-29T19:29:26Z

+
+pip3 install -r dev-tools/scripts/requirements.txt
+
+[[ -e "$TMP_ROOT" ]] && chmod -R u+w "$TMP_ROOT"


this was quirky... had to do because our release process actually goes out of its way to remove the write permission! No justification given.

dsmiley · 2026-10-29T19:29:49Z

+set -euo pipefail
+cd "$(git rev-parse --show-toplevel)"
+
+TMP_ROOT="${1:-${WORKSPACE:-$(pwd)}_smoke}"


a sibling dir.

dsmiley · 2026-10-29T19:30:21Z


-  print("    run tests w/ Java %s and testArgs='%s'..." % (java.version, testArgs))
-  java.run_java('./gradlew test %s' % testArgs, '%s/test.log' % logDir)
+  # SMOKETEST_SRC_TEST_TASK lets CI swap the full test run for something lighter


small feature here to run this without running all tests

dsmiley · 2026-10-29T19:33:00Z

+  // (e.g. an unpacked source release inside a clone).
+  def findGitRepository = {
+    if (!rootProject.file(".git").exists()) {
+      throw new RepositoryNotFoundException(rootProject.projectDir)


note: will be caught; not a new failure scenario

It's for the Solr-Smoketest-* Jenkins jobs. * smokeTestRelease.py: SMOKETEST_SRC_TEST_TASK to reduce/eliminate unit tests to run * git-status.gradle: allow source only execution in a subdirectory of another git checkout Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> (cherry picked from commit d5d7df9)

Add releaseDryRun.sh: CI dry run of the release process

e3a8c4c

Prepares the changelog on a local branch, builds an unsigned RC with buildAndPushRelease.py, and runs smokeTestRelease.py on it. For the Solr-Smoketest-* Jenkins jobs. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

github-actions Bot added the scripts label Oct 27, 2026

dsmiley requested a review from janhoy October 27, 2026 21:37

dsmiley added the no-changelog label Oct 27, 2026

releaseDryRun.sh: cd to the git toplevel of the current directory, so…

b9ccd37

… it also works pasted inline in Jenkins Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

dsmiley and others added 3 commits October 28, 2026 21:57

releaseDryRun.sh: make the previous run's read-only dist tree deletab…

b834216

…le before cleanup Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

github-actions Bot added the tool:build label Oct 29, 2026

Merge remote-tracking branch 'apache/main' into releaseDryRun

6ff7f1e

dsmiley commented Oct 29, 2026

View reviewed changes

dsmiley merged commit d5d7df9 into apache:main Nov 2, 2026
3 checks passed

dsmiley deleted the releaseDryRun branch November 2, 2026 14:32

dsmiley added this to the 10.x milestone Nov 3, 2026

Navigation Menu

Repository navigation

Add releaseDryRun.sh: CI dry run of the release process - #5252

Add releaseDryRun.sh: CI dry run of the release process#5252
dsmiley merged 6 commits into
apache:mainfrom
dsmiley:releaseDryRun

dsmiley commented Oct 27, 2026

Uh oh!

dsmiley commented Oct 27, 2026

Uh oh!

dsmiley commented Oct 27, 2026

Uh oh!

dsmiley commented Oct 28, 2026

Uh oh!

dsmiley commented Oct 29, 2026

Uh oh!

dsmiley left a comment

Uh oh!

dsmiley Oct 29, 2026

Uh oh!

dsmiley Oct 29, 2026

Uh oh!

dsmiley Oct 29, 2026

Uh oh!

dsmiley Oct 29, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant


		pip3 install -r dev-tools/scripts/requirements.txt

		[[ -e "$TMP_ROOT" ]] && chmod -R u+w "$TMP_ROOT"

Conversation

dsmiley commented Oct 27, 2026

Uh oh!

dsmiley commented Oct 27, 2026

Uh oh!

dsmiley commented Oct 27, 2026

Uh oh!

dsmiley commented Oct 28, 2026

Uh oh!

dsmiley commented Oct 29, 2026

Uh oh!

dsmiley left a comment

Choose a reason for hiding this comment

Uh oh!

dsmiley Oct 29, 2026

Choose a reason for hiding this comment

Uh oh!

dsmiley Oct 29, 2026

Choose a reason for hiding this comment

Uh oh!

dsmiley Oct 29, 2026

Choose a reason for hiding this comment

Uh oh!

dsmiley Oct 29, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant