fix: gate loadOtherState validators/balances preload behind opt-in#9245
Merged
fix: gate loadOtherState validators/balances preload behind opt-in#9245
Conversation
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Code Review
This pull request introduces an optional preloadValidatorsAndBalances flag to the loadOtherState method, enabling eager materialization of validator and balance arrays only when necessary, such as during block replay. This change helps avoid significant memory overhead in API paths that only require specific fields. The update includes modifications to the BeaconStateView implementation, its interface, and the persistent checkpoint cache, along with a new unit test. A review comment suggests refactoring the inline options type into a named interface to improve code maintainability.
twoeths
force-pushed
the
te/fix_loadOtherState
branch
from
914f164 to
74b3a11
Compare
twoeths
force-pushed
the
te/fix_loadOtherState
branch
from
74b3a11 to
af04829
Compare
Contributor
Performance Report✔️ no performance regression detected Full benchmark results
|
4 tasks
Contributor
|
Cross-linking from #9246: this PR addresses the API-path memory spike, but there is a separate correctness bug in the same The cache-aliasing bug in The default Why the preload gating in this PR does not fix it The poisoning happens inside
So this PR correctly fixes the memory spike but leaves the correctness bug untouched. Also relevant: Fix #9246 (two-line |
nflaig
approved these changes
Apr 21, 2026
lodekeeper
approved these changes
Apr 21, 2026
Contributor
lodekeeper
left a comment
lodekeeper
left a comment
There was a problem hiding this comment.
LGTM. Surgical fix: gates the eager getAllReadonlyValues() / getAll() preload behind an opt-in flag and only persistentCheckpointsCache (which always consumes the state immediately via block replay) sets it.
Correctness: Interface + impl + single call-site change are consistent. All six other loadOtherState() callers (api/impl/beacon/state, api/impl/validator, api/impl/proof, api/impl/lodestar × 2, plus the unit test) now revert to lazy materialization — restores pre-#8857 semantics on API paths. Optional arg keeps the signature backwards-compatible.
Risk: Low. This just narrows an existing optimization to where it's actually needed.
Independence from #9246: Confirmed — this PR doesn't touch loadState() where the cache-aliasing bug lives, so the two fixes address distinct v1.42.0 regressions (memory spike vs. withdrawal mismatch). Both are needed for the public-node redeploy.
Nice minimal fix 👍
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## unstable #9245 +/- ##
=========================================
Coverage 52.53% 52.53%
=========================================
Files 848 848
Lines 61405 61405
Branches 4525 4525
=========================================
Hits 32259 32259
Misses 29081 29081
Partials 65 65 🚀 New features to boost your workflow:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Main-thread memory spike on
serveHistoricalState: truenodes after #8857#8857 rerouted the API path through
getState()inpackages/beacon-node/src/api/impl/beacon/state/index.tsfrom the lightweightloadState(...)toBeaconStateView.loadOtherState(), which eagerly materializesall validators and balances. That is only needed for
persistentCheckpointsCache.Description
loadOtherState()opt-in via{preloadValidatorsAndBalances: true}. Default is lazy, matching pre-chore: consume BeaconStateView #8857 semantics.persistentCheckpointsCachepasses in this flag as truelodestar/packages/beacon-node/src/api/impl/beacon/state/index.ts
Line 34 in 9fa9f08
AI Assistance Disclosure
This PR was developed with AI assistance (Claude Code).