Repository navigation
Add native BF16 VGGT reconstruction - #1635
Open
for-the-juan wants to merge 3 commits into
Open
for-the-juan wants to merge 3 commits into
for-the-juan wants to merge 3 commits into
Conversation
This was referenced Oct 20, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Split from #1628 at reviewer request. Add native BF16 VGGT-1B inference through LightX2V's runner registry (
recon). This PR targetsmainindependently and requires no other model PR.scripts/bench/vggt/README.md.Model graphs, algorithms and operator selection are separate. Platform setup remains in existing
lightx2v_platform; new model code has no vendor imports or branches. Shared dense adapters and measurement code are identical commits in the two split PRs, so they remain one implementation after merging. The other PR is #1636. Central runner/config registration entries may need rebasing after either PR merges; local composition was checked with both models present.Validation
pre-commit run --all-filespassed.These short runs validate the split; they are not a new complete performance measurement. The original complete frozen-cohort measurements are documented with their source revision (
c20b99d) in the guide. The shared event/wall boundaries, alternating A/B order, seeds, input hashes and reductions are preserved; rerun the documented full suite for this checkout's timings.Reproduction and scope
Run from the repository root:
Prepare the frozen inputs first using the guide. Expose one idle device per process. Matrix weights, large matrix/conv operands and attention Q/K/V are BF16; normalization, phase/coordinate arithmetic, accumulation and geometry may be FP32. Coordinates remain integers.
The formal cohort is 36 requests with original ETH3D JPEGs (32/32/26 views, three scenes × 12 repetitions), excluding the first pair for 35 observations. Events time one forward; synchronized wall time covers image reading through CPU predictions. Tracking is outside this integration.
Weights, input data and the vendor runtime/driver remain external prerequisites; no private experiment checkout or patch is needed. CUDA/A100 and MetaX performance, offload, quantization and distributed inference have not been validated. Full-dataset GT metrics have not been rerun after splitting. Upstream CI status should be checked separately from local validation.