Repository navigation
Add native BF16 TRELLIS.2 inference - #1636
Open
for-the-juan wants to merge 3 commits into
Open
for-the-juan wants to merge 3 commits into
for-the-juan wants to merge 3 commits into
Conversation
This was referenced Oct 20, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Split from #1628 at reviewer request. Add native BF16 TRELLIS.2-4B inference through LightX2V's runner registry (
i23d). This PR targetsmainindependently and requires no other model PR.scripts/bench/trellis2/README.md.Model graphs, algorithms and operator selection are separate. Platform setup remains in existing
lightx2v_platform; new model code has no vendor imports or branches. Shared dense adapters and measurement code are identical commits in the two split PRs, so they remain one implementation after merging. The other PR is #1635. Central runner/config registration entries may need rebasing after either PR merges; local composition was checked with both models present.Validation
pre-commit run --all-filespassed.These short runs validate the split; they are not a new complete performance measurement. The original complete frozen-cohort measurements are documented with their source revision (
c20b99d) in the guide. The shared event/wall boundaries, alternating A/B order, seeds, input hashes and reductions are preserved; rerun the documented full suite for this checkout's timings.Reproduction and scope
Run from the repository root:
Prepare the frozen inputs first using the guide. Expose one idle device per process. Matrix weights, large matrix/conv operands and attention Q/K/V are BF16; normalization, phase/coordinate arithmetic, accumulation and geometry may be FP32. Coordinates remain integers.
The formal cohort is 40 common-success GSO objects, seed
42 + order, 512, three × 12 steps, excluding the first pair for 39 observations. Events record 36sample_oncecalls per request, reduced within each request then across requests. Wall time includes geometry export and texture voxels. This cohort does not estimate full-dataset success rate.Only 512 and geometry GLB are included; no cascade/1024/1536 or baked textures. Some
segment_reduceoperations fall back to CPU in the tested torch_mlu version. The earlier experimental sparse kernel indexing, missed BF16 decoder storage and FP32 deformable path are corrected. Historical mesh metrics do not apply; full-dataset ground-truth quality has not been reevaluated for the corrected graph.Weights, input data and the vendor runtime/driver remain external prerequisites; no private experiment checkout or patch is needed. Pinned BiRefNet Python files are public model assets, downloaded alongside its weights and loaded locally with
trust_remote_code=True. The complete public GSO archive download was not repeated in this validation; archive/member hashes are enforced by the preparation command. CUDA/A100 and MetaX performance, offload, quantization and distributed inference have not been validated. Full-dataset GT metrics have not been rerun after splitting. Upstream CI status should be checked separately from local validation.