Files
solvecraft/docs/render-vndf-prototype.md
selune 9e6e0b8df1 Render workspace: complete experimental ribbon, resources and effects integration (#5493) (#5494)
* wip(render): reconcile completed material and image pipeline source with 0.20 (#5493)

Source-only integration reference for staged review, not a merge-ready aggregate.
Donor: 0xlillith/solidcraft@aea20b0115.
Upstream: 858e5995d6.

Retain original CPU/material contracts and explicit GPU donor provenance in
docs/render-materials-lab.md (#2067, #2191, #2780, #3306). Preserve released
format migrations and current navigation/startup/shell behavior. New saved
records use pending descriptors. The physical-card descriptor follows the
maintainer's material-engineering-cards naming request, with a legacy-lab
format-29 regression. Replace raw new panel hosts with shared containers.

Repository checks, complete workspace/all-target Clippy, and the independent
physical/resource authoring checks pass for this source. The fresh full local
CI invocation has reached test compilation and is not yet complete. Do not
transfer donor native output or prior test totals to this integration.

Generated review screenshots, video, package ZIP and machine logs remain at
the immutable personal evidence pin. Uncommitted geometric displacement is
backed up separately, not silently included. No kernel/vendor change, direct
main write, release or independent contributor-branch rewrite.

Co-authored-by: Christian Svensson <blue@cmd.nu>

* test(cli): pin the Compact camera-sample admission diagnostic (#5493)

The bounded request still refuses 1024x1024x64 samples before host initialization and writes no output. Update only the stale expected diagnostic to the existing Compact budget wording; production limits and code are unchanged. Exact-tree CLI regression suite: 14 passed, 0 failed. The full repository gate has been invoked separately and is not yet complete.

* Normalize UI container violation paths across platforms

Report repository-relative paths with forward slashes so diagnostics and the existing nested-package regression assertions agree on Windows and Unix. Keep the container detection rules unchanged.

Validation: official ui-containers gate and all seven focused xtask tests passed; rustfmt and diff checks passed. Only xtask/dependencies were compiled; no application build or heavy tests.
(cherry picked from commit 44b58d8e10)

* fix(render): preserve camera contracts and correct acceptance regressions (#5493)

Preserve Design view.apply semantics with a separate strict Render camera command. Retain existing translations when English-only aliases collide; add material-axis entries and camera-specific pitch labels. Compare complete validated engineering cards and retain job handles before cancellation.

Focused and native acceptance is pinned to tree f8a423b21f. Full CI has been invoked separately and is not claimed green. Landing follows the render integration policy in #5493.

* fix(render): resolve showcase licence and upstream resource hygiene (#5493)

Record SychPL's explicit MIT OR Apache-2.0 grant, retaining source/model bytes and the Ubuntu lettering notice. Remove 80 absent attribution rows, personal fork records, dead delivery attributes and three fork/resource-only workflows. Existing xtask assets now performs bounded offline hash checks and rejects orphan render attribution; no parallel draft CI or package installation. Original authoring reproduction remains explicit. Scoped xtask tests, assets, Clippy, formatting and prepared SELENE validation pass; no application or renderer-wide result is inferred.

* fix(render): align saved bounds and progressive sample resolution (#5493)

Address review r4364211669/r4364211677/r4364211681/r4364211691/r4364211695. Persisted light/frame domains respect the existing 1e9 document bound; related LED/rectangle/direction cases use the same bound. Workstation primary resolve shares the 4096 admission cap and film counters use checked conversions. Exact candidate: 485 CPU render tests, 21 render document tests and strict scoped Clippy pass, including positive boundary round trips and 2048/4096 end-to-end checkpoints. No released format/migration edits, relaxed test limits or full-stack acceptance claim.

* wip(render): isolate optional resources and harden sample handling (#5493)

Review work in progress: opt-in encoded render library with reproducible runtime catalog exports; native-only robust dependency through the workspace; checked bloom slices; per-sample point-light diagnostics; independent area-light spatial/film keys. Resource-module binaries in both configurations, generation, Cargo production feature graphs and attribution checks pass. Full engine/render regression and combined acceptance are pending: do not merge this donor as a constituent or treat scoped resource proof as runtime acceptance.

* fix(gpu): preserve donor allocations through the scope-safety repair (#5722)

Port the native-validated #5723 scope-cleanup correction into the experimental donor, retaining its adaptive, volume, aging, photographic and bloom allocations. Same reverse-drain helper and regression cases; the donor combination still needs its own compile/test gate and is not covered retroactively by render-base results.

* claim: #1369

* Reject unknown pending concepts after format folding (#1369)

* test(render): close bounded sampling and bloom review regressions (#5493)

Validate the optional-resource/lighting/dependency donor at its exact tree. Required Vulkan GPU 127/0/3; CPU renderer 487/0; engine Render 72/0; document render 21/0; lean library 7/0; strict scoped Clippy, assets/layers/lists/containers and lean-engine WASM pass. Preserve original failed controller/typing attempts. This is the draft donor/disposition source, not a replacement for constituent render PRs or final main acceptance.

* wip(render): preserve stable aging target validation candidate

Exact staged source from prior review work on donor 3b892eab5e. This is a recovery/review checkpoint, NOT accepted delivery. An actual command-path regression currently fails because the selected executor refuses ordered surface aging. No assertion, capability or admission limit is weakened. Native/UI/full combination acceptance remains pending. Saved/runtime split adds one pending descriptor and retains original file scope; no main/render branch is changed.

* test(render): preserve numeric setup intent at the admitted coordinate bound

Follow up jyviko review on #5494 without weakening the corrected saved-coordinate contract. The positive clicked fixture uses 1e9 instead of inadmissible 2e9; explicit out-of-range cases still refuse, and the full saved setup round-trips through JSON and the native container. Exact-source Render workspace 95/0 and strict all-target UI Clippy pass. This does not incorporate the separately failing stable-aging candidate or claim full current-render acceptance.

* test(render): use the real GPU executor for saved aging

Move successful native cold-reopen Check/Start coverage from the CPU-backed protocol fixture into the production GPU executor tests. Verify capture-index changes preserve the stable target and that enabling aging changes both PNG and raw EXR output. Retain explicit, allocation-free refusal coverage for executors without aging support. Production capabilities and admission checks are unchanged.

* fix(render): persist stable identities for targeted aging (#5493)

Separate saved RenderBodyTarget identities from captured mesh ordinals. Reject legacy ambiguous targets, resolve Check/Start after visibility changes and preserve native reopening, copies and undo. Unsupported executors still refuse; real AMD Vulkan regression completes saved aging after reordered capture.

Source tree 6b84c8ad passes document 23, engine Render 75, GPU effects 5 and Render UI 95 with no failures; scoped strict Clippy, WASM and repository gates pass. Fresh CLI/native reopen and clean/aged GPU exports pass with identical physical totals and inspected actual images. Whole current-render integration is separate.

* fix(render): reconcile combined CPU/GPU contracts on current upstream

Unify captured resources/status and CPU-vs-GPU request schemas after the real two-parent integration; remove obsolete duplicate Vulkan selector and retain combined platform-filter regression. Deduplicate only identical or superseded test definitions, retaining the stronger card metadata and reserved-executor assertions. No assertions, admission limits or feature refusals are weakened.

All targets of render dependencies, GPU, engine, UI, CLI and native app pass cargo check with raytrace-cpu and bundled-render-library at tree c70d00d1. Native executable tests and full current-source acceptance remain pending. This is a private integration rehearsal for subsequent constituent PRs, not an aggregate official render/main merge.

* test(render): retain one complete host lifetime regression set

Deduplicate byte-identical DropProbe/task-lifetime tests and retain the adapted environment/texture ownership regressions with every assertion and complete memory estimate. Keep the registered-geometry admission regression once; only struct field order differed. Replace a one-element diagnostic loop with its equivalent block, preserving all wrap/width assertions.

Test-only integration repair. Formatting and diff checks pass; refreshed executable validation is required. No production behavior, limits, assertions or ignores changed.

* fix(doc): recognize the proven format-29 card descriptor alias

Normalize only the historical format-29 physical-material-cards spelling, and only when material-engineering-cards is registered. Admission and migration de-duplication use the same identity. Unknown concepts, wrong versions and incapable readers still refuse before mutation. Six controlled-history Rust regressions and actual CLI migration/no-clobber acceptance pass. No version, released migration or CI changes. Refs #5793, #1369, #5493.

* test(render): preserve grounding refusal before explicit instance moves

Update the two Render binding fixtures for upstream first-occurrence grounding. Verify grounded movement refuses without changing document/history, then explicitly unground through the public command before the intended move. Retain every target, resource, copy and persistence assertion. Refs #5493.

---------

Co-authored-by: Christian Svensson <blue@cmd.nu>
Co-authored-by: Victor Santos Oliveira <56417388+Vittuu@users.noreply.github.com>
Co-authored-by: cfaulkingham <colin.faulkingham@gmail.com>
2026-10-24 14:21:59 +00:00

8.2 KiB
Raw Permalink Blame History

Matched GGX visible-normal proposal (#1658)

Recovered VNDF source port, connected to the CPU image consumer. The tests are written but have not run on this combined CPU/GPU2 revision. No measured variance reduction or visual acceptance follows from this document. The exact integration baseline and recovered source identity are recorded in advanced CPU integration.

This change does not diagnose the prior bright pixels as a PDF bug: the prior projected-NDF sampler and its PDF were matched.

Mathematical contract

Keep the existing opaque specular BSDF: Schlick F, GGX D, perceptual roughness squared to alpha, and separable Smith G2=G1(v)G1(l). Let c_v=n.v>0 and c_l=n.l>0, with h=normalize(v+l) and v.h>0. Define S(v)=G1(v)/c_v, evaluated without dividing by c_v:

S(v) = 2 / (v_z + sqrt(v_z² + (alpha_x v_x)² + (alpha_y v_y)²))
p_visible(h|v) = D(h) S(v) max(v.h,0)
p(l|v) = p_visible(h|v)/(4 v.h) = D(h) S(v)/4
f_spec(v,l) = F(v.h) D(h) S(v) S(l)/4
f_spec(v,l) c_l / p(l|v) = F(v.h) G1(l)

Thus no tiny view-cosine or half-vector-cosine division is needed in the weight. This cancellation requires the same distribution, visibility convention and Fresnel law in sampling, PDF and BSDF. It does not apply unchanged to a height-correlated Smith G2, transmission or a diffuse/specular mixture. For admitted reflectance and valid unit directions, each channel of F*G1(l) is mathematically in [0,1]; it is not clamped. HDR radiance and remaining lighting estimators can still cause strong variation.

Original construction from the spherical-cap equations

In the visual frame let A=diag(alpha_x,alpha_y,1) and w=normalize(A v). For two uniform variates (u,t) in [0,1), choose phi=2pit and z=1-u*(1+w_z). Uniform azimuth and uniform z give a uniform solid-angle direction c on the cap z in [-w_z,1]. Its density is 1/(2pi(1+w_z)). The visible unit-roughness normal is proportional to w+c. The desired normal is therefore normalize(A(w+c)); intermediate normalization cancels.

The prototype computes the radial component as sqrt((1-z)(1+z)) and the vertical sum directly as (1-u)(1+w_z). The latter avoids subtracting and then re-adding w_z near the lower cap boundary. No disk-radicand clamp, weight clamp, rejection loop, retry or conditional density is introduced. Finite-precision support at arbitrary tilted frames remains a review and execution requirement, not a universal numerical proof.

Production route and controls

The proposed isotropic rough_specular wrapper and planar anisotropic adapter call sample_visible_reflection; they use the matching visible-reflection PDF. The shared anisotropic implementation covers equal axes too. The delta mirror function is unchanged. Existing projected-NDF methods sample_normal, normal_pdf, reflection_pdf and sample_reflection retain their contracts and assertions as explicit legacy numerical controls. The previous isotropic implementation is retained only as rough_specular_ndf under cfg(test). Their earlier passes do not certify the new production VNDF route.

Below-shading/geometric-hemisphere reflections remain null events. Every null attempt counts in R and the original final divisor. The receiver's variates, R in 1..64, primary samples S in 1/4/16, bounce limits, captured selectors, host pool, Record lease, work/cancel debits, geometry, environment partition and radiance caps are unchanged. Default S=1 retains its deterministic-primary reuse policy; S>1 completes all S*R attempts. Existing directional, punctual, rectangle/LED and HDR continuations retain their reset and ownership policies. Actual outgoing paths, null counts and traversal work can differ. No equal-work or all-noise-resolved claim is made. No MIS, HDR importance sampling, filtering, new primary anti-aliasing policy or new persistence is installed by this delta.

New written checks and required review

New tests target the actual VNDF APIs and production wrapper: normal-incidence mean 1-ln(2), second moment 3-4ln(2), half-null mass, unit-alpha grazing cap density and acceptance, unchanged-BSDF throughput, anisotropic rotation, finite open endpoints/subnormal grazing, PDF support and density normalization. The original ten regressions remain, including cancellation and exhausted work after a rough spawn across R=1/4/16/64. A spawn alone is not a second-body hit. Five additional tests cover the previously identified source-coverage gaps:

  • Rotation about an arbitrary three-component axis checks direction, PDF, throughput and geometric rejection away from unresolved boundaries. A separate tilted test covers both sides of a resolved 1e-6/1e-9 horizon and near-opposition cap endpoints, including u=next_down(1). It checks finite outcomes and explicit support; it does not certify signs of subnormal elevations lost when added to O(1) world coordinates.
  • For unequal axes at normal incidence, acceptance has the independent value 1/sqrt((1+alpha_x^2)*(1+alpha_y^2)). The radial acceptance threshold is u < 1/(1+alpha_x^2*cos(phi)^2+alpha_y^2*sin(phi)^2); integrating azimuth gives that value. Solid-angle quadrature checks normal-density mass one and outgoing-density mass equal to acceptance, with nulls counted separately. A grazing unequal-axis case adds an independently tilted geometric rejection plane and compares outgoing PDF mass with accepted attempts. Its finite-grid 0.01 agreement gate is not a universal quadrature-error bound. The sampled BSDF check and original moment assertions retain their prior tolerances.
  • A real ImageTask fixture puts the camera and selected reflector inside a separate inward-facing box. Every accepted secondary must resolve body1; no spawn flag substitutes for that identity check. It records distinct primary attempts, actual secondary spawns and resolved second-body hits for S=1/4/16 and R=1/4/16/64, requires all S*R attempts before pixel publication, checks null attempts at unit roughness, and completes/decodes the PNG.

The current planar bridge rebuilds its frame from the oriented geometric normal and captured visual tangent; that receiver behavior is preserved. Its existing exact-equality regression now calls the visible-normal reference API, retaining every equality/rotation/reciprocity assertion. Projected-NDF controls remain explicit and unchanged. All fifteen VNDF tests are WRITTEN, NOT RUN.

Independent numerical review and actual execution must verify the cap measure/Jacobian, Smith separability, no accidental NDF production path, geometric rejection, extreme arithmetic and null accounting. Future separately allocated gates must compile default/feature modes, run old controls and new VNDF tests, strict Clippy, wasm and required full CI on the final receiver. Only then compare actual matched images and measure error/work with appropriate references. The foundation publication is not held hostage by this unqualified follow-up.

Primary references and licence scope

  • Eric Heitz, Sampling the GGX Distribution of Visible Normals, JCGT 7(4), 2018, revised 2019: paper, equations 1–3 and 15–19. The paper states CC BY-ND 3.0 on its last page.
  • Jonathan Dupuy and Anis Benyoub, Sampling Visible GGX Normals with Spherical Caps, 2023: primary paper, equations 5–10 and the ellipsoid transformation. Its arXiv version states CC BY 4.0.

Paper equations and displayed listings were consulted. Rust code here is an original implementation from the equations and the derivation above; no source listing, figure or paper prose is copied into the repository. No supplemental implementation repository, GPL-family source or Blender source was consulted. No dependency is added. Original code remains MIT OR Apache-2.0 under the project contribution licence; paper licences are not relicensed as project code.

Landed numerical foundation versus this advanced candidate

The numerical foundation is already in the basic Render delivery through #1658. The CPU consumer and the additional experimental work above remain part of #5494. Historical validation notes retain their original source pins; the current combined source requires its own acceptance. The two delivery scopes are not equivalent.