Files
solvecraft/docs/render-hdr-reflections-integration.md
selune 9e6e0b8df1 Render workspace: complete experimental ribbon, resources and effects integration (#5493) (#5494)
* wip(render): reconcile completed material and image pipeline source with 0.20 (#5493)

Source-only integration reference for staged review, not a merge-ready aggregate.
Donor: 0xlillith/solidcraft@aea20b0115.
Upstream: 858e5995d6.

Retain original CPU/material contracts and explicit GPU donor provenance in
docs/render-materials-lab.md (#2067, #2191, #2780, #3306). Preserve released
format migrations and current navigation/startup/shell behavior. New saved
records use pending descriptors. The physical-card descriptor follows the
maintainer's material-engineering-cards naming request, with a legacy-lab
format-29 regression. Replace raw new panel hosts with shared containers.

Repository checks, complete workspace/all-target Clippy, and the independent
physical/resource authoring checks pass for this source. The fresh full local
CI invocation has reached test compilation and is not yet complete. Do not
transfer donor native output or prior test totals to this integration.

Generated review screenshots, video, package ZIP and machine logs remain at
the immutable personal evidence pin. Uncommitted geometric displacement is
backed up separately, not silently included. No kernel/vendor change, direct
main write, release or independent contributor-branch rewrite.

Co-authored-by: Christian Svensson <blue@cmd.nu>

* test(cli): pin the Compact camera-sample admission diagnostic (#5493)

The bounded request still refuses 1024x1024x64 samples before host initialization and writes no output. Update only the stale expected diagnostic to the existing Compact budget wording; production limits and code are unchanged. Exact-tree CLI regression suite: 14 passed, 0 failed. The full repository gate has been invoked separately and is not yet complete.

* Normalize UI container violation paths across platforms

Report repository-relative paths with forward slashes so diagnostics and the existing nested-package regression assertions agree on Windows and Unix. Keep the container detection rules unchanged.

Validation: official ui-containers gate and all seven focused xtask tests passed; rustfmt and diff checks passed. Only xtask/dependencies were compiled; no application build or heavy tests.
(cherry picked from commit 44b58d8e10)

* fix(render): preserve camera contracts and correct acceptance regressions (#5493)

Preserve Design view.apply semantics with a separate strict Render camera command. Retain existing translations when English-only aliases collide; add material-axis entries and camera-specific pitch labels. Compare complete validated engineering cards and retain job handles before cancellation.

Focused and native acceptance is pinned to tree f8a423b21f. Full CI has been invoked separately and is not claimed green. Landing follows the render integration policy in #5493.

* fix(render): resolve showcase licence and upstream resource hygiene (#5493)

Record SychPL's explicit MIT OR Apache-2.0 grant, retaining source/model bytes and the Ubuntu lettering notice. Remove 80 absent attribution rows, personal fork records, dead delivery attributes and three fork/resource-only workflows. Existing xtask assets now performs bounded offline hash checks and rejects orphan render attribution; no parallel draft CI or package installation. Original authoring reproduction remains explicit. Scoped xtask tests, assets, Clippy, formatting and prepared SELENE validation pass; no application or renderer-wide result is inferred.

* fix(render): align saved bounds and progressive sample resolution (#5493)

Address review r4364211669/r4364211677/r4364211681/r4364211691/r4364211695. Persisted light/frame domains respect the existing 1e9 document bound; related LED/rectangle/direction cases use the same bound. Workstation primary resolve shares the 4096 admission cap and film counters use checked conversions. Exact candidate: 485 CPU render tests, 21 render document tests and strict scoped Clippy pass, including positive boundary round trips and 2048/4096 end-to-end checkpoints. No released format/migration edits, relaxed test limits or full-stack acceptance claim.

* wip(render): isolate optional resources and harden sample handling (#5493)

Review work in progress: opt-in encoded render library with reproducible runtime catalog exports; native-only robust dependency through the workspace; checked bloom slices; per-sample point-light diagnostics; independent area-light spatial/film keys. Resource-module binaries in both configurations, generation, Cargo production feature graphs and attribution checks pass. Full engine/render regression and combined acceptance are pending: do not merge this donor as a constituent or treat scoped resource proof as runtime acceptance.

* fix(gpu): preserve donor allocations through the scope-safety repair (#5722)

Port the native-validated #5723 scope-cleanup correction into the experimental donor, retaining its adaptive, volume, aging, photographic and bloom allocations. Same reverse-drain helper and regression cases; the donor combination still needs its own compile/test gate and is not covered retroactively by render-base results.

* claim: #1369

* Reject unknown pending concepts after format folding (#1369)

* test(render): close bounded sampling and bloom review regressions (#5493)

Validate the optional-resource/lighting/dependency donor at its exact tree. Required Vulkan GPU 127/0/3; CPU renderer 487/0; engine Render 72/0; document render 21/0; lean library 7/0; strict scoped Clippy, assets/layers/lists/containers and lean-engine WASM pass. Preserve original failed controller/typing attempts. This is the draft donor/disposition source, not a replacement for constituent render PRs or final main acceptance.

* wip(render): preserve stable aging target validation candidate

Exact staged source from prior review work on donor 3b892eab5e. This is a recovery/review checkpoint, NOT accepted delivery. An actual command-path regression currently fails because the selected executor refuses ordered surface aging. No assertion, capability or admission limit is weakened. Native/UI/full combination acceptance remains pending. Saved/runtime split adds one pending descriptor and retains original file scope; no main/render branch is changed.

* test(render): preserve numeric setup intent at the admitted coordinate bound

Follow up jyviko review on #5494 without weakening the corrected saved-coordinate contract. The positive clicked fixture uses 1e9 instead of inadmissible 2e9; explicit out-of-range cases still refuse, and the full saved setup round-trips through JSON and the native container. Exact-source Render workspace 95/0 and strict all-target UI Clippy pass. This does not incorporate the separately failing stable-aging candidate or claim full current-render acceptance.

* test(render): use the real GPU executor for saved aging

Move successful native cold-reopen Check/Start coverage from the CPU-backed protocol fixture into the production GPU executor tests. Verify capture-index changes preserve the stable target and that enabling aging changes both PNG and raw EXR output. Retain explicit, allocation-free refusal coverage for executors without aging support. Production capabilities and admission checks are unchanged.

* fix(render): persist stable identities for targeted aging (#5493)

Separate saved RenderBodyTarget identities from captured mesh ordinals. Reject legacy ambiguous targets, resolve Check/Start after visibility changes and preserve native reopening, copies and undo. Unsupported executors still refuse; real AMD Vulkan regression completes saved aging after reordered capture.

Source tree 6b84c8ad passes document 23, engine Render 75, GPU effects 5 and Render UI 95 with no failures; scoped strict Clippy, WASM and repository gates pass. Fresh CLI/native reopen and clean/aged GPU exports pass with identical physical totals and inspected actual images. Whole current-render integration is separate.

* fix(render): reconcile combined CPU/GPU contracts on current upstream

Unify captured resources/status and CPU-vs-GPU request schemas after the real two-parent integration; remove obsolete duplicate Vulkan selector and retain combined platform-filter regression. Deduplicate only identical or superseded test definitions, retaining the stronger card metadata and reserved-executor assertions. No assertions, admission limits or feature refusals are weakened.

All targets of render dependencies, GPU, engine, UI, CLI and native app pass cargo check with raytrace-cpu and bundled-render-library at tree c70d00d1. Native executable tests and full current-source acceptance remain pending. This is a private integration rehearsal for subsequent constituent PRs, not an aggregate official render/main merge.

* test(render): retain one complete host lifetime regression set

Deduplicate byte-identical DropProbe/task-lifetime tests and retain the adapted environment/texture ownership regressions with every assertion and complete memory estimate. Keep the registered-geometry admission regression once; only struct field order differed. Replace a one-element diagnostic loop with its equivalent block, preserving all wrap/width assertions.

Test-only integration repair. Formatting and diff checks pass; refreshed executable validation is required. No production behavior, limits, assertions or ignores changed.

* fix(doc): recognize the proven format-29 card descriptor alias

Normalize only the historical format-29 physical-material-cards spelling, and only when material-engineering-cards is registered. Admission and migration de-duplication use the same identity. Unknown concepts, wrong versions and incapable readers still refuse before mutation. Six controlled-history Rust regressions and actual CLI migration/no-clobber acceptance pass. No version, released migration or CI changes. Refs #5793, #1369, #5493.

* test(render): preserve grounding refusal before explicit instance moves

Update the two Render binding fixtures for upstream first-occurrence grounding. Verify grounded movement refuses without changing document/history, then explicitly unground through the public command before the intended move. Retain every target, resource, copy and persistence assertion. Refs #5493.

---------

Co-authored-by: Christian Svensson <blue@cmd.nu>
Co-authored-by: Victor Santos Oliveira <56417388+Vittuu@users.noreply.github.com>
Co-authored-by: cfaulkingham <colin.faulkingham@gmail.com>
2026-10-24 14:21:59 +00:00

9.6 KiB

HDR radiance in scene reflections (#1693 + #1658)

This document records the shared CPU HDR/reflection contract and its recovered follow-ups. The personal rendering branch now ports that work onto the combined CPU/GPU2 snapshot described in advanced CPU integration. VNDF, spatial AA, surface effects, visible emission and the bounded dielectric path are integrated source, but their exact-revision execution and visual acceptance remain pending. Historical checks do not qualify this new combination.

Disjoint lighting paths

A camera ray that misses geometry still writes the requested background exactly. It does not see the environment emitter and does not pass that background through exposure. A reflected secondary ray that misses geometry reads the existing owned environment through radiance_linear_srgb(direction) and adds throughput * Li to its linear path radiance. Reflection sampling already put specular_BRDF * incident_cosine / matching_PDF into that throughput; do not divide by a second environment PDF at the miss. Mirror is an explicit delta event with its existing Fresnel weight, independent of minimum roughness.

Selected mirror/rough reflectors receive no environment next-event estimate. Nonselected opaque hits retain the existing environment direct-light estimator and visibility. This partitions the environment contribution at each hit, without MIS or double counting the same specular environment paths. Existing directional direct lighting remains separate: there is no emissive geometry or infinite directional-light intersection on a reflected miss. At the fixed bounce cap, untraced continuation is discarded, as in the original finite-depth preview.

The first HDR+rough combination admits only fully metallic (metallic == 1) selected bodies and every effective face override. Dielectric, partly metallic or scalar face responses refuse in engine preflight, host admission and direct task construction. This conservative body-wide check also refuses a mixed body whose unvisited face is nonmetallic. Without this restriction, omitting the environment next-event term would silently lose diffuse illumination. Supporting those responses requires an explicit diffuse/specular partition or validated MIS. Explicit mirrors retain their declared ideal-reflection/Fresnel intent.

The foundation retained the pinned reflection unit's projected-NDF GGX proposal. The separate VNDF follow-up replaces its production proposal and outgoing PDF together, with the same BSDF and null accounting; its source-only checks do not transfer foundation validation. The integrated planar anisotropic adjunct replaces only the selected face's matched rough sampler and directional direct BRDF. There is no retry, PDF renormalization or diffuse-over- specular-PDF mixture. Both samplers preserve the same HDR miss contract.

Reflection sequence and deterministic primary reuse

The reflection variate generator receives the actual requested count R in 1..64 and rejects ordinals outside that count. It visits each radial stratum once using a shared 32-bit midpoint jitter, with a pixel/bounce digital shift of a base-two radical-inverse azimuth. Both coordinates remain strictly open. Exact dyadic azimuth coverage applies only to power-of-two R; other counts retain radial coverage only. Changing R changes the radial sequence, so there is no progressive prefix, independent-draw, unbiasedness or universal variance-reduction guarantee.

The variate sequence itself changes no mapping, PDF or specular weight; the matched VNDF follow-up is separate. Null-event accounting remains unchanged. Every null attempt still contributes zero to the original R divisor. R-attempt and bounce bounds are unchanged; actual outgoing paths, null outcomes and work can differ with the directions. Five new source tests exercise the production generator, including the white-conductor mean 1-ln(2), second moment 3-4ln(2) and a derived 1/R quadrature bound for that specific monotone fixture. Existing tests that retain the test-only hash control do not certify the new generator. The production image's independent weight check uses the new sequence.

The primary generator uses a fixed center for one sample, or a fixed 2x2/4x4 grid for spatial AA. Within one spatial sample, a completed nonselected primary surface's direct/environment shading can be reused across reflection samples, while retaining the original ordered scalar sums, per-add radiance bound, divisor and single display transform. See primary AA. Selected reflectors and secondary paths retain their full sampling. Future jitter, film or time-varying inputs must revoke that repeatability proof. No antialiasing or film capability follows from this optimization. Seven source tests cover its color, work and refusal contracts; none has executed on this central candidate. Equal-R visible quality and actual-work comparisons remain required for the new reflection sequence.

Ownership, budgets and colour

The same captured source, decoder, decoded pixels, host pool and work budget are used. RaytraceOptions::retained_bytes now accounts for original light capacities, reflection selector slots and selector string capacities in one calculation used by engine preflight and host admission. Fixed HDR capture metadata keeps the Record lease; captured image storage stays under the work lease and is released before PNG publication. The combined 384 MiB job limit and 512 MiB pool remain.

One existing decoder state is held in a fallibly allocated capacity-one vector, with a checked 4096-byte state bound, covered by the existing 8192-byte HDR state allowance. This keeps its scanline-scale array out of the image task's inline metadata as the reflection cursor state grows. It is not another decoder, cache, loader, worker or pool. Actual vector capacity must be one. Completion drops that slot; decoded/scanline capacities and source capacities retain their prior checks. A source regression checks the combined image task fits its 4096-byte host slot; that test has NOT RUN.

Preparation, traversal and reflection continuation charge the shared cumulative work budget and observe cancellation. Cursor-to-shading transitions yield before another debit. HDR misses remain linear; finite radiance caps apply before the sample average and single exposure/Reinhard/sRGB output transform. Primary background is independent. Only explicit sRGB/D65 HDR primaries are admitted; default/unknown Radiance primaries and unsupported optics remain refused.

Added source regressions and remaining validation

Five source tests cover: a white ideal mirror receiving constant HDR exactly once; unchanged camera background; rough-metal output from independent normal-view GGX sample weights and deterministic variates; a broad bright cell rotating in world space; rejection of mixed/diffuse rough responses; retained selector capacities/task layout; and cancellation/work exhaustion during secondary transport. All previous HDR and reflection test sources are retained unchanged. These tests have NOT RUN, and the prepared PNG comparisons are not screenshots.

Before publication, integrate real prerequisite history, run the combined default/feature checks, Clippy/wasm and required project gates, then produce and inspect exact-build native images. The original constant and bright-cell HDR fixtures carry MIT OR Apache-2.0 attribution; no external assets are added here.

Planar anisotropic hooks (source only)

The Kernel-authored core and PlanarTarget::sample bridge are adopted from pinned #1694 source; its reference ImageTask is not copied. One image task captures an authoritative optional mesh face tag per primitive, binds at most two targets by captured body ordinal AND exact body name AND face tag, and caches their validated planar frames. A missing tag or identity mismatch refuses instead of retargeting by plane geometry. Strict planarity can conservatively refuse imported/rotated roundoff. Face appearance surface: None replaces body PBR with the scalar response; it never inherits a metal response for admission.

At a rough selected hit, a bound target supplies the existing matched anisotropic specular direction/PDF/weight. Equal axes delegate the existing isotropic sampler. Other faces use the original rough sampler. Directional direct light uses the bound anisotropic BRDF. HDR next-event lighting is still isotropic, so HDR plus anisotropy on a non-reflector is rejected in preflight/host/task. The supported HDR combination requires a rough reflection selection and the same fully metallic body/ALL-face rule. A delta mirror plus anisotropic rough axes is rejected even without HDR. No anisotropic HDR direct estimator is advertised.

Original target-name capacities join the same retained request calculation and Record lease. Fixed cached targets and request clones fit the conservative bounded state allowance; primitive face tags are included in actual primitive size. Task construction repeats at most two 4096-triangle target validations, debiting the existing cumulative work/cancellation callback. Pixel traversal and sampling keep the existing one-unit yields, including secondary hits and final shadows.

The prior five HDR/reflection tests remain, with three added combination tests: equal-axis HDR reflection matches isotropic PNG bytes; unsupported direct/mirror combinations refuse; and an actual anisotropic secondary hit into another body yields within one unit (four per public quantum) and observes cancellation. Kernel's core/face tests and v4 continuation regressions are also retained from pinned source. Every added/adopted test is NOT RUN in this integration. Independent source review and the combined execution/visual gates remain pending.