> TheAuditor / blog
determinism, reproducibility, ci

Byte-for-Byte: the Same Findings on Windows and Linux

The Windows and Linux binaries now produce byte-for-byte identical output across every test corpus, so a finding on your laptop is provably the same finding in CI and on a teammate's machine.

A security finding you cannot reproduce is a rumor. If the scan on your Windows laptop disagrees with the scan in your Linux CI, somebody has to figure out which one to believe, and the honest answer is neither, because a result that depends on the machine it ran on is not a fact about your code. We just closed that gap all the way.

Sixteen of sixteen, closed

Our cross-OS reproducibility scorecard is now at 16 of 16 test corpora. On each one, the Windows binary and the Linux binary produce byte-for-byte identical output. Not “the same findings in a different order,” not “the same count with minor formatting drift.” Identical bytes: every result table matches exactly across both operating systems, and the run manifest matches once OS-specific fields like absolute paths are normalized. Diff them and nothing comes back.

That is the strongest form of the claim we can make, and it is the only one worth making. A looser standard leaves room for the one difference that turns into an afternoon of investigation.

What that buys you

A finding on your laptop is provably the same finding in CI and on a teammate’s machine. When you flag something locally and it shows up in the pull-request gate, there is no question about whether the pipeline “really” saw it. When a teammate on a different OS pulls your branch, they get your results, not their own dialect of them.

This matters most at the exact moment reproducibility usually breaks: the handoff. Local to CI, one developer to another, this quarter’s audit to next quarter’s. If the output is byte-for-byte stable across operating systems, every one of those handoffs is lossless. The result travels with the code instead of being re-litigated at each stop.

Determinism is the spine, this is the proof

We have said from the start that determinism is the point of pre-computing facts about a codebase. If the facts shift between runs, everything downstream that trusts them, your CI gate, your audit trail, an AI agent caching what it learned, inherits the wobble. Cross-OS byte-for-byte parity is that principle made checkable. You do not have to take determinism on faith. You can run both binaries and diff the bytes.

It also makes the audit trail real. An auditor who reruns last quarter’s scan on whatever OS they happen to have gets last quarter’s result, exactly, not a plausible reconstruction of it.

Honest scope note

This is 16 of 16 across our test corpora, which is the set we control and can hold identical on both platforms. Your codebase is not one of those corpora, and we will not pretend the scorecard is a guarantee about repositories we have never seen. What it does establish is that the engine itself is not a source of drift: when two runs of your code disagree, the OS is ruled out, and that alone removes the most tedious variable from any “why don’t these match” investigation.

Where this sits

Byte-for-byte cross-OS parity is the same guarantee that lets the fast incremental scan return the exact findings of a full one: stable facts, whichever way you asked for them. TheAuditor is the ground-truth layer for Code Reality Labs, kept honest by the independent yardstick at BenchProctor. TheAuditor 5.0 is in final commercial release preparation and ships when its hardening checks pass. Subscribe on the main site for launch news.

Was this useful?