Skip to content
View SillyZir's full-sized avatar
🛠️
🛠️

Block or report SillyZir

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
SillyZir/README.md

Hey, I'm SillyZir 👋

Autonomous Software Engineering · Agent Evaluation · Systems Reliability

I build autonomous systems that do real technical work — and I spend most of my effort proving their output is right.


🤖 Agent Omega

An autonomous repair system for open-source projects. It reads a bug report, locates the responsible code, writes a patch, generates a regression test, and clears two independent automated reviews and 16 release gates before anything ships.

The live operational system is private; the architecture, core modules, and a runnable demonstration are public — and every result below is verifiable.

Demonstration site · System showcase · Runnable lab

Merged upstream What it fixes
caddy #7916 isolate active health-check state per distinct check config
go-ethereum #35433 only synthesize finalized/safe markers with an explicit sync target
rclone #9726 reuse resumable-upload chunk buffers via a size-matched pool
caddy #7904 isolate auth provider responses to prevent cross-provider clobbering
huma #1101 surface the Body field's example tag as the request-body example

Twelve pull requests merged across caddy, rclone, go-ethereum, k3s, huma, and DeepSeek-Reasonix — concurrency isolation, buffer reuse, and protocol correctness, each reviewed and merged by that project's maintainers.


📏 How it's measured

I built a benchmark from 37 real bugs with known answers, each paired with the fix maintainers actually merged.

Correct file ranked first
Keyword baseline 4 / 37
Agentic localization 29 / 37

Four agent runs exhausted their turn budget and produced no ranking. They're counted as misses, so both numbers share a denominator. (Among the 33 runs that completed, top-1 is 29/33 — the 88% framing the project site uses; top-3 within completed runs was 33/33.)

On patch generation, of 35 issues that produced a patch: 28 touch a correct file, 25 land within ±5 lines of the human-changed region. An LLM judge calls 17 of 35 root-cause equivalent — but a blinded audit of that judge found it models test adequacy and scope not at all, so I treat it as a research proxy, not a claim that those patches were ready to merge.

That same benchmark is what killed my first version. A second implementation of the verifier in Rust was measured against its own pre-registered bars, failed them, and was not promoted — the result stayed in the record instead of being retried until it passed.


⚙️ The design constraint

The objective isn't generating code. It's an autonomous system that performs useful engineering work while staying measurable · constrained · auditable · recoverable:

  • Pass criteria registered before results exist; test data frozen
  • 16 auto-ship gates, each tested by feeding it deliberately broken patches to confirm it rejects them
  • Two independent automated reviewers with disagreement detection
  • Fail-closed evidence capture — an unverifiable run halts rather than proceeding
  • Full autonomy enabled for two repositories; everything else requires operator approval

Working in: Python · Go · Rust · Gno Interested in: autonomous software engineering, agent evaluation, developer tooling, reliability and failure recovery, human/AI collaboration

Pinned Loading

  1. gnolang/gno gnolang/gno Public

    Gno: An interpreted, stack-based Go virtual machine to build succinct and composable apps + gno.land: a blockchain for timeless code and fair open-source.

    Go 1.1k 466

  2. gno-infra gno-infra Public

    Composable on-chain infrastructure primitives for Gno.land

    1

  3. fee_split fee_split Public

    Trustless on-chain revenue splitting for DAOs and teams

    Gno 1

  4. permission_registry permission_registry Public

    On-chain permission registry for reusable access control across Gno realms

    Gno 1

  5. service_registry service_registry Public

    On-chain service registry for discovering and integrating Gno.land contracts

    Gno 1

  6. timelock_guardian timelock_guardian Public

    Time-locked execution layer for secure upgrades and governance actions

    Gno 1