Skip to content
View xianyu-sheng's full-sized avatar
🎯
Focusing
🎯
Focusing
  • CQUPT
  • Chong Qing
  • 16:58 (UTC -12:00)

Highlights

  • Pro

Block or report xianyu-sheng

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
xianyu-sheng/README.md

Hi, I'm Xianyu Sheng 👋

M.S. in Computer Science @ CQUPT (2027). I build Agent Harnesses — the runtime layer that decides whether an AI agent's output can be trusted. I verify my work with reproducible benchmarks, adversarial boundary probing, and upstream contributions, not adjectives.

My design philosophy, shared across everything I build:

Let the model think. Let the program decide. LLM output is a claim; only a tool result is evidence.

The corollary I keep returning to: capability benchmarks measure the model, but the harness is what makes a result trustworthy. So I work on the layers between "the model said something" and "the system can act on it" — constraint boundaries, evidence gates, and evaluation you can reproduce.


Featured work

Xenon — Agent Harness

An open-source runtime for running, constraining, and evaluating AI coding agents. The core contribution is architectural: treating constraint and verification as first-class layers that sit between reasoning and tool execution, rather than as afterthoughts.

Why it matters: Most agent projects prove capability with benchmarks, then ship a different system to users. Xenon's interactive mode and evaluation harness share the same isolation boundaries and verification gates — so the 40.0% SWE-bench_Lite pass rate is a valid claim about the CLI you'd actually use.

Key results:

  • SWE-bench_Lite: 40.0% instance-level (12/30, single attempt) on deepseek-v4-flash — +6.7pp over the previous version in same-model A/B. Full methodology, sampling seed, and cost accounting are committed and reproducible (report).
  • Security hardening (v0.8.5): Found and fixed two real sandbox escapes via systematic boundary probing — path fence symlink bypass + runtime binding gap. Each came with POC, validity self-check (revert → must fail), and regression tests. Verified in production use.
  • Architecture: 7 swappable reasoning paradigms, Evidence Runtime verification layer, MCP-native tooling, 2300+ unit tests with CI on every commit.

The project demonstrates that trustworthiness is an architectural property, not a tuning target.

SmartBench — evidence-constrained code diagnosis

A code-diagnosis workbench that splits responsibility deliberately: language frontends and deterministic analyzers own source facts; the LLM may only propose hypotheses; resolvers and validators decide whether a claim binds back to real operations, types, and control flow. Under-supported conclusions stay unknown/abstained — they are never promoted to findings.

  • Real upstream bugs found and verified before submission — e.g. stunner #89 (TURN connection leak) confirmed fixed upstream; issues/PRs to sniproxy, Robyn, qscan.

Open-source contributions

Merged into DeepSeek-Reasonix (DeepSeek's official agent framework):

  • #7086 — preserve advisory diagnostics without weakening the evidence gate (merged 2026-07-31)
  • #6618 — honour finish_reason=stop on reasoning-only final answers (merged 2026-07-17)

Open / under discussion:


Technical focus

Research interests:

  • Agent harness design: constraint boundaries, evidence gates, and trust semantics
  • Reasoning-paradigm comparison and evaluation methodology
  • Static analysis + semantic IR for deterministic code understanding
  • Cost-efficiency in production LLM applications

Currently exploring:

  • Cross-language semantic analysis (Python, Go, TypeScript, Rust)
  • MCP protocol integration for agent tool ecosystems
  • Benchmark design for agent reliability measurement

Open to opportunities

Seeking: AI Agent / LLM Infrastructure engineering roles (2027 grad, available from July 2027)

What I bring:

  • Reproducible evaluation methodology (SWE-bench official harness, same-model A/B, committed seeds)
  • Adversarial self-review: I probe my own systems for boundary failures and fix them with POCs and regression locks
  • Architecture that keeps guarantees consistent between benchmark and production paths
  • Cross-stack engineering (Python/Go/C++/TypeScript, static analysis, distributed systems)

Contact


💡 Open-source philosophy: Every claim should be reproducible. Every benchmark should publish its methodology. Every "smart" system should show its work.

Pinned Loading

  1. Xenon Xenon Public

    🚀 Xenon — Agent Harness for AI coding agents. 证据导向架构 + 7种推理范式 + 执行隔离边界 + SWE-bench 40% 通过率(+6.7pp)。可信、可验证、可评测的 AI Agent 运行时。

    Python 53 1

  2. SmartBench SmartBench Public

    证据约束的代码诊断工作台:确定性静态分析拥有源码事实,LLM 只提假设,resolver/validator 决定能否绑定回真实操作——证据不足保持 unknown/abstained,从架构抑制幻觉。已在真实开源项目发现 bug(stunner #89 已被上游确认修复)。Python。

    Python 1 2

  3. Agent-hub Agent-hub Public

    Multi-Agent orchestration system with LLM intent routing, DAG scheduling & 7 collaboration strategies. 多 Agent 中央调度系统 — 自然语言输入,自动路由到专业 Agent 协同工作。

    Python