Skip to content
View sHyanorn's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report sHyanorn

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
sHyanorn/README.md

Aaron Yang

Algorithm engineering and server-side systems, with backend development next to them. Each project below ships its tests in its repository, with its decision log or its pre-registration, and every number on my site traces back to a project repository.

Algorithms

  • push-lab · page An offline lab for push notification recommendation: recall and ranking checked on public data, send volume and timing tested only in a simulator, with every result labelled by how far it can be trusted without live traffic. On Duolingo's randomized notification logs, the template bandit beats uniform choice by 0.00174 (0.00126 to 0.00221) in two-hour completion per notification (Tier A, randomized real data). In a registered long-horizon study in the simulator, the estimator SMIS, on the project's exploration logs, favours one push a day over none at 6 of 8 settings, the reverse of the truth (Tier C, simulator only).
  • ope-checks · page Pre-registered checks of published off-policy evaluation results. On the two confirmatory campaigns of the Open Bandit benchmark, the IPS estimate pooled over both is 0.974 of the on-policy click rate, with an interval of 0.915 to 1.036 over ten-minute blocks: no shortfall shown. A further study re-scores two published estimator comparisons against a reference unbiased for the evaluated target: both replications are reproduced; on All, with ten-minute blocks and the target applied to its own (item, position) pairs, MIPS (w/ SLOPE) against IPS "flips" (closer in 91 of 500 runs); and on Men's, with ten-minute blocks, at the full size of the data and with the reward model and the target fixed, BLUE's unbiasedness is "contradicted".
  • retrieval-lab · page BM25 and dense retrieval in Go. BM25, exact dense search and fusion are each accepted against a number that Pyserini publishes for BEIR. BM25 equals the published nDCG@10 and Recall@100 to four decimals on six datasets. BGE-base with exact search is within 0.0006 in nDCG@10 on all six, and within 0.0004 on all but TREC-COVID.
  • seqrec-lab · page A pre-registered study of Transformer sequential recommenders, SASRec, BERT4Rec and gSASRec, with equal tuning budgets, five to ten seeds per arm and full-ranking evaluation on one rented consumer GPU. On MovieLens-1M, Video_Games and Steam, SASRec with full cross-entropy is ahead of BERT4Rec and gSASRec, and SASRec with BCE and one negative trails it by more than 2%. MovieLens-1M's test targets had been read for anchor checks before its final runs. MovieLens-20M has no results yet.

Server-side systems

  • recserve · page A recommendation serving system in Go: retrieval, features, ranking and rerank behind one HTTP API, with the item vectors on gRPC shard replicas. In kind at 100 requests/s, through rolling restarts of the gateways and of the replicas and a bundle swap, no response failed or was degraded, with stage budgets of 100 ms.

Backend systems

  • matching-engine · page A Go limit order book with a write-ahead command log and open-loop load testing. The matching core runs 6.25M to 8.88M commands/s on one symbol on a noisy cloud VM, and p99 is 1.76 ms at 10k requests/s and 41.1 ms at 50k, near saturation.

Earlier

vault-share (end-to-end encrypted file sharing) · backtest-lab (overfitting checks for backtests) · local-ledger (an encrypted personal finance desktop app)

Pinned Loading

  1. push-lab push-lab Public

    Offline lab for push notification recommendation: recall, ranking, uplift, send volume, timing and copy, with off-policy evaluation checked on the Open Bandit Dataset.

    Python 1

  2. seqrec-lab seqrec-lab Public

    Transformer sequential recommendation on one GPU: SASRec, BERT4Rec and gSASRec compared under equal tuning, several seeds and full ranking, with the training time each loss needs to reach a target …

    Python 1

  3. ope-checks ope-checks Public

    Pre-registered checks of published off-policy evaluation results on the Open Bandit Dataset: a recheck of the IPS shortfall with block bootstrap intervals, a re-scoring of published estimator compa…

    Python 1

  4. recserve recserve Public

    Recommendation serving in Go: multi-source retrieval, ONNX ranking, item vectors on sharded gRPC replicas with failover and hedging, Valkey caching, deadline-based degradation, and open-loop benchm…

    Go 1

  5. retrieval-lab retrieval-lab Public

    BM25 and dense retrieval in Go, where each component is accepted against a number Pyserini publishes for BEIR and every result reproduces from public commands and data.

    Python 1

  6. matching-engine matching-engine Public

    Limit order book matching engine in Go with REST and WebSocket APIs, a write-ahead command log and deterministic replay.

    Go 1