Vidur: Microsoft's LLM Inference System Simulator
Vidur: Microsoft’s LLM Inference System Simulator Introduction Vidur is a high-fidelity LLM inference system simulator developed by Microsoft Research that enables engineers and researchers to study LLM deployment performance without requiring access to expensive GPU hardware. Published at MLSys’24 (paper...
SGLang: The High-Performance LLM Serving Framework Powering 400K+ GPUs
SGLang is a fast and powerful LLM serving framework designed to deliver high-throughput, low-latency inference for large language models at production scale. Developed by the SGLang team at UC Berkeley and the open-source community, SGLang has rapidly become one of...
InferSim: AI-Powered Circuit Simulation by Alibaba
Introduction InferSim is a lightweight, simulation framework developed by Alibaba’s Alimama AI Infra Team and Future Living Lab. While traditional circuit simulation tools like SPICE rely on numerical solvers for analog circuit analysis, InferSim takes a fundamentally different approach: it...
wterm: A High-Performance Web Terminal Emulator Built with Zig and WASM
wterm: A High-Performance Web Terminal Emulator Built with Zig and WASM wterm (pronounced “dub-term”) is a terminal emulator for the web that renders directly to the DOM, giving you native text selection, copy/paste, browser find, and accessibility out of the...
Web Design Skill: AI Agent That Transforms Functional Web Pages Into Stunning...
Web Design Skill: AI Agent That Transforms Functional Web Pages Into Stunning Designs Modern LLMs can already produce functional web pages from simple prompts, but their output tends to converge on the same aesthetic: Inter font, blue primary buttons, purple-pink...
Video Use: Edit Videos With Coding Agents
Table of Contents Table of Contents What is Video Use? Why It Matters How It Works: Reading Video Through Text The Editing Pipeline Key Components transcribe.py / transcribe_batch.py pack_transcripts.py timeline_view.py render.py grade.py Hard Rules: Production Correctness Getting Started Prerequisites Installation...
Universal Commerce Protocol: The Open Standard Breaking Down E-Commerce Silos
Universal Commerce Protocol: The Open Standard Breaking Down E-Commerce Silos The Universal Commerce Protocol (UCP) is an open-source specification that addresses one of the most persistent problems in digital commerce: fragmentation. Backed by co-developers including Shopify, Google, Etsy, Target, Walmart,...
Skills Manage: The Desktop App That Unifies AI Coding Agent Skills Across 27+...
Skills Manage: The Desktop App That Unifies AI Coding Agent Skills Across 27+ Platforms Managing AI coding agent skills across multiple platforms is a growing challenge for developers. Each AI coding tool – Claude Code, Cursor, Windsurf, Copilot, Aider –...
Roo Code: AI Dev Team of Agents Right in Your Code Editor
Roo Code: AI Dev Team of Agents Right in Your Code Editor Roo Code is an open-source AI-powered dev team that lives directly inside your VS Code editor, combining multi-mode agent capabilities with 20+ built-in tools and Model Context Protocol...
OpenAI Privacy Filter: Protecting Sensitive Data with Bidirectional Token Cla...
OpenAI Privacy Filter: Protecting Sensitive Data with Bidirectional Token Classification OpenAI Privacy Filter is a bidirectional token-classification model for personally identifiable information (PII) detection and masking in text. Released under the permissive Apache 2.0 license, it provides a fast, context-aware,...
Open CoDesign: Open-Source Claude Design Alternative with Multi-Model Support
Open CoDesign: Open-Source Claude Design Alternative with Multi-Model Support Open CoDesign is the open-source Claude Design alternative that turns natural-language prompts into polished design artifacts – locally, with whichever model you already pay for. Built as an MIT-licensed Electron desktop...
Mercury Agent: Soul-Driven AI Agents with Permission-Hardened Tools and Secon...
Mercury Agent: Soul-Driven AI Agents with Permission-Hardened Tools and Second Brain Memory Mercury Agent is an open-source, soul-driven AI agent framework that runs 24/7 from your CLI or Telegram. With over 671 stars on GitHub, it distinguishes itself from other...