vmlx

vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!

Repository
jjang-ai/vmlx
Stars
733
Last push
2026-07-02
License
Apache-2.0
Category
AI & ML

Score breakdown — how scoring works

  • Maintenance

    30 / 30
    • Pushed within 14 days0 days ago+30
  • Adoption

    16.7 / 25
    • GitHub stars (no package published — stars weighted fully)733+16.7
  • Documentation

    25 / 25
    • Comprehensive README (6,000+ chars)30908 chars+10
    • Install / setup instructionsyes+6
    • Tools / capabilities documentedyes+5
    • Code or client-config exampleyes+4
  • Trust signals

    7 / 20
    • OSS license declaredApache-2.0+7
    • First-party vendor implementationno+0
    • DNS-verified registry namespaceno+0
    • Listed in official MCP Registryno+0
    • Owned by an organizationno+0

Install

From sourcegit clone https://github.com/jjang-ai/vmlx

No package published to a registry — see the README for setup instructions.

Always review a server's code and required credentials before connecting it to your MCP client. MCP Vetted scores public metadata — it does not audit code for malicious behavior (yet). Methodology →

View on GitHub