--- title: SpinCache: KV-Cache Compression for Long-Context LLMs | SpinForge url: https://spin-forge.com/spincache description: KV-cache compression and direct-decode software for supported long-context LLM serving. --- [← The collection](https://spin-forge.com/products) 07 / Long-context KV-cache compression # SpinCache ## Longer context. Less baggage. KV-cache compression and direct-decode software for supported long-context LLM serving. See what it solves ↔ Drag to change perspective Customer outcome [Run AI more efficiently](https://spin-forge.com/platform/ai-serving) Available now CLI MCP Headless Choose your access mode THE PRODUCT, IN PRACTICE ## Keep the context. Reduce the cache footprint. Long documents, code histories and retrieval conversations increase the cache a model must retain while generating responses. SpinCache addresses that footprint with a compact KV-cache representation and supported direct decode. Streaming updates and the Transformers integration connect the cache tier to a continuing serving workload rather than treating compression as a one-time offline task. BUILT FOR LLM-serving teams building document applications, code agents and retrieval workflows with supported Transformers models. CHALLENGES PRODUCT RESPONSE ## The problem you face. What SpinCache changes. 01 ### Context competes for memory Retaining more conversation or document context can make the KV cache a limiting part of a serving deployment. SpinCache compresses the stored keys and values to reduce their footprint within the supported model and cache configuration. 02 ### Compression must work during serving A compact offline representation is not enough if the serving path cannot use it as the context changes. Supported direct decode and streaming append let the compact cache participate in the ongoing generation workflow. 03 ### Smaller is not automatically acceptable A setting that saves memory may change model quality or introduce runtime overhead. The product’s configurable scope supports deployment-specific trade-offs. Evaluate the chosen setting on your model, and pair it with SpinProof when that assessment is required. WHAT YOU GET ## A defined capability. A useful output. The product scope below describes the capability and outputs to confirm for your release. Custom integration, operated delivery and additional engineering are separately agreed. 01 ### A compact cache tier KV-cache compression for the supported models and settings. 02 ### A supported decode path Direct use of the compact cache in the product’s decode integration. 03 ### Streaming cache updates Append support for context that grows during the serving session. 04 ### A Transformers integration The supplied cache and attention integration for the qualified environment. AVAILABLE NOW ## One product. Three ways to work. SpinCache is fully available with CLI, MCP and headless access. Use the interface that fits your terminal, your agents or your automated workflow. 01 / CLI ### For your terminal. Run the product from a terminal or script, alongside the tools your team already uses. [Get CLI access](https://spin-forge.com/contact?product=spincache&interface=cli&brief=I+would+like+SpinCache+access+through+CLI.+Please+share+the+setup+documentation+and+configuration+for+the+selected+product.+We+will+confirm+the+environment%2C+license+scope+and+workflow+during+onboarding.) 02 / MCP ### For your agents. Connect MCP-compatible clients and agents to the product’s exposed capabilities. [Get MCP access](https://spin-forge.com/contact?product=spincache&interface=mcp&brief=I+would+like+SpinCache+access+through+MCP.+Please+share+the+setup+documentation+and+configuration+for+the+selected+product.+We+will+confirm+the+environment%2C+license+scope+and+workflow+during+onboarding.) 03 / HEADLESS ### For your workflows. Operate without a graphical interface in unattended, scheduled or pipeline-driven work. [Set up headless access](https://spin-forge.com/contact?product=spincache&interface=headless&brief=I+would+like+SpinCache+access+through+headless.+Please+share+the+setup+documentation+and+configuration+for+the+selected+product.+We+will+confirm+the+environment%2C+license+scope+and+workflow+during+onboarding.) Product-specific inputs, hardware requirements and result guarantees still apply. An access mode does not change your license or deployment scope. [Explore all product interfaces](https://spin-forge.com/developers?section=access-directory) EXAMPLE CUSTOMER WORKFLOW ## Serve a document workflow with a larger retained history A team wants to compare a compact cache with its current long-context serving configuration. Illustrative use of the supported scope, not a customer case study or a measured result. 1. 01 Choose the supported model, representative documents and quality limits. 2. 02 Integrate the cache tier and run the same serving workload. 3. 03 Compare cache memory, useful concurrency, latency and output quality together. THE WORK, IN MOTION ## Make space. Keep the context. Explore the product workflow, from your input to a result you can use. 01 / Store Attention keys and values accumulate as the context grows. Interactive explanation. This illustration does not execute customer workloads or display measured performance. IN YOUR WORKFLOW ## Start with your task. Agree the useful outcome. LLM-serving teams building document applications, code agents and retrieval workflows with supported Transformers models. What you bring The supported Transformers model, context lengths, serving workload, current cache configuration and quality requirements. What a useful evaluation measures - Cache memory for the same context workload - Serving throughput and latency including cache overhead - Model quality at the selected setting Where it fits Use the selected product in a qualified customer environment, or agree a defined implementation with SpinForge. A hosted or managed service is quoted for its actual operating responsibilities; it is not automatically included with software access. QUESTIONS BEFORE YOU BUY ## A clear scope. No hidden assumptions. **How can we use SpinCache?**CLI, MCP and headless access are all available. Run from a terminal or script, connect an MCP-compatible client, or use the product without a graphical interface. Choose the mode during onboarding and receive its setup instructions. Runtime requirements and supported operations remain product-specific. **What is the important product boundary? **No universal compression ratio or quality-preservation claim applies to every model. SpinCache addresses representation and decode; SpinMem addresses placement and KX MemoryForge has a separate offload-and-restore runtime. **What comes with the selected license? **The agreed SpinCache release, its supported interfaces and outputs, the applicable checks and the support stated in your order. The plan defines users, workflow, environment and capacity. Source-code transfer, unrestricted redistribution and bespoke engineering are not automatically included. **Can SpinForge implement or operate it for us? **Request a scoped engineering or operated-service proposal. It identifies what our team delivers, where the workload runs, infrastructure costs, acceptance requirements and ongoing support. Your software subscription alone does not activate a hosted runtime. [Explore engineering](https://spin-forge.com/engineering) **How do we establish fit before production? **Agree the model or workload, current baseline, environment, required output and acceptance tests. Evaluate the selected release against those conditions. A product description or a test count does not establish a gain on a different customer workload. [Plan an integration](https://spin-forge.com/integration) ANNUAL APPLICATION LICENSE $90,000 / year One named production deployment. Shared engine rights for this application included. [Scope & packages](https://spin-forge.com/licensing?tab=software) PUT SPINCACHE TO WORK ## Tell us what needs to improve. Bring a representative workload and the result your team needs. We’ll define the product, deployment and engineering scope around that task. [Discuss this workflow](https://spin-forge.com/contact?product=spincache&brief=Product%3A+SpinCache%0AOur+challenge%3A+Context+competes+for+memory%0AWorkload+%2F+baseline%3A+%0AEnvironment%3A+%0ARequired+output%3A+%0AAcceptance+measures%3A+Cache+memory+for+the+same+context+workload%3B+Serving+throughput+and+latency+including+cache+overhead%3B+Model+quality+at+the+selected+setting%0ADelivery+preference+%28software+%2F+engineering+%2F+managed%29%3A+) **Related products, workflows and system connections + **RELATED CAPABILITIES ## Connect the right products. Distinct responsibilities. Explore each scope before choosing a combined deployment. [### SpinProof AI-performance assessment software that profiles a workload, prioritizes optimization changes and checks their effect on model quality.](https://spin-forge.com/spinproof) [### SpinMem KV-cache and memory-tier placement software, supplied with a service interface and a vLLM integration hook.](https://spin-forge.com/spinmem) [### KX MemoryForge A multi-tier LLM KV-cache runtime for compressing, offloading and restoring cache in a supported memory and storage environment.](https://spin-forge.com/kx-memoryforge) ONE PLATFORM / OR A DIRECT PURCHASE ## AI Serving with SpinCache. Activate this capability inside a qualified ai serving workflow. Compatible methods and required shared checking are included once within that workflow; the product remains independently purchasable. Capacity, release, environment, result contract and operating responsibilities are specified before activation. Choosing an additional method is not permission to add an unrelated workload or unqualified deployment. [Explore AI Serving](https://spin-forge.com/platform/ai-serving) [Choose workflow capacity](https://spin-forge.com/plans?configuration=ai-serving&product=spincache) CONNECTED WORKFLOWS ## Use SpinCache in your workflow. The product remains independently available. These customer-specific solution paths use the relevant supported capabilities, with integration and delivery rights agreed separately. [05 ### Performance & release checks Make performance and quality evaluation a repeatable part of your release process. Compare an agreed workload before a change is accepted into production.](https://spin-forge.com/solutions/release-checks) [07 ### Cloud & infrastructure enablement Build a supported optimization, inference-performance or agent-workload offering on your infrastructure, with a clear product boundary and operating model.](https://spin-forge.com/solutions/cloud-provider-services) [Explore all 17 solution workflows](https://spin-forge.com/workflows) FROM PRODUCT TO CUSTOMER WORKFLOW ## A useful outcome. A defined delivery. Commission the model, integration and acceptance work needed for your task. Existing products stay independently available. [03 / Scoped customer program ### Improve a computational workflow Commission a bounded performance improvement with source identity, numerical acceptance and the appropriate checking evidence.](https://spin-forge.com/programs/compute-improvement) [Explore decision programs](https://spin-forge.com/decision-systems) THE WHOLE-SYSTEM ROLE ## SpinCache in a wider workflow. Change the memory representation so a new batching/routing regime becomes feasible; evaluate task-sensitive fidelity. POTENTIAL SYSTEM CONTRIBUTION No inherited end-to-end error guarantee; allowed representations and customer quality thresholds need validation. [S1 · Joint workload & machine optimization](https://spin-forge.com/system-synergies/joint-configuration) [S2 · Decision-sensitive computation](https://spin-forge.com/system-synergies/decision-sensitive-compute) [S3 · Checked computational memory](https://spin-forge.com/system-synergies/checked-computational-memory) [See this product in the map](https://spin-forge.com/system-synergies/product-map?q=SpinCache) [Define an integration evaluation](https://spin-forge.com/system-synergies/evaluation) The product is independently available through CLI, MCP and headless access. The joins above are integration candidates; compatibility, authority, data rights and end-to-end benefit must be established for the selected workflow. START WITH THIS PRODUCT Use the software directly or ask us to scope the implementation. [Software access](https://spin-forge.com/plans?product=spincache) [Have us do the work](https://spin-forge.com/contact?product=spincache&delivery=engineering)