--- title: ValueForge: Markov Decision Process (MDP) Computation | SpinForge url: https://spin-forge.com/forge15/valueforge description: Markov decision-process computation with a stopping certificate for supported state-value estimates. --- FORGE15 / 08 / LOGIC & OPTIMIZATION [The full offering](https://spin-forge.com/platform) # ValueForge. Markov decision-process computation with a stopping certificate for supported state-value estimates. [Discuss ValueForge](https://spin-forge.com/contact?product=forge15%2Fvalueforge) Customer outcome [Build better plans and decisions](https://spin-forge.com/platform/checked-decisions) Available now CLI MCP Headless Choose your access mode THE PRODUCT, IN PRACTICE ## Planning values need a meaningful error limit. When a planning model includes uncertain state transitions, the quality of its value estimate matters to the decision that follows. ValueForge computes values for a supported Markov decision process and uses an error certificate to determine when the requested computation can stop. It gives the customer a numerical planning component with an explicit accuracy target rather than an arbitrary iteration count. BUILT FOR Planning-software developers and researchers using supported finite Markov decision processes. CHALLENGES PRODUCT RESPONSE ## The problem you face. What ValueForge changes. 01 ### The next state is uncertain A choice needs to be evaluated through modeled rewards and transitions, not only its immediate outcome. ValueForge computes the state-value result for the supported transition and reward model. 02 ### Iteration count does not explain accuracy Stopping after a fixed number of updates may not communicate how close the values are to the accepted result. The product uses the supported error certificate as a meaningful stopping requirement. 03 ### The numerical model must remain visible A precise solve does not repair incorrect transition probabilities or reward definitions. The returned result is assessed against the supplied planning model and its certificate assumptions, keeping model quality separate from solve accuracy. WHAT YOU GET ## A defined capability. A useful output. The product scope below describes the capability and outputs to confirm for your release. Custom integration, operated delivery and additional engineering are separately agreed. 01 ### A state-value computation Values for the supported Markov decision-process model. 02 ### A stopping certificate The error evidence associated with the accepted convergence scope. 03 ### A numerical result to integrate Planning values for use by the customer’s downstream decision workflow. 04 ### An upgrade path A distinct link to the newer certnum: MDP track, with scope compared rather than assumed identical. AVAILABLE NOW ## One product. Three ways to work. ValueForge is fully available with CLI, MCP and headless access. Use the interface that fits your terminal, your agents or your automated workflow. 01 / CLI ### For your terminal. Run the product from a terminal or script, alongside the tools your team already uses. [Get CLI access](https://spin-forge.com/contact?product=forge15%2Fvalueforge&interface=cli&brief=I+would+like+ValueForge+access+through+CLI.+Please+share+the+setup+documentation+and+configuration+for+the+selected+product.+We+will+confirm+the+environment%2C+license+scope+and+workflow+during+onboarding.) 02 / MCP ### For your agents. Connect MCP-compatible clients and agents to the product’s exposed capabilities. [Get MCP access](https://spin-forge.com/contact?product=forge15%2Fvalueforge&interface=mcp&brief=I+would+like+ValueForge+access+through+MCP.+Please+share+the+setup+documentation+and+configuration+for+the+selected+product.+We+will+confirm+the+environment%2C+license+scope+and+workflow+during+onboarding.) 03 / HEADLESS ### For your workflows. Operate without a graphical interface in unattended, scheduled or pipeline-driven work. [Set up headless access](https://spin-forge.com/contact?product=forge15%2Fvalueforge&interface=headless&brief=I+would+like+ValueForge+access+through+headless.+Please+share+the+setup+documentation+and+configuration+for+the+selected+product.+We+will+confirm+the+environment%2C+license+scope+and+workflow+during+onboarding.) Product-specific inputs, hardware requirements and result guarantees still apply. An access mode does not change your license or deployment scope. [Explore all product interfaces](https://spin-forge.com/developers?section=access-directory) EXAMPLE CUSTOMER WORKFLOW ## Evaluate a finite-state planning model A planning team needs a value calculation at an agreed accuracy before comparing decisions. Illustrative use of the supported scope, not a customer case study or a measured result. 1. 01 Provide the supported transitions, rewards and numerical requirements. 2. 02 Run the model to the applicable stopping condition. 3. 03 Inspect the value estimates and error evidence before downstream use. IN YOUR WORKFLOW ## Start with your task. Agree the useful outcome. Planning-software developers and researchers using supported finite Markov decision processes. What you bring The supported states, transition/reward model, numerical assumptions and error target. What a useful evaluation measures - Error under the certificate assumptions - Consistency against accepted reference cases - Time to the requested accuracy Where it fits Use the selected product in a qualified customer environment, or agree a defined implementation with SpinForge. A hosted or managed service is quoted for its actual operating responsibilities; it is not automatically included with software access. QUESTIONS BEFORE YOU BUY ## A clear scope. No hidden assumptions. **How can we use ValueForge?**CLI, MCP and headless access are all available. Run from a terminal or script, connect an MCP-compatible client, or use the product without a graphical interface. Choose the mode during onboarding and receive its setup instructions. Runtime requirements and supported operations remain product-specific. **What is the important product boundary? **The campaign’s tight error result belongs to its tested model. It does not guarantee accurate real-world transition models. certnum: MDP is a separately qualified upgrade. **What comes with the selected license? **The agreed ValueForge release, its supported interfaces and outputs, the applicable checks and the support stated in your order. The plan defines users, workflow, environment and capacity. Source-code transfer, unrestricted redistribution and bespoke engineering are not automatically included. **Can SpinForge implement or operate it for us? **Request a scoped engineering or operated-service proposal. It identifies what our team delivers, where the workload runs, infrastructure costs, acceptance requirements and ongoing support. Your software subscription alone does not activate a hosted runtime. [Explore engineering](https://spin-forge.com/engineering) **What evidence is available for review? **P53 / Company-reported. The supplied campaign reports an error certificate matching the true error on the tested cases. That observation belongs to the studied model and is not a universal equality for every planning problem. These descriptions come from the supplied product and campaign material. Website checks are not an independent rerun of the engine. Qualification identifies the actual release, workload and available artifacts. [Read the evidence summary](https://spin-forge.com/results) SOFTWARE / OPERATED DELIVERY By proposal Customer-hosted access and a service operated by SpinForge are different scopes. Confirm the release, deployment and included support before activation. [Plans & delivery](https://spin-forge.com/pricing) PUT VALUEFORGE TO WORK ## Tell us what needs to improve. Bring a representative workload and the result your team needs. We’ll define the product, deployment and engineering scope around that task. [Discuss this workflow](https://spin-forge.com/contact?product=forge15%2Fvalueforge&brief=Product%3A+ValueForge%0AOur+challenge%3A+The+next+state+is+uncertain%0AWorkload+%2F+baseline%3A+%0AEnvironment%3A+%0ARequired+output%3A+%0AAcceptance+measures%3A+Error+under+the+certificate+assumptions%3B+Consistency+against+accepted+reference+cases%3B+Time+to+the+requested+accuracy%0ADelivery+preference+%28software+%2F+engineering+%2F+managed%29%3A+) **Related products, workflows and system connections + **RELATED CAPABILITIES ## Connect the right products. Distinct responsibilities. Explore each scope before choosing a combined deployment. [### certnum: MDP A certificate-oriented numerical track for supported Markov decision-process computations.](https://spin-forge.com/solvers/certnum) [### enkf_scale Ensemble-based data assimilation that updates a high-dimensional state estimate using incoming observations.](https://spin-forge.com/forge15/enkf-scale) [### Industrial planning & operations Translate planning, scheduling or allocation requirements into an integrated optimization workflow, checked against the original operational constraints.](https://spin-forge.com/solutions/industrial) ONE PLATFORM / OR A DIRECT PURCHASE ## Checked Decisions with ValueForge. Activate this capability inside a qualified checked decisions workflow. Compatible methods and required shared checking are included once within that workflow; the product remains independently purchasable. Capacity, release, environment, result contract and operating responsibilities are specified before activation. Choosing an additional method is not permission to add an unrelated workload or unqualified deployment. [Explore Checked Decisions](https://spin-forge.com/platform/checked-decisions) [Choose workflow capacity](https://spin-forge.com/plans?configuration=checked-decisions&product=forge15/valueforge) CONNECTED WORKFLOWS ## Use ValueForge in your workflow. The product remains independently available. These customer-specific solution paths use the relevant supported capabilities, with integration and delivery rights agreed separately. [03 ### AI training & evaluation environments Commission a task environment or evaluation suite in which supported mathematical and decision outcomes are checked by code, not judged only by the fluency of an explanation.](https://spin-forge.com/solutions/ai-training-evaluation) [06 ### Embedded decision services Add a bounded optimization, configuration-checking or re-planning capability to the product your customers already use. Keep your user experience; integrate the computational capability behind it.](https://spin-forge.com/solutions/embedded-decisions) [Explore all 17 solution workflows](https://spin-forge.com/workflows) FROM PRODUCT TO CUSTOMER WORKFLOW ## A useful outcome. A defined delivery. Commission the model, integration and acceptance work needed for your task. Existing products stay independently available. [02 / Scoped customer program ### Maintain a recurring decision Commission a revision-aware workflow that keeps models, assumptions, results and evidence connected as inputs change.](https://spin-forge.com/programs/living-decisions) [03 / Scoped customer program ### Improve a computational workflow Commission a bounded performance improvement with source identity, numerical acceptance and the appropriate checking evidence.](https://spin-forge.com/programs/compute-improvement) [Explore decision programs](https://spin-forge.com/decision-systems) THE WHOLE-SYSTEM ROLE ## ValueForge in a wider workflow. Plan which computational action or future decision has value under a bounded, calibrated transition model. POTENTIAL SYSTEM CONTRIBUTION Not general POMDP support; state abstraction and error conditions must be checked. [S2 · Decision-sensitive computation](https://spin-forge.com/system-synergies/decision-sensitive-compute) [S4 · Options, flexibility & recourse](https://spin-forge.com/system-synergies/options-and-recourse) [See this product in the map](https://spin-forge.com/system-synergies/product-map?q=ValueForge) [Define an integration evaluation](https://spin-forge.com/system-synergies/evaluation) The product is independently available through CLI, MCP and headless access. The joins above are integration candidates; compatibility, authority, data rights and end-to-end benefit must be established for the selected workflow. START WITH THIS PRODUCT Use the software directly or ask us to scope the implementation. [Software access](https://spin-forge.com/plans?product=forge15/valueforge) [Have us do the work](https://spin-forge.com/contact?product=forge15/valueforge&delivery=engineering)