S - State classA - Action classpublic abstract class DTMDP<S extends State,A extends Action> extends InfiniteMDP<S,A>
PolicyIterationSolver,
ValueIterationSolver| Constructor and Description |
|---|
DTMDP(S initial)
Creates a new infinite horizon discrete time (MDP) Problem.
|
DTMDP(States<S> initial)
Creates a new infinite horizon discrete time (MDP) Problem.
|
| Modifier and Type | Method and Description |
|---|---|
ValueFunction<S> |
getSteadyStateProbabilities() |
abstract double |
immediateCost(S i,
A a)
Cost incurred when taking action a from state i
|
abstract double |
prob(S i,
S j,
A a)
Probability of going from state i to state j by taking the
action a
|
abstract States<S> |
reachable(S i,
A a)
Set of states that can be reached from this state i, after
taking the action a.
|
void |
setProbabilitySolver(ProbabilitySolver<S,A> solv) |
Solution<S,A> |
solve(double interestRate)
Solves the problem with the given interest rate
|
feasibleActions, getAllStates, getNumStates, getSolverdebug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solvepublic DTMDP(States<S> initial)
initial - set of initial states for the exploration
algorithmpublic DTMDP(S initial)
initial - An initial state for the exploration algorithmpublic abstract double immediateCost(S i, A a)
i - Current Statea - Current Actionpublic abstract double prob(S i, S j, A a)
i - Current state.j - Destination Statea - Actionpublic abstract States<S> reachable(S i, A a)
i - Current Statea - Action takenpublic ValueFunction<S> getSteadyStateProbabilities() throws SolverException
SolverExceptionpublic void setProbabilitySolver(ProbabilitySolver<S,A> solv)
solv - Sets the solver that solves the steady state
probabilities.public final Solution<S,A> solve(double interestRate) throws SolverException
interestRate - the interest rate parameter to solve the
problem.SolverException