S - The state classA - The Action classpublic abstract class CTMDP<S extends State,A extends Action> extends InfiniteMDP<S,A>
PolicyIterationSolver,
ValueIterationSolver| Constructor and Description |
|---|
CTMDP(States<S> initial)
Creates a new continuous time infinite horizon MDP Problem.
|
| Modifier and Type | Method and Description |
|---|---|
abstract double |
continuousCost(S i,
A a)
Cost incurred continuously in time until the next transition
from state i given that action a is taken.
|
StatesSet<S> |
getAllStates()
Complete set of states explored
|
double |
getMaxRate() |
ValueFunction<S> |
getSteadyStateProbabilities() |
abstract double |
lumpCost(S i,
A a)
Cost incurred instantaneously in the moment when action a is
taken from state i.
|
abstract double |
rate(S i,
S j,
A a)
Rate of going from state i to state j by taking the action a
|
abstract States<S> |
reachable(S i,
A a)
Set of States that can be reached from this state i, after
taking the action a.
|
void |
setConverter(CT2DTConverter<S,A> converter)
Sets the class in charge of making a DTMDP equivalent to the
CTMDP
|
Solution<S,A> |
solve(double interestRate)
Solves the problem with the given interest rate
|
feasibleActions, getNumStates, getSolverdebug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solvepublic StatesSet<S> getAllStates()
getAllStates in class InfiniteMDP<S extends State,A extends Action>public void setConverter(CT2DTConverter<S,A> converter)
converter - class that makes a DTMDP equivalent to the
CTMDPpublic double getMaxRate()
public ValueFunction<S> getSteadyStateProbabilities() throws SolverException
SolverExceptionpublic Solution<S,A> solve(double interestRate) throws SolverException
interestRate - the interest rate parameter to solve the
problem.SolverExceptionpublic abstract double lumpCost(S i, A a)
i - Statea - Actionpublic abstract double continuousCost(S i, A a)
i - Statea - Actionpublic abstract States<S> reachable(S i, A a)
i - current Statea - action taken