Uncertain optimal control problem with the first hitting time objective and application to a portfolio selection model

Abstract

This paper discusses an uncertain time optimal control problem by considering time efficiency, which is to optimize the objective function about the first hitting time subject to uncertain differential equations. According to the definition of the α-path, the uncertain time optimal control problem is transformed into an equivalent deterministic optimal control problem. Two kinds of time optimal control models are presented where optimistic value and reaching index are chosen as the optimality criteria, respectively. Applying the proposed uncertain optimal control model to a portfolio selection problem, we obtain the uncertainty distribution of the first hitting time (the investors’ first profit time). Meanwhile, sufficient conditions of the optimal control strategy of such models are provided. Numerical simulations are provided which reveal the change for our optimal control strategy.

Keywords

Uncertainty optimal control first hitting time portfolio selection optimistic value reaching index

Get full access to this article

View all access options for this article.

References

Ahmed

N.U.

and Teo

K.L.

, Stochastic bang-bang control, IEEE Transactions on Automatic Control 6 (1957), 73–79.

Bryson

A.E.

Applied optimal control: optimization, estimation and control, London, New York: Routledge, 2018.

Cairns

, Some notes on the dynamics and optimal control of stochastic pension fund models in continuous time, ASTIN Bulletin: The Journal of the IAA 30(1) (2000), 19–55.

Guo

, Hernández-del-Valle

and Hernández-Lerma.

, First passage problems for nonstationarydiscrete-time stochastic control systems, European Journal of Control 18(6) (2012), 528–538.

Kao

E.P.C.

An Introduction to Stochastic Process, Belmont, CA, USA: Wadworth Publishing Company, 1997.

Karatzas

, Optimization problems in the theory of continuous trading, SIAM Journal on Control and Optimization 27(6) (1989), 1221–1259.

Liu

Uncertainty theory, 2nd ed., Berlin, Germany: Springer-Verlag, 2007.

Liu

, Fuzzy process, hybrid process and uncertain process, Journal of Uncertain Systems 2(1) (2008), 3–16.

Liu

, Some research problems in uncertainty theory, Journal of Uncertain Systems 3(1) (2009), 3–10.

10.

Liu

Uncertainty theory: a branch of mathmatics for modeling human uncertainty, Berlin, Germany: Springer Verlag, 2010.

11.

Liu

, Extreme value theorems of uncertain process with application to insurance risk model, Soft Computing 17(4) (2013), 549–556.

12.

Merton

, Lifetime portfoliio selection under uncertainty: the continuous case, The review of Economics and Statistics 51 (1969), 247–257.

13.

Merton

Comtinuous-time finance, Cambridge, London, UK: Basil Blackwell, 1990.

14.

Sheng

and Zhu

, Optimistic value model of uncertain optimal control. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 21 (2013), 75–87.

15.

Shu

and Zhu

, Optimistic value based optimal control for uncertain linear singular systems and application to a dynamic input-output model, ISA Transactions 71 (2017), 235–251.

16.

Yan

and Zhu

, Bang-bang control model for uncertain switched systems, Applied Mathematical Modelling 39 (2015), 2994–3002.

17.

Yao

and Chen

, A numerical method for solving uncertain differential equations, Journal of Intelligent & Fuzzy Systems 25 (2013), 825–832.

18.

Yao

, Extreme values and integral of solution of uncertain differential equation,Article, Journal of Uncertainty Analysis and Applications 1(1) (2013), 2

19.

Yavin

and Retuer

, Optimal bang-bang control of patially observable stochastic systems, International Journal of Systems Science 12(2) (1981), 141–161.

20.

Zhu

, Uncertain optimal control with application to a portfolio selection model, Cybernetics and Systems: An International Journal 41(7) (2010), 535–547.

21.

Zhu

W.Q.

, Deng

M.L.

and Huang

Z.L.

, Optimal bounded control of first-passage failure of quasi-integrablehamiltonian system with wind-band random excitatio.}, {Nonlinear Dynamics 33(2) (2003), 189–207.

22.

Liu

Theory and practice of uncertain programming, 2nd ed., Berlin, Germany: Springer-Verlag, 2009.

23.

Merton

, Optimal consumption and portfolio rules in a continuous time model, Stochastic Optimization Models in Finance 3(4) (1975), 621–661.

24.

Peng

, Risk metrics of loss function for uncertain system, Fuzzy Optimization and Decision Making 12(1) (2013), 53–64.

25.

Liu

and Ralescu

D.A.

, Value-at-risk in uncertain random risk analysis, Information Sciences 391 (2017), 1–8.

26.

Pontryagin

The mathematical theory of optimal processes. New York: Wiley, 1962.

27.

Bellman

Dynamic programming. New Jersey: Princeton University Press, 1957.

28.

Kalman

, On the general theory of control system, IEEE Transactions on Automatic Control 4(3) (1960), 110–110.

29.

Wonham

W.M.

, On a matrix Riccati equation of stochastic control, SIAM Journal on Control and Optimization 6 (1968), 681–697.

30.

Dixit

A.K.

, Pindyck

R.S.

Pindyck, Investment under uncertainty. Princeton: Princeton University Press, 1994.

31.

and Zhou

X.Y.

, Indefinite stochastic LQ controls with Markovian jumps in a finite time horizon, Communications in Information and Systems 2 (2002), 265–282.

32.

Chen

S.P.

, Li

X.J.

and Zhou

X.Y.

, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Control and Optimization 36 (1998), 1685–1702.

33.

Peng

and Li

, Bound Evaluation for Spacecraft Swarm on Libration Orbits with an Uncertain Boundary, Journal of Guidance, Control, and Dynamics 40(10) (2017), 2688–2696.

34.

Peng

, Shi

, Wang

and Li

, Interval estimation and optimization for motion trajectory of overhead crane under uncertainty, Nonlinear Dynamics 96(2) (2019), 1693–1715.

35.

Solow

, A contribution to the theory of economic growth, The Quarterly Journal of Economics 70(1) (1956), 65–94.

36.

Zhu

Uncertain optimal control, Singapore: Springer Nature, 2019.

37.

Chen

, Zhu

Optimal control for multistage uncertain random dynamic systems with multiple time delays. ISA Transactions, 2022.

38.

Chen

and Zhu

, Uncertain random linear quadratic control with multiplicative and additive noises, Asian Journal of Control 23(6) (2021), 2849–2864.

39.

Yao

and Liu

, Parameter estimation in uncertain differential equations, Fuzzy Optimization and Decision Making 19(1) (2020), 1–12.

40.

Liu

and Liu

, Residual analysis and parameter estimation of uncertain differential equations, Fuzzy Optimization and Decision Making (2022), 1–18.

41.

Markowitz

, Portfolio selection, J Financ 7(1) (1952), 77–19.

42.

Qin

, Kar

and Zheng

, Uncertain portfolio adjusting model using semiabsolute deviation, Soft Computing 20(2) (2016), 717–725.

43.

and Zhang

, A new mean-variance-entropy model for uncertain portfolio optimization with liquidity and diversification, Chaos, Solitons & Fractals 146 (2021), 110842

44.

Dai

and Qin

, Multi-period uncertain portfolio optimization model with minimum transaction lots and dynamic risk preference, Applied Soft Computing 109 (2021), 107519

45.

Chen

, Li

and Liu

Y.J.

, A novel hybrid ICA-FA algorithm for multiperiod uncertain portfolio optimization model based on multiple criteria, IEEE Transactions on Fuzzy Systems 27(5) (2018), 1023–1036.

46.

, Sun

, AW

et al Uncertain portfolio optimization problem under a minimax risk measure, Applied Mathematical Modelling 76 (2019), 274–281.