Abstract
We have previously described trading systems based on un-supervised learning approaches such as reinforcement learning and genetic algorithms which take as input a collection of commonly used technical indicators and generate profitable trading decisions from them. This article demonstrates the advantages of applying evolutionary algorithms to the reinforcement learning problem using a hybrid credit assignment approach. In earlier work, the temporal difference reinforcement learning approach suffered from problems with overfitting the in-sample data. This motivated the present approach.
Technical analysis has been shown previously to have predictive value regarding future movements of foreign exchange prices and this article presents methods for automated high-frequency FX trading based on evolutionary reinforcement learning about signals from a variety of technical indicators. These methods are applied to GBPUSD, USDCHF and USDJPY exchange rates at various frequencies. Statistically significant profits are made consistently at transaction costs of up to 4bp for the hybrid system while the standard RL is only able to trade profitably up to about 1bp slippage per trade.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S. Achelis, Technical Analysis from A to Z, McGraw-Hill, New York, 2001.
N. Chidambaran, C. Jevons Lee, AND J. Trigueros, An adaptive evolutionary approach to option pricing via genetic programming, Proceedings of the 6th International Conference on Computational Finance, (1999).
M. A. H. Dempster AND C. M. Jones, Can technical pattern trading be profitably automated: 2. The head and shoulders. Working Paper No. 12/99, Judge Institute of Management, University of Cambridge, 1999.
-, The profitability of intra-day FX trading using technical indicators. Working Paper No. 35/00, Judge Institute of Management, University of Cambridge, 2000.
-, A real-time adaptive trading system using genetic programming, Quantitative Finance, 1 (2001), pp. 397–413.
M. A. H. Dempster, T. W. Payne, Y. Romahi, AND G. Thompson, Computational learning techniques for intraday fx trading using popular technical indicators, IEEE Transactions on Neural Networks, Special Issue on Computational Finance, 12 (2001), pp. 744–754.
M. A. H. Dempster, T. W. Payne, AND Y. S. Romahi, Intraday FX trading: Reinforcement learning vs evolutionary learning. Working Paper No. 23/01, Judge Institute of Management, University of Cambridge, 2001, December 2001.
J. H. Holland, Adaptation in natural and artificial systems, University of Michigan Press, Ann Arbour, MI, 1975.
C. M. Jones, Automated technical foreign exchange trading with high frequency data, PhD thesis, Centre for Financial Research, Judge Institute of Management Studies, University of Cambridge, June 1999.
L. P. Kaelbling, M. L. Littman, AND A. W. Moore, Reinforcement. A survey, Journal of Artificial Intelligence Research, 4 (1996), pp. 237–285.
R. Levich AND L. Thomas, The significance of technical trading rule profits in the foreign exchange market: A bootstrap approach, Journal of International Money and Finance, 12 (1993), pp. 451–474.
A. W. Lo AND A. C. MacKinlay, Stock market prices do not follow random walks: Evidence from a simple specification test, Review of Financial Studies, 1 (1988), pp. 41–66.
A. W. Lo AND A. C. MacKinlay, A Non-Random Walk Down Wall Street, Princeton University Press, Princeton, NJ, 1999.
P. Maes AND R. Brooks, Learning to coordinate behaviors, Proceedings of the 8th National Conference on Artificial Intelligence, (1990), pp. 796–802.
J. Moody, L. Wu, Y. Liao, AND M. Saffell, Performance functions and reinforcement learning for trading systems and portfolios, The Journal of Forecasting, 17 (1998), pp. 441–470.
C. Neely AND P. Weller, Intraday technical trading in the foreign exchange market. Working Paper 99-016A, Federal Reserve Bank of St. Louis, November 1999.
C. J. Neely, Technical analysis in the foreign exchange market: a layman’s guide, in Federal Reserve Bank of St. Louis Review, September/October 1997, pp. 23–38.
C. J. Neely, P. A. Weller, AND R. Dittmar, Is technical analysis in the foreign exchange market profitable? a genetic programming approach, Journal of Financial and Quantitative Analysis, 32 (1997), pp. 405–426. Also available as Federal Reserve Bank of St. Louis Working Paper 96-006C.
R. Neuneier, Enhancing Q-learning for optimal asset allocation, in Advances in Neural Information Processing Systems, M. I. Jordan, M. J. Kearns, and S. A. Solla, eds., vol. 10, The MIT Press, 1998.
C. L. Osler AND P. H. K. Chang, Methodical madness: Technical analysis and the irrationality of exchange-rate forecasts, Economic Journal, 109 (1999), pp. 636–661.
O. V. Pictet, M. M. Dacorogna, B. Chopard, M. Oudsaidene, R. Schirru, AND M. Tomassini, Using genetic algorithm for robust optimization in financial applications, Neural Network World, 5 (1995), pp. 573–587.
R. S. Sutton AND A. G. Barto, Reinforcement learning: An introduction, The MIT Press, 1998.
C. Watkins, Learning from Delayed Reward, PhD thesis, Kings College, University of Cambridge, 1989.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dempster, M.A.H., Romahi, Y.S. (2002). Intraday FX Trading: An Evolutionary Reinforcement Learning Approach. In: Yin, H., Allinson, N., Freeman, R., Keane, J., Hubbard, S. (eds) Intelligent Data Engineering and Automated Learning — IDEAL 2002. IDEAL 2002. Lecture Notes in Computer Science, vol 2412. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45675-9_52
Download citation
DOI: https://doi.org/10.1007/3-540-45675-9_52
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44025-3
Online ISBN: 978-3-540-45675-9
eBook Packages: Springer Book Archive