This paper presents the first large-scale application of deep reinforcement learning to optimize the placement of limit orders at cryptocurrency exchanges. For training and out-of-sample evaluation, we use a virtual limit order exchange to reward agents according to the realized shortfall over a series of time steps. Based on the literature, we generate features that inform the agent about the current market state. Leveraging 18 months of high-frequency data with 300 million historic trades and more than 3.5 million order book states from major exchanges and currency pairs, we empirically compare state-of-the-art deep reinforcement learning algorithms to several benchmarks. We find proximal policy optimization to reliably learn superior order placement strategies when compared to deep double Q-networks and other benchmarks. Further analyses shed light into the black box of the learned execution strategy. Important features are current liquidity costs and queue imbalances, where the latter can be interpreted as predictors of short-term mid-price returns. To preferably execute volume in limit orders to avoid additional market order exchange fees, order placement tends to be more aggressive in expectation of unfavorable price movements.


    Access

    Download


    Export, share and cite



    Title :

    Deep reinforcement learning for the optimal placement of cryptocurrency limit orders


    Contributors:

    Publication date :

    2020-01-01


    Remarks:

    RePEc:zbw:iwqwdp:052020


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    330 / 629




    Adaptive Function Placement with Distributed Deep Reinforcement Learning in RAN Slicing

    Tsukamoto, Yu / Hirayama, Haruhisa / Il Moon, Seung et al. | IEEE | 2022


    Traffic-Aware UAV Placement Using a Generalizable Deep Reinforcement Learning Methodology

    Almeida, Eduardo Nuno / Campos, Rui / Ricardo, Manuel | ArXiv | 2022

    Free access

    Optimal placement of electric vehicle charging infrastructures utilizing deep learning

    Alansari, Mohamad / Al‐Sumaiti, Ameena Saad / Abughali, Ahmed | Wiley | 2024

    Free access

    AUTOMATIC PLACEMENT OF MICROSERVICES WITH REINFORCEMENT LEARNING

    RAO KUNAL G / COVIELLO GIUSEPPE / CHAKRADHAR SRIMAT | European Patent Office | 2025

    Free access

    Optimal placement of electric vehicle charging infrastructures utilizing deep learning

    Mohamad Alansari / Ameena Saad Al‐Sumaiti / Ahmed Abughali | DOAJ | 2024

    Free access