Real-time Anomaly Detection in Dark Pool Trading Using Enhanced Transformer Networks

Authors

  • Guanghe Cao Computer Science, University of Southern California, CA, USA Author
  • Shuaiqi Zheng Data Analytics, Illinois Institute of Technology, IL, USA Author
  • Yibang Liu Business Analytics, Fordham University, NY, USA Author

DOI:

https://doi.org/10.60087/jklst.v3.n4.p320

Abstract

This paper uses an enhanced transformer network architecture to present a novel approach to real-time anomaly detection in dark pool trading environments. Dark pools facilitate anonymous large-volume trades and require sophisticated surveillance mechanisms to maintain market integrity. We propose a specialized transformer-based framework integrating advanced attention mechanisms with optimized processing pipelines for efficient anomaly detection. The system incorporates modified self-attention patterns and specialized feature engineering techniques for high-frequency trading data. Our implementation demonstrates significant improvements in detection accuracy and computational efficiency compared to existing approaches. Experimental evaluation on a comprehensive dataset of 2.5 million trading records shows a detection accuracy of 97.8% while maintaining a low false positive rate of 0.8%. The system achieves a processing latency of 2.3ms, representing a 45.2% improvement over baseline models. The architecture demonstrates robust performance across various market conditions and trading volumes, making it suitable for production environments. Our research contributes to advancing financial market surveillance systems by establishing new performance standards for real-time anomaly detection in dark pool trading environments.

Downloads

Download data is not yet available.

References

Choncholas, J., Bhardwaj, K., Kolesnikov, V., & Gavrilovska, A. (2023, December). Angler: Dark Pool Resource Allocation. In 2023 IEEE/ACM Symposium on Edge Computing (SEC) (pp. 108-120). IEEE.

Park, C. H. (2018, January). Anomaly pattern detection on data streams. In 2018 IEEE International Conference on Big Data and Smart Computing (BigComp) (pp. 689-692). IEEE.

Dalvi, A., Kulkarni, P., Kore, A., & Bhirud, S. G. (2023, March). Dark web crawling for cybersecurity: Insights into vulnerabilities and ransomware discussions. In 2023 2nd In-ternational Conference for Innovation in Technology (INO-CON) (pp. 1-6). IEEE.

Yang, S., Guo, H., & Moustafa, N. (2021, December). Hunter in the dark: Discover anomalous network activity using deep ensemble network. In 2021 IEEE 21st International Confer-ence on Software Quality, Reliability and Security (QRS) (pp. 829-840). IEEE.

Kumar, A., Rizk, R., & Santosh, K. C. (2024, June). Trans-former-based Reinforcement Learning Model for Optimized Quantitative Trading. In 2024 IEEE Conference on Artificial Intelligence (CAI) (pp. 1454-1455). IEEE.

Xia, S., Wei, M., Zhu, Y., & Pu, Y. (2024). AI-Driven Intelli-gent Financial Analysis: Enhancing Accuracy and Efficiency in Financial Decision-Making. Journal of Economic Theory and Business Management, 1(5), 1-11.

Zhang, H., Lu, T., Wang, J., & Li, L. (2024). Enhancing Faci-al Micro-Expression Recognition in Low-Light Conditions Using Attention-guided Deep Learning. Journal of Economic Theory and Business Management, 1(5), 12-22.

Wang, J., Lu, T., Li, L., & Huang, D. (2024). Enhancing Per-sonalized Search with AI: A Hybrid Approach Integrating Deep Learning and Cloud Computing. International Journal of Innovative Research in Computer Science & Technology, 12(5), 127-138.

Che, C., Huang, Z., Li, C., Zheng, H., & Tian, X. (2024). Integrating generative AI into financial market prediction for improved decision-making. arXiv preprint arXiv:2404.03523.

Che, C., Zheng, H., Huang, Z., Jiang, W., & Liu, B. (2024). Intelligent robotic control system based on computer vision technology. arXiv preprint arXiv:2404.01116.

Jiang, Y., Tian, Q., Li, J., Zhang, M., & Li, L. (2024). The Application Value of Ultrasound in the Diagnosis of Ovarian Torsion. International Journal of Biology and Life Sciences, 7(1), 59-62.

Li, L., Li, X., Chen, H., Zhang, M., & Sun, L. (2024). Appli-cation of AI-assisted Breast Ultrasound Technology in Breast Cancer Screening. International Journal of Biology and Life Sciences, 7(1), 1-4.

Lijie, L., Caiying, P., Liqian, S., Miaomiao, Z., & Yi, J. The application of ultrasound automatic volume imaging in de-tecting breast tumors.

Xu, K., Zhou, H., Zheng, H., Zhu, M., & Xin, Q. (2024). In-telligent Classification and Personalized Recommendation of E-commerce Products Based on Machine Learning. arXiv preprint arXiv:2403.19345.

Xu, K., Zheng, H., Zhan, X., Zhou, S., & Niu, K. (2024). Evaluation and Optimization of Intelligent Recommendation System Performance with Cloud Resource Automation Compatibility.

Zheng, H., Xu, K., Zhou, H., Wang, Y., & Su, G. (2024). Medication Recommendation System Based on Natural Language Processing for Patient Emotion Analysis. Academ-ic Journal of Science and Technology, 10(1), 62-68.

Zheng, H.; Wu, J.; Song, R.; Guo, L.; Xu, Z. Predicting Fi-nancial Enterprise Stocks and Economic Data Trends Using Machine Learning Time Series Analysis. Applied and Com-putational Engineering 2024, 87, 26–32.

Zhang, M., Yuan, B., Li, H., & Xu, K. (2024). LLM-Cloud Complete: Leveraging Cloud Computing for Efficient Large Language Model-based Code Completion. Journal of Artifi-cial Intelligence General Science (JAIGS) ISSN: 3006-4023, 5(1), 295-326.

Li, P., Hua, Y., Cao, Q., & Zhang, M. (2020, December). Im-proving the Restore Performance via Physical-Locality Mid-dleware for Backup Systems. In Proceedings of the 21st In-ternational Middleware Conference (pp. 341-355).

Zhou, S., Yuan, B., Xu, K., Zhang, M., & Zheng, W. (2024). THE IMPACT OF PRICING SCHEMES ON CLOUD COMPUTING AND DISTRIBUTED SYSTEMS. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 193-205.

Shang, F., Zhao, F., Zhang, M., Sun, J., & Shi, J. (2024). Per-sonalized Recommendation Systems Powered By Large Language Models: Integrating Semantic Understanding and User Preferences. International Journal of Innovative Re-search in Engineering and Management, 11(4), 39-49.

Sun, J., Wen, X., Ping, G., & Zhang, M. (2024). Application of News Analysis Based on Large Language Models in Sup-ply Chain Risk Prediction. Journal of Computer Technology and Applied Mathematics, 1(3), 55-65.

Zhao, F., Zhang, M., Zhou, S., & Lou, Q. (2024). Detection of Network Security Traffic Anomalies Based on Machine Learning KNN Method. Journal of Artificial Intelligence General Science (JAIGS) ISSN: 3006-4023, 1(1), 209-218.

Ju, C., & Zhu, Y. (2024). Reinforcement Learning‐Based Model for Enterprise Financial Asset Risk Assessment and Intelligent Decision‐Making.

Huang, D., Yang, M., & Zheng, W. (2024). Integrating AI and Deep Learning for Efficient Drug Discovery and Target Iden-tification.

Yang, M., Huang, D., & Zhan, X. (2024). Federated Learning for Privacy-Preserving Medical Data Sharing in Drug Devel-opment.

Li, H., Wang, G., Li, L., & Wang, J. (2024). Dynamic Re-source Allocation and Energy Optimization in Cloud Data Centers Using Deep Reinforcement Learning. Journal of Ar-tificial Intelligence General Science (JAIGS) ISSN: 3006-4023, 1(1), 230-258.

Li, H., Sun, J., & Ke, X. (2024). AI-Driven Optimization System for Large-Scale Kubernetes Clusters: Enhancing Cloud Infrastructure Availability, Security, and Disaster Re-covery. Journal of Artificial Intelligence General Science (JAIGS) ISSN: 3006-4023, 2(1), 281-306.

Downloads

Published

25-12-2024

How to Cite

Guanghe , C., Zheng, S. ., & Liu, Y. . (2024). Real-time Anomaly Detection in Dark Pool Trading Using Enhanced Transformer Networks. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(4), 320-329. https://doi.org/10.60087/jklst.v3.n4.p320