skip to main content
10.1145/3673038.3673147acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicppConference Proceedingsconference-collections
research-article
Open access

Parallel Task Scheduling in Autonomous Robotic Systems: An Event-Driven Multimodal Prediction Approach

Published: 12 August 2024 Publication History

Abstract

In autonomous robotic systems, the parallel processing of multiple tasks often competes for limited resources, affecting system performance and the robot’s responsiveness to environmental changes. Traditional computational task scheduling methods often overlook the dynamic nature of task priorities in autonomous robotic systems, where task importance can shift based on interactions with the external environment. Therefore, there’s a crucial need for a mechanism capable of adaptively adjusting task scheduling in response to environmental changes, ensuring timely access to resources for critical tasks. To address this challenge, this study presents Priorest, a neural network model that incorporates multimodal data processing and multitask learning. Priorest integrates sensor data with logs monitoring computational device performance to predict events influencing task priority, enabling task adjustments while preserving essential resource allocations. When deployed in autonomous robotic systems, Priorest’s event-prediction-based adjustment strategy reduced critical task completion times by 18.7%, which demonstrates the effectiveness of Priorest in enhancing parallel task scheduling.

References

[1]
Shivani Arbat, Vinodh Kumaran Jayakumar, Jaewoo Lee, Wei Wang, and In Kee Kim. 2022. Wasserstein adversarial transformer for cloud workload prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 12433–12439.
[2]
KHALDUN I Arif, MOHAMMED Morad, MOHAMMED A Mohammed, and MOHAMMED A Subhi. 2020. An Efficient Threshold Round-Robin Scheme for CPU Scheduling (ETRR). Journal of Engineering Science and Technology 15, 6 (2020), 4048–4060.
[3]
Seonmyeong Bak, Yanfei Guo, Pavan Balaji, and Vivek Sarkar. 2019. Optimized execution of parallel loops via user-defined scheduling policies. In Proceedings of the 48th International Conference on Parallel Processing. 1–10.
[4]
Khaled Bayoudh, Raja Knani, Fayçal Hamdaoui, and Abdellatif Mtibaa. 2022. A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets. The Visual Computer 38, 8 (2022), 2939–2970.
[5]
Lorenz Braun, Sotirios Nikas, Chen Song, Vincent Heuveline, and Holger Fröning. 2020. A simple model for portable and fast prediction of execution time and power consumption of GPU kernels. ACM Transactions on Architecture and Code Optimization (TACO) 18, 1 (2020), 1–25.
[6]
Chao Chen, Chris Porter, and Santosh Pande. 2022. Case: A compiler-assisted scheduling framework for multi-gpu systems. In Proceedings of the 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 17–31.
[7]
Guin Gilman. 2021. Concurrent Deep Learning Workloads on NVIDIA GPUs. Ph. D. Dissertation. WORCESTER POLYTECHNIC INSTITUTE.
[8]
Mingcong Han, Hanze Zhang, Rong Chen, and Haibo Chen. 2022. Microsecond-scale preemption for concurrent { GPU-accelerated}{ DNN} inferences. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22). 539–558.
[9]
Biao Hu, Zhengcai Cao, and Mengchu Zhou. 2019. Scheduling real-time parallel applications in cloud to minimize energy consumption. IEEE Transactions on Cloud Computing 10, 1 (2019), 662–674.
[10]
Zhiyu Huang, Xiaoyu Mo, and Chen Lv. 2022. Multi-modal motion prediction with transformer-based neural network for autonomous driving. In 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2605–2611.
[11]
In Kee Kim, Wei Wang, Yanjun Qi, and Marty Humphrey. 2020. Forecasting cloud application workloads with cloudinsight for predictive resource management. IEEE Transactions on Cloud Computing 10, 3 (2020), 1848–1863.
[12]
Dian-Lun Lin and Tsung-Wei Huang. 2021. Efficient GPU computation using task graph parallelism. In Euro-Par 2021: Parallel Processing: 27th International Conference on Parallel and Distributed Computing, Lisbon, Portugal, September 1–3, 2021, Proceedings 27. Springer, 435–450.
[13]
Mohammad Masdari and Afsane Khoshnevis. 2020. A survey and classification of the workload forecasting methods in cloud computing. Cluster Computing 23, 4 (2020), 2399–2424.
[14]
Priyanka Nehra and A Nagaraju. 2022. Host utilization prediction using hybrid kernel based support vector regression in cloud data centers. Journal of King Saud University-Computer and Information Sciences 34, 8 (2022), 6481–6490.
[15]
Soukaina Ouhame, Youssef Hadi, and Arif Ullah. 2021. An efficient forecasting approach for resource utilization in cloud data center using CNN-LSTM model. Neural Computing and Applications 33, 16 (2021), 10043–10055.
[16]
Erfan Pakdamanian, Shili Sheng, Sonia Baee, Seongkook Heo, Sarit Kraus, and Lu Feng. 2021. Deeptake: Prediction of driver takeover behavior using multimodal data. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
[17]
Bratislav Predić, Luka Jovanovic, Vladimir Simic, Nebojsa Bacanin, Miodrag Zivkovic, Petar Spalevic, Nebojsa Budimirovic, and Milos Dobrojevic. 2024. Cloud-load forecasting via decomposition-aided attention recurrent neural network tuned by modified particle swarm optimization. Complex & Intelligent Systems 10, 2 (2024), 2249–2269.
[18]
Mohamed Reda, Ahmed Onsy, Amira Y Haikal, and Ali Ghanbari. 2024. Path planning algorithms in the autonomous driving system: A comprehensive review. Robotics and Autonomous Systems 174 (2024), 104630.
[19]
Francisco Romero, Qian Li, Neeraja J Yadwadkar, and Christos Kozyrakis. 2021. { INFaaS} : Automated model-less inference serving. In 2021 USENIX Annual Technical Conference (USENIX ATC 21). 397–411.
[20]
Shanjiang Tang, Ce Yu, and Yusen Li. 2020. Fairness-efficiency scheduling for cloud computing with soft fairness guarantees. IEEE Transactions on Cloud Computing 10, 3 (2020), 1806–1818.
[21]
Balakrishnan Varadarajan, Ahmed Hefny, Avikalp Srivastava, Khaled S Refaat, Nigamaa Nayakanti, Andre Cornman, Kan Chen, Bertrand Douillard, Chi Pang Lam, Dragomir Anguelov, 2022. Multipath++: Efficient information fusion and trajectory aggregation for behavior prediction. In 2022 International Conference on Robotics and Automation (ICRA). IEEE, 7814–7821.
[22]
Tianfu Wang, Qilin Fan, Xiuhua Li, Xu Zhang, Qingyu Xiong, Shu Fu, and Min Gao. 2021. DRL-SFCP: Adaptive Service Function Chains Placement with Deep Reinforcement Learning. In ICC 2021 - IEEE International Conference on Communications. 1–6. https://doi.org/10.1109/ICC42927.2021.9500964
[23]
Tianfu Wang, Li Shen, Qilin Fan, Tong Xu, Tongliang Liu, and Hui Xiong. 2023. Joint Admission Control and Resource Allocation of Virtual Network Embedding Via Hierarchical Deep Reinforcement Learning. IEEE Transactions on Services Computing (2023), 1–14. https://doi.org/10.1109/TSC.2023.3326539
[24]
Wencong Xiao, Shiru Ren, Yong Li, Yang Zhang, Pengyang Hou, Zhi Li, Yihui Feng, Wei Lin, and Yangqing Jia. 2020. { AntMan} : Dynamic scaling on { GPU} clusters for deep learning. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). 533–548.
[25]
Yi Yao, Han Gao, Jiayin Wang, Bo Sheng, and Ningfang Mi. 2019. New scheduling algorithms for improving performance and resource utilization in hadoop YARN clusters. IEEE Transactions on Cloud Computing 9, 3 (2019), 1158–1171.
[26]
Gingfung Yeung, Damian Borowiec, Renyu Yang, Adrian Friday, Richard Harper, and Peter Garraghan. 2021. Horus: Interference-aware and prediction-based scheduling in deep learning systems. IEEE Transactions on Parallel and Distributed Systems 33, 1 (2021), 88–100.
[27]
Renteng Yuan, Mohamed Abdel-Aty, Qiaojun Xiang, Zijin Wang, and Xin Gu. 2023. A Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Prediction. IEEE Transactions on Intelligent Vehicles (2023).
[28]
Xinan Zhang, Tat Kei Chau, Yau Hing Chow, Tyrone Fernando, and Herbert Ho-Ching Iu. 2023. A novel sequence to sequence data modelling based CNN-LSTM algorithm for three years ahead monthly peak load forecasting. IEEE Transactions on Power Systems 39, 1 (2023), 1932–1947.
[29]
Xiaorui Zhang, Xuan Chen, Wei Sun, and Xiaozheng He. 2021. Vehicle Re-Identification Model Based on Optimized DenseNet121 with Joint Loss.Computers, Materials & Continua 67, 3 (2021).
[30]
Yazhou Zhang, Jinglin Wang, Yaochen Liu, Lu Rong, Qian Zheng, Dawei Song, Prayag Tiwari, and Jing Qin. 2023. A multitask learning model for multimodal sarcasm, sentiment and emotion recognition in conversations. Information Fusion 93 (2023), 282–301.
[31]
Wei Zhong, Yi Zhuang, Jian Sun, and Jingjing Gu. 2018. A load prediction model for cloud computing using PSO-based weighted wavelet support vector machine. Applied Intelligence 48 (2018), 4072–4083.
[32]
Sonia Zouaoui, Lotfi Boussaid, and Abdellatif Mtibaa. 2019. Priority based round robin (PBRR) CPU scheduling algorithm.International Journal of Electrical & Computer Engineering (2088-8708) 9, 1 (2019).

Index Terms

  1. Parallel Task Scheduling in Autonomous Robotic Systems: An Event-Driven Multimodal Prediction Approach

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICPP '24: Proceedings of the 53rd International Conference on Parallel Processing
    August 2024
    1279 pages
    ISBN:9798400717932
    DOI:10.1145/3673038
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 August 2024

    Check for updates

    Author Tags

    1. Autonomous robotic systems
    2. event-driven multimodal prediction.
    3. parallel task scheduling

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    ICPP '24

    Acceptance Rates

    Overall Acceptance Rate 91 of 313 submissions, 29%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 104
      Total Downloads
    • Downloads (Last 12 months)104
    • Downloads (Last 6 weeks)104
    Reflects downloads up to 15 Sep 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media