D&A: resource optimization in personalized PageRank computations using multi-core machines
Resource optimization is commonly used in workload management, ensuring efficient and timely task completion utilising available resources. It serves to minimise costs, prompting the development of numerous algorithms tailored to this end. The majority of these techniques focus on scheduling and exe...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE Computer Society
2024
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/119419/ http://psasir.upm.edu.my/id/eprint/119419/1/119419.pdf |
| _version_ | 1848867960247025664 |
|---|---|
| author | Yow, Kai Siong Li, Chunbo |
| author_facet | Yow, Kai Siong Li, Chunbo |
| author_sort | Yow, Kai Siong |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Resource optimization is commonly used in workload management, ensuring efficient and timely task completion utilising available resources. It serves to minimise costs, prompting the development of numerous algorithms tailored to this end. The majority of these techniques focus on scheduling and executing workloads effectively within the provided resource constraints. In this paper, we tackle this problem using another approach. We propose a novel framework D&A to determine the number of cores required in completing a workload under time constraint. We first preprocess a small portion of queries to derive the number of required slots, allowing for the allocation of the remaining workloads into each slot. We introduce a scaling factor in handling the time fluctuation issue caused by random functions. We further establish a lower bound of the number of cores required under this scenario, serving as a baseline for comparison purposes. We examine the framework by computing personalized PageRank values involving intensive computations. Our experimental results show that D&A surpasses the baseline, achieving reductions in the required number of cores ranging from 38.89%38.89% to 73.68%73.68% across benchmark datasets comprising millions of vertices and edges. |
| first_indexed | 2025-11-15T14:44:48Z |
| format | Article |
| id | upm-119419 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T14:44:48Z |
| publishDate | 2024 |
| publisher | IEEE Computer Society |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-1194192025-08-21T07:17:24Z http://psasir.upm.edu.my/id/eprint/119419/ D&A: resource optimization in personalized PageRank computations using multi-core machines Yow, Kai Siong Li, Chunbo Resource optimization is commonly used in workload management, ensuring efficient and timely task completion utilising available resources. It serves to minimise costs, prompting the development of numerous algorithms tailored to this end. The majority of these techniques focus on scheduling and executing workloads effectively within the provided resource constraints. In this paper, we tackle this problem using another approach. We propose a novel framework D&A to determine the number of cores required in completing a workload under time constraint. We first preprocess a small portion of queries to derive the number of required slots, allowing for the allocation of the remaining workloads into each slot. We introduce a scaling factor in handling the time fluctuation issue caused by random functions. We further establish a lower bound of the number of cores required under this scenario, serving as a baseline for comparison purposes. We examine the framework by computing personalized PageRank values involving intensive computations. Our experimental results show that D&A surpasses the baseline, achieving reductions in the required number of cores ranging from 38.89%38.89% to 73.68%73.68% across benchmark datasets comprising millions of vertices and edges. IEEE Computer Society 2024 Article PeerReviewed text en http://psasir.upm.edu.my/id/eprint/119419/1/119419.pdf Yow, Kai Siong and Li, Chunbo (2024) D&A: resource optimization in personalized PageRank computations using multi-core machines. IEEE Transactions on Knowledge and Data Engineering, 36 (11). pp. 5905-5910. ISSN 1041-4347; eISSN: 1558-2191 https://ieeexplore.ieee.org/document/10568343/ 10.1109/TKDE.2024.3417264 |
| spellingShingle | Yow, Kai Siong Li, Chunbo D&A: resource optimization in personalized PageRank computations using multi-core machines |
| title | D&A: resource optimization in personalized PageRank computations using multi-core machines |
| title_full | D&A: resource optimization in personalized PageRank computations using multi-core machines |
| title_fullStr | D&A: resource optimization in personalized PageRank computations using multi-core machines |
| title_full_unstemmed | D&A: resource optimization in personalized PageRank computations using multi-core machines |
| title_short | D&A: resource optimization in personalized PageRank computations using multi-core machines |
| title_sort | d&a: resource optimization in personalized pagerank computations using multi-core machines |
| url | http://psasir.upm.edu.my/id/eprint/119419/ http://psasir.upm.edu.my/id/eprint/119419/ http://psasir.upm.edu.my/id/eprint/119419/ http://psasir.upm.edu.my/id/eprint/119419/1/119419.pdf |