Titles for previous plots. Conclusions and Future Work

This commit is contained in:
Noah L. Schrick 2023-04-22 17:13:30 -05:00
parent 5db09e309d
commit f22d9c87ca
13 changed files with 141 additions and 66 deletions

View File

@ -1360,3 +1360,44 @@ month = {oct},
keywords = {cyber-physical system, high performance computing, attack graph, breadth-first search}
}
@article{Gust,
author = {Gustafson, John L.},
title = {Reevaluating Amdahl's Law},
year = {1988},
issue_date = {May 1988},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {31},
number = {5},
issn = {0001-0782},
url = {https://doi.org/10.1145/42411.42415},
doi = {10.1145/42411.42415},
journal = {Commun. ACM},
month = {may},
pages = {532533},
numpages = {2}
}
@inproceedings{sun,
title={Another view on parallel speedup},
author={Sun, Xian-He and Ni, Lionel M},
booktitle={Proceedings of the 1990 ACM/IEEE conference on Supercomputing},
pages={324--333},
year={1990}
}
@inproceedings{Amdahl,
author = {Amdahl, Gene M.},
title = {Validity of the Single Processor Approach to Achieving Large Scale Computing Capabilities},
year = {1967},
isbn = {9781450378956},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/1465482.1465560},
doi = {10.1145/1465482.1465560},
booktitle = {Proceedings of the April 18-20, 1967, Spring Joint Computer Conference},
pages = {483485},
numpages = {3},
location = {Atlantic City, New Jersey},
series = {AFIPS '67 (Spring)}
}

View File

@ -112,6 +112,15 @@
\newlabel{fig:overall-speedup}{{12}{9}{Minimum, Maximum, and Mean Speedups of MPI Tasking Across All Problem Sizes}{figure.12}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {13}{\ignorespaces Minimum, Maximum, and Mean Efficiencies of MPI Tasking Across All Problem Sizes}}{9}{figure.13}\protected@file@percent }
\newlabel{fig:overall-efficiency}{{13}{9}{Minimum, Maximum, and Mean Efficiencies of MPI Tasking Across All Problem Sizes}{figure.13}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {14}{\ignorespaces Mean Speedup and Efficiency for the Exploit Parameter Across the Number of Compute Nodes}}{10}{figure.14}\protected@file@percent }
\newlabel{fig:param-exploit}{{14}{10}{Mean Speedup and Efficiency for the Exploit Parameter Across the Number of Compute Nodes}{figure.14}{}}
\@writefile{toc}{\contentsline {section}{\numberline {VIII}Conclusion and Future Work}{10}{section.8}\protected@file@percent }
\newlabel{sec:FW}{{VIII}{10}{Conclusion and Future Work}{section.8}{}}
\@writefile{lof}{\contentsline {figure}{\numberline {15}{\ignorespaces Mean Speedup and Efficiency for the Applicability of Exploit Parameter Across the Number of Compute Nodes}}{10}{figure.15}\protected@file@percent }
\newlabel{fig:param-appl}{{15}{10}{Mean Speedup and Efficiency for the Applicability of Exploit Parameter Across the Number of Compute Nodes}{figure.15}{}}
\citation{Amdahl}
\citation{Gust}
\citation{sun}
\bibdata{Bibliography}
\bibcite{9678822}{1}
\bibcite{7993827}{2}
@ -126,13 +135,6 @@
\bibcite{pacheco_introduction_2011}{11}
\bibcite{ainsworth_graph_2016}{12}
\bibcite{yao_efficient_2018}{13}
\@writefile{lof}{\contentsline {figure}{\numberline {14}{\ignorespaces Mean Speedup and Efficiency for the Exploit Parameter Across the Number of Compute Nodes}}{10}{figure.14}\protected@file@percent }
\newlabel{fig:param-exploit}{{14}{10}{Mean Speedup and Efficiency for the Exploit Parameter Across the Number of Compute Nodes}{figure.14}{}}
\@writefile{toc}{\contentsline {section}{\numberline {VIII}Conclusion and Future Work}{10}{section.8}\protected@file@percent }
\newlabel{sec:FW}{{VIII}{10}{Conclusion and Future Work}{section.8}{}}
\@writefile{toc}{\contentsline {section}{References}{10}{section*.1}\protected@file@percent }
\@writefile{lof}{\contentsline {figure}{\numberline {15}{\ignorespaces Mean Speedup and Efficiency for the Applicability of Exploit Parameter Across the Number of Compute Nodes}}{10}{figure.15}\protected@file@percent }
\newlabel{fig:param-appl}{{15}{10}{Mean Speedup and Efficiency for the Applicability of Exploit Parameter Across the Number of Compute Nodes}{figure.15}{}}
\bibcite{zhang_boosting_2017}{14}
\bibcite{dai_fpgp_2016}{15}
\bibcite{arifuzzaman_fast_2015}{16}
@ -145,9 +147,13 @@
\bibcite{li_concurrency_2019}{23}
\bibcite{9150145}{24}
\bibcite{7087377}{25}
\bibcite{li_combining_2019}{26}
\bibcite{Slurm}{27}
\bibstyle{ieeetr}
\@writefile{lof}{\contentsline {figure}{\numberline {16}{\ignorespaces Mean Speedup and Efficiency for the Database Load Parameter Across the Number of Compute Nodes}}{11}{figure.16}\protected@file@percent }
\newlabel{fig:param-load}{{16}{11}{Mean Speedup and Efficiency for the Database Load Parameter Across the Number of Compute Nodes}{figure.16}{}}
\gdef \@abspage@last{11}
\@writefile{toc}{\contentsline {section}{References}{11}{section*.1}\protected@file@percent }
\bibcite{li_combining_2019}{26}
\bibcite{Slurm}{27}
\bibcite{Amdahl}{28}
\bibcite{Gust}{29}
\bibcite{sun}{30}
\bibstyle{ieeetr}
\gdef \@abspage@last{12}

View File

@ -140,4 +140,19 @@ M.~Li, P.~Hawrylak, and J.~Hale, ``Combining {OpenCL} and {MPI} to support
\bibitem{Slurm}
SchedMD, ``Slurm {Workload} {Manager}.''
\bibitem{Amdahl}
G.~M. Amdahl, ``Validity of the single processor approach to achieving large
scale computing capabilities,'' in {\em Proceedings of the April 18-20, 1967,
Spring Joint Computer Conference}, AFIPS '67 (Spring), (New York, NY, USA),
p.~483485, Association for Computing Machinery, 1967.
\bibitem{Gust}
J.~L. Gustafson, ``Reevaluating amdahl's law,'' {\em Commun. ACM}, vol.~31,
p.~532533, may 1988.
\bibitem{sun}
X.-H. Sun and L.~M. Ni, ``Another view on parallel speedup,'' in {\em
Proceedings of the 1990 ACM/IEEE conference on Supercomputing}, pp.~324--333,
1990.
\end{thebibliography}

View File

@ -5,45 +5,45 @@ The style file: ieeetr.bst
Database file #1: Bibliography.bib
Warning--entry type for "Slurm" isn't style-file defined
--line 1112 of file Bibliography.bib
You've used 27 entries,
You've used 30 entries,
1876 wiz_defined-function locations,
614 strings with 8964 characters,
and the built_in function-call counts, 6725 in all, are:
= -- 621
> -- 283
636 strings with 9395 characters,
and the built_in function-call counts, 7761 in all, are:
= -- 739
> -- 299
< -- 0
+ -- 105
- -- 78
* -- 456
:= -- 942
add.period$ -- 27
call.type$ -- 27
change.case$ -- 27
+ -- 112
- -- 82
* -- 504
:= -- 1055
add.period$ -- 30
call.type$ -- 30
change.case$ -- 30
chr.to.int$ -- 0
cite$ -- 27
duplicate$ -- 359
empty$ -- 693
format.name$ -- 78
if$ -- 1648
cite$ -- 30
duplicate$ -- 437
empty$ -- 789
format.name$ -- 82
if$ -- 1925
int.to.chr$ -- 0
int.to.str$ -- 27
missing$ -- 23
newline$ -- 87
num.names$ -- 26
pop$ -- 135
int.to.str$ -- 30
missing$ -- 26
newline$ -- 96
num.names$ -- 29
pop$ -- 148
preamble$ -- 1
purify$ -- 0
quote$ -- 0
skip$ -- 221
skip$ -- 296
stack$ -- 0
substring$ -- 383
swap$ -- 122
substring$ -- 451
swap$ -- 169
text.length$ -- 0
text.prefix$ -- 0
top$ -- 0
type$ -- 0
warning$ -- 0
while$ -- 60
width$ -- 29
write$ -- 240
while$ -- 68
width$ -- 32
write$ -- 271
(There was 1 warning)

View File

@ -1,4 +1,4 @@
This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023/Arch Linux) (preloaded format=pdflatex 2023.4.3) 22 APR 2023 16:00
This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023/Arch Linux) (preloaded format=pdflatex 2023.4.3) 22 APR 2023 17:12
entering extended mode
restricted \write18 enabled.
%&-line parsing enabled.
@ -651,37 +651,43 @@ Underfull \vbox (badness 3815) has occurred while \output is active []
[9 <./images/applicability-runtime.png> <./images/dbload-runtime.png> <./image
s/overall-speedup.png> <./images/overall-efficiency.png>]
<./images/exploit-speedup.png, id=292, 414.8298pt x 312.2064pt>
<./images/exploit-speedup.png, id=292, 414.8298pt x 344.0052pt>
File: ./images/exploit-speedup.png Graphic file (type png)
<use ./images/exploit-speedup.png>
Package pdftex.def Info: ./images/exploit-speedup.png used on input line 357.
(pdftex.def) Requested size: 252.0pt x 189.65482pt.
<./images/exploit-eff.png, id=293, 414.8298pt x 312.2064pt>
(pdftex.def) Requested size: 252.0pt x 208.97151pt.
<./images/exploit-eff.png, id=293, 414.8298pt x 344.0052pt>
File: ./images/exploit-eff.png Graphic file (type png)
<use ./images/exploit-eff.png>
Package pdftex.def Info: ./images/exploit-eff.png used on input line 358.
(pdftex.def) Requested size: 252.0pt x 189.65482pt.
<./images/appl-speedup.png, id=294, 409.7709pt x 312.2064pt>
(pdftex.def) Requested size: 252.0pt x 208.97151pt.
<./images/appl-speedup.png, id=294, 409.7709pt x 344.0052pt>
File: ./images/appl-speedup.png Graphic file (type png)
<use ./images/appl-speedup.png>
Package pdftex.def Info: ./images/appl-speedup.png used on input line 365.
(pdftex.def) Requested size: 252.0pt x 191.99866pt.
<./images/appl-eff.png, id=295, 409.7709pt x 312.2064pt>
(pdftex.def) Requested size: 252.0pt x 211.55406pt.
<./images/appl-eff.png, id=295, 409.7709pt x 344.0052pt>
File: ./images/appl-eff.png Graphic file (type png)
<use ./images/appl-eff.png>
Package pdftex.def Info: ./images/appl-eff.png used on input line 366.
(pdftex.def) Requested size: 252.0pt x 191.99866pt.
<./images/load-speedup.png, id=296, 409.7709pt x 312.2064pt>
(pdftex.def) Requested size: 252.0pt x 211.55406pt.
<./images/load-speedup.png, id=296, 409.7709pt x 344.0052pt>
File: ./images/load-speedup.png Graphic file (type png)
<use ./images/load-speedup.png>
Package pdftex.def Info: ./images/load-speedup.png used on input line 373.
(pdftex.def) Requested size: 252.0pt x 191.99866pt.
<./images/load-eff.png, id=297, 409.7709pt x 312.2064pt>
(pdftex.def) Requested size: 252.0pt x 211.55406pt.
<./images/load-eff.png, id=297, 409.7709pt x 344.0052pt>
File: ./images/load-eff.png Graphic file (type png)
<use ./images/load-eff.png>
Package pdftex.def Info: ./images/load-eff.png used on input line 374.
(pdftex.def) Requested size: 252.0pt x 191.99866pt.
(./Schrick-Noah_MPI-Tasking.bbl
(pdftex.def) Requested size: 252.0pt x 211.55406pt.
[10 <./images/exploit-speedup.png> <./images/exploit-eff.png> <./images/appl-s
peedup.png> <./images/appl-eff.png>]
Underfull \hbox (badness 4779) in paragraph at lines 387--388
[]\OT1/ptm/m/n/10 The analysis portion of this work also has room
[]
(./Schrick-Noah_MPI-Tasking.bbl
Underfull \hbox (badness 1442) in paragraph at lines 21--26
\OT1/ptm/m/n/8 A Focus on Cyberphysical Systems and Internet of Things,'' in
[]
@ -702,8 +708,7 @@ Underfull \hbox (badness 1859) in paragraph at lines 65--68
[]\OT1/ptm/m/n/8 P. Yao, L. Zheng, X. Liao, H. Jin, and B. He, ``An efficient
[]
[10 <./images/exploit-speedup.png> <./images/exploit-eff.png> <./images/appl-sp
eedup.png> <./images/appl-eff.png>]
Underfull \hbox (badness 10000) in paragraph at lines 110--114
[]\OT1/ptm/m/n/8 J. Siek, L.-Q. Lee, and A. Lumsdaine,
[]
@ -713,7 +718,7 @@ Underfull \hbox (badness 10000) in paragraph at lines 110--114
\OT1/ptm/m/n/8 ``The Boost Graph Library, vers. 1.75.0.''
[]
)
[11 <./images/load-speedup.png> <./images/load-eff.png>])
** Conference Paper **
Before submitting the final camera ready copy, remember to:
@ -725,20 +730,21 @@ Before submitting the final camera ready copy, remember to:
uses only Type 1 fonts and that every step in the generation
process uses the appropriate paper size.
[11 <./images/load-speedup.png> <./images/load-eff.png>]
(./Schrick-Noah_MPI-Tasking.aux)
[12
] (./Schrick-Noah_MPI-Tasking.aux)
Package rerunfilecheck Info: File `Schrick-Noah_MPI-Tasking.out' has not change
d.
(rerunfilecheck) Checksum: 267D7A1F68719DE5E57F3E8948B6C837;3398.
)
Here is how much of TeX's memory you used:
12325 strings out of 476025
196992 string characters out of 5796533
12332 strings out of 476025
197046 string characters out of 5796533
1871388 words of memory out of 5000000
32510 multiletter control sequences out of 15000+600000
32513 multiletter control sequences out of 15000+600000
550927 words of font info for 105 fonts, out of 8000000 for 9000
1141 hyphenation exceptions out of 8191
75i,14n,76p,2022b,593s stack positions out of 5000i,500n,10000p,200000b,80000s
75i,14n,76p,2022b,587s stack positions out of 5000i,500n,10000p,200000b,80000s
</usr/share/texmf-dist/fonts/type1/public/amsfonts/cm/cmmi10.pfb></usr/share/
texmf-dist/fonts/type1/public/amsfonts/cm/cmr10.pfb></usr/share/texmf-dist/font
s/type1/public/amsfonts/cm/cmr7.pfb></usr/share/texmf-dist/fonts/type1/public/a
@ -746,10 +752,10 @@ msfonts/cm/cmsy10.pfb></usr/share/texmf-dist/fonts/type1/public/amsfonts/cm/cms
y7.pfb></usr/share/texmf-dist/fonts/type1/urw/times/utmb8a.pfb></usr/share/texm
f-dist/fonts/type1/urw/times/utmbi8a.pfb></usr/share/texmf-dist/fonts/type1/urw
/times/utmr8a.pfb></usr/share/texmf-dist/fonts/type1/urw/times/utmri8a.pfb>
Output written on Schrick-Noah_MPI-Tasking.pdf (11 pages, 897394 bytes).
Output written on Schrick-Noah_MPI-Tasking.pdf (12 pages, 943257 bytes).
PDF statistics:
373 PDF objects out of 1000 (max. 8388607)
298 compressed objects within 3 object streams
81 named destinations out of 1000 (max. 500000)
385 PDF objects out of 1000 (max. 8388607)
308 compressed objects within 4 object streams
85 named destinations out of 1000 (max. 500000)
298 words of extra memory for PDF output out of 10000 (max. 10000000)

Binary file not shown.

View File

@ -378,6 +378,13 @@ Speedups and efficiencies were also computed across each parameter. Using pivot
\section{Conclusion and Future Work} \label{sec:FW}
This work presents a task parallelism approach for large-scale attack and compliance graphs. This approach is a distributed approach rather than a shared-memory approach, allowing for the generation of these large-scale graphs to be deployed on HPC systems. Tasks were identified in the generation process, with parallelization of the tasks clearly identified and incorporated into the tasking algorithm. The results of this approach highlighted its success, showing speedups as generation parameters and the number of nodes increased. Efficiencies were also computed, with various figures illustrating the efficiency across the generation process as a whole, as well as efficiencies across individual parameters.
Future work can be performed to investigate and improve the method of this work. This work focused on a distributed approach to large-scale graph generation, but leaves room for additional parallelism at the node-level. For example, after work for Tasks 1 or 2 has been distributed to a node, the node can then leverage OpenMP for additional parallelism. Results can be obtained to show how the additional parallelism affects the speedup and efficiency of the approach.
Additional work can be performed to investigate long-term speedup and efficiency of the approach. This work made use of a local HPC cluster with a limited number of compute nodes. The generation algorithm can be deployed to larger clusters to measure speedup and efficiency as more nodes are added to the tasking pipeline. Scalability can likewise be reexamined as the number of nodes increases.
The analysis portion of this work also has room for additional investigations. This work measured speedup according to Amdahl \cite{Amdahl}. Since tasks are clearly defined and timing data is collected for each task, other speedup metrics can be used. Both Gustafson's Law \cite{Gust} and Sun and Ni's Law \cite{sun} can be leveraged to obtain other results regarding the speedup of the tasking approach.
%\bibliographyp
\bibliography{Bibliography}

Binary file not shown.

Before

Width:  |  Height:  |  Size: 26 KiB

After

Width:  |  Height:  |  Size: 37 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 39 KiB

After

Width:  |  Height:  |  Size: 51 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 20 KiB

After

Width:  |  Height:  |  Size: 31 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 22 KiB

After

Width:  |  Height:  |  Size: 32 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 17 KiB

After

Width:  |  Height:  |  Size: 29 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 25 KiB

After

Width:  |  Height:  |  Size: 35 KiB