his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Empirical Study of Time Efficiency and Accuracy of Support Vector Machines Using an Improved Version of PSVM
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. Department of Information Technology, University of Borås, Borås, Sweden. (Skövde Artificial Intelligence Lab (SAIL))
Department of Information Technology, University of Borås, Borås, Sweden.
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. (Skövde Artificial Intelligence Lab (SAIL))
2015 (English)In: Proceedings of the 2015 International Conference on Parallel and Distributed Processing Techniques and Applications: PDPTA 2015: Volume 1 / [ed] Hamid R. Arabnia, Hiroshi Ishii, Kazuki Joe, Hiroaki Nishikawa, Havaru Shouno, Printed in the United States of America: CSREA Press, 2015, Vol. 1, p. 177-183Conference paper, Published paper (Refereed)
Abstract [en]

We present a significantly improved implementation of a parallel SVM algorithm (PSVM) together with a comprehensive experimental study. Support Vector Machines (SVM) is one of the most well-known machine learning classification techniques. PSVM employs the Interior Point Method, which is a solver used for SVM problems that has a high potential of parallelism. We improve PSVM regarding its structure and memory management for contemporary processor architectures. We perform a number of experiments and study the impact of the reduced column size p and other important parameters as C and gamma on the class-prediction accuracy and training time. The experimental results show that there exists a threshold between the number of computational cores and the training time, and that choosing an appropriate value of p effects the choice of the C and gamma parameters as well as the accuracy.

Place, publisher, year, edition, pages
Printed in the United States of America: CSREA Press, 2015. Vol. 1, p. 177-183
Keywords [en]
parallel svm, processor technology, training time
National Category
Computer Sciences
Research subject
Technology; Skövde Artificial Intelligence Lab (SAIL)
Identifiers
URN: urn:nbn:se:his:diva-11644ISBN: 1-60132-400-6 (print)ISBN: 1-60132-401-4 (print)ISBN: 1-60132-402-2 (print)OAI: oai:DiVA.org:his-11644DiVA, id: diva2:866010
Conference
PDPTA'15 - The 21st International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, July 27-30, 2015
Available from: 2015-10-30 Created: 2015-10-30 Last updated: 2019-01-14Bibliographically approved
In thesis
1. High-Performance Computing For Support Vector Machines
Open this publication in new window or tab >>High-Performance Computing For Support Vector Machines
2018 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Machine learning algorithms are very successful in solving classification and regression problems, however the immense amount of data created by digitalization slows down the training and predicting processes, if solvable at all. High-Performance Computing(HPC) and particularly parallel computing are promising tools for improving the performance of machine learning algorithms in terms of time. Support Vector Machines(SVM) is one of the most popular supervised machine learning techniques that enjoy the advancement of HPC to overcome the problems regarding big data, however, efficient parallel implementations of SVM is a complex endeavour. While there are many parallel techniques to facilitate the performance of SVM, there is no clear roadmap for every application scenario. This thesis is based on a collection of publications. It addresses the problems regarding parallel implementations of SVM through four research questions, all of which are answered through three research articles. In the first research question, the thesis investigates important factors such as parallel algorithms, HPC tools, and heuristics on the efficiency of parallel SVM implementation. This leads to identifying the state of the art parallel implementations of SVMs, their pros and cons, and suggests possible avenues for future research. It is up to the user to create a balance between the computation time and the classification accuracy. In the second research question, the thesis explores the impact of changes in problem size, and the value of corresponding SVM parameters that lead to significant performance. This leads to addressing the impact of the problem size on the optimal choice of important parameters. Besides, the thesis shows the existence of a threshold between the number of cores and the training time. In the third research question, the thesis investigates the impact of the network topology on the performance of a network-based SVM. This leads to three key contributions. The first contribution is to show how much the expansion property of the network impact the convergence. The next is to show which network topology is preferable to efficiently use the computing powers. Third is to supply an implementation making the theoretical advances practically available. The results show that graphs with large spectral gaps and higher degrees exhibit accelerated convergence. In the last research question, the thesis combines all contributions in the articles and offers recommendations towards implementing an efficient framework for SVMs regarding large-scale problems.

Place, publisher, year, edition, pages
Skövde: University of Skövde, 2018. p. 115
Series
Dissertation Series ; 26 (2018)
National Category
Computer Sciences
Research subject
Skövde Artificial Intelligence Lab (SAIL); INF301 Data Science
Identifiers
urn:nbn:se:his:diva-16556 (URN)978-91-984187-8-1 (ISBN)
Presentation
2019-01-28, G207, Skövde, 13:15 (English)
Opponent
Supervisors
Available from: 2019-01-22 Created: 2019-01-14 Last updated: 2019-02-14Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Länk till fulltext

Authority records BETA

Tavara, ShirinDahlbom, Anders

Search in DiVA

By author/editor
Tavara, ShirinDahlbom, Anders
By organisation
School of InformaticsThe Informatics Research Centre
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 625 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf