Effective parallelisation for machine learning
We present a novel parallelisation scheme that simplifies the adaptation of learning algorithms to growing amounts of data as well as growing needs for accurate and confident predictions in critical applications. In contrast to other parallelisation techniques, it can be applied to a broad class of...
| Main Authors: | , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
Massachusetts Institute of Technology Press
2017
|
| Online Access: | https://eprints.nottingham.ac.uk/48362/ |
| _version_ | 1848797747832946688 |
|---|---|
| author | Kamp, Michael Boley, Mario Missura, Olana Gärtner, Thomas |
| author_facet | Kamp, Michael Boley, Mario Missura, Olana Gärtner, Thomas |
| author_sort | Kamp, Michael |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | We present a novel parallelisation scheme that simplifies the adaptation of learning algorithms to growing amounts of data as well as growing needs for accurate and confident predictions in critical applications. In contrast to other parallelisation techniques, it can be applied to a broad class of learning algorithms without further mathematical derivations and without writing dedicated code, while at the same time maintaining theoretical performance guarantees. Moreover, our parallelisation scheme is able to reduce the runtime of many learning algorithms to polylogarithmic time on quasi-polynomially many processing units. This is a significant step towards a general answer to an open question [21] on efficient parallelisation of machine learning algorithms in the sense of Nick’s Class (NC). The cost of this parallelisation is in the form of a larger sample complexity. Our empirical study confirms the potential of our parallelisation scheme with fixed numbers of processors and instances in realistic application scenarios. |
| first_indexed | 2025-11-14T20:08:48Z |
| format | Conference or Workshop Item |
| id | nottingham-48362 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T20:08:48Z |
| publishDate | 2017 |
| publisher | Massachusetts Institute of Technology Press |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-483622020-05-04T19:21:08Z https://eprints.nottingham.ac.uk/48362/ Effective parallelisation for machine learning Kamp, Michael Boley, Mario Missura, Olana Gärtner, Thomas We present a novel parallelisation scheme that simplifies the adaptation of learning algorithms to growing amounts of data as well as growing needs for accurate and confident predictions in critical applications. In contrast to other parallelisation techniques, it can be applied to a broad class of learning algorithms without further mathematical derivations and without writing dedicated code, while at the same time maintaining theoretical performance guarantees. Moreover, our parallelisation scheme is able to reduce the runtime of many learning algorithms to polylogarithmic time on quasi-polynomially many processing units. This is a significant step towards a general answer to an open question [21] on efficient parallelisation of machine learning algorithms in the sense of Nick’s Class (NC). The cost of this parallelisation is in the form of a larger sample complexity. Our empirical study confirms the potential of our parallelisation scheme with fixed numbers of processors and instances in realistic application scenarios. Massachusetts Institute of Technology Press 2017-12-04 Conference or Workshop Item PeerReviewed Kamp, Michael, Boley, Mario, Missura, Olana and Gärtner, Thomas (2017) Effective parallelisation for machine learning. In: 31st Annual Conference: Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, California. https://papers.nips.cc/paper/7226-effective-parallelisation-for-machine-learning |
| spellingShingle | Kamp, Michael Boley, Mario Missura, Olana Gärtner, Thomas Effective parallelisation for machine learning |
| title | Effective parallelisation for machine learning |
| title_full | Effective parallelisation for machine learning |
| title_fullStr | Effective parallelisation for machine learning |
| title_full_unstemmed | Effective parallelisation for machine learning |
| title_short | Effective parallelisation for machine learning |
| title_sort | effective parallelisation for machine learning |
| url | https://eprints.nottingham.ac.uk/48362/ https://eprints.nottingham.ac.uk/48362/ |