Ask HN: Are Modular Neural Networks an interesting avenue for further research?
9 by hsikka | 1 comments on Hacker News.
Modular/Multiple Neural networks (MNNs) revolve around training smaller, independent networks that can feed into each other or another higher network https://ift.tt/2O42qv7 In principle, the hierarchical organization could allow us to make sense of more complex problem spaces and reach a higher functionality, but it seems difficult to find examples of concrete research done in the past regarding this. I've found a few sources: https://ift.tt/2FStPAD https://ift.tt/2P4f6SM A few concrete questions I have: Are there any tasks where MNNs have shown better performance than large single nets? Could MNNs be used for multimodal classification, i.e. train each net on a fundamentally different type of data, (text vs image) and feed forward to a higher level intermediary that operates on all the outputs? From a software engineering perspective, aren't these more fault tolerant and easily isolatable on a distributed system? Has there been any work into dynamically adapting the topologies of subnetworks using a process like Neural Architecture Search? Generally, are MNNs practical in any way? Apologies if these questions seem naive, I've just come into ML and more broadly CS from a biology/neuroscience background and am captivated by the potential interplay. I really appreciate you taking the time and lending your insight!
Post Top Ad
Responsive Ads Here
Monday, December 3, 2018
Home
Hacker News
New top story on Hacker News: Ask HN: Are Modular Neural Networks an interesting avenue for further research?
New top story on Hacker News: Ask HN: Are Modular Neural Networks an interesting avenue for further research?
Subscribe to:
Post Comments (Atom)
वो स्टारकिड, जिसने 6 की उम्र से किया काम, निकला फ्लॉप हीरो, विलेन बनते ही पलटी किस्मत, बना स्टार
नील नितिन मुकेश बॉलीवुड के उन एक्टर्स में से हैं, जिनकी स्क्रीन पर मौजूदगी हमेशा खास रही है. चाहे हीरो का रोल हो या विलेन का, नील ने अपने अभ...
Post Bottom Ad
Responsive Ads Here
Author Details
Templatesyard is a blogger resources site is a provider of high quality blogger template with premium looking layout and robust design. The main mission of templatesyard is to provide the best quality blogger templates which are professionally designed and perfectlly seo optimized to deliver best result for your blog.
No comments:
Post a Comment