SOURCE-LINKED INTELLIGENCE

Dynamics-Aware Theory of Deep Learning

CORDIS · observation · Publication date unknown

Dynamics-Aware Theory of Deep Learning The recent advances in deep learning (DL) have transformed many scientific domains and have had major impacts on industry and society. Despite their success, DL methods do not obey most of the wisdoms of statistical learning theory, and the vast majority of the current DL techniques mainly stand as poorly understood black-box algorithms. Even though DL theory has been a very active research field in the past few years, there is a significant gap between the current theory and practice: (i) the current theory often becomes vacuous for models with large number of parameters (which is typical in DL), and (ii) it cannot capture the interaction between data, architecture, training algorithm and its hyper-parameters, which can have drastic effects on the overall performance. Due to this lack of theoretical understanding, designing new DL systems has been dominantly performed by

Read original source ↗ Open in workspace

recordType

award

status

SIGNED

region

EU

value

1498410

unit

EUR