#infinite width

towards first-principles architecture design – The Berkeley Artificial Intelligence Research Blog

2022-08-29 09:00:00 Foundational works showed how to find the kernel corresponding to a wide network. We find the inverse mapping, showing how to find the wide network corresponding to a given kernel. Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously…