We demonstrate that the scattering matrix of nanophotonic systems is completely determined by their quasinormal modes and present a first-principle expansion technique which is directly applicable to an arbitrary number of modes and input-output channels.@en