Brightness limitations in sources for static and ultra-fast high resolution electron microscopy