Please try the following:
– Make sure you connect the adapter directly to the computer, don’t use a hub or an extension.
– Experiment with connecting it to a different USB port.
– Experiment with connecting the adapter before and after Kali fully loads (don’t forget to attache it from the device menu).
– Experiment with setting Virtual Box to use USB 2 and USB 3 from the usb settings window.