That can happen becuase you are not using the proper ips or the machines are connected to different networks.
Can you show the results of:
ifconfig and route -n in kali
ipconfig in windows
Can you share a screenshot of the Network settings used in VirtualBox for both machines?