Hi!
That can happen becuase you are not using the proper ips or the machines are connected to different networks.

Can you show the results of:
ifconfig and route -n in kali
ipconfig in windows
Can you share a screenshot of the Network settings used in VirtualBox for both machines?

Thanks!
Diego