Im gonna leave my solution that worked here for future references:
I finally got it to work after years of trying ))
There were two problems:
1-The IP I was entering the Server IP 192.85,46.... but never worked and I stumbled in one comment today that mentioned to enter instead 127.0.0.1
And it worked
2-Also, my Private key was RSA so aaPanel doesn't accept it, so I had to convert it to an "OpenSSH Key" format by using the "Putty Generator" and it worked finally:
I have been years trying (on & off) but never worked till today changing those two things.