git clone ssh://git@github.com/<user>/<repository name>.git
If it is asking you for a username and password, your origin remote is pointing at the https url rather than the ssh url.
https://github.com/<Username>/<Project>.git
git@github.com:<Username>/<Project>.git
git remote set-url origin git@github.com:<Username>/<Project>.git
to change the url.