If they've provided you with SSH credentials, I would expect that to mean what you want is an SSH protocol connection, not a type of Azure connection (although it's also mighty odd for them to provide you with a private key). However, I use neither much Azure (by coincidence) nor any Filezilla (by choice), so it may be that the terminology is leading me astray.