Hi Verity, the ants themselves shouldn't be doing any damage to your tree, but it probably means that you have aphids that they are 'farming'.
Several methods of removing them can be found on the Internet, such as hosing (as you mentioned), spraying the tree with vinegar, putting a band of sticky tape/trap around the trunk and branches, etc, etc, etc. Take a look on the Internet and choose your favourite method!