No. You can simply throw your sim card away.
However, in the unlikely event that you ever used your credit card to purchase additional credit directly with AT&T then you must ring AT&T to cancel. Please see the information here about how to ring AT&T.