A media type of application/swagger+json has been suggested on the mailing list before. I would recommend formally declaring this as part of the spec.
RAML defines its media type as application/raml+yaml
API Blueprint defines its base media type as application/vnd.apiblueprint.ast plus similar ones for other serializations