Who gets to call it Art?

Consider two very different ideas:

"All art is a kind of confession, more or less oblique. All artists, if they are to survive, are forced, at last, to tell the whole story; to vomit the anguish up." - James Baldwin

"Art is what you can get away with." - Andy Warhol