Captions are part of the source and story on people's original posts! It's not fair that their work gets to be altered with no consequence. Tumblr should make it so either it's against the rules or you actually psychically cannot remove the caption like they have made it with the source.