Speaking with his former executive producer, Barbara Gaines, in a YouTube video Friday, Letterman called the axing of The Late Show With Stephen Colbert “pure cowardice” and said he doesn’t believe the official line from CBS that the decision was purely about economics (the show has reportedly become a money-loser for the network).

The cost of producing late night programs has risen as the media industry has been upended by streaming and shifting consumer habits.