yaml check always returns 0

I verified that ruby is being run but in my environment it always returns 0;  This is no matter how mangled the yaml I am feeding it.

ruby -e "require 'yaml'; YAML.parse(File.open('$1'))"

My system ruby is ruby-2.2.5, I also tried using ruby as installed by puppet labs for the puppet agent (2.1.9p490)
