Any downside to kegging 3 -gal batches in 5 -gal kegs?

you are correct, any amount of less than 5gal in a 5gal keg will be fine, just purge the O2.