Yes it would help some but you need to cover the whole floor to have the most effect. In fact, there is some stuff that's called MLVB Mass Loaded Vinyl Barrier that's used for sound control that pretty much does the same.
Also, if you want a low cost sound deadener, buy some cheap old paint and mix it up with sand and apply a very thick coat to your floor boards.