Don't be shy!
You need to adjust the valves while the lifter is sitting on the base circle of the cam.