kinda sounds like the secondaries are opening up too fast and too soon. mine would act like that when I was setting up my secondaries.
I dont know about a holley, but on my edelbrock, the secondary butterflies do open all the way when you mash it to the floor, BUT the edelbrock also had an upper set of "butterflies" (cant think of a better word now) above the seconadries and they only open as far as is required. in other words they open only if the engine can use the extra air.
otherwise, I'm thinking maybe to adjust the accelerator pump.
if the secondaries are out of adjustment, opening too soon, it will get really lean and die
if the accelerator pump is off it can make it lean or rich.