The fast idle cam needs to be cleaned and lubricated. You also have a vacuum pull-off on that side of the carb. The electric choke thermal spring should have 12 volts on it when the ignition is on. Some people use B+ from the distributor as long as there isn't a resistor in line to drop the voltage.. But you probably have all that working. When the ignition is off, the spring in the electric choke coil cools off and fully closes the choke plate. It also resets the fast idle cam, which will remain on fast idle until the next time you press the gas pedal, even a little bit - then the cam drops out and the main idle screw (right side of carb) will determine your idle speed.
The choke will be fully closed when the vehicle is COLD, ie, sitting for a few hours at most.. Naturally the engine won't run at all with the choke fully closed, so just as soon as you hit the starter and the engine fires, vacuum is pulled on a pull-off vacuum diaphragm and it allows the choke to open just a little bit, just enough for the motor to run. As the electric choke warms up with the 12 volts on it, it gradually opens the choke and keeps it open fully after a few minutes.
Your problem doesn't sound like it's in the electric choke. It sounds like the fast idle cam isn't releasing or it's sticking. Clean all moving cams, springs, etc, with choke cleaner then spray some mild lubricant on it and see if that helps.
Just to be hypocritical, I took my auto choke and fast idle cam off because I got irritated at it, and put a manual choke on it. Works great, but I wish I hadn't done that now that I think back on it, with a little patience, I could have repaired it like it was supposed to be.
Good luck.