No such thing as a dumb question here buddy. Better than breaking something. I've asked plenty myself.
Yes do as Rawhide says, takes a one-quarter turn reverse to shut off you will feel it 'pop out' when it is off.
Been a long time since I changed that bulb, but I think when it is 'off' you just grab the cover with your thumb and pointer finger and pull it off straight back towards you? I last changed that bulb in about 1978 so been awhile