Glazed windows...yes. Does it involve a stepladder or working from any height? If that is something you do not do often I'd refrain or be very careful. They make a product that comes in a 10.5 ounce tube, used with a caulking gun, glaze in a tube. Glazing windows is a PITA and if they open to a heated/cooled area there exists other options...what are called replacement windows. The terminology in your parts may differ. I could install new windows in your openings (doesn't that sound feelthy?) for @$350-400 per opening your cost. A window that will save you money! as the song goes. But, if one must glaze windows...a porch maybe, sun porch, 10-15 windows that rarely open...you could opt for the tube glaze or buy a can and there's different sizes available. You're helpful hardware person can assist with that decision. If you have a putty knife, that works...a 5-in-1 works, too, as it has a number of edges, one of which assists in removing loose material. If the old glaze is almost gone and the panes are loose, you can buy push-points, small triangular metal object that are pushed into the wood around the pane. If the panes are fast and tight, clean up the edges--loose glaze, paint, fly poop--and apply glaze. If no putty knife or 5-in-1 a butter knife will work. Maybe you have an old set lying around waiting on a job like this. You could dig out a clump of glaze, roll it in the palm of you hand a tad, and then roll out a snake of glaze, say on something smooth clean and flat. I've rolled it on a vertical piece of glass if nothing else is available. Apply the snake of glaze (about a 3/8" diameter snake or less) to the area where the pane meets the wood and use the butter knife to push-spread it into the area it needs to go, one edge of the knife on the glass, the other riding the edge of the wood. The idea is smooth and extra material will ooze away from the knife as you spread. You will likely need to repeat the buttering motion...corners where two lines of glaze meet are tricky. The glaze in the tube helps the job go quicker but you still need to butter it. Best of luck with it!
Allow the glaze to harden and apply primer/paint. Paint is cheap. Put it on.