Is there a delay between the time you publish after making site changes until the site appears updated?

I added a button to my site replacing another and published. When I go into my site the old button is still there .... I want it to be gone and the new one to appear. Is there a delay does anyone know?

Thanks!

Jill