Filling space at the bottom of fireplace hearth

I just noticed this morning that there seemed to be some cold air around the bottom of our fireplace hearth, which is brick and mortar. A quick look shows that the mortar under the bottom brick has worn away, in many places quite deeply. Should I fill with mortar, or could I use some other sort of sealant (foam?) to fill this space?
Add pictures here
<% if( /^image/.test(type) ){ %>
<% } %>
Add image file
Upload is a website for homeowners and building and maintenance pros. It is not affiliated with any of the manufacturers or service providers discussed here. All logos and trade names are the property of their respective owners.