Yes. Responding quickly can help you turn more LSA leads into actual customers. People who contact you through LSA are often ready to hire and may be reaching out to several businesses at the same time. If you answer quickly, you have a better chance of getting the appointment before a competitor does.
A fast response also means fewer missed calls and more value from the leads you are already paying for. Just keep in mind that faster responses do not automatically mean Google will show your ad more often or send you more leads. The main benefit is better lead-to-customer conversion.