I like how Azure puts these definitions.

Web API. An API that's accessible from servers that accept requests via HTTP.

Web API endpoint. The location of the code library.

REST API. The design of the URL style that's used to expose the API's functionality.