Should a library have caching implementation inside it

I am working on building a library and wondering if caching should be a part of the library or should the client using it should handle the caching.