What design pattern should I use for writing a CacheManager?

I can only think about singleton pattern for this task.

But, Everyone seems to have negative opinions about Singleton Pattern.

If not singleton then what design pattern should I use for a CacheManager?

I am using Java + Spring though I don't want the CacheManager to be spring dependent.

Any pointers?