What are some disadvantages of the GoF Flyweight design pattern

I understand the benefits of the flyweight design pattern, but I am unsure of its exact drawback. For example, I understand that it may be break encapsulation, but that is all I can currently think of, what are some possible drawbacks of the flyweight design pattern, there is very little documentation, on this matter.