Remove the same item from two recyclerviews

I have a fragment that contains two recylerviews, one for memos, and the other is for starred memos. The memos recyclerview contains all the data the exists in the starred memos recyclerview. What is the best approach to remove and item from starred memos recyclerview when the user removes it from memos recyclerview?