Generating images from text/sentence

I am working on a project named 'Textile Design Generation' in which I need to generate images of textile design/pattern from a given text/sentence. After reading some research papers, I found that GANs can be used for this purpose.

OpenAI has recently released DALL-E, but they haven't disclosed text encoder as it not full release (I guess). Hence, I will have to use GAN.

It would be great if anyone of you can suggest me some resources from where I can get started (may some blog or research papers).

Please let me know if the question require more details.